c' requestId: <none>
2025-10-02T09:35:32.853011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.853036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324846:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.853158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.853176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.853201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692324846:7823]
2025-10-02T09:35:32.853209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:32.853261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2821 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0
2025-10-02T09:35:32.853391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2821 sessionId: src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0 is DEAD
2025-10-02T09:35:32.853511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:32.853521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Write session will restart in 0.009523s
2025-10-02T09:35:32.853535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Write session: Do CDS request
2025-10-02T09:35:32.853539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.861619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.863013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.863114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.863120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.863126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.863153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.863178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750913:10535]
2025-10-02T09:35:32.863533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.863713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.863735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.863924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.863957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.863961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.863961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.863962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.863962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.863963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.863963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.863964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.863964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.863965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.863965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.863966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.863969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.863975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.863977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.863980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.863982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.863984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.863986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.863988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.863990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.863992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.863994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.863996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.863999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.864003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.864006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.864009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.864011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.864014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.864016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.864018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.864021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.864023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.864025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.864028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.864030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.864033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.864035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.864038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.864040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.864043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.864045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.864048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.864050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.864052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.864054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.864057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.864074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.864146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.864215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.864224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2822
2025-10-02T09:35:32.864322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.864342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.864348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.864351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.864607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2822 sessionId:  describe result for acl check
2025-10-02T09:35:32.864630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.864634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.864635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.864638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.865078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.866493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.870901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.870908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.870910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324974:7542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.870914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.871433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.872888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.872898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.872899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.872901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.872905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2821 [2:7556555720616750913:10535]
2025-10-02T09:35:32.872911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.872921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.872924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.872925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.872926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.872935Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.872942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.872946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.872975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.872980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.872982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.872984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.872985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.873021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.873025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.873031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.873037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.873048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.873061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324847:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.873066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692325009:7542], now have 1 active actors on pipe
2025-10-02T09:35:32.873070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.873071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.873072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.873079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.873089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.873092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.873094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.873095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.873099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.873101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.873104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2821
2025-10-02T09:35:32.873106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2821
2025-10-02T09:35:32.873114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.873116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.873118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.873132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.873134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.873181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21bfb28-1938133a-432b72c4-51e443b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.873188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.873191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.873192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.873197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.873202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.873215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.873314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.873320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.873330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.873384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2822 partition: 0 MaxSeqNo: 36 sessionId: src_id|21bfb28-1938133a-432b72c4-51e443b0_0
2025-10-02T09:35:32.873559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|21bfb28-1938133a-432b72c4-51e443b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.876289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Write session: try to update token
2025-10-02T09:35:32.876298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.882259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.882274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.882275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.882276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.882281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.882284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.882286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750908:10535]
2025-10-02T09:35:32.882306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.882309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.882311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.882312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.882314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.882316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.882416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.887693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId: src_id|21bfb28-1938133a-432b72c4-51e443b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.889855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.953128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692325023:7823]
2025-10-02T09:35:32.953280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2821, pipe: [1:7556555720692325023:7823]
2025-10-02T09:35:32.992398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.992610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.992622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.992636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692325023:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.992787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.992795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.992795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692325023:7823]
2025-10-02T09:35:32.992819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.992852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2822 reason: error at write: Disconnected sessionId: src_id|21bfb28-1938133a-432b72c4-51e443b0_0
2025-10-02T09:35:32.992972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2822 sessionId: src_id|21bfb28-1938133a-432b72c4-51e443b0_0 is DEAD
2025-10-02T09:35:32.993087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.993078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.993096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Write session will restart in 0.008164s
2025-10-02T09:35:32.993125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Write session: Do CDS request
2025-10-02T09:35:32.993128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.000646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.002017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.002105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.002143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.002150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.002156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.002188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.002214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911718370:10537]
2025-10-02T09:35:33.002213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.002223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2823
2025-10-02T09:35:33.002316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.002335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.002338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.002340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.002567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.002619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2823 sessionId:  describe result for acl check
2025-10-02T09:35:33.002641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.002642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.002643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.002646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.002743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.002766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.002940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.002966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.002970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.002971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.002971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.002972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.002972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.002973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.002973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.002974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.002975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.002975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.002976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.002978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.002985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.002987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.002989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.002999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.002991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.002993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.002995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.002997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.002999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.003001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.003003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.003005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.003008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.003012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.003015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.003018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.003021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.003024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.003026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.003028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.003030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.003033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.003035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.003037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.003039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.003042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.003044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.003047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.003049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.003052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.003054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.003056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.003059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.003061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.003063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.003066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.003082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.004111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.008287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.008294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.008296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987292446:7581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.008300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.010463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.011967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.011978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.011980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.011982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.011985Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2822 [2:7556555724911718370:10537]
2025-10-02T09:35:33.011992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.012003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.012004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.012006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.012007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.012015Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.012023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.012027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.012057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.012061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.012062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.012064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.012066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.012100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.012105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.012111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.012119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.012130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.012144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292485:7581], now have 1 active actors on pipe
2025-10-02T09:35:33.012149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692325027:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.012152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.012154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.012155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.012162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.012169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.012175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.012177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.012178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.012181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.012182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.012192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.012195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.012195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.012172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2822
2025-10-02T09:35:33.012204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.012181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2822
2025-10-02T09:35:33.012210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.012237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.012243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.012245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.012246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.012251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.012259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.012272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.012369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.012374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.012382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.012445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2823 partition: 0 MaxSeqNo: 36 sessionId: src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0
2025-10-02T09:35:33.012646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21bfb28-1938133a-432b72c4-51e443b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.015502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Write session: try to update token
2025-10-02T09:35:33.015512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.021475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.021488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.021489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.021491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.021496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.021499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.021502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911718365:10537]
2025-10-02T09:35:33.021523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.021526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.021527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.021528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.021531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.021533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.021643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.027394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId: src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.029700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.092904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987292493:7823]
2025-10-02T09:35:33.093319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2822, pipe: [1:7556555724987292493:7823]
2025-10-02T09:35:33.131876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.132066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.132075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.132087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292493:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.132197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.132220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:33.132231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:33.132269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2823 reason: error at write: Disconnected sessionId: src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0
2025-10-02T09:35:33.132401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2823 sessionId: src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0 is DEAD
2025-10-02T09:35:33.132512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:33.132523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Write session will restart in 0.009589s
2025-10-02T09:35:33.132512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.132537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Write session: Do CDS request
2025-10-02T09:35:33.132542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.132542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987292493:7823]
2025-10-02T09:35:33.140512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.141843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.141947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.141953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.141958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.141986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.142009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911718558:10547]
2025-10-02T09:35:33.142353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.142517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.142552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.142730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.142832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.142837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.142837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.142838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.142838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.142840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.142840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.142841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.142842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.142842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.142845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.142851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.142854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.142856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.142858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.142860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.142862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.142864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.142867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.142871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.142874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.142877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.142883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.142889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.142894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.142899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.142902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.142907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.142914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.142917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.142919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.142922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.142923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.142926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.142932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.142935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.142937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.142939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.142942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.142945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.142947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.142949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.142951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.142954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.142956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.142958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.142976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.143088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.143283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.143291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2824
2025-10-02T09:35:33.143364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.143381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.143387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.143390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.143616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2824 sessionId:  describe result for acl check
2025-10-02T09:35:33.143633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.143637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.143638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.143640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.143949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.145198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.149357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.149365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.149367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987292635:7648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.149370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.150624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.152067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.152078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.152079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.152081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.152084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2823 [2:7556555724911718558:10547]
2025-10-02T09:35:33.152090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.152100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.152101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.152103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.152104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.152113Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.152120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.152124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.152154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.152159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.152160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.152163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.152165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.152200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.152205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.152211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.152217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.152224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.152238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292507:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.152244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292679:7648], now have 1 active actors on pipe
2025-10-02T09:35:33.152247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.152248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.152249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.152256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.152263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.152269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.152271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.152271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.152272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.152267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2823
2025-10-02T09:35:33.152272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.152283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2823
2025-10-02T09:35:33.152287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.152290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.152292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.152302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.152304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.152326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9356daea-1d49b557-5a8887e4-80523a9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.152332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.152334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.152335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.152340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.152346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.152356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.152445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.152450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.152457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.152503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2824 partition: 0 MaxSeqNo: 36 sessionId: src_id|9356daea-1d49b557-5a8887e4-80523a9a_0
2025-10-02T09:35:33.152683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6615026b-81bbe8d1-aba79571-5394d8a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9356daea-1d49b557-5a8887e4-80523a9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.155470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Write session: try to update token
2025-10-02T09:35:33.155483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.161657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.161671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.161672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.161675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.161680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.161682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.161684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911718553:10547]
2025-10-02T09:35:33.161706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.161710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.161711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.161712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.161716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.161718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.161823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.167011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId: src_id|9356daea-1d49b557-5a8887e4-80523a9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.169191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.232679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987292699:7823]
2025-10-02T09:35:33.233033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2823, pipe: [1:7556555724987292699:7823]
2025-10-02T09:35:33.271951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.272176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.272189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.272203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292699:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.272397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.272399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987292699:7823]
2025-10-02T09:35:33.272418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:33.272420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:33.272467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2824 reason: error at write: Disconnected sessionId: src_id|9356daea-1d49b557-5a8887e4-80523a9a_0
2025-10-02T09:35:33.272603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2824 sessionId: src_id|9356daea-1d49b557-5a8887e4-80523a9a_0 is DEAD
2025-10-02T09:35:33.272699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.272734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:33.272743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Write session will restart in 0.008678s
2025-10-02T09:35:33.272758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Write session: Do CDS request
2025-10-02T09:35:33.272762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.280406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.281798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.281919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.281926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.281932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.281964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.281988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911718743:10555]
2025-10-02T09:35:33.282095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.282297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.282305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2825
2025-10-02T09:35:33.282358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.282384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.282403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.282410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.282413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.282555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.282581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.282684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2825 sessionId:  describe result for acl check
2025-10-02T09:35:33.282708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.282712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.282713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.282715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.282760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.282790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.282793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.282794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.282795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.282795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.282796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.282796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.282797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.282797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.282798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.282799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.282799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.282802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.282809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.282811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.282813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.282815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.282817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.282819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.282821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.282823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.282825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.282827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.282829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.282832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.282836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.282839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.282842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.282844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.282847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.282849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.282852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.282854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.282856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.282861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.282864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.282866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.282870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.282872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.282874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.282877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.282879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.282882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.282885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.282888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.282890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.282893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.282910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.283105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.284795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.289726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.289734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.289736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987292827:7667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.289740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.290247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.291920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.291931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.291932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.291934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.291937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2824 [2:7556555724911718743:10555]
2025-10-02T09:35:33.291944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.291953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.291954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.291956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.291957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.291965Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.291968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.291972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.292005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.292009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.292010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.292012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.292013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.292047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.292052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.292058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.292063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.292071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.292084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292700:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.292089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292864:7667], now have 1 active actors on pipe
2025-10-02T09:35:33.292093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.292094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.292095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.292104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.292111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.292112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2824
2025-10-02T09:35:33.292121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.292125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.292112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2824
2025-10-02T09:35:33.292125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.292128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.292129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.292149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.292154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.292161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.292168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.292180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.292184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10fae3ba-360773b8-71c3f381-d46a206c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.292188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.292191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.292192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.292197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.292202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.292217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.292312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.292317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.292324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.292382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2825 partition: 0 MaxSeqNo: 36 sessionId: src_id|10fae3ba-360773b8-71c3f381-d46a206c_0
2025-10-02T09:35:33.292578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9356daea-1d49b557-5a8887e4-80523a9a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10fae3ba-360773b8-71c3f381-d46a206c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.295354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Write session: try to update token
2025-10-02T09:35:33.295365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.301362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.301377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.301379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.301381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.301386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.301389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.301393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911718738:10555]
2025-10-02T09:35:33.301418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.301422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.301426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.301426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.301428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.301428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.301551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.306466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId: src_id|10fae3ba-360773b8-71c3f381-d46a206c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.308602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.372439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987292874:7823]
2025-10-02T09:35:33.372574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2824, pipe: [1:7556555724987292874:7823]
2025-10-02T09:35:33.411970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.412182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.412190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.412203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292874:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.412358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.412405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987292874:7823]
2025-10-02T09:35:33.412419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:33.412425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.412476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2825 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10fae3ba-360773b8-71c3f381-d46a206c_0
2025-10-02T09:35:33.412610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2825 sessionId: src_id|10fae3ba-360773b8-71c3f381-d46a206c_0 is DEAD
2025-10-02T09:35:33.412738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:33.412747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Write session will restart in 0.007411s
2025-10-02T09:35:33.412766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Write session: Do CDS request
2025-10-02T09:35:33.412770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.420818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.421109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.421228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.421236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2826
2025-10-02T09:35:33.421315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.421335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.421341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.421344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.421602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2826 sessionId:  describe result for acl check
2025-10-02T09:35:33.421624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.421628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.421629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.421633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.421977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.422188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.422287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.422294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.422299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.422325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.422351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911718908:10558]
2025-10-02T09:35:33.422701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.422880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.422903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.423078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.423107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.423111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.423112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.423112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.423113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.423113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.423114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.423114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.423115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.423115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.423116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.423116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.423119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.423125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.423127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.423129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.423131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.423133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.423135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.423137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.423139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.423141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.423143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.423145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.423150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.423153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.423157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.423159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.423161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.423164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.423166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.423169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.423171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.423174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.423176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.423179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.423181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.423184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.423186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.423188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.423192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.423195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.423197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.423200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.423202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.423205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.423207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.423209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.423226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.423538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.427899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.427907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.427908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987293001:7693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.427912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.430685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.432108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.432120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.432122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.432124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.432128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2825 [2:7556555724911718908:10558]
2025-10-02T09:35:33.432135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.432145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.432148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.432149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.432150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.432160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.432167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.432171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.432201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.432206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.432207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.432208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.432210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.432245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.432250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.432256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.432261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.432269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.432283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987292875:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.432288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293040:7693], now have 1 active actors on pipe
2025-10-02T09:35:33.432292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.432293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.432294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.432302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.432312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.432319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.432321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.432323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.432324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.432325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.432339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.432344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.432326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2825
2025-10-02T09:35:33.432338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2825
2025-10-02T09:35:33.432352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.432360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.432362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.432379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.432382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.432386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.432387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.432393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.432397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.432406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.432495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.432500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.432508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.432564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2826 partition: 0 MaxSeqNo: 36 sessionId: src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0
2025-10-02T09:35:33.432751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fae3ba-360773b8-71c3f381-d46a206c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.435498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Write session: try to update token
2025-10-02T09:35:33.435508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.441495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.441507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.441508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.441509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.441514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.441517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.441519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911718903:10558]
2025-10-02T09:35:33.441539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.441542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.441544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.441549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.441553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.441556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.441653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.446996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId: src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.449056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.512734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987293047:7823]
2025-10-02T09:35:33.512951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2825, pipe: [1:7556555724987293047:7823]
2025-10-02T09:35:33.551256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.551652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.551661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.551674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293047:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.551789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.551840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.551863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:33.551875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987293047:7823]
2025-10-02T09:35:33.551924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2826 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0
2025-10-02T09:35:33.552057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2826 sessionId: src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0 is DEAD
2025-10-02T09:35:33.552213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:33.552222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Write session will restart in 0.006725s
2025-10-02T09:35:33.552237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Write session: Do CDS request
2025-10-02T09:35:33.552241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.560137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.560221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.560230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2827
2025-10-02T09:35:33.560215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.560316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.560339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.560342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.560345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.560698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2827 sessionId:  describe result for acl check
2025-10-02T09:35:33.560747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.560756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.560757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.560762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.561327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.561604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.561698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.561704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.561710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.561736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.561758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911719072:10560]
2025-10-02T09:35:33.562092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.562273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.562295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.562471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.562500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.562504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.562505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.562505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.562506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.562506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.562507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.562507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.562508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.562508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.562509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.562510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.562512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.562518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.562520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.562522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.562524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.562526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.562528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.562530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.562532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.562546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.562550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.562552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.562555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.562559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.562564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.562567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.562570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.562572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.562579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.562581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.562584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.562586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.562589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.562591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.562593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.562595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.562598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.562600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.562603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.562605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.562608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.562610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.562616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.562618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.562621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.562637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.562744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.567439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.567450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.567452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987293176:7711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.567455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.570089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.571554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.571565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.571567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.571569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.571572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2826 [2:7556555724911719072:10560]
2025-10-02T09:35:33.571579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.571589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.571591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.571593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.571594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.571602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.571606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.571610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.571641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.571646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.571648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.571650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.571651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.571723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.571727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.571733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.571738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.571747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.571761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293214:7711], now have 1 active actors on pipe
2025-10-02T09:35:33.571767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293049:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.571770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.571771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.571773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.571773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2826
2025-10-02T09:35:33.571781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.571791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.571795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.571797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.571799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.571802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.571791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2826
2025-10-02T09:35:33.571803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.571817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.571822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.571824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.571849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.571853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.571869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.571876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.571878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.571879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.571884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.571892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.571900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.571983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.571988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.571995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.572043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2827 partition: 0 MaxSeqNo: 36 sessionId: src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0
2025-10-02T09:35:33.572237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f02ee1-c4bc14d-b125e07a-4e36d8f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.575038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Write session: try to update token
2025-10-02T09:35:33.575048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.581009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.581022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.581023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.581024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.581028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.581031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.581033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911719067:10560]
2025-10-02T09:35:33.581055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.581058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.581059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.581064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.581068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.581070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.581166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.586901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId: src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.589004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.652008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987293222:7823]
2025-10-02T09:35:33.652186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2826, pipe: [1:7556555724987293222:7823]
2025-10-02T09:35:33.692817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.693187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.693197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.693211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293222:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.693328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.693350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:33.693360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:33.693366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987293222:7823]
2025-10-02T09:35:33.693380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.693405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2827 reason: error at write: Disconnected sessionId: src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0
2025-10-02T09:35:33.693543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2827 sessionId: src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0 is DEAD
2025-10-02T09:35:33.693693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:33.693701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Write session will restart in 0.009676s
2025-10-02T09:35:33.693721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Write session: Do CDS request
2025-10-02T09:35:33.693725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.702063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.703420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.703517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.703524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.703529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.703555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.703577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911719236:10562]
2025-10-02T09:35:33.703919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.704078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.704101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.704118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.704213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.704223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2828
2025-10-02T09:35:33.704324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.704330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.704342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.704348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.704350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.704370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.704374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.704375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.704375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.704376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.704377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.704377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.704377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.704378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.704378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.704379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.704380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.704382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.704388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.704391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.704393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.704394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.704397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.704399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.704400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.704402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.704405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.704407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.704408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.704412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.704416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.704419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.704422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.704424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.704426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.704429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.704431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.704434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.704436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.704438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.704441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.704443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.704446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.704448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.704450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.704453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.704455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.704461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.704464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.704466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.704469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.704471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.704473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.704491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.704599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2828 sessionId:  describe result for acl check
2025-10-02T09:35:33.704617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.704619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.704620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.704624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.704974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.706038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.709688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.709695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.709697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987293355:7743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.709701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.711882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.713426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.713437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.713438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.713440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.713443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2827 [2:7556555724911719236:10562]
2025-10-02T09:35:33.713450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.713459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.713460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.713462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.713463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.713472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.713478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.713482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.713511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.713516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.713517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.713519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.713520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.713554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.713558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.713565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.713570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.713578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.713592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293391:7743], now have 1 active actors on pipe
2025-10-02T09:35:33.713597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293224:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.713601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.713602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.713603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.713610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.713619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.713623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.713626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.713628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.713630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.713631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.713641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.713633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2827
2025-10-02T09:35:33.713643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.713633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2827
2025-10-02T09:35:33.713648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.713662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.713667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.713682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c265c98f-47d42542-cda1ce98-cde98dea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.713688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.713690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.713691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.713697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.713703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.713710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.713800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.713805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.713812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.713866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2828 partition: 0 MaxSeqNo: 36 sessionId: src_id|c265c98f-47d42542-cda1ce98-cde98dea_0
2025-10-02T09:35:33.714029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d1fdf8-c4dbca57-8fabd24c-25cefe7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c265c98f-47d42542-cda1ce98-cde98dea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.716905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Write session: try to update token
2025-10-02T09:35:33.716915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.723021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.723034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.723035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.723036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.723042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.723046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.723049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911719231:10562]
2025-10-02T09:35:33.723077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.723079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.723080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.723082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.723086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.723089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.723196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.729353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId: src_id|c265c98f-47d42542-cda1ce98-cde98dea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.731400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.793302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987293398:7823]
2025-10-02T09:35:33.793445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2827, pipe: [1:7556555724987293398:7823]
2025-10-02T09:35:33.836290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.836504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.836512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.836524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293398:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.836665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.836716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.836741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987293398:7823]
2025-10-02T09:35:33.836745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:33.836747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:33.836786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2828 reason: error at write: Disconnected sessionId: src_id|c265c98f-47d42542-cda1ce98-cde98dea_0
2025-10-02T09:35:33.836938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2828 sessionId: src_id|c265c98f-47d42542-cda1ce98-cde98dea_0 is DEAD
2025-10-02T09:35:33.837089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:33.837099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Write session will restart in 0.006075s
2025-10-02T09:35:33.837115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Write session: Do CDS request
2025-10-02T09:35:33.837120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.844090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.844208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.844215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2829
2025-10-02T09:35:33.844305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.844323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.844328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.844330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.844580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2829 sessionId:  describe result for acl check
2025-10-02T09:35:33.844597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.844602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.844603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.844606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.844951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.845513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.846384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.846993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.847092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.847098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.847104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.847130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.847156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911719402:10564]
2025-10-02T09:35:33.847774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.847884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.847892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.847894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987293521:7758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.847897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:33.847927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.847950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.848228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.848258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.848262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.848263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.848263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.848264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.848264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.848265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.848265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.848266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.848267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.848267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.848268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.848271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.848276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.848279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.848281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.848283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.848285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.848287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.848289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.848291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.848294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.848296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.848298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.848302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.848306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.848309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.848312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.848314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.848317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.848319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.848322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.848324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.848327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.848329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.848332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.848334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.848337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.848340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.848342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.848345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.848348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.848350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.848353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.848357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.848360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.848362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.848365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.848384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.855925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:33.857468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:33.857480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:33.857481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:33.857483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:33.857486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2828 [2:7556555724911719402:10564]
2025-10-02T09:35:33.857493Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:33.857502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:33.857506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.857509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.857510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.857518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:33.857521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:33.857524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:33.857559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.857563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.857564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.857566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:33.857567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:33.857603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:33.857607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.857613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.857619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.857630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:33.857645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293564:7758], now have 1 active actors on pipe
2025-10-02T09:35:33.857650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293399:2446], now have 1 active actors on pipe
2025-10-02T09:35:33.857653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.857655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.857656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.857663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:33.857674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:33.857675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:33.857677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:33.857678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:33.857684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:33.857685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:33.857674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2828
2025-10-02T09:35:33.857682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2828
2025-10-02T09:35:33.857699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.857704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:33.857706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:33.857716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.857721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.857745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ffd102f-52cfb949-d8129929-48bf897d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:33.857753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:33.857755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:33.857756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:33.857761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:33.857769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:33.857780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.857865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.857870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.857877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:33.857928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2829 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ffd102f-52cfb949-d8129929-48bf897d_0
2025-10-02T09:35:33.858146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c265c98f-47d42542-cda1ce98-cde98dea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ffd102f-52cfb949-d8129929-48bf897d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:33.860939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Write session: try to update token
2025-10-02T09:35:33.860950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:33.867013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:33.867025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:33.867027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:33.867028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:33.867032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.867034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.867037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911719397:10564]
2025-10-02T09:35:33.867057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:33.867060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.867061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:33.867065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:33.867069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:33.867072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:33.867171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:33.873430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId: src_id|2ffd102f-52cfb949-d8129929-48bf897d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:33.875511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:33.936664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555724987293582:7823]
2025-10-02T09:35:33.936845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2828, pipe: [1:7556555724987293582:7823]
2025-10-02T09:35:33.981533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:33.981743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:33.981752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:33.981765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293582:7823], now have 1 active actors on pipe
2025-10-02T09:35:33.981878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:33.981904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555724987293582:7823]
2025-10-02T09:35:33.981914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:33.981923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:33.981973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2829 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ffd102f-52cfb949-d8129929-48bf897d_0
2025-10-02T09:35:33.982109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2829 sessionId: src_id|2ffd102f-52cfb949-d8129929-48bf897d_0 is DEAD
2025-10-02T09:35:33.982241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:33.982250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Write session will restart in 0.009516s
2025-10-02T09:35:33.982327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Write session: Do CDS request
2025-10-02T09:35:33.982346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:33.990664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:33.992053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:33.992152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:33.992159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:33.992165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:33.992189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:33.992212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555724911719569:10566]
2025-10-02T09:35:33.992552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:33.992710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:33.992731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:33.992933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:33.992968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.992972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.992973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.992973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.992974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.992975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.992975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.992976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.992976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.992977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.992977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.992978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.992980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.992988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.992990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.992992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.992994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.992996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.992998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.993000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.993002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.993004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.993006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.993008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.993012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.993016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:33.993019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.993022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:33.993024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.993027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:33.993029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.993032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:33.993034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.993038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:33.993040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.993044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:33.993047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.993053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:33.993057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.993060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:33.993062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.993065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:33.993070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.993073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:33.993075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.993077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:33.993079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.993082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:33.993098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:33.993114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.993183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:33.993189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2830
2025-10-02T09:35:33.993279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:33.993297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:33.993300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:33.993304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:33.993573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2830 sessionId:  describe result for acl check
2025-10-02T09:35:33.993597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:33.993601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:33.993602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:33.993605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:33.993939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:33.995348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:33.999235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:33.999243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:33.999245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555724987293721:7800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:33.999248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.000468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.001968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.001980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.001981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.001983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.001986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2829 [2:7556555724911719569:10566]
2025-10-02T09:35:34.001994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.002003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.002004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.002006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.002007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.002016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.002019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.002023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.002051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.002057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.002058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.002059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.002061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.002097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.002102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.002109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.002114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.002126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.002139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.002143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.002144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.002149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.002156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.002157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293586:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.002159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555724987293755:7800], now have 1 active actors on pipe
2025-10-02T09:35:34.002163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.002164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.002164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.002171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.002172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.002175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2829
2025-10-02T09:35:34.002176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2829
2025-10-02T09:35:34.002187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.002192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.002194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.002208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.002213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.002230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.002237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.002240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.002241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.002245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.002252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.002261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.002346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.002351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.002358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.002410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2830 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0
2025-10-02T09:35:34.002634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffd102f-52cfb949-d8129929-48bf897d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.005283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Write session: try to update token
2025-10-02T09:35:34.005299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.011150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.011162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.011163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.011164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.011168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.011170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.011173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555724911719564:10566]
2025-10-02T09:35:34.011191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.011197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.011198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.011201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.011203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.011207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.011300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.017423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId: src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.019552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.082081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261059:7823]
2025-10-02T09:35:34.082246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2829, pipe: [1:7556555729282261059:7823]
2025-10-02T09:35:34.122219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.122482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.122492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.122504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261059:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.122644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.122656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.122675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261059:7823]
2025-10-02T09:35:34.122690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:34.122739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2830 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0
2025-10-02T09:35:34.122876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2830 sessionId: src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0 is DEAD
2025-10-02T09:35:34.123061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:34.123077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Write session will restart in 0.008790s
2025-10-02T09:35:34.123105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Write session: Do CDS request
2025-10-02T09:35:34.123111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.131250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.132670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.132771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.132777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.132783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.132819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.132844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687047:10570]
2025-10-02T09:35:34.133120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.133232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.133237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.133246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2831
2025-10-02T09:35:34.133340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.133357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.133363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.133366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.133421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.133446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.133610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2831 sessionId:  describe result for acl check
2025-10-02T09:35:34.133630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.133631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.133636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.133637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.133639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.133666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.133670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.133671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.133672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.133672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.133673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.133673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.133674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.133674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.133676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.133679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.133685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.133688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.133690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.133692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.133693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.133695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.133697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.133699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.133701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.133703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.133705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.133709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.133713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.133716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.133719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.133721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.133724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.133726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.133729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.133731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.133734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.133736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.133738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.133741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.133743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.133747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.133750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.133752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.133754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.133757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.133760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.133762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.133764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.133766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.133768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.133785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.133984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.135107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.138969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.138980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.138983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282261193:7822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.138988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.141161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.142659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.142670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.142671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.142673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.142677Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2830 [2:7556555729206687047:10570]
2025-10-02T09:35:34.142683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.142692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.142696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.142697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.142698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.142708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.142711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.142715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.142746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.142751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.142752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.142754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.142755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.142791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.142796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.142802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.142807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.142817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.142831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261060:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.142837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261230:7822], now have 1 active actors on pipe
2025-10-02T09:35:34.142840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.142842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.142843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.142850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.142863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.142864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.142866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.142867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.142871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.142873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.142865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2830
2025-10-02T09:35:34.142868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2830
2025-10-02T09:35:34.142886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.142891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.142892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.142901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.142906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.142931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81966cf3-951e7c4d-52b653b7-e4055436_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.142938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.142940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.142941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.142946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.142955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.142964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.143057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.143062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.143069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.143118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2831 partition: 0 MaxSeqNo: 36 sessionId: src_id|81966cf3-951e7c4d-52b653b7-e4055436_0
2025-10-02T09:35:34.143363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e4c05a-a4c10e96-e4e346db-e9c3b1ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81966cf3-951e7c4d-52b653b7-e4055436_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.145844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Write session: try to update token
2025-10-02T09:35:34.145861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.151976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.151988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.151989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.151990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.151993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.151996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.151998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687042:10570]
2025-10-02T09:35:34.152018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.152021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.152022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.152023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.152025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.152027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.152147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.158452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId: src_id|81966cf3-951e7c4d-52b653b7-e4055436_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.160553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.222871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261272:7823]
2025-10-02T09:35:34.223061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2830, pipe: [1:7556555729282261272:7823]
2025-10-02T09:35:34.263125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.263535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.263545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.263558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261272:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.263708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.263726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261272:7823]
2025-10-02T09:35:34.263745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.263744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:34.263747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:34.263795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2831 reason: error at write: Disconnected sessionId: src_id|81966cf3-951e7c4d-52b653b7-e4055436_0
2025-10-02T09:35:34.263942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2831 sessionId: src_id|81966cf3-951e7c4d-52b653b7-e4055436_0 is DEAD
2025-10-02T09:35:34.264101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:34.264116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Write session will restart in 0.005942s
2025-10-02T09:35:34.264138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Write session: Do CDS request
2025-10-02T09:35:34.264144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.271114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.271239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.271246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2832
2025-10-02T09:35:34.271374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.271394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.271401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.271403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.271661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2832 sessionId:  describe result for acl check
2025-10-02T09:35:34.271683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.271688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.271689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.271692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.272019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.272474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.273679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.273905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.274002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.274009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.274015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.274040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.274064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687253:10584]
2025-10-02T09:35:34.274404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.274587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.274609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.274802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.274837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.274841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.274841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.274842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.274842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.274843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.274844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.274844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.274845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.274845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.274846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.274846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.274849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.274855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.274857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.274859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.274861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.274863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.274865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.274867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.274869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.274871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.274873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.274875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.274879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.274883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.274886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.274889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.274891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.274894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.274896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.274899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.274902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.274904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.274908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.274911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.274915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.274918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.274920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.274923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.274925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.274928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.274931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.274934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.274940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.274943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.274945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.274948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.274964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.280976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.280988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.280991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282261402:7870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.280995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.287649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.289236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.289246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.289247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.289249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.289252Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2831 [2:7556555729206687253:10584]
2025-10-02T09:35:34.289261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.289272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.289275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.289277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.289278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.289286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.289291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.289295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.289328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.289334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.289335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.289337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.289338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.289381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.289386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.289394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.289399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.289408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.289422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261273:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.289426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261444:7870], now have 1 active actors on pipe
2025-10-02T09:35:34.289429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.289432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.289433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.289441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.289451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.289459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.289461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.289463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.289456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2831
2025-10-02T09:35:34.289468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.289470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.289464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2831
2025-10-02T09:35:34.289478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.289480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.289482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.289498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.289503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.289520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.289532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.289537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.289538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.289544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.289550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.289559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.289653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.289658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.289665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.289719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2832 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0
2025-10-02T09:35:34.289983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81966cf3-951e7c4d-52b653b7-e4055436_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.292399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Write session: try to update token
2025-10-02T09:35:34.292415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.301010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.301021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.301022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.301023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.301027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.301029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.301031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687248:10584]
2025-10-02T09:35:34.301050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.301053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.301054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.301063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.301066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.301071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.301161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.309168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId: src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.311283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.363661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261454:7823]
2025-10-02T09:35:34.363790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2831, pipe: [1:7556555729282261454:7823]
2025-10-02T09:35:34.413406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.413809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.413819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.413831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261454:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.413983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.414020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.414051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:34.414103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2832 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0
2025-10-02T09:35:34.414248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2832 sessionId: src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0 is DEAD
2025-10-02T09:35:34.414344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:34.414336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261454:7823]
2025-10-02T09:35:34.414354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Write session will restart in 0.006105s
2025-10-02T09:35:34.414383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Write session: Do CDS request
2025-10-02T09:35:34.414388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.421275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.421380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.421387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2833
2025-10-02T09:35:34.421482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.421501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.421507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.421509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.421848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2833 sessionId:  describe result for acl check
2025-10-02T09:35:34.421872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.421876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.421878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.421883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.422254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.423380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.423437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.426155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.426255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.426262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.426268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.426293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.426316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687427:10587]
2025-10-02T09:35:34.426356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.426364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.426367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282261550:7912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.426370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.426680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.426858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.426883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.427088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.427122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.427126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.427127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.427127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.427128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.427129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.427130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.427130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.427131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.427131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.427132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.427132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.427135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.427142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.427144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.427146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.427148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.427150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.427152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.427154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.427156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.427159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.427161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.427162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.427166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.427170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.427173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.427176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.427179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.427181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.427183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.427186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.427189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.427195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.427197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.427200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.427204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.427207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.427208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.427211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.427217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.427220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.427222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.427226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.427228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.427231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.427236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.427240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.427257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.436378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.438007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.438020Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.438021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.438023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.438027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2832 [2:7556555729206687427:10587]
2025-10-02T09:35:34.438034Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.438044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.438046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.438047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.438048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.438057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.438060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.438064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.438096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.438102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.438103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.438105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.438106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.438142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.438148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.438154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.438159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.438171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.438185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261623:7912], now have 1 active actors on pipe
2025-10-02T09:35:34.438190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261455:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.438194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.438195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.438197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.438205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.438215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.438222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.438226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.438227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.438229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.438230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.438245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.438251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.438243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2832
2025-10-02T09:35:34.438246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2832
2025-10-02T09:35:34.438261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.438269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.438272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.438290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b32e804c-10760657-aaba7715-eef90ba0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.438297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.438300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.438305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.438312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.438320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.438331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.438445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.438450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.438457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.438512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2833 partition: 0 MaxSeqNo: 36 sessionId: src_id|b32e804c-10760657-aaba7715-eef90ba0_0
2025-10-02T09:35:34.438761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a6e5af-9b74bedf-407cc8d-6b9e3599_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b32e804c-10760657-aaba7715-eef90ba0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.441599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Write session: try to update token
2025-10-02T09:35:34.441611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.449828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.449843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.449845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.449846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.449851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.449853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.449856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687421:10587]
2025-10-02T09:35:34.449877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.449884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.449885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.449887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.449890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.449892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.449993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.455363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId: src_id|b32e804c-10760657-aaba7715-eef90ba0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.457486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.514727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261634:7823]
2025-10-02T09:35:34.514905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2832, pipe: [1:7556555729282261634:7823]
2025-10-02T09:35:34.562806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.563086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.563094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.563120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261634:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.563340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.563330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261634:7823]
2025-10-02T09:35:34.563346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:34.563348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:34.563352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.563396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2833 reason: error at write: Disconnected sessionId: src_id|b32e804c-10760657-aaba7715-eef90ba0_0
2025-10-02T09:35:34.563547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2833 sessionId: src_id|b32e804c-10760657-aaba7715-eef90ba0_0 is DEAD
2025-10-02T09:35:34.563691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:34.563700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Write session will restart in 0.005164s
2025-10-02T09:35:34.563716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Write session: Do CDS request
2025-10-02T09:35:34.563720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.570232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.570290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.570296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2834
2025-10-02T09:35:34.570382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.570401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.570407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.570410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.570686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2834 sessionId:  describe result for acl check
2025-10-02T09:35:34.570712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.570717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.570718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.570721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.571107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.572393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.572398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.573934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.574036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.574042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.574049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.574075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.574099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687598:10589]
2025-10-02T09:35:34.574164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.574171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.574173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282261717:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.574177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.574444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.574610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.574633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.574808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.574838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.574842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.574842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.574843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.574843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.574844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.574844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.574845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.574846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.574846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.574847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.574847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.574850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.574856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.574858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.574860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.574862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.574864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.574867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.574869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.574871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.574873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.574875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.574877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.574881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.574885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.574888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.574891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.574894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.574896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.574898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.574901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.574904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.574908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.574910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.574913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.574918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.574921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.574924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.574928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.574931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.574933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.574939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.574942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.574944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.574947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.574952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.574955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.574972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.584205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.585843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.585854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.585855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.585857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.585860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2833 [2:7556555729206687598:10589]
2025-10-02T09:35:34.585869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.585878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.585882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.585884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.585885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.585894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.585899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.585903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.585938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.585942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.585944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.585946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.585947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.585985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.585989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.585996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.586001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.586012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.586027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261636:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.586032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261803:7916], now have 1 active actors on pipe
2025-10-02T09:35:34.586036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.586037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.586038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.586046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.586057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.586061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.586063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.586065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.586067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.586056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2833
2025-10-02T09:35:34.586069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.586060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2833
2025-10-02T09:35:34.586082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.586087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.586088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.586099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.586104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.586128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3aa6da-ed276c11-e863789c-bab778b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.586134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.586136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.586137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.586142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.586147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.586159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.586239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.586245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.586252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.586306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2834 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3aa6da-ed276c11-e863789c-bab778b5_0
2025-10-02T09:35:34.586581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e804c-10760657-aaba7715-eef90ba0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3aa6da-ed276c11-e863789c-bab778b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.589301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Write session: try to update token
2025-10-02T09:35:34.589318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.597623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.597635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.597636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.597637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.597640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.597642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.597644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687593:10589]
2025-10-02T09:35:34.597663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.597669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.597669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.597670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.597672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.597675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.597778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.603683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId: src_id|b3aa6da-ed276c11-e863789c-bab778b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.605816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.663711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261816:7823]
2025-10-02T09:35:34.663930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2833, pipe: [1:7556555729282261816:7823]
2025-10-02T09:35:34.710380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.710583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.710592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.710616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261816:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.710762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261816:7823]
2025-10-02T09:35:34.710778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.710790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:34.710793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:34.710837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2834 reason: error at write: Disconnected sessionId: src_id|b3aa6da-ed276c11-e863789c-bab778b5_0
2025-10-02T09:35:34.710981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2834 sessionId: src_id|b3aa6da-ed276c11-e863789c-bab778b5_0 is DEAD
2025-10-02T09:35:34.711033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.711129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:34.711142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Write session will restart in 0.009093s
2025-10-02T09:35:34.711257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Write session: Do CDS request
2025-10-02T09:35:34.711283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.719631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.721074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.721179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.721186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.721192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.721196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.721217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.721241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687771:10591]
2025-10-02T09:35:34.721303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.721309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2835
2025-10-02T09:35:34.721424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.721441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.721447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.721449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.721591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.721713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2835 sessionId:  describe result for acl check
2025-10-02T09:35:34.721752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.721737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.721741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.721742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.721775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.721745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.721956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.721987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.721991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.721991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.721992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.721992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.721993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.721993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.721994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.721995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.721995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.721996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.721996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.721999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.722005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.722008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.722010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.722012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.722014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.722016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.722018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.722020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.722022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.722024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.722026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.722030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.722034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.722037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.722040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.722043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.722046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.722048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.722052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.722054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.722057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.722059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.722062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.722065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.722068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.722070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.722073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.722075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.722079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.722081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.722084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.722085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.722089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.722091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.722096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.722097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.722112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.723448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.728828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.728836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.728838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282261955:7932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.728842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.731464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.733057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.733068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.733069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.733071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.733074Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2834 [2:7556555729206687771:10591]
2025-10-02T09:35:34.733081Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.733090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.733091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.733093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.733094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.733103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.733107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.733111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.733141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.733146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.733147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.733149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.733151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.733188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.733193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.733200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.733206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.733217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.733232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261818:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.733238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261992:7932], now have 1 active actors on pipe
2025-10-02T09:35:34.733241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.733243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.733244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.733252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.733259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.733266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.733268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.733269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.733270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.733271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.733271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2834
2025-10-02T09:35:34.733280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2834
2025-10-02T09:35:34.733288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.733293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.733294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.733310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.733316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.733333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5255330b-d53cd56b-98719773-976f7a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.733340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.733342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.733344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.733349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.733356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.733364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.733452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.733457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.733464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.733517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2835 partition: 0 MaxSeqNo: 36 sessionId: src_id|5255330b-d53cd56b-98719773-976f7a8a_0
2025-10-02T09:35:34.733753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6da-ed276c11-e863789c-bab778b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5255330b-d53cd56b-98719773-976f7a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.736244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Write session: try to update token
2025-10-02T09:35:34.736259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.744610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.744622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.744623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.744624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.744628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.744630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.744633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687766:10591]
2025-10-02T09:35:34.744651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.744655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.744657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.744668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.744681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.744684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.744763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.748964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId: src_id|5255330b-d53cd56b-98719773-976f7a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.751168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.811173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282261999:7823]
2025-10-02T09:35:34.811365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2834, pipe: [1:7556555729282261999:7823]
2025-10-02T09:35:34.856944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:34.857149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.857158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.857182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282261999:7823], now have 1 active actors on pipe
2025-10-02T09:35:34.857343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282261999:7823]
2025-10-02T09:35:34.857350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:34.857356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:34.857359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:34.857364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:34.857412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2835 reason: error at write: Disconnected sessionId: src_id|5255330b-d53cd56b-98719773-976f7a8a_0
2025-10-02T09:35:34.857553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2835 sessionId: src_id|5255330b-d53cd56b-98719773-976f7a8a_0 is DEAD
2025-10-02T09:35:34.857727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:34.857743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Write session will restart in 0.008065s
2025-10-02T09:35:34.857765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Write session: Do CDS request
2025-10-02T09:35:34.857770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:34.866240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:34.867260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.867340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:34.867349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2836
2025-10-02T09:35:34.867457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:34.867478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:34.867481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:34.867484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:34.867671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:34.867732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2836 sessionId:  describe result for acl check
2025-10-02T09:35:34.867751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:34.867752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:34.867753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:34.867756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:34.867825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:34.867832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:34.867839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:34.867880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:34.867909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555729206687944:10593]
2025-10-02T09:35:34.868102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:34.868259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:34.868453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:34.868485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:34.868780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:34.868823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.868827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.868828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.868828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.868829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.868830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.868830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.868831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.868831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.868832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.868833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.868833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.868837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.868843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.868845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.868847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.868849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.868852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.868854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.868856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.868858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.868860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.868862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.868864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.868867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.868871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:34.868874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.868877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:34.868879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.868882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:34.868884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.868887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:34.868889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.868891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:34.868894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.868896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:34.868898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.868901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:34.868903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.868906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:34.868908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.868911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:34.868913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.868916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.868918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.868921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.868923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.868925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.868943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:34.869349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:34.874843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:34.874851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:34.874853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555729282262137:7950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:34.874857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:34.877791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:34.879373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:34.879383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:34.879385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:34.879387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:34.879391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2835 [2:7556555729206687944:10593]
2025-10-02T09:35:34.879399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:34.879409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:34.879414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.879415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.879416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.879425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:34.879428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:34.879432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:34.879461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.879465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.879466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.879468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:34.879470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:34.879507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:34.879512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.879518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:34.879523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:34.879531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:34.879544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.879548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.879549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.879554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:34.879563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282262176:7950], now have 1 active actors on pipe
2025-10-02T09:35:34.879564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:34.879566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:34.879568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:34.879570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:34.879576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:34.879578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:34.879582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282262000:2446], now have 1 active actors on pipe
2025-10-02T09:35:34.879595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.879603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:34.879612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:34.879616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2835
2025-10-02T09:35:34.879627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2835
2025-10-02T09:35:34.879648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.879653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.879668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6def311-4997a708-a32a25bd-10703f24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:34.879675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:34.879678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:34.879679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:34.879683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:34.879689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:34.879696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.879787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:34.879791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:34.879799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:34.879855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2836 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6def311-4997a708-a32a25bd-10703f24_0
2025-10-02T09:35:34.880115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5255330b-d53cd56b-98719773-976f7a8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6def311-4997a708-a32a25bd-10703f24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:34.882642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Write session: try to update token
2025-10-02T09:35:34.882658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:34.888967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:34.888977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:34.888978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:34.888979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:34.888982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.888984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.888986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555729206687939:10593]
2025-10-02T09:35:34.889004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:34.889008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:34.889009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:34.889009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:34.889012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:34.889013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:34.889125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:34.894896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId: src_id|f6def311-4997a708-a32a25bd-10703f24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:34.897000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:34.957596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555729282262188:7823]
2025-10-02T09:35:34.957751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2835, pipe: [1:7556555729282262188:7823]
2025-10-02T09:35:35.001975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.002211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.002221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.002232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555729282262188:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.002389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.002391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555729282262188:7823]
2025-10-02T09:35:35.002406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.002409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.002414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.002465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2836 reason: error at write: Disconnected sessionId: src_id|f6def311-4997a708-a32a25bd-10703f24_0
2025-10-02T09:35:35.002622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2836 sessionId: src_id|f6def311-4997a708-a32a25bd-10703f24_0 is DEAD
2025-10-02T09:35:35.002783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.002791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Write session will restart in 0.007637s
2025-10-02T09:35:35.002810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Write session: Do CDS request
2025-10-02T09:35:35.002815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.011280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.011333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.011449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.011456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2837
2025-10-02T09:35:35.011576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.011597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.011603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.011605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.011916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2837 sessionId:  describe result for acl check
2025-10-02T09:35:35.011941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.011945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.011947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.011949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.012388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.012726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.012833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.012839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.012845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.012871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.012899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501655415:10595]
2025-10-02T09:35:35.013244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.013401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.013427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.013608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.013636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.013640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.013640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.013641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.013641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.013642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.013643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.013643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.013644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.013644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.013645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.013645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.013648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.013653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.013655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.013657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.013659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.013661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.013663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.013665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.013667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.013670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.013672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.013674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.013678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.013681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.013685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.013688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.013690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.013692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.013695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.013697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.013699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.013702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.013704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.013707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.013709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.013712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.013714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.013717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.013719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.013723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.013725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.013728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.013730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.013735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.013737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.013739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.013757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.013804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.019402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.019409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.019411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577229625:7980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.019415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.024539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.026175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.026186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.026187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.026189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.026193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2836 [2:7556555733501655415:10595]
2025-10-02T09:35:35.026200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.026211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.026212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.026214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.026215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.026224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.026227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.026231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.026262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.026268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.026268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.026270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.026271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.026308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.026312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.026319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.026324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.026332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.026346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229664:7980], now have 1 active actors on pipe
2025-10-02T09:35:35.026348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229488:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.026352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.026353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.026354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.026365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.026375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.026379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.026381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.026383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.026383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.026384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.026400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.026404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.026401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2836
2025-10-02T09:35:35.026406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2836
2025-10-02T09:35:35.026413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.026424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.026430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.026447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c09f03da-491511c1-53efa95d-d64c527a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.026454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.026456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.026457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.026464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.026472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.026481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.026565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.026570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.026577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.026618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2837 partition: 0 MaxSeqNo: 36 sessionId: src_id|c09f03da-491511c1-53efa95d-d64c527a_0
2025-10-02T09:35:35.026876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6def311-4997a708-a32a25bd-10703f24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c09f03da-491511c1-53efa95d-d64c527a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.032019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Write session: try to update token
2025-10-02T09:35:35.032037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.035470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:35.035482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.035486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.035507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:35.035507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:35.035634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:35.035747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:35.035856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:35.035963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:35.036126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:35.036152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:35.044503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.044515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.044516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.044517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.044521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.044524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.044526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501655410:10595]
2025-10-02T09:35:35.044546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.044549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.044552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.044553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.044554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.044554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.044667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.049290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId: src_id|c09f03da-491511c1-53efa95d-d64c527a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.060938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.102500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577229672:7823]
2025-10-02T09:35:35.102656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2836, pipe: [1:7556555733577229672:7823]
2025-10-02T09:35:35.154263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.154463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.154471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.154483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229672:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.154635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.154651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577229672:7823]
2025-10-02T09:35:35.154666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.154670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.154671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.154720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2837 reason: error at write: Disconnected sessionId: src_id|c09f03da-491511c1-53efa95d-d64c527a_0
2025-10-02T09:35:35.154859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2837 sessionId: src_id|c09f03da-491511c1-53efa95d-d64c527a_0 is DEAD
2025-10-02T09:35:35.155030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.155046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Write session will restart in 0.009143s
2025-10-02T09:35:35.155069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Write session: Do CDS request
2025-10-02T09:35:35.155075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.163840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.165194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.165270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.165333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.165342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2838
2025-10-02T09:35:35.165358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.165365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.165372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.165407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.165430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501655604:10599]
2025-10-02T09:35:35.165472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.165490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.165496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.165498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.165754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2838 sessionId:  describe result for acl check
2025-10-02T09:35:35.165775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.165780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.165781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.165785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.165777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.165939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.165962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.166138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.166156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.166166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.166170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.166171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.166171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.166172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.166172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.166173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.166173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.166173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.166174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.166175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.166175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.166178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.166184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.166186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.166188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.166190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.166192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.166194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.166196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.166198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.166200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.166202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.166204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.166207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.166211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.166214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.166217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.166219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.166222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.166224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.166226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.166228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.166231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.166233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.166236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.166238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.166241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.166243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.166245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.166247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.166252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.166254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.166256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.166259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.166261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.166265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.166268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.166284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.167294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.172374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.172381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.172385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577229811:7992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.172389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.174873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.176367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.176369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.176371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.176374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2837 [2:7556555733501655604:10599]
2025-10-02T09:35:35.176382Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.176394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.176400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.176402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.176405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.176415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.176423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.176429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.176466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.176471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.176472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.176474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.176475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.176515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.176520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.176526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.176532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.176544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.176557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229673:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.176562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229850:7992], now have 1 active actors on pipe
2025-10-02T09:35:35.176566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.176567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.176569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.176578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.176588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.176588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.176590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.176591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.176571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2837
2025-10-02T09:35:35.176600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.176605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.176591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2837
2025-10-02T09:35:35.176638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.176646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.176658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.176667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.176678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.176690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.176698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.176701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.176706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.176712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.176723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.176745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.176853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.176861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.176872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.176935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2838 partition: 0 MaxSeqNo: 36 sessionId: src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0
2025-10-02T09:35:35.177176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09f03da-491511c1-53efa95d-d64c527a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.179463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Write session: try to update token
2025-10-02T09:35:35.179474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.186080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.186093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.186095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.186097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.186102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.186104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.186106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501655599:10599]
2025-10-02T09:35:35.186129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.186133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.186135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.186136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.186137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.186139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.186244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.191430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId: src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.194085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.254542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577229892:7823]
2025-10-02T09:35:35.254704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2837, pipe: [1:7556555733577229892:7823]
2025-10-02T09:35:35.295755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.296035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.296045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.296057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229892:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.296250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.296274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.296273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.296282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.296299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577229892:7823]
2025-10-02T09:35:35.296328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2838 reason: error at write: Disconnected sessionId: src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0
2025-10-02T09:35:35.296463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2838 sessionId: src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0 is DEAD
2025-10-02T09:35:35.296575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.296585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Write session will restart in 0.007505s
2025-10-02T09:35:35.296600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Write session: Do CDS request
2025-10-02T09:35:35.296603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.305567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.306186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.306348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.306355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2839
2025-10-02T09:35:35.306586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.306607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.306613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.306615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.306867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2839 sessionId:  describe result for acl check
2025-10-02T09:35:35.306885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.306889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.306888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.306890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.306893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.306989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.306996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.307002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.307027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.307051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501655817:10613]
2025-10-02T09:35:35.307216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.307390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.307585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.307615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.307796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.307824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.307828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.307828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.307829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.307830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.307830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.307831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.307831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.307832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.307832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.307833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.307833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.307837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.307846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.307849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.307853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.307856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.307859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.307862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.307865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.307872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.307875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.307882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.307885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.307889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.307896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.307904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.307909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.307916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.307919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.307921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.307924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.307926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.307928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.307930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.307933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.307937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.307940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.307943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.307946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.307949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.307955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.307957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.307960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.307962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.307968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.307971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.307973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.307991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.308602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.313739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.313747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.313748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577230034:8047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.313751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.316441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.317970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.317981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.317982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.317985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.317988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2838 [2:7556555733501655817:10613]
2025-10-02T09:35:35.317995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.318005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.318009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.318011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.318012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.318020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.318024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.318029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.318061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.318066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.318067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.318069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.318071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.318114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.318121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.318130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.318143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.318160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.318177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577229893:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.318184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230073:8047], now have 1 active actors on pipe
2025-10-02T09:35:35.318188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.318189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.318190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.318198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.318213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.318213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.318220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.318222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.318225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.318227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.318221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2838
2025-10-02T09:35:35.318220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2838
2025-10-02T09:35:35.318243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.318250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.318251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.318260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.318266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.318297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.318305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.318309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.318311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.318317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.318324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.318336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.318430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.318436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.318446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.318501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2839 partition: 0 MaxSeqNo: 36 sessionId: src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0
2025-10-02T09:35:35.318737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76af59d-cb88f1e5-4ff7e0e7-528674a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.320967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Write session: try to update token
2025-10-02T09:35:35.320981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.327691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.327702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.327703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.327704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.327708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.327710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.327711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501655812:10613]
2025-10-02T09:35:35.327736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.327743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.327745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.327748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.327752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.327754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.327894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.332777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId: src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.334943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.354375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:35:35.354389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-02T09:35:35.396376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577230083:7823]
2025-10-02T09:35:35.396574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2838, pipe: [1:7556555733577230083:7823]
2025-10-02T09:35:35.437664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.438091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.438102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.438141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230083:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.438320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.438356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.438368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-02T09:35:35.438385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:35.438385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577230083:7823]
2025-10-02T09:35:35.438437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0
2025-10-02T09:35:35.438569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2839 sessionId: src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0 is DEAD
2025-10-02T09:35:35.438709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:35.438729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Write session will restart in 0.009181s
2025-10-02T09:35:35.438750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Write session: Do CDS request
2025-10-02T09:35:35.438755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.447622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.449009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.449147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.449154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.449161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.449191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.449216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.449215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501655998:10617]
2025-10-02T09:35:35.449293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.449301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2840
2025-10-02T09:35:35.449397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.449414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.449419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.449422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.449563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.449687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2840 sessionId:  describe result for acl check
2025-10-02T09:35:35.449712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.449717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.449718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.449721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.449768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.449798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.449982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.450012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.450016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.450017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.450017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.450018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.450018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.450019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.450019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.450020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.450021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.450021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.450022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.450024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.450031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.450033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.450035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.450037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.450039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.450041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.450043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.450045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.450047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.450049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.450050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.450055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.450059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.450062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.450065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.450067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.450070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.450072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.450074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.450077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.450079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.450081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.450084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.450086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.450089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.450091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.450101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.450094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.450096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.450098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.450101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.450103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.450105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.450108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.450111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.450113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.450129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.451473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.456447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.456456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.456460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577230226:8051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.456464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.458722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.460290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.460301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.460302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.460304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.460308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2839 [2:7556555733501655998:10617]
2025-10-02T09:35:35.460314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.460324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.460326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.460327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.460328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.460337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.460340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.460344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.460372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.460377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.460378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.460381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.460382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.460431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.460439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.460448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.460461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.460477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.460495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230263:8051], now have 1 active actors on pipe
2025-10-02T09:35:35.460502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230084:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.460506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.460507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.460509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.460520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.460528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.460530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.460510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2839
2025-10-02T09:35:35.460531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.460534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2839
2025-10-02T09:35:35.460534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.460546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.460549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.460575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.460583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.460600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.460610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.460620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.460635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6900fbbf-e3423df5-6bae5154-862888f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.460644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.460646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.460648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.460655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.460666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.460710Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:35:35.460742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.460852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 21 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:35:35.460875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:35:35.460876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.460883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.460893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.460943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2840 partition: 0 MaxSeqNo: 36 sessionId: src_id|6900fbbf-e3423df5-6bae5154-862888f_0
2025-10-02T09:35:35.461166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d648a848-77634a89-b5b0a8ed-ce4db86e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6900fbbf-e3423df5-6bae5154-862888f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.463482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Write session: try to update token
2025-10-02T09:35:35.463497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.470151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.470164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.470165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.470166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.470169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.470172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.470174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501655993:10617]
2025-10-02T09:35:35.470197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.470200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.470202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.470211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.470223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.470227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.470325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.475890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId: src_id|6900fbbf-e3423df5-6bae5154-862888f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.478015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.538729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577230274:7823]
2025-10-02T09:35:35.538960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2839, pipe: [1:7556555733577230274:7823]
2025-10-02T09:35:35.581436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.581735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.581745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.581757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230274:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.581976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.581986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.582003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577230274:7823]
2025-10-02T09:35:35.582025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.582034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2840 reason: error at write: Disconnected sessionId: src_id|6900fbbf-e3423df5-6bae5154-862888f_0
2025-10-02T09:35:35.582086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.582179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2840 sessionId: src_id|6900fbbf-e3423df5-6bae5154-862888f_0 is DEAD
2025-10-02T09:35:35.582349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.582362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Write session will restart in 0.008741s
2025-10-02T09:35:35.582384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Write session: Do CDS request
2025-10-02T09:35:35.582390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.591229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.592182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.592258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.592265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2841
2025-10-02T09:35:35.592378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.592397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.592403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.592405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.592578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.592689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.592696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.592702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.592707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2841 sessionId:  describe result for acl check
2025-10-02T09:35:35.592735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.592731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.592741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.592742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.592753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501656179:10620]
2025-10-02T09:35:35.592747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.593100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.593133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.593300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.593326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.593516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.593554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.593560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.593560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.593561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.593562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.593563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.593564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.593564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.593565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.593566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.593567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.593568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.593572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.593581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.593584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.593587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.593590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.593593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.593596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.593600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.593603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.593607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.593610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.593614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.593618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.593622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.593625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.593628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.593631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.593633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.593635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.593638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.593640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.593643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.593645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.593647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.593649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.593652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.593654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.593657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.593659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.593662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.593664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.593666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.593669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.593671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.593673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.593676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.593694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.594278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.598354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.598361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.598363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577230418:8090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.598366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.601063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.602618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.602628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.602629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.602631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.602634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2840 [2:7556555733501656179:10620]
2025-10-02T09:35:35.602642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.602651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.602656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.602657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.602658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.602667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.602669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.602674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.602703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.602708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.602709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.602710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.602712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.602755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.602761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.602770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.602783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.602800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.602817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230278:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.602823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230457:8090], now have 1 active actors on pipe
2025-10-02T09:35:35.602827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.602829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.602830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.602830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2840
2025-10-02T09:35:35.602850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2840
2025-10-02T09:35:35.602840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.602852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.602854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.602854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.602855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.602867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.602869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.602896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.602903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.602911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.602920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.602935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.602939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.602945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.602947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.602948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.602955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.602964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.602981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.603064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.603071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.603080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.603140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2841 partition: 0 MaxSeqNo: 36 sessionId: src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0
2025-10-02T09:35:35.603351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900fbbf-e3423df5-6bae5154-862888f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.605662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Write session: try to update token
2025-10-02T09:35:35.605677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.612050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.612062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.612063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.612064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.612067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.612069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.612070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501656173:10620]
2025-10-02T09:35:35.612093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.612098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.612100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.612111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.612123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.612126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.612221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.618279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId: src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.620348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.682056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577230465:7823]
2025-10-02T09:35:35.682231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2840, pipe: [1:7556555733577230465:7823]
2025-10-02T09:35:35.723070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.723459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.723468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.723482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230465:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.723696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577230465:7823]
2025-10-02T09:35:35.723699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.723718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.723718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.723722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.723773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2841 reason: error at write: Disconnected sessionId: src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0
2025-10-02T09:35:35.723917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2841 sessionId: src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0 is DEAD
2025-10-02T09:35:35.724055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.724068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Write session will restart in 0.005881s
2025-10-02T09:35:35.724094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Write session: Do CDS request
2025-10-02T09:35:35.724100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.731190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.731304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.731311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2842
2025-10-02T09:35:35.731431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.731453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.731460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.731463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.731757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2842 sessionId:  describe result for acl check
2025-10-02T09:35:35.731781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.731786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.731787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.731790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.732209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.733823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.734337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.735764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.735817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.735825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.735829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577230546:8084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.735832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.735879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.735886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.735893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.735930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.735961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501656360:10622]
2025-10-02T09:35:35.736355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.736551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.736579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.736761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.736792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.736796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.736796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.736797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.736797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.736798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.736798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.736799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.736813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.736813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.736814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.736815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.736817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.736823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.736825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.736827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.736830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.736832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.736834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.736836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.736838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.736840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.736842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.736844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.736847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.736851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.736854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.736857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.736859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.736865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.736867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.736870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.736872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.736875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.736877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.736880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.736882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.736885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.736891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.736893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.736896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.736899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.736901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.736903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.736906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.736908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.736911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.736914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.736932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.744346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.745808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.745819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.745820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.745822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.745825Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2841 [2:7556555733501656360:10622]
2025-10-02T09:35:35.745832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.745841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.745846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.745848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.745849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.745858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.745861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.745865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.745993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.745998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.745999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.746001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.746002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.746046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.746053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.746062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.746075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.746092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.746109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230643:8084], now have 1 active actors on pipe
2025-10-02T09:35:35.746116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230466:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.746120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.746122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.746123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.746131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.746145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.746146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.746148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.746149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.746159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.746165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.746183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.746178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2841
2025-10-02T09:35:35.746187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2841
2025-10-02T09:35:35.746193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.746201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.746216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.746223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.746246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.746255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.746262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.746263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.746270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.746278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.746292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.746405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.746411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.746422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.746479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2842 partition: 0 MaxSeqNo: 36 sessionId: src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0
2025-10-02T09:35:35.746732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566cb40a-1071e41f-58a67fb3-7a629d0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.749050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Write session: try to update token
2025-10-02T09:35:35.749065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.755555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.755569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.755570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.755571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.755575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.755578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.755579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501656354:10622]
2025-10-02T09:35:35.755602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.755606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.755607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.755619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.755630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.755633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.755723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.761830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId: src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.763907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.823909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577230654:7823]
2025-10-02T09:35:35.824126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2841, pipe: [1:7556555733577230654:7823]
2025-10-02T09:35:35.864821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:35.865140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.865150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.865163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230654:7823], now have 1 active actors on pipe
2025-10-02T09:35:35.865380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:35.865386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:35.865395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:35.865397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:35.865426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577230654:7823]
2025-10-02T09:35:35.865442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2842 reason: error at write: Disconnected sessionId: src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0
2025-10-02T09:35:35.865568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2842 sessionId: src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0 is DEAD
2025-10-02T09:35:35.865721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:35.865733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Write session will restart in 0.007197s
2025-10-02T09:35:35.865756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Write session: Do CDS request
2025-10-02T09:35:35.865763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:35.874230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.874313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:35.874331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2843
2025-10-02T09:35:35.874458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:35.874479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:35.874488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:35.874491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:35.874789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2843 sessionId:  describe result for acl check
2025-10-02T09:35:35.874809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:35.874814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:35.874815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:35.874818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:35.875148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:35.875164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:35.876470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:35.876544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:35.876573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:35.876580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:35.876586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:35.876635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:35.876657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555733501656540:10624]
2025-10-02T09:35:35.877011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:35.877216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:35.877246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:35.877432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:35.877460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.877464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.877465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.877465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.877466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.877466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.877467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.877467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.877468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.877469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.877469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.877470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.877473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.877478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.877480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.877482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.877484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.877486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.877488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.877490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.877492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.877494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.877496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.877498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.877502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.877506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:35.877509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.877512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:35.877514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.877517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:35.877519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.877522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:35.877524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.877527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:35.877529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.877531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:35.877533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.877536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:35.877538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.877541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:35.877544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.877546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:35.877548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.877551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.877553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.877555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.877557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.877560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.877578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:35.881427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:35.881435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:35.881437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555733577230797:8104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:35.881441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:35.885067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:35.886600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:35.886611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:35.886612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:35.886614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:35.886618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2842 [2:7556555733501656540:10624]
2025-10-02T09:35:35.886624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:35.886636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:35.886641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.886642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.886643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.886653Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:35.886659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:35.886663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:35.886698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.886703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.886704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.886706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:35.886707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:35.886753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:35.886760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.886771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:35.886783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:35.886800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:35.886817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230656:2446], now have 1 active actors on pipe
2025-10-02T09:35:35.886823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230838:8104], now have 1 active actors on pipe
2025-10-02T09:35:35.886827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.886829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.886830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.886838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:35.886848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:35.886852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:35.886855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:35.886857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:35.886865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:35.886872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:35.886860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2842
2025-10-02T09:35:35.886862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2842
2025-10-02T09:35:35.886889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.886895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:35.886897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:35.886913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.886920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.886945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:35.886954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:35.886956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:35.886958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:35.886964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:35.886974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:35.886989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.887076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:35.887083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:35.887093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:35.887147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2843 partition: 0 MaxSeqNo: 36 sessionId: src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0
2025-10-02T09:35:35.887415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c578aa71-f16cd564-41920ceb-e19a3d88_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:35.889902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Write session: try to update token
2025-10-02T09:35:35.889918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:35.896116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:35.896129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:35.896130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:35.896131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:35.896134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.896137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.896139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555733501656535:10624]
2025-10-02T09:35:35.896163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:35.896170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:35.896172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:35.896176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:35.896187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:35.896191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:35.896286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:35.902721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId: src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:35.904918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:35.965733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555733577230850:7823]
2025-10-02T09:35:35.965949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2842, pipe: [1:7556555733577230850:7823]
2025-10-02T09:35:36.006653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.006945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.006955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.006967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555733577230850:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.007136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555733577230850:7823]
2025-10-02T09:35:36.007152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.007161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.007163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.007181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.007209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2843 reason: error at write: Disconnected sessionId: src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0
2025-10-02T09:35:36.007367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2843 sessionId: src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0 is DEAD
2025-10-02T09:35:36.007542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.007557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Write session will restart in 0.009147s
2025-10-02T09:35:36.007580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Write session: Do CDS request
2025-10-02T09:35:36.007586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.016536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.017950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.018055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.018062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.018067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.018094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.018186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624017:10626]
2025-10-02T09:35:36.018240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.018331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.018341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2844
2025-10-02T09:35:36.018456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.018476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.018478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.018482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.018537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.018759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2844 sessionId:  describe result for acl check
2025-10-02T09:35:36.018753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.018782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.018783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.018789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.018790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.018792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.018965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.018995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.018999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.019000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.019000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.019001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.019001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.019002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.019002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.019003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.019004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.019004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.019005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.019009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.019018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.019021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.019024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.019027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.019031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.019033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.019037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.019040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.019044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.019047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.019050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.019055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.019061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.019070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.019074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.019078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.019086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.019089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.019095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.019097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.019100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.019103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.019106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.019110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.019113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.019116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.019118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.019120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.019123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.019125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.019128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.019130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.019134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.019136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.019139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.019132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.019155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.020303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.024461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.024469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.024471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872198297:8124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.024474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.026749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.028227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.028239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.028240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.028242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.028245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2843 [2:7556555737796624017:10626]
2025-10-02T09:35:36.028252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.028262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.028264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.028265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.028266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.028275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.028278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.028282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.028311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.028317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.028318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.028320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.028321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.028366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.028372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.028381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.028392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.028409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.028429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198150:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.028435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198334:8124], now have 1 active actors on pipe
2025-10-02T09:35:36.028439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.028440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.028441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.028449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.028463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.028465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.028467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.028469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.028460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2843
2025-10-02T09:35:36.028479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.028483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.028460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2843
2025-10-02T09:35:36.028505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.028512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.028523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.028533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.028545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.028555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.028560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.028567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.028569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.028575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.028584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.028604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.028685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.028691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.028701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.028758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2844 partition: 0 MaxSeqNo: 36 sessionId: src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0
2025-10-02T09:35:36.029017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43873c5-a7b59f52-fc20d3c4-104a0361_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.031528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Write session: try to update token
2025-10-02T09:35:36.031543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.037635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.037645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.037646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.037648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.037652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.037654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.037655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624012:10626]
2025-10-02T09:35:36.037675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.037678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.037679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.037680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.037683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.037685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.037815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.044100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId: src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.046201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.107039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872198342:7823]
2025-10-02T09:35:36.107413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2843, pipe: [1:7556555737872198342:7823]
2025-10-02T09:35:36.146138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.146465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.146474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.146487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198342:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.146876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.146884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.146895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.146921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2844 reason: error at write: Disconnected sessionId: src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0
2025-10-02T09:35:36.146926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872198342:7823]
2025-10-02T09:35:36.147013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.147049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2844 sessionId: src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0 is DEAD
2025-10-02T09:35:36.147487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.147501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Write session will restart in 0.009246s
2025-10-02T09:35:36.147525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Write session: Do CDS request
2025-10-02T09:35:36.147530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.155869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.157211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.157306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.157312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.157318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.157342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.157363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624213:10630]
2025-10-02T09:35:36.157705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.157856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.157878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.158058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.158088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.158092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.158092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.158093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.158093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.158094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.158094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.158095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.158095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.158096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.158096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.158097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.158100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.158106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.158108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.158110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.158112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.158114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.158116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.158118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.158120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.158122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.158124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.158126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.158130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.158133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.158136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.158139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.158141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.158144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.158147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.158149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.158152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.158157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.158159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.158162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.158165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.158170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.158172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.158175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.158178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.158181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.158186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.158190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.158192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.158195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.158197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.158199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.158217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.158257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.158264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2845
2025-10-02T09:35:36.158307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.158509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.158525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.158531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.158533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.158790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2845 sessionId:  describe result for acl check
2025-10-02T09:35:36.158813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.158817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.158818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.158821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.159150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.160615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.164577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.164585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.164588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872198493:8146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.164592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.165795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.167256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.167268Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.167269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.167271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.167275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2844 [2:7556555737796624213:10630]
2025-10-02T09:35:36.167282Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.167291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.167294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.167296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.167297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.167305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.167311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.167316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.167344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.167349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.167350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.167352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.167353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.167456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2844
2025-10-02T09:35:36.167469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2844
2025-10-02T09:35:36.167484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.167490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.167496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.167503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.167515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.167529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198343:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.167534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198527:8146], now have 1 active actors on pipe
2025-10-02T09:35:36.167547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.167552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.167561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.167565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.167566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.167575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.167586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.167587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.167589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.167590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.167597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.167599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.167607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.167613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.167616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.167617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.167621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.167628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.167643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.167650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.167655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.167658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.167733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.167738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.167750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.167794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2845 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0
2025-10-02T09:35:36.168052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1f18e-5b0b105d-26fdcb29-8b61e5d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.170529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Write session: try to update token
2025-10-02T09:35:36.170545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.176593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.176604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.176606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.176607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.176611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.176613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.176615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624208:10630]
2025-10-02T09:35:36.176633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.176635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.176636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.176638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.176637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.176640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.176750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.183172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId: src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.185268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.246830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872198569:7823]
2025-10-02T09:35:36.247253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2844, pipe: [1:7556555737872198569:7823]
2025-10-02T09:35:36.290035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.290406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.290414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.290426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198569:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.290585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.290602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.290605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.290619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872198569:7823]
2025-10-02T09:35:36.290605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.290665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2845 reason: error at write: Disconnected sessionId: src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0
2025-10-02T09:35:36.290805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2845 sessionId: src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0 is DEAD
2025-10-02T09:35:36.290968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.290980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Write session will restart in 0.006753s
2025-10-02T09:35:36.291003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Write session: Do CDS request
2025-10-02T09:35:36.291010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.299243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.299324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.299330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2846
2025-10-02T09:35:36.299358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.299447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.299467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.299473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.299475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.299728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2846 sessionId:  describe result for acl check
2025-10-02T09:35:36.299754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.299758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.299759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.299762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.300107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.300762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.300898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.300905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.300912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.300941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.300964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624433:10644]
2025-10-02T09:35:36.301305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.301467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.301491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.301654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.301669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.301697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.301702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.301702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.301703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.301703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.301704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.301705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.301705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.301706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.301706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.301707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.301708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.301710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.301716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.301718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.301720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.301722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.301724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.301726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.301728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.301730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.301733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.301735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.301737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.301740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.301744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.301747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.301749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.301752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.301754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.301756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.301759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.301761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.301764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.301766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.301769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.301771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.301774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.301776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.301779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.301781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.301784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.301788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.301791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.301793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.301796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.301798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.301800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.301820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.306591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.306599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.306602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872198716:8195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.306605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.309200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.310601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.310611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.310612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.310614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.310617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2845 [2:7556555737796624433:10644]
2025-10-02T09:35:36.310623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.310633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.310635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.310636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.310638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.310646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.310652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.310657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.310685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.310690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.310691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.310692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.310694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.310730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.310734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.310740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.310749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.310757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.310771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198757:8195], now have 1 active actors on pipe
2025-10-02T09:35:36.310776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198570:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.310779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.310780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.310782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.310788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.310799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.310802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.310805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.310806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.310809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.310811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.310825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.310805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2845
2025-10-02T09:35:36.310830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.310807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2845
2025-10-02T09:35:36.310831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.310841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.310842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.310863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe5cab23-bc593956-28431243-f10487f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.310870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.310872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.310873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.310877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.310883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.310892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.310973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.310977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.310985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.311037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2846 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe5cab23-bc593956-28431243-f10487f5_0
2025-10-02T09:35:36.311391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2570610-b4091a27-68ebcfd-e3d1137d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe5cab23-bc593956-28431243-f10487f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.313790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Write session: try to update token
2025-10-02T09:35:36.313805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.319846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.319857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.319858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.319859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.319862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.319864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.319868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624428:10644]
2025-10-02T09:35:36.319886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.319887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.319889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.319890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.319890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.319891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.320011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.326254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId: src_id|fe5cab23-bc593956-28431243-f10487f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.328198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.390678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872198765:7823]
2025-10-02T09:35:36.390835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2845, pipe: [1:7556555737872198765:7823]
2025-10-02T09:35:36.428936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.429246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.429255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.429267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198765:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.429641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872198765:7823]
2025-10-02T09:35:36.429643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.429646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.429664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.429695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2846 reason: error at write: Disconnected sessionId: src_id|fe5cab23-bc593956-28431243-f10487f5_0
2025-10-02T09:35:36.429846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2846 sessionId: src_id|fe5cab23-bc593956-28431243-f10487f5_0 is DEAD
2025-10-02T09:35:36.429851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.430015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.430029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Write session will restart in 0.006694s
2025-10-02T09:35:36.430060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Write session: Do CDS request
2025-10-02T09:35:36.430065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.438216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.438332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.438339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2847
2025-10-02T09:35:36.438435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.438456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.438462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.438464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.438740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2847 sessionId:  describe result for acl check
2025-10-02T09:35:36.438761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.438766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.438767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.438770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.439109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.439783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.440688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.441376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.441468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.441475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.441480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.441504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.441526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624621:10647]
2025-10-02T09:35:36.442131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.442171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.442178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.442180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872198898:8211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.442184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.442276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.442299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.442581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.442610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.442614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.442614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.442616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.442616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.442617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.442618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.442618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.442619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.442619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.442622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.442628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.442630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.442633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.442635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.442637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.442639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.442641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.442643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.442645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.442647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.442649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.442653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.442657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.442660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.442663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.442669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.442671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.442674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.442676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.442679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.442681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.442684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.442686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.442689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.442691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.442694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.442697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.442699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.442702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.442705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.442707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.442711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.442713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.442736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.450138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.451766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.451776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.451777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.451780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.451783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2846 [2:7556555737796624621:10647]
2025-10-02T09:35:36.451789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.451800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.451801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.451803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.451804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.451812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.451819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.451823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.451852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.451857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.451858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.451860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.451861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.451895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.451900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.451907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.451912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.451923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.451937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198957:8211], now have 1 active actors on pipe
2025-10-02T09:35:36.451943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198766:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.451946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.451948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.451949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.451956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.451963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.451969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.451970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.451971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.451972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.451973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.451987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.451990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.451992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.451974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2846
2025-10-02T09:35:36.451976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2846
2025-10-02T09:35:36.452006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.452011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.452027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.452034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.452036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.452037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.452043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.452051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.452063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.452156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.452161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.452168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.452222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2847 partition: 0 MaxSeqNo: 36 sessionId: src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0
2025-10-02T09:35:36.452494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5cab23-bc593956-28431243-f10487f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.454982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Write session: try to update token
2025-10-02T09:35:36.454998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.461035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.461046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.461047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.461048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.461051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.461054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.461056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624615:10647]
2025-10-02T09:35:36.461074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.461078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.461079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.461079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.461081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.461084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.461195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.467789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId: src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.469911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.529952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872198967:7823]
2025-10-02T09:35:36.530324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2846, pipe: [1:7556555737872198967:7823]
2025-10-02T09:35:36.572569Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.572964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.572973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.572985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198967:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.573195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.573205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.573207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.573210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.573249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872198967:7823]
2025-10-02T09:35:36.573252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2847 reason: error at write: Disconnected sessionId: src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0
2025-10-02T09:35:36.573379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2847 sessionId: src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0 is DEAD
2025-10-02T09:35:36.573486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.573500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Write session will restart in 0.008113s
2025-10-02T09:35:36.573521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Write session: Do CDS request
2025-10-02T09:35:36.573526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.581975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.582108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.582227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.582235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2848
2025-10-02T09:35:36.582344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.582364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.582370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.582372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.582664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2848 sessionId:  describe result for acl check
2025-10-02T09:35:36.582686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.582690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.582691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.582694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.583041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.583315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.583443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.583450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.583456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.583485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.583509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624806:10649]
2025-10-02T09:35:36.584111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.584265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.584287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.584511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.584561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.584590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.584594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.584595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.584595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.584596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.584596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.584597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.584597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.584598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.584599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.584599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.584600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.584603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.584608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.584611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.584613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.584615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.584617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.584619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.584621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.584623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.584625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.584628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.584630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.584633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.584637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.584640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.584643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.584646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.584648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.584651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.584653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.584656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.584659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.584661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.584664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.584666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.584669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.584671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.584673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.584676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.584678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.584681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.584684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.584686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.584689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.584691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.584694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.584710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.588479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.588486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.588488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872199119:8264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.588491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.592090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.593668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.593680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.593681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.593683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.593686Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2847 [2:7556555737796624806:10649]
2025-10-02T09:35:36.593692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.593701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.593703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.593705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.593706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.593714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.593716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.593721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.593751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.593756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.593758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.593759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.593760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.593796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.593801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.593807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.593812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.593822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.593834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.593839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.593840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.593844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.593850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.593852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199158:8264], now have 1 active actors on pipe
2025-10-02T09:35:36.593854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872198968:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.593858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.593858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.593860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.593865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.593867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.593880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.593889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.593890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2847
2025-10-02T09:35:36.593890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2847
2025-10-02T09:35:36.593904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.593944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.593949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.593963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.593970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.593972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.593973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.593979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.593986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.593994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.594092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.594096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.594103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.594151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2848 partition: 0 MaxSeqNo: 36 sessionId: src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0
2025-10-02T09:35:36.594369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e630669c-fa4f02ce-3e1faece-4828d72a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.596890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Write session: try to update token
2025-10-02T09:35:36.596910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.603773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.603785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.603787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.603788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.603792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.603794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.603796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624801:10649]
2025-10-02T09:35:36.603817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.603820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.603822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.603824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.603824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.603825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.603945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.609670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId: src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.611757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.673311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872199165:7823]
2025-10-02T09:35:36.673516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2847, pipe: [1:7556555737872199165:7823]
2025-10-02T09:35:36.713877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.714171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.714180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.714203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199165:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.714383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.714409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.714414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872199165:7823]
2025-10-02T09:35:36.714419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.714429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.714463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2848 reason: error at write: Disconnected sessionId: src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0
2025-10-02T09:35:36.714604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2848 sessionId: src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0 is DEAD
2025-10-02T09:35:36.714770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.714785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Write session will restart in 0.007197s
2025-10-02T09:35:36.714806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Write session: Do CDS request
2025-10-02T09:35:36.714812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.723233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.723313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.723320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2849
2025-10-02T09:35:36.723417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.723436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.723441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.723443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.723418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.723690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2849 sessionId:  describe result for acl check
2025-10-02T09:35:36.723712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.723716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.723717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.723720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.724063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.724862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.724956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.724962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.724967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.724991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.725016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796624992:10651]
2025-10-02T09:35:36.725351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.725352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.725511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.725533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.725707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.725735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.725739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.725739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.725740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.725740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.725741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.725741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.725742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.725742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.725743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.725743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.725744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.725747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.725753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.725755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.725757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.725759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.725761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.725763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.725765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.725767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.725769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.725771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.725773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.725776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.725780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.725784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.725787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.725789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.725792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.725794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.725797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.725799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.725801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.725804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.725806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.725810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.725813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.725816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.725819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.725821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.725824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.725826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.725830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.725832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.725835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.725837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.725839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.725857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.729727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.729734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.729736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872199316:8271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.729739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.733367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.734867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.734878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.734879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.734880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.734883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2848 [2:7556555737796624992:10651]
2025-10-02T09:35:36.734890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.734899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.734903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.734905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.734906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.734914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.734920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.734923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.734951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.734955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.734956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.734958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.734959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.734996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.735000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.735006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.735012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.735020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.735029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.735034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.735035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.735040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.735046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.735047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199355:8271], now have 1 active actors on pipe
2025-10-02T09:35:36.735049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199167:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.735054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.735054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.735055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.735062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.735063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.735076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.735085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.735092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.735090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2848
2025-10-02T09:35:36.735109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2848
2025-10-02T09:35:36.735116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.735121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.735134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.735141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.735143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.735145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.735150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.735156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.735164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.735270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.735275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.735282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.735333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2849 partition: 0 MaxSeqNo: 36 sessionId: src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0
2025-10-02T09:35:36.735532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63338a3c-3fe7d7dd-ede2b621-9799632a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.738410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Write session: try to update token
2025-10-02T09:35:36.738420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.747836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:36.747848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.747853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.747874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:36.747875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:36.748011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:36.748126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:36.748238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:36.748350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:36.748508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:36.748530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:36.751074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId: src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.752365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.752376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.752378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.752379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.752383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.752385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.752388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796624987:10651]
2025-10-02T09:35:36.752405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.752406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.752408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.752410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.752410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.752411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.752520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.753181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.814620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872199362:7823]
2025-10-02T09:35:36.814795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2848, pipe: [1:7556555737872199362:7823]
2025-10-02T09:35:36.861137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:36.861510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.861520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.861533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199362:7823], now have 1 active actors on pipe
2025-10-02T09:35:36.861729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872199362:7823]
2025-10-02T09:35:36.861740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:36.861742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:36.861750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:36.861795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2849 reason: error at write: Disconnected sessionId: src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0
2025-10-02T09:35:36.861945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2849 sessionId: src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0 is DEAD
2025-10-02T09:35:36.862081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:36.862120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:36.862135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Write session will restart in 0.009122s
2025-10-02T09:35:36.862167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Write session: Do CDS request
2025-10-02T09:35:36.862173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:36.871006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:36.872247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.872311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:36.872320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2850
2025-10-02T09:35:36.872370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:36.872445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:36.872464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:36.872470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:36.872473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:36.872471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:36.872478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:36.872484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:36.872509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:36.872533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555737796625180:10653]
2025-10-02T09:35:36.872735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2850 sessionId:  describe result for acl check
2025-10-02T09:35:36.872754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:36.872758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:36.872760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:36.872763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:36.872923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:36.873088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:36.873111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:36.873115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:36.873291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:36.873321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.873325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.873326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.873326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.873327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.873327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.873328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.873328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.873329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.873329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.873330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.873330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.873333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.873339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.873341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.873343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.873345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.873347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.873349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.873351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.873353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.873355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.873357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.873359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.873364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.873368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:36.873371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.873374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:36.873376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.873379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:36.873381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.873384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:36.873386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.873388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:36.873391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.873393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:36.873395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.873398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:36.873400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.873402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:36.873405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.873407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:36.873412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.873416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.873418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.873421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.873426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.873429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.873447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:36.874352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:36.878684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:36.878693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:36.878696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555737872199514:8291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:36.878700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:36.880837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:36.882495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:36.882506Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:36.882508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:36.882510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:36.882513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2849 [2:7556555737796625180:10653]
2025-10-02T09:35:36.882521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:36.882531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:36.882536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.882538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.882539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.882547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:36.882550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:36.882554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:36.882593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.882598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.882599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.882602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:36.882603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:36.882640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:36.882645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.882652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:36.882657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:36.882665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:36.882680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199553:8291], now have 1 active actors on pipe
2025-10-02T09:35:36.882684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199364:2446], now have 1 active actors on pipe
2025-10-02T09:35:36.882689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.882690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.882691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.882698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:36.882707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:36.882711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:36.882714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:36.882716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:36.882718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:36.882720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:36.882731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.882717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2849
2025-10-02T09:35:36.882722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2849
2025-10-02T09:35:36.882734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:36.882736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:36.882749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.882751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.882773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c367d1d-6751db44-ba10f45-41522de6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:36.882780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:36.882782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:36.882784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:36.882788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:36.882794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:36.882806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.882897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:36.882902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:36.882910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:36.882964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2850 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c367d1d-6751db44-ba10f45-41522de6_0
2025-10-02T09:35:36.883224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670f130-de4f7ca5-b26106e3-c21c76d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c367d1d-6751db44-ba10f45-41522de6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:36.885776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Write session: try to update token
2025-10-02T09:35:36.885790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:36.891902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:36.891916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:36.891917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:36.891918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:36.891922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.891924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.891926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555737796625175:10653]
2025-10-02T09:35:36.891947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:36.891947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:36.891949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:36.891951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:36.891953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:36.891954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:36.892066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:36.897659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId: src_id|5c367d1d-6751db44-ba10f45-41522de6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:36.899749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:36.962080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555737872199565:7823]
2025-10-02T09:35:36.962242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2849, pipe: [1:7556555737872199565:7823]
2025-10-02T09:35:37.006489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.006799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.006807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.006820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555737872199565:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.007009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555737872199565:7823]
2025-10-02T09:35:37.007028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.007030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.007031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.007088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2850 reason: error at write: Disconnected sessionId: src_id|5c367d1d-6751db44-ba10f45-41522de6_0
2025-10-02T09:35:37.007101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.007232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2850 sessionId: src_id|5c367d1d-6751db44-ba10f45-41522de6_0 is DEAD
2025-10-02T09:35:37.007396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.007411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Write session will restart in 0.005325s
2025-10-02T09:35:37.007434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Write session: Do CDS request
2025-10-02T09:35:37.007439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.014176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.014291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.014298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2851
2025-10-02T09:35:37.014422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.014443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.014446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.014448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.014778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2851 sessionId:  describe result for acl check
2025-10-02T09:35:37.014801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.014805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.014806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.014809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.015150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.016923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.017314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.018879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.019011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.019018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.019024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.019054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.019076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091592667:10655]
2025-10-02T09:35:37.019080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.019088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.019091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167166937:8322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.019094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.019420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.019589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.019613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.019787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.019818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.019821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.019822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.019823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.019823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.019824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.019824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.019825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.019825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.019826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.019826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.019827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.019830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.019835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.019837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.019840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.019842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.019844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.019846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.019847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.019849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.019852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.019853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.019855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.019859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.019863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.019866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.019869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.019871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.019874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.019876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.019879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.019881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.019884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.019886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.019888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.019891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.019894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.019895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.019898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.019900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.019903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.019905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.019908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.019915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.019921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.019923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.019925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.019941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.027330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.028762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.028774Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.028775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.028777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.028780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2850 [2:7556555742091592667:10655]
2025-10-02T09:35:37.028787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.028797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.028814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.028819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.028820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.028828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.028831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.028835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.028871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.028875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.028877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.028878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.028880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.028989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.028995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.029001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.028989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2850
2025-10-02T09:35:37.029006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.028990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2850
2025-10-02T09:35:37.029014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.029025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167166865:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.029030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167052:8322], now have 1 active actors on pipe
2025-10-02T09:35:37.029043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.029047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.029057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.029061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.029062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.029070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.029081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.029082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.029084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.029084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.029091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.029092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.029103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2172f8c-cb2a819-fe93c682-caef983a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.029110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.029112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.029116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.029121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.029126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.029143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.029150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.029155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.029158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.029237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.029242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.029250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.029290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2851 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2172f8c-cb2a819-fe93c682-caef983a_0
2025-10-02T09:35:37.029539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c367d1d-6751db44-ba10f45-41522de6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2172f8c-cb2a819-fe93c682-caef983a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.032040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Write session: try to update token
2025-10-02T09:35:37.032054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.037999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:37.038010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.038016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.038036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:37.038041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:37.038205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:37.038332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:37.038455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:37.038598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:37.038761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:37.038788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:37.044718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId: src_id|f2172f8c-cb2a819-fe93c682-caef983a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.046460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.046473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.046474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.046475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.046479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.046481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.046484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091592661:10655]
2025-10-02T09:35:37.046502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.046502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.046505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.046507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.046511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.046513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.046616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.047368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.106981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167167063:7823]
2025-10-02T09:35:37.107130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2850, pipe: [1:7556555742167167063:7823]
2025-10-02T09:35:37.153930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.154278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.154287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.154302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167063:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.154446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.154467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.154470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.154482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167167063:7823]
2025-10-02T09:35:37.154530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2851 reason: error at write: Disconnected sessionId: src_id|f2172f8c-cb2a819-fe93c682-caef983a_0
2025-10-02T09:35:37.154686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2851 sessionId: src_id|f2172f8c-cb2a819-fe93c682-caef983a_0 is DEAD
2025-10-02T09:35:37.154906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.154919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Write session will restart in 0.009316s
2025-10-02T09:35:37.154909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.154941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Write session: Do CDS request
2025-10-02T09:35:37.154947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.164103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.165154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.165270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.165277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2852
2025-10-02T09:35:37.165409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.165430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.165436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.165439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.165504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.165598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.165605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.165610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.165635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.165661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091592869:10659]
2025-10-02T09:35:37.165698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2852 sessionId:  describe result for acl check
2025-10-02T09:35:37.165719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.165723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.165724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.165727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.166005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.166055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.166157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.166180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.166350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.166378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.166382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.166383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.166383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.166384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.166384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.166385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.166385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.166386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.166386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.166387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.166387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.166390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.166396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.166398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.166400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.166402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.166404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.166406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.166408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.166410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.166412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.166414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.166416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.166420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.166423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.166426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.166429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.166431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.166434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.166436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.166439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.166441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.166444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.166446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.166448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.166451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.166453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.166456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.166458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.166461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.166464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.166466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.166468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.166470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.166473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.166475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.166478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.166494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.167207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.171217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.171224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.171228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167167216:8326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.171231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.173876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.175388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.175399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.175401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.175403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.175406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2851 [2:7556555742091592869:10659]
2025-10-02T09:35:37.175504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.175517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.175518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.175520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.175521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.175529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.175534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.175537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.175567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.175571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.175572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.175574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.175575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.175605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.175610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.175616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.175624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.175632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.175647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167255:8326], now have 1 active actors on pipe
2025-10-02T09:35:37.175651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167064:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.175655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.175656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.175657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.175650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2851
2025-10-02T09:35:37.175661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.175653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2851
2025-10-02T09:35:37.175668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.175677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.175678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.175680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.175680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.175681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.175699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.175704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.175712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.175721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.175732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.175737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d85eca82-10077fca-93666e49-d44eeee3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.175740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.175742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.175743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.175748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.175752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.175764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.175855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.175860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.175868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.175917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2852 partition: 0 MaxSeqNo: 36 sessionId: src_id|d85eca82-10077fca-93666e49-d44eeee3_0
2025-10-02T09:35:37.176168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2172f8c-cb2a819-fe93c682-caef983a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d85eca82-10077fca-93666e49-d44eeee3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.178631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Write session: try to update token
2025-10-02T09:35:37.178644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.184650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.184659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.184660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.184661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.184664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.184666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.184668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091592864:10659]
2025-10-02T09:35:37.184688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.184690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.184690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.184692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.184694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.184695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.184825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.191140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId: src_id|d85eca82-10077fca-93666e49-d44eeee3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.193325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.254410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167167296:7823]
2025-10-02T09:35:37.254507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2851, pipe: [1:7556555742167167296:7823]
2025-10-02T09:35:37.293576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.293833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.293841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.293853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167296:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.293970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.293989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.293998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.294004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167167296:7823]
2025-10-02T09:35:37.294017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.294041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2852 reason: error at write: Disconnected sessionId: src_id|d85eca82-10077fca-93666e49-d44eeee3_0
2025-10-02T09:35:37.294177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2852 sessionId: src_id|d85eca82-10077fca-93666e49-d44eeee3_0 is DEAD
2025-10-02T09:35:37.294339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.294353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Write session will restart in 0.005891s
2025-10-02T09:35:37.294375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Write session: Do CDS request
2025-10-02T09:35:37.294380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.301200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.301253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.301259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2853
2025-10-02T09:35:37.301390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.301410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.301416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.301419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.301693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2853 sessionId:  describe result for acl check
2025-10-02T09:35:37.301715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.301719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.301720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.301723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.302060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.303295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.303473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.304942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.305052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.305060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.305066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.305094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.305116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091593096:10673]
2025-10-02T09:35:37.305301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.305308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.305310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167167397:8375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.305313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.305445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.305591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.305613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.305789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.305816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.305819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.305820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.305821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.305821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.305822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.305822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.305823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.305823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.305824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.305824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.305825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.305828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.305833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.305835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.305837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.305839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.305841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.305843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.305845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.305847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.305850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.305852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.305854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.305857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.305861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.305864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.305867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.305869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.305871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.305874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.305877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.305879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.305882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.305883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.305886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.305888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.305891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.305893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.305895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.305902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.305904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.305906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.305909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.305911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.305915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.305918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.305921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.305941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.313282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.314803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.314813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.314814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.314816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.314819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2852 [2:7556555742091593096:10673]
2025-10-02T09:35:37.314826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.314835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.314840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.314841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.314842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.314851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.314857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.314861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.314888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.314893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.314894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.314896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.314897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.314930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.314935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.314941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.314947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.314959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.314973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167298:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.314978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167487:8375], now have 1 active actors on pipe
2025-10-02T09:35:37.314981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.314983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.314984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.314991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.315000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.315003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.315005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.315006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.315010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.315012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.315004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2852
2025-10-02T09:35:37.315025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.315007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2852
2025-10-02T09:35:37.315029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.315030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.315042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.315044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.315068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.315074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.315076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.315077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.315081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.315089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.315101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.315184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.315189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.315197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.315252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2853 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0
2025-10-02T09:35:37.315489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85eca82-10077fca-93666e49-d44eeee3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.317902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Write session: try to update token
2025-10-02T09:35:37.317919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.323986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.323998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.323999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.323999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.324003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.324008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.324010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091593091:10673]
2025-10-02T09:35:37.324029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.324031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.324033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.324034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.324035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.324037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.324143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.329998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId: src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.332079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.394204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167167500:7823]
2025-10-02T09:35:37.394317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2852, pipe: [1:7556555742167167500:7823]
2025-10-02T09:35:37.431500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.431732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.431741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.431753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167500:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.431870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.431902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167167500:7823]
2025-10-02T09:35:37.431921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.431924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.431960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2853 reason: error at write: Disconnected sessionId: src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0
2025-10-02T09:35:37.432066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2853 sessionId: src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0 is DEAD
2025-10-02T09:35:37.432089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.432222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.432239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Write session will restart in 0.007153s
2025-10-02T09:35:37.432260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Write session: Do CDS request
2025-10-02T09:35:37.432267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.440176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.440280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.440288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2854
2025-10-02T09:35:37.440399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.440417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.440422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.440424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.440692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2854 sessionId:  describe result for acl check
2025-10-02T09:35:37.440719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.440723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.440724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.440727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.440937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.441079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.442327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.442417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.442423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.442429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.442454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.442545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091593291:10676]
2025-10-02T09:35:37.442767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.442890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.443061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.443084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.443260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.443289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.443292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.443293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.443294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.443294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.443295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.443295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.443296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.443296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.443297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.443297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.443298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.443301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.443307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.443309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.443311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.443313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.443315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.443317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.443319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.443321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.443326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.443328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.443331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.443335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.443339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.443342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.443344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.443347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.443349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.443352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.443354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.443356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.443358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.443361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.443363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.443366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.443368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.443370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.443372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.443375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.443377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.443380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.443383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.443385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.443387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.443390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.443408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.447163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.447171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.447174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167167654:8398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.447177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.450740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.452200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.452210Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.452211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.452213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.452217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2853 [2:7556555742091593291:10676]
2025-10-02T09:35:37.452224Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.452233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.452234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.452236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.452237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.452246Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.452249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.452254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.452287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.452292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.452293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.452295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.452296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.452329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.452333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.452340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.452345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.452353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.452367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167501:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.452372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167693:8398], now have 1 active actors on pipe
2025-10-02T09:35:37.452375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.452376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.452377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.452384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.452392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.452396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.452398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.452399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.452402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.452403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.452403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2853
2025-10-02T09:35:37.452404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2853
2025-10-02T09:35:37.452416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.452421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.452422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.452433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.452437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.452461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.452467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.452470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.452471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.452475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.452482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.452491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.452572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.452577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.452584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.452633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2854 partition: 0 MaxSeqNo: 36 sessionId: src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0
2025-10-02T09:35:37.452873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaad993-6e0e6d72-1279940f-9f055d2d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.455361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Write session: try to update token
2025-10-02T09:35:37.455375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.461359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.461370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.461371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.461372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.461376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.461378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.461380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091593286:10676]
2025-10-02T09:35:37.461400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.461403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.461405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.461406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.461407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.461407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.461510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.467885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId: src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.470014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.531930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167167701:7823]
2025-10-02T09:35:37.532100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2853, pipe: [1:7556555742167167701:7823]
2025-10-02T09:35:37.570635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.571031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.571039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.571052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167701:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.571177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.571227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:37.571241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.571273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167167701:7823]
2025-10-02T09:35:37.571288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0
2025-10-02T09:35:37.571440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2854 sessionId: src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0 is DEAD
2025-10-02T09:35:37.571625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:37.571639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Write session will restart in 0.005177s
2025-10-02T09:35:37.571667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Write session: Do CDS request
2025-10-02T09:35:37.571672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.578208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.578285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.578293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2855
2025-10-02T09:35:37.578409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.578429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.578435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.578438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.578734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2855 sessionId:  describe result for acl check
2025-10-02T09:35:37.578752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.578755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.578756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.578758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.579095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.580672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.580915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.582327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.582420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.582426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.582432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.582456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.582478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091593483:10678]
2025-10-02T09:35:37.582523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.582531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.582533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167167789:8394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.582537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.582820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.582972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.582993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.583166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.583193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.583197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.583198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.583198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.583199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.583199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.583200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.583200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.583201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.583201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.583202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.583202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.583205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.583211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.583213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.583216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.583218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.583220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.583222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.583224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.583226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.583228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.583230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.583231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.583235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.583239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.583242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.583245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.583247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.583250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.583252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.583254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.583257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.583259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.583261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.583264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.583266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.583269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.583271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.583274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.583277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.583283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.583285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.583288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.583290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.583295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.583297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.583300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.583317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.590686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.592063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.592074Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.592075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.592077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.592080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2854 [2:7556555742091593483:10678]
2025-10-02T09:35:37.592088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.592099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.592104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.592106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.592107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.592116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.592119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.592124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.592157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.592162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.592163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.592165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.592166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.592214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.592219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.592225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.592231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.592243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.592257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167702:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.592262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167891:8394], now have 1 active actors on pipe
2025-10-02T09:35:37.592266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.592267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.592268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.592276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.592286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.592287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2854
2025-10-02T09:35:37.592287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.592289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.592288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2854
2025-10-02T09:35:37.592291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.592297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.592299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.592312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.592314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.592315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.592323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.592327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.592355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.592363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.592365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.592366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.592371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.592377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.592387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.592467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.592472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.592479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.592531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2855 partition: 0 MaxSeqNo: 36 sessionId: src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0
2025-10-02T09:35:37.592790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f0741d-e0e504e8-c5d67dac-d17a1685_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.595151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Write session: try to update token
2025-10-02T09:35:37.595165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.601434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.601446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.601447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.601448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.601453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.601455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.601457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091593478:10678]
2025-10-02T09:35:37.601475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.601478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.601478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.601480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.601480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.601482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.601593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.617073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId: src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.619244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.671234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167167903:7823]
2025-10-02T09:35:37.671412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2854, pipe: [1:7556555742167167903:7823]
2025-10-02T09:35:37.714079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.714337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.714346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.714358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167903:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.714535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.714540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167167903:7823]
2025-10-02T09:35:37.714545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.714570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.714599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2855 reason: error at write: Disconnected sessionId: src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0
2025-10-02T09:35:37.714696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.714763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2855 sessionId: src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0 is DEAD
2025-10-02T09:35:37.714947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.714961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Write session will restart in 0.008757s
2025-10-02T09:35:37.714984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Write session: Do CDS request
2025-10-02T09:35:37.714989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.724216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.725180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.725329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.725336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2856
2025-10-02T09:35:37.725543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.725563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.725568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.725572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.725790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.725840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2856 sessionId:  describe result for acl check
2025-10-02T09:35:37.725863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.725867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.725868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.725871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.725891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.725898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.725903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.725929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.725953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091593676:10680]
2025-10-02T09:35:37.726223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.726302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.726457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.726479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.726659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.726687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.726691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.726692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.726692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.726693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.726693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.726694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.726694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.726695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.726696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.726696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.726697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.726699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.726705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.726708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.726710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.726712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.726714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.726715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.726717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.726719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.726721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.726723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.726725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.726729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.726733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.726736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.726739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.726741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.726744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.726746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.726749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.726751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.726754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.726756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.726759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.726761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.726764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.726766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.726769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.726771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.726775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.726777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.726780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.726782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.726785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.726787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.726789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.726808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.727309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.731658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.731667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.731669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167168061:8420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.731673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.734336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.736201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.736211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.736212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.736215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.736218Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2855 [2:7556555742091593676:10680]
2025-10-02T09:35:37.736225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.736235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.736237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.736238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.736239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.736248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.736251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.736255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.736289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.736294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.736296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.736297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.736299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.736336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.736342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.736348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.736353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.736362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.736375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167167905:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.736381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168099:8420], now have 1 active actors on pipe
2025-10-02T09:35:37.736385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.736386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.736387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.736395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.736405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.736408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.736407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2855
2025-10-02T09:35:37.736412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.736408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2855
2025-10-02T09:35:37.736414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.736415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.736416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.736429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.736431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.736432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.736442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.736447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.736472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.736479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.736482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.736483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.736488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.736497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.736507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.736595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.736600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.736608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.736661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2856 partition: 0 MaxSeqNo: 36 sessionId: src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0
2025-10-02T09:35:37.736938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472dd0f8-b436e5c0-6edfaf7f-550a5fa6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.739239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Write session: try to update token
2025-10-02T09:35:37.739252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.746324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.746337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.746339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.746340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.746343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.746346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.746348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091593671:10680]
2025-10-02T09:35:37.746367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.746370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.746372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.746373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.746374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.746375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.746481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.759001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId: src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.761073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.814557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167168107:7823]
2025-10-02T09:35:37.814727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2855, pipe: [1:7556555742167168107:7823]
2025-10-02T09:35:37.857387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.857709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.857718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.857730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168107:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.857846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.857836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.857866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167168107:7823]
2025-10-02T09:35:37.857879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.857887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.857935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2856 reason: error at write: Disconnected sessionId: src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0
2025-10-02T09:35:37.858061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2856 sessionId: src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0 is DEAD
2025-10-02T09:35:37.858187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.858202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Write session will restart in 0.007752s
2025-10-02T09:35:37.858226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Write session: Do CDS request
2025-10-02T09:35:37.858232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:37.867188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:37.867216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.867332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:37.867340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2857
2025-10-02T09:35:37.867462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:37.867483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:37.867489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:37.867491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:37.867753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2857 sessionId:  describe result for acl check
2025-10-02T09:35:37.867785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:37.867786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:37.867787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:37.867790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:37.868142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:37.868646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:37.868745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:37.868752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:37.868758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:37.868784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:37.868820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555742091593871:10682]
2025-10-02T09:35:37.869149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:37.869298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:37.869320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:37.869495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:37.869522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.869526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.869528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.869528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.869529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.869529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.869530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.869530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.869531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.869531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.869534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.869540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.869542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.869544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.869546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.869548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.869550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.869552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.869554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.869556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.869558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.869560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.869565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.869568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:37.869572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.869575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:37.869577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.869580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:37.869582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.869585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:37.869587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.869589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:37.869591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.869594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:37.869597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.869599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:37.869605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.869608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:37.869610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.869612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:37.869614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.869617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.869619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.869622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.869624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.869627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.869643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:37.869704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:37.874360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:37.874369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:37.874371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555742167168266:8442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:37.874374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:37.876980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:37.878404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:37.878415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:37.878416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:37.878418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:37.878421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2856 [2:7556555742091593871:10682]
2025-10-02T09:35:37.878428Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:37.878436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:37.878438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.878439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.878440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.878449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:37.878455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:37.878459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:37.878488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.878493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.878494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.878495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:37.878496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:37.878617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:37.878622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.878629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:37.878614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2856
2025-10-02T09:35:37.878614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2856
2025-10-02T09:35:37.878634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:37.878646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:37.878660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168305:8442], now have 1 active actors on pipe
2025-10-02T09:35:37.878665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168109:2446], now have 1 active actors on pipe
2025-10-02T09:35:37.878674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.878679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.878690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.878694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.878695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.878703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:37.878713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:37.878716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:37.878718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:37.878719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:37.878724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:37.878725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:37.878733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:37.878740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:37.878742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:37.878743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:37.878748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:37.878753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:37.878768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.878775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:37.878781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.878783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:37.878853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.878858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.878865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:37.878908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2857 partition: 0 MaxSeqNo: 36 sessionId: src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0
2025-10-02T09:35:37.879141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48e1297-12c636b7-d3f1312c-9bf641c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:37.881458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Write session: try to update token
2025-10-02T09:35:37.881474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:37.887699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:37.887722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:37.887723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:37.887724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:37.887728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.887730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.887732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555742091593866:10682]
2025-10-02T09:35:37.887751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:37.887755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:37.887757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:37.887758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:37.887759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:37.887759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:37.887873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:37.896673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId: src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:37.898826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:37.957914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555742167168319:7823]
2025-10-02T09:35:37.958076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2856, pipe: [1:7556555742167168319:7823]
2025-10-02T09:35:37.996069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:37.996365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:37.996373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:37.996385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168319:7823], now have 1 active actors on pipe
2025-10-02T09:35:37.996501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:37.996532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555742167168319:7823]
2025-10-02T09:35:37.996551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:37.996554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:37.996556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:37.996601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2857 reason: error at write: Disconnected sessionId: src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0
2025-10-02T09:35:37.996741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2857 sessionId: src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0 is DEAD
2025-10-02T09:35:37.996919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:37.996935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Write session will restart in 0.007988s
2025-10-02T09:35:37.996956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Write session: Do CDS request
2025-10-02T09:35:37.996961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.005685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.006183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.006300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.006306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2858
2025-10-02T09:35:38.006425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.006445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.006451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.006454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.006723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2858 sessionId:  describe result for acl check
2025-10-02T09:35:38.006754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.006759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.006760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.006762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.007093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.007103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.007210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.007216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.007222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.007249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.007272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386561362:10684]
2025-10-02T09:35:38.007610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.007829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.007851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.008026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.008057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.008061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.008061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.008062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.008062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.008063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.008064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.008064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.008065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.008065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.008066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.008067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.008069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.008075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.008077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.008080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.008082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.008084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.008086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.008087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.008089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.008092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.008094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.008096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.008099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.008102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.008105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.008108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.008111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.008113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.008115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.008118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.008120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.008123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.008125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.008128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.008130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.008132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.008135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.008137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.008140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.008143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.008145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.008147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.008149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.008152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.008154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.008157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.008174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.008407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.012917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.012924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.012926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462135777:8471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.012930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.015561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.017078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.017089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.017090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.017092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.017096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2857 [2:7556555746386561362:10684]
2025-10-02T09:35:38.017102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.017112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.017117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.017118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.017119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.017127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.017130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.017134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.017168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.017172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.017173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.017175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.017176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.017216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.017221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.017227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.017232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.017242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.017255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.017260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.017261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.017265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.017274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462135817:8471], now have 1 active actors on pipe
2025-10-02T09:35:38.017273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.017275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.017276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555742167168323:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.017276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.017281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.017288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.017292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.017306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.017314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.017309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2857
2025-10-02T09:35:38.017311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2857
2025-10-02T09:35:38.017329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.017350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.017355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.017368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.017375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.017377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.017378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.017383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.017388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.017395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.017482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.017486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.017493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.017545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2858 partition: 0 MaxSeqNo: 36 sessionId: src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0
2025-10-02T09:35:38.017811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ee3f3-7b03b154-ef38c881-2d64d410_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.020084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Write session: try to update token
2025-10-02T09:35:38.020098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.026304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.026316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.026318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.026319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.026322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.026324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.026326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386561357:10684]
2025-10-02T09:35:38.026345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.026351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.026352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.026353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.026357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.026359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.026458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.034539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId: src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.036597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.096682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462135824:7823]
2025-10-02T09:35:38.096816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2857, pipe: [1:7556555746462135824:7823]
2025-10-02T09:35:38.135393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.135694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.135703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.135714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462135824:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.135827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.135867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:38.135878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:38.135878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.135908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462135824:7823]
2025-10-02T09:35:38.135978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2858 reason: error at write: Disconnected sessionId: src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0
2025-10-02T09:35:38.136103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2858 sessionId: src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0 is DEAD
2025-10-02T09:35:38.136251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:38.136261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Write session will restart in 0.006269s
2025-10-02T09:35:38.136276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Write session: Do CDS request
2025-10-02T09:35:38.136280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.143088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.143170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.143178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2859
2025-10-02T09:35:38.143242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.143260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.143265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.143267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.143611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2859 sessionId:  describe result for acl check
2025-10-02T09:35:38.143634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.143638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.143639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.143642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.143967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.145144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.145238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.146788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.146881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.146887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.146893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.146918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.146938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.146945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.146947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462135933:8475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.146951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.146942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386561573:10688]
2025-10-02T09:35:38.147278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.147427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.147449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.147622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.147649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.147653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.147654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.147654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.147655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.147655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.147656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.147657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.147657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.147658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.147658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.147659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.147661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.147666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.147668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.147671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.147673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.147675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.147677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.147678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.147680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.147683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.147684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.147686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.147690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.147693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.147697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.147699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.147701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.147704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.147706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.147709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.147711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.147714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.147716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.147718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.147720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.147723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.147725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.147728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.147730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.147733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.147735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.147738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.147740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.147743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.147745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.147748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.147765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.155127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.156578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.156589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.156590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.156592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.156595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2858 [2:7556555746386561573:10688]
2025-10-02T09:35:38.156707Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.156720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.156722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.156723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.156724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.156733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.156740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.156744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.156771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.156776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.156777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.156779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.156780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.156825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.156831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.156837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.156842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.156851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.156865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136018:8475], now have 1 active actors on pipe
2025-10-02T09:35:38.156870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462135825:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.156873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.156874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.156875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.156884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.156893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.156896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.156898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.156900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.156901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.156902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.156892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2858
2025-10-02T09:35:38.156895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2858
2025-10-02T09:35:38.156917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.156922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.156924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.156938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.156942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.156960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.156966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.156968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.156969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.156974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.156980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.156988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.157079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.157084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.157091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.157148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2859 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0
2025-10-02T09:35:38.157348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4b2a53-10d600e3-9e2e06ee-7088ad55_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.160207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Write session: try to update token
2025-10-02T09:35:38.160216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.166157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.166169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.166171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.166172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.166175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.166178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.166180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386561568:10688]
2025-10-02T09:35:38.166200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.166201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.166203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.166203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.166204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.166205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.166307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.174449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId: src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.176530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.235923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462136043:7823]
2025-10-02T09:35:38.236044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2858, pipe: [1:7556555746462136043:7823]
2025-10-02T09:35:38.274625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.275127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.275137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.275148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136043:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.275262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.275273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.275305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462136043:7823]
2025-10-02T09:35:38.275316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:38.275360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2859 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0
2025-10-02T09:35:38.275504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2859 sessionId: src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0 is DEAD
2025-10-02T09:35:38.275645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:38.275659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Write session will restart in 0.005131s
2025-10-02T09:35:38.275684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Write session: Do CDS request
2025-10-02T09:35:38.275690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.282162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.282218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.282225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2860
2025-10-02T09:35:38.282407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.282427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.282432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.282434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.282763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2860 sessionId:  describe result for acl check
2025-10-02T09:35:38.282785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.282789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.282789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.282792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.283238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.284405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.285314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.286792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.286889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.286896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.286901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.286925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.286946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386561807:10696]
2025-10-02T09:35:38.287039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.287046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.287048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462136146:8560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.287051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.287279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.287427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.287448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.287620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.287646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.287650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.287650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.287651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.287651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.287652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.287652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.287653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.287653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.287654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.287654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.287655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.287657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.287663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.287666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.287668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.287669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.287671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.287673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.287675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.287677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.287679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.287681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.287683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.287686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.287690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.287693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.287696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.287698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.287701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.287702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.287705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.287707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.287709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.287711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.287714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.287716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.287718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.287720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.287723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.287725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.287728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.287734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.287736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.287738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.287741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.287746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.287749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.287766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.295094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.296548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.296559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.296560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.296562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.296565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2859 [2:7556555746386561807:10696]
2025-10-02T09:35:38.296573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.296582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.296585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.296586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.296587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.296595Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.296598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.296607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.296636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.296640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.296641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.296643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.296644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.296678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.296683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.296689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.296694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.296703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.296718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136057:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.296724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136260:8560], now have 1 active actors on pipe
2025-10-02T09:35:38.296727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.296728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.296729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.296736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.296745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.296746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.296748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.296750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.296754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.296755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.296741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2859
2025-10-02T09:35:38.296743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2859
2025-10-02T09:35:38.296767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.296772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.296774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.296784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.296790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.296826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.296833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.296835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.296836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.296841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.296846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.296854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.296958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.296964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.296971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.297024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2860 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0
2025-10-02T09:35:38.297254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7694483-ac4865b8-19bda1bb-ebbbd2da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.299977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Write session: try to update token
2025-10-02T09:35:38.299987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.305952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.305964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.305965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.305966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.305971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.305973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.305976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386561802:10696]
2025-10-02T09:35:38.305994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.305996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.305997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.305999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.305999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.306001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.306110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.311741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId: src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.313719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.375186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462136275:7823]
2025-10-02T09:35:38.375342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2859, pipe: [1:7556555746462136275:7823]
2025-10-02T09:35:38.415507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.415886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.415896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.415908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136275:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.416218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462136275:7823]
2025-10-02T09:35:38.416234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:38.416236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:38.416238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.416237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.416269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2860 reason: error at write: Disconnected sessionId: src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0
2025-10-02T09:35:38.416397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2860 sessionId: src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0 is DEAD
2025-10-02T09:35:38.416523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:38.416532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Write session will restart in 0.006815s
2025-10-02T09:35:38.416548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Write session: Do CDS request
2025-10-02T09:35:38.416552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.424267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.424285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.424291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2861
2025-10-02T09:35:38.424472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.424490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.424496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.424499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.424739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2861 sessionId:  describe result for acl check
2025-10-02T09:35:38.424757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.424761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.424763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.424766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.425099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.425894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.426727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.427473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.427566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.427572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.427578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.427603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.427625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386562008:10705]
2025-10-02T09:35:38.427960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.428106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.428127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.428264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.428271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.428273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462136420:8590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.428277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.428299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.428328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.428332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.428333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.428333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.428334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.428334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.428335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.428335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.428336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.428336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.428337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.428338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.428341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.428346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.428348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.428351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.428352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.428354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.428356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.428358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.428360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.428363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.428364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.428367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.428370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.428374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.428377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.428380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.428382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.428385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.428387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.428390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.428392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.428394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.428396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.428399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.428401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.428404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.428407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.428410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.428412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.428415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.428417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.428420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.428422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.428424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.428431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.428434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.428452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.435791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.437411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.437421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.437422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.437424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.437427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2860 [2:7556555746386562008:10705]
2025-10-02T09:35:38.437434Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.437444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.437445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.437446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.437448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.437457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.437463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.437467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.437497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.437501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.437502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.437504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.437505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.437540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.437544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.437551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.437556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.437567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.437581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136474:8590], now have 1 active actors on pipe
2025-10-02T09:35:38.437586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136276:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.437589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.437591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.437593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.437600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.437610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.437613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.437618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.437619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.437620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.437621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.437632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.437637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.437621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2860
2025-10-02T09:35:38.437624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2860
2025-10-02T09:35:38.437645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.437652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.437654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.437671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5b62a91-6319670-a1740f10-51c0aab5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.437678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.437680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.437681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.437686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.437695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.437709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.437794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.437799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.437806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.437859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2861 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5b62a91-6319670-a1740f10-51c0aab5_0
2025-10-02T09:35:38.438093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a17f6d-bbc7db7e-d2a76d17-2a7df731_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5b62a91-6319670-a1740f10-51c0aab5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.440832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Write session: try to update token
2025-10-02T09:35:38.440851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.446592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.446605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.446607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.446608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.446611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.446614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.446616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386562003:10705]
2025-10-02T09:35:38.446636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.446638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.446641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.446641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.446642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.446642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.446794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.453548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId: src_id|c5b62a91-6319670-a1740f10-51c0aab5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.455650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.516496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462136484:7823]
2025-10-02T09:35:38.516627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2860, pipe: [1:7556555746462136484:7823]
2025-10-02T09:35:38.556236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.556464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.556473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.556486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136484:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.556626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.556674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462136484:7823]
2025-10-02T09:35:38.556690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.556698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:38.556701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:38.556744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2861 reason: error at write: Disconnected sessionId: src_id|c5b62a91-6319670-a1740f10-51c0aab5_0
2025-10-02T09:35:38.556883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2861 sessionId: src_id|c5b62a91-6319670-a1740f10-51c0aab5_0 is DEAD
2025-10-02T09:35:38.557063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:38.557078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Write session will restart in 0.008609s
2025-10-02T09:35:38.557104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Write session: Do CDS request
2025-10-02T09:35:38.557110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.566158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.567179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.567278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.567285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2862
2025-10-02T09:35:38.567407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.567427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.567433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.567435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.567586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.567681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.567688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.567693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.567686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2862 sessionId:  describe result for acl check
2025-10-02T09:35:38.567710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.567715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.567716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.567720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.567718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.567744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386562208:10707]
2025-10-02T09:35:38.568057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.568088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.568269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.568292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.568463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.568492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.568496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.568497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.568497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.568498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.568498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.568499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.568500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.568500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.568500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.568501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.568501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.568504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.568510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.568512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.568514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.568516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.568518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.568520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.568522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.568524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.568526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.568528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.568530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.568534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.568537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.568540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.568543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.568545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.568548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.568550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.568553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.568555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.568557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.568559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.568562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.568564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.568568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.568570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.568573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.568575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.568578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.568580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.568583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.568585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.568588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.568590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.568592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.568611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.569513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.573805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.573813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.573815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462136647:8599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.573819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.575966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.577509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.577520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.577522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.577524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.577527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2861 [2:7556555746386562208:10707]
2025-10-02T09:35:38.577533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.577542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.577548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.577550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.577551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.577560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.577562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.577566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.577598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.577603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.577604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.577606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.577607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.577643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.577647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.577653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.577658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.577669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.577683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136485:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.577689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136686:8599], now have 1 active actors on pipe
2025-10-02T09:35:38.577692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.577694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.577695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.577703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.577713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.577717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.577719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.577721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.577699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2861
2025-10-02T09:35:38.577723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.577725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.577704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2861
2025-10-02T09:35:38.577748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.577753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.577760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.577767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.577779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.577788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e698640-3d651fb8-d19537a5-afee1232_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.577792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.577798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.577799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.577804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.577812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.577825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.577904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.577909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.577916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.577957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2862 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e698640-3d651fb8-d19537a5-afee1232_0
2025-10-02T09:35:38.578200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b62a91-6319670-a1740f10-51c0aab5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e698640-3d651fb8-d19537a5-afee1232_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.580486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Write session: try to update token
2025-10-02T09:35:38.580499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.586746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.586759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.586760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.586761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.586764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.586766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.586768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386562203:10707]
2025-10-02T09:35:38.586787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.586790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.586791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.586792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.586792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.586794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.586903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.592720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId: src_id|5e698640-3d651fb8-d19537a5-afee1232_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.594801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.656791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462136693:7823]
2025-10-02T09:35:38.656960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2861, pipe: [1:7556555746462136693:7823]
2025-10-02T09:35:38.694463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.694781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.694790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.694803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136693:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.694940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.695148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462136693:7823]
2025-10-02T09:35:38.695166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.695169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:38.695221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2862 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e698640-3d651fb8-d19537a5-afee1232_0
2025-10-02T09:35:38.695341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2862 sessionId: src_id|5e698640-3d651fb8-d19537a5-afee1232_0 is DEAD
2025-10-02T09:35:38.695440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:38.695445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Write session will restart in 0.006631s
2025-10-02T09:35:38.695460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Write session: Do CDS request
2025-10-02T09:35:38.695464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.703142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.703269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.703276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2863
2025-10-02T09:35:38.703387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.703407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.703412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.703415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.703680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2863 sessionId:  describe result for acl check
2025-10-02T09:35:38.703699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.703703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.703704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.703707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.704043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.705222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.705323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.706870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.706966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.706973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.706979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.707004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.707026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386562408:10709]
2025-10-02T09:35:38.707041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.707048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.707050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462136809:8617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.707053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.707357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.707511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.707533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.707705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.707733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.707737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.707737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.707738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.707738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.707739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.707739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.707740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.707740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.707741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.707741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.707742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.707745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.707751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.707753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.707755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.707757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.707759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.707760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.707762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.707764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.707766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.707768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.707770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.707774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.707777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.707780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.707783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.707785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.707788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.707790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.707793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.707795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.707797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.707799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.707802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.707805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.707807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.707810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.707812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.707815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.707817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.707820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.707823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.707824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.707827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.707829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.707835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.707852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.715171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.716632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.716642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.716644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.716645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.716648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2862 [2:7556555746386562408:10709]
2025-10-02T09:35:38.716656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.716665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.716670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.716671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.716672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.716681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.716684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.716692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.716720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.716724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.716725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.716727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.716728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.716845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2862
2025-10-02T09:35:38.716863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2862
2025-10-02T09:35:38.716861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.716867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.716874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.716879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.716889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.716905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136695:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.716910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136893:8617], now have 1 active actors on pipe
2025-10-02T09:35:38.716920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.716925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.716934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.716939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.716940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.716948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.716958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.716961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.716963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.716963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.716970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.716971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.716980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.716987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.716989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.716990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.716995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.717000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.717014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.717021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.717029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.717029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.717124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.717129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.717138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.717182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2863 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0
2025-10-02T09:35:38.717435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e698640-3d651fb8-d19537a5-afee1232_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.719722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Write session: try to update token
2025-10-02T09:35:38.719739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.725958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.725969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.725970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.725972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.725975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.725977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.725979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386562403:10709]
2025-10-02T09:35:38.725996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.725998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.726001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.726003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.726003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.726004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.726114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.731051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId: src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.733090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.795557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462136904:7823]
2025-10-02T09:35:38.795736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2862, pipe: [1:7556555746462136904:7823]
2025-10-02T09:35:38.834693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.834969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.834978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.835002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136904:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.835143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.835196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.835225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:38.835225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462136904:7823]
2025-10-02T09:35:38.835230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:38.835273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2863 reason: error at write: Disconnected sessionId: src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0
2025-10-02T09:35:38.835411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2863 sessionId: src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0 is DEAD
2025-10-02T09:35:38.835580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:38.835595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Write session will restart in 0.006009s
2025-10-02T09:35:38.835615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Write session: Do CDS request
2025-10-02T09:35:38.835621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.842180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.842250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.842258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2864
2025-10-02T09:35:38.842363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.842383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.842388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.842391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.842692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2864 sessionId:  describe result for acl check
2025-10-02T09:35:38.842724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.842731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.842732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.842735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.843076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.844622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.845099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.846481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.846584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.846590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.846596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.846621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.846644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386562610:10711]
2025-10-02T09:35:38.846679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.846687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.846689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462136996:8632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.846693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.846977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.847130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.847151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.847323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.847353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.847357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.847357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.847358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.847358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.847359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.847359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.847360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.847361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.847361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.847362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.847362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.847365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.847371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.847373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.847375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.847377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.847379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.847381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.847383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.847385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.847387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.847389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.847391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.847395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.847398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.847401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.847404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.847406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.847408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.847411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.847413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.847416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.847418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.847420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.847423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.847425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.847428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.847430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.847432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.847434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.847437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.847439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.847442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.847448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.847451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.847453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.847456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.847471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.854859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.856445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.856456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.856457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.856459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.856463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2863 [2:7556555746386562610:10711]
2025-10-02T09:35:38.856471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.856480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.856484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.856485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.856486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.856495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.856501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.856505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.856536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.856541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.856542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.856543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.856545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.856581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.856586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.856593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.856598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.856609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.856624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462136905:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.856630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462137104:8632], now have 1 active actors on pipe
2025-10-02T09:35:38.856633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.856635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.856636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.856645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.856654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.856658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.856660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.856662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.856662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.856664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.856667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2863
2025-10-02T09:35:38.856678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.856683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.856684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.856676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2863
2025-10-02T09:35:38.856699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.856704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.856721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.856728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.856730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.856731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.856736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.856744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.856753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.856854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.856859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.856867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.856926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2864 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0
2025-10-02T09:35:38.857138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5af5721-ef0ab43d-83cd69f2-f6b71c79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:38.859903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Write session: try to update token
2025-10-02T09:35:38.859914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:38.866011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:38.866027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:38.866028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:38.866030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:38.866034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.866037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.866039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386562604:10711]
2025-10-02T09:35:38.866060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:38.866063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:38.866063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.866065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:38.866066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:38.866068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:38.866169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:38.872721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId: src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:38.874855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:38.935330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555746462137123:7823]
2025-10-02T09:35:38.935488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2863, pipe: [1:7556555746462137123:7823]
2025-10-02T09:35:38.976014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:38.976223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.976232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.976244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462137123:7823], now have 1 active actors on pipe
2025-10-02T09:35:38.976399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:38.976420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555746462137123:7823]
2025-10-02T09:35:38.976428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:38.976430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:38.976442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:38.976466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2864 reason: error at write: Disconnected sessionId: src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0
2025-10-02T09:35:38.976586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2864 sessionId: src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0 is DEAD
2025-10-02T09:35:38.976685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:38.976689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Write session will restart in 0.006770s
2025-10-02T09:35:38.976706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Write session: Do CDS request
2025-10-02T09:35:38.976710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:38.984085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.984334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:38.984340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2865
2025-10-02T09:35:38.984453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:38.984471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:38.984476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:38.984479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:38.984730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2865 sessionId:  describe result for acl check
2025-10-02T09:35:38.984746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:38.984750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:38.984751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:38.984754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:38.985097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:38.986067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:38.986356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:38.987654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:38.987751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:38.987758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:38.987764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:38.987789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:38.987810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555746386562812:10713]
2025-10-02T09:35:38.987834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:38.987842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:38.987844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555746462137264:8682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:38.987847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:38.988145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:38.988298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:38.988319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:38.988492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:38.988521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.988524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.988525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.988525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.988526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.988527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.988527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.988528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.988528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.988529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.988529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.988530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.988533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.988538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.988540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.988542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.988544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.988546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.988548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.988550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.988552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.988554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.988556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.988558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.988561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.988565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:38.988568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.988571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:38.988574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.988577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:38.988579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.988582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:38.988584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.988587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:38.988589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.988591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:38.988594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.988596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:38.988598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.988603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:38.988605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.988608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:38.988610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.988612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.988614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.988617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.988619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.988622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.988639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:38.995933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:38.997490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:38.997501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:38.997503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:38.997504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:38.997508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2864 [2:7556555746386562812:10713]
2025-10-02T09:35:38.997515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:38.997524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:38.997525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.997526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.997527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.997536Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:38.997538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:38.997543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:38.997570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.997576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.997577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.997579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:38.997581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:38.997683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2864
2025-10-02T09:35:38.997687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2864
2025-10-02T09:35:38.997692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:38.997698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:38.997704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:38.997710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:38.997722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:38.997736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462137326:8682], now have 1 active actors on pipe
2025-10-02T09:35:38.997740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555746462137127:2446], now have 1 active actors on pipe
2025-10-02T09:35:38.997750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.997755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.997766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:38.997770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:38.997771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:38.997779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:38.997790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:38.997792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:38.997794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:38.997796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:38.997801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:38.997802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:38.997811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:38.997818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:38.997820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:38.997821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:38.997826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:38.997832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:38.997848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:38.997855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:38.997861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.997863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:38.997943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:38.997948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:38.997955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:38.997995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2865 partition: 0 MaxSeqNo: 36 sessionId: src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0
2025-10-02T09:35:38.998191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a209ef-658e81c9-34fa0288-6b8176ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.000908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Write session: try to update token
2025-10-02T09:35:39.000918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.006774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.006786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.006787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.006788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.006791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:39.006793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:39.006795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555746386562807:10713]
2025-10-02T09:35:39.006813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.006816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.006817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.006818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.006821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.006822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.006964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.013782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId: src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.015793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.076627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757104635:7823]
2025-10-02T09:35:39.076791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2864, pipe: [1:7556555750757104635:7823]
2025-10-02T09:35:39.115583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.115919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.115927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.115939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757104635:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.116052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.116080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757104635:7823]
2025-10-02T09:35:39.116098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:39.116104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.116143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2865 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0
2025-10-02T09:35:39.116267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2865 sessionId: src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0 is DEAD
2025-10-02T09:35:39.116421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:39.116437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Write session will restart in 0.008838s
2025-10-02T09:35:39.116459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Write session: Do CDS request
2025-10-02T09:35:39.116465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.125903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.126144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.126213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.126220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2866
2025-10-02T09:35:39.126311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.126329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.126335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.126337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.126598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2866 sessionId:  describe result for acl check
2025-10-02T09:35:39.126622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.126627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.126628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.126631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.126970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.127363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.127481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.127488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.127495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.127544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.127573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681530314:10716]
2025-10-02T09:35:39.127925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.128116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.128134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.128154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.128348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.128376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.128380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.128381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.128381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.128383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.128384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.128384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.128385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.128385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.128386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.128389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.128395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.128397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.128399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.128401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.128403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.128405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.128407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.128409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.128411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.128413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.128415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.128419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.128424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.128427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.128430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.128432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.128435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.128437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.128440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.128442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.128444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.128446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.128451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.128453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.128456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.128458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.128462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.128464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.128467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.128470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.128473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.128476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.128482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.128484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.128487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.128504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.132276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.132283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.132285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757104802:8692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.132289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.135901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.137297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.137308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.137309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.137311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.137315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2865 [2:7556555750681530314:10716]
2025-10-02T09:35:39.137321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.137331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.137332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.137334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.137335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.137344Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.137348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.137352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.137382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.137387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.137388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.137390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.137391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.137478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.137484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.137491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.137496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.137505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.137516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757104841:8692], now have 1 active actors on pipe
2025-10-02T09:35:39.137522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757104636:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.137526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.137515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2865
2025-10-02T09:35:39.137515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2865
2025-10-02T09:35:39.137527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.137528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.137532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.137538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.137539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.137539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.137540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.137547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.137548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.137558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.137563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.137581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.137589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.137596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.137597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.137603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.137605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.137606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.137611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.137616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.137637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.137723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.137728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.137735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.137775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2866 partition: 0 MaxSeqNo: 36 sessionId: src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0
2025-10-02T09:35:39.137985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60803a1c-845cbca5-cc109d9b-4f90a420_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.140674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Write session: try to update token
2025-10-02T09:35:39.140690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.146611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.146621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.146622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.146623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.146630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.146631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.146633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681530309:10716]
2025-10-02T09:35:39.146651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.146654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.146655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.146656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.146656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.146658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.146757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.153961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId: src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.156179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.216403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757104861:7823]
2025-10-02T09:35:39.216526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2865, pipe: [1:7556555750757104861:7823]
2025-10-02T09:35:39.254674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.254909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.254917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.254928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757104861:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.255072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757104861:7823]
2025-10-02T09:35:39.255086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.255096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.255099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.255136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2866 reason: error at write: Disconnected sessionId: src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0
2025-10-02T09:35:39.255247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2866 sessionId: src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0 is DEAD
2025-10-02T09:35:39.255398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.255413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Write session will restart in 0.008396s
2025-10-02T09:35:39.255433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Write session: Do CDS request
2025-10-02T09:35:39.255438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.255450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.264490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.265198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.265268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.265275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2867
2025-10-02T09:35:39.265336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.265355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.265359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.265361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.265608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2867 sessionId:  describe result for acl check
2025-10-02T09:35:39.265631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.265635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.265636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.265639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.265964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.266019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.266143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.266150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.266157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.266185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.266209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681530531:10719]
2025-10-02T09:35:39.266544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.266770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.266793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.266966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.266995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.266999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.266999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.267000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.267000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.267001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.267001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.267002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.267002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.267003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.267003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.267004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.267007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.267012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.267014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.267016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.267018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.267020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.267023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.267025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.267026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.267029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.267030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.267032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.267036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.267040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.267043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.267046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.267048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.267051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.267053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.267055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.267058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.267060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.267062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.267065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.267068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.267071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.267073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.267075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.267078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.267081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.267083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.267086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.267088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.267090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.267092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.267094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.267111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.267405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.271746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.271753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.271755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757105029:8713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.271758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.274423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.275944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.275955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.275956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.275958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.275961Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2866 [2:7556555750681530531:10719]
2025-10-02T09:35:39.275968Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.275977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.275982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.275983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.275984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.275993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.275995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.275999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.276027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.276032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.276034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.276035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.276037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.276072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.276076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.276083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.276090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.276100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.276114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757104862:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.276120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105068:8713], now have 1 active actors on pipe
2025-10-02T09:35:39.276124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.276125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.276126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.276133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.276144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.276145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.276147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.276148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.276154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.276155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.276146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2866
2025-10-02T09:35:39.276147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2866
2025-10-02T09:35:39.276169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.276174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.276176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.276186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.276191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.276213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.276220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.276222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.276223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.276227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.276235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.276246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.276316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.276320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.276327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.276360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2867 partition: 0 MaxSeqNo: 36 sessionId: src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0
2025-10-02T09:35:39.276523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f9dfaf-488d0da4-d17a40f9-c4b34ed7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.279276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Write session: try to update token
2025-10-02T09:35:39.279285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.285209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.285221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.285222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.285223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.285228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.285231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.285233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681530526:10719]
2025-10-02T09:35:39.285253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.285255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.285257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.285259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.285260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.285261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.285413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.292610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId: src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.294587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.355151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757105100:7823]
2025-10-02T09:35:39.355287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2866, pipe: [1:7556555750757105100:7823]
2025-10-02T09:35:39.397123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.397478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.397487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.397499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105100:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.397632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.397640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.397667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757105100:7823]
2025-10-02T09:35:39.397680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2867 reason: error at write: Disconnected sessionId: src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0
2025-10-02T09:35:39.397683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.397810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2867 sessionId: src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0 is DEAD
2025-10-02T09:35:39.397874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.397965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.397979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Write session will restart in 0.007605s
2025-10-02T09:35:39.398021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Write session: Do CDS request
2025-10-02T09:35:39.398026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.406232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.406264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.406270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2868
2025-10-02T09:35:39.406427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.406445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.406451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.406454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.406727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2868 sessionId:  describe result for acl check
2025-10-02T09:35:39.406750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.406754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.406755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.406758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.407091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.407650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.408509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.409076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.409194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.409202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.409207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.409236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.409257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681530775:10734]
2025-10-02T09:35:39.409610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.409776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.409803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.409993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.410023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.410027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.410027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.410028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.410029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.410030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.410030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.410031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.410031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.410032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.410032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.410033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.410036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.410042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.410044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.410046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.410048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.410050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.410052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.410054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.410056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.410058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.410060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.410062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.410066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.410070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.410073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.410076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.410081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.410084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.410087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.410092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.410095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.410097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.410100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.410102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.410104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.410107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.410113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.410116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.410121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.410124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.410126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.410128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.410131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.410134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.410136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.410138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.410155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.410280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.410289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.410291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757105266:5276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.410294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.417527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.418978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.418989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.418991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.418993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.418996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2867 [2:7556555750681530775:10734]
2025-10-02T09:35:39.419002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.419012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.419013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.419015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.419016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.419024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.419031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.419035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.419064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.419069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.419070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.419072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.419073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.419106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.419111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.419120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.419131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.419150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.419167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105101:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.419173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105308:5276], now have 1 active actors on pipe
2025-10-02T09:35:39.419176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.419178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.419179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.419187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.419196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.419176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2867
2025-10-02T09:35:39.419199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.419203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.419183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2867
2025-10-02T09:35:39.419205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.419205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.419207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.419226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.419232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.419239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.419247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.419257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.419264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a20a9f02-4644cb5e-61424480-5aed8693_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.419268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.419270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.419271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.419276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.419285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.419297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.419397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.419404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.419413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.419465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2868 partition: 0 MaxSeqNo: 36 sessionId: src_id|a20a9f02-4644cb5e-61424480-5aed8693_0
2025-10-02T09:35:39.419680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b2f2a3-885be560-338eecaa-2b105d7b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a20a9f02-4644cb5e-61424480-5aed8693_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.422184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Write session: try to update token
2025-10-02T09:35:39.422198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.428210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.428222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.428223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.428224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.428227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.428229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.428231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681530770:10734]
2025-10-02T09:35:39.428250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.428253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.428254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.428255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.428256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.428258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.428369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.433775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId: src_id|a20a9f02-4644cb5e-61424480-5aed8693_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.435822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.498008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757105315:7823]
2025-10-02T09:35:39.498181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2867, pipe: [1:7556555750757105315:7823]
2025-10-02T09:35:39.536492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.537052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.537062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.537074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105315:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.537226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.537260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.537262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.537299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2868 reason: error at write: Disconnected sessionId: src_id|a20a9f02-4644cb5e-61424480-5aed8693_0
2025-10-02T09:35:39.537400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.537423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2868 sessionId: src_id|a20a9f02-4644cb5e-61424480-5aed8693_0 is DEAD
2025-10-02T09:35:39.537500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757105315:7823]
2025-10-02T09:35:39.537543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.537548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Write session will restart in 0.006768s
2025-10-02T09:35:39.537563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Write session: Do CDS request
2025-10-02T09:35:39.537568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.545129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.545219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.545225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2869
2025-10-02T09:35:39.545329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.545348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.545354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.545357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.545605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2869 sessionId:  describe result for acl check
2025-10-02T09:35:39.545627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.545631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.545632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.545635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.545976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.546623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.547609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.548240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.548335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.548341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.548346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.548370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.548393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681530981:10736]
2025-10-02T09:35:39.548741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.548892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.548919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.549101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.549130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.549134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.549134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.549135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.549135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.549136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.549136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.549137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.549137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.549138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.549139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.549139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.549142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.549148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.549150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.549152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.549154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.549156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.549158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.549160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.549162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.549165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.549168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.549171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.549176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.549182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.549186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.549191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.549195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.549199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.549201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.549203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.549206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.549212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.549214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.549217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.549220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.549223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.549228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.549231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.549233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.549236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.549238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.549241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.549245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.549247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.549250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.549256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.549272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.549501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.549509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.549510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757105472:5273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.549514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.556659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.558218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.558230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.558231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.558233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.558236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2868 [2:7556555750681530981:10736]
2025-10-02T09:35:39.558242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.558250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.558255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.558257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.558258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.558266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.558271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.558275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.558308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.558313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.558314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.558316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.558317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.558352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.558357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.558364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.558369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.558377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.558395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105525:5273], now have 1 active actors on pipe
2025-10-02T09:35:39.558401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105317:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.558406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.558411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.558414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.558420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2868
2025-10-02T09:35:39.558423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2868
2025-10-02T09:35:39.558425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.558436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.558439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.558441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.558443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.558443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.558444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.558464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.558469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.558478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.558486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.558498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.558504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.558507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.558509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.558510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.558514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.558519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.558537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.558623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.558629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.558639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.558697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2869 partition: 0 MaxSeqNo: 36 sessionId: src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0
2025-10-02T09:35:39.558932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20a9f02-4644cb5e-61424480-5aed8693_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.561233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Write session: try to update token
2025-10-02T09:35:39.561251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.567530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.567543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.567544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.567545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.567549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.567551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.567553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681530976:10736]
2025-10-02T09:35:39.567572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.567574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.567575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.567575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.567579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.567580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.567717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.573259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId: src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.575371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.637789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757105532:7823]
2025-10-02T09:35:39.637956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2868, pipe: [1:7556555750757105532:7823]
2025-10-02T09:35:39.675752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.676051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.676060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.676073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105532:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.676216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757105532:7823]
2025-10-02T09:35:39.676230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.676235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.676222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.676236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.676275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2869 reason: error at write: Disconnected sessionId: src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0
2025-10-02T09:35:39.676394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2869 sessionId: src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0 is DEAD
2025-10-02T09:35:39.676555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.676569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Write session will restart in 0.006724s
2025-10-02T09:35:39.676594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Write session: Do CDS request
2025-10-02T09:35:39.676601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.684201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.684336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.684342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2870
2025-10-02T09:35:39.684473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.684504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.684510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.684513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.684783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2870 sessionId:  describe result for acl check
2025-10-02T09:35:39.684821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.684827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.684828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.684830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.685170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.686165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.686843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.687671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.687809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.687816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.687822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.687850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.687875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681531189:10738]
2025-10-02T09:35:39.688227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.688397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.688424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.688630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.688663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.688667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.688667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.688668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.688669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.688670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.688670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.688671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.688671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.688672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.688672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.688673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.688676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.688682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.688684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.688686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.688688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.688690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.688692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.688694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.688696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.688698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.688701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.688703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.688707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.688710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.688714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.688717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.688721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.688724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.688726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.688729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.688732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.688734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.688739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.688741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.688745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.688747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.688749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.688752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.688754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.688756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.688759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.688761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.688764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.688766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.688769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.688786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.688822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.688830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.688832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757105672:5279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.688835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.696181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.697791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.697803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.697805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.697807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.697810Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2869 [2:7556555750681531189:10738]
2025-10-02T09:35:39.697818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.697827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.697832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.697834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.697835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.697843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.697846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.697853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.697883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.697888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.697889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.697890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.697892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.697930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.697934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.697941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.697946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.697954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.697969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105533:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.697975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105742:5279], now have 1 active actors on pipe
2025-10-02T09:35:39.697980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.697981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.697982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.697990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.698001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.698002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.698004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.698006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.698011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.698012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.698026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.698034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.698038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.698040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2869
2025-10-02T09:35:39.698071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.698078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.698069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2869
2025-10-02T09:35:39.698094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d037ad51-97218d02-acff566-2aa25678_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.698101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.698103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.698104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.698109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.698116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.698123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.698256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.698263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.698271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.698340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2870 partition: 0 MaxSeqNo: 36 sessionId: src_id|d037ad51-97218d02-acff566-2aa25678_0
2025-10-02T09:35:39.698648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db302ef1-b29e75ee-cdcd3ff7-de384bb6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d037ad51-97218d02-acff566-2aa25678_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.701023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Write session: try to update token
2025-10-02T09:35:39.701037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.706962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:39.706971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.706975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.706996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:39.706999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:39.707130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:39.707254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:39.707367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:39.707491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:39.707662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:39.707685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:39.714384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId: src_id|d037ad51-97218d02-acff566-2aa25678_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.715282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.715294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.715295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.715296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.715300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.715302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.715305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681531184:10738]
2025-10-02T09:35:39.715324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.715328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.715330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.715332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.715332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.715333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.715445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.716577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.776553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757105754:7823]
2025-10-02T09:35:39.776731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2869, pipe: [1:7556555750757105754:7823]
2025-10-02T09:35:39.825614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.825995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.826004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.826016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105754:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.826186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.826201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.826211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.826221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.826249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757105754:7823]
2025-10-02T09:35:39.826254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2870 reason: error at write: Disconnected sessionId: src_id|d037ad51-97218d02-acff566-2aa25678_0
2025-10-02T09:35:39.826395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2870 sessionId: src_id|d037ad51-97218d02-acff566-2aa25678_0 is DEAD
2025-10-02T09:35:39.826553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.826569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Write session will restart in 0.009394s
2025-10-02T09:35:39.826597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Write session: Do CDS request
2025-10-02T09:35:39.826602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.835959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.837146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.837264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.837271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2871
2025-10-02T09:35:39.837374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.837394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.837400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.837402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.837409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.837518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.837525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.837531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.837556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.837580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681531398:10740]
2025-10-02T09:35:39.837661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2871 sessionId:  describe result for acl check
2025-10-02T09:35:39.837685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.837689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.837690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.837693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.837920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.838027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.838083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.838108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.838285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.838313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.838317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.838317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.838318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.838320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.838320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.838321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.838321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.838321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.838322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.838325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.838330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.838333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.838335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.838337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.838339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.838341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.838343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.838345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.838347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.838349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.838351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.838354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.838358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.838362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.838365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.838368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.838370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.838372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.838376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.838378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.838381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.838383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.838386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.838388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.838390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.838392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.838395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.838397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.838401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.838403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.838406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.838411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.838414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.838416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.838419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.838440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.839333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.843594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.843601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.843603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757105927:5295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.843606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.845789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.847265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.847276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.847277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.847279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.847282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2870 [2:7556555750681531398:10740]
2025-10-02T09:35:39.847289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.847299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.847303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.847305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.847306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.847313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.847316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.847324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.847352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.847357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.847358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.847360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.847361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.847396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.847400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.847407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.847412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.847420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.847433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105966:5295], now have 1 active actors on pipe
2025-10-02T09:35:39.847435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105756:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.847439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.847441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.847442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.847450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.847459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.847455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2870
2025-10-02T09:35:39.847460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2870
2025-10-02T09:35:39.847468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.847470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.847472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.847476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.847478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.847494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.847500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.847507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.847514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.847527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.847532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.847535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.847537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.847538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.847543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.847548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.847564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.847646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.847651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.847659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.847715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2871 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0
2025-10-02T09:35:39.847932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d037ad51-97218d02-acff566-2aa25678_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.850340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Write session: try to update token
2025-10-02T09:35:39.850356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.856492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.856505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.856506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.856507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.856510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.856512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.856514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681531393:10740]
2025-10-02T09:35:39.856533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.856535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.856537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.856538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.856539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.856539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.856659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:39.864151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId: src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:39.866323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:39.926545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555750757105981:7823]
2025-10-02T09:35:39.926706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2870, pipe: [1:7556555750757105981:7823]
2025-10-02T09:35:39.966347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:39.966537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.966546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.966559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105981:7823], now have 1 active actors on pipe
2025-10-02T09:35:39.966699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:39.966708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:39.966739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555750757105981:7823]
2025-10-02T09:35:39.966757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:39.966771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2871 reason: error at write: Disconnected sessionId: src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0
2025-10-02T09:35:39.966883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2871 sessionId: src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0 is DEAD
2025-10-02T09:35:39.967030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:39.967045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Write session will restart in 0.006635s
2025-10-02T09:35:39.967065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Write session: Do CDS request
2025-10-02T09:35:39.967070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:39.967256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:39.975143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.975257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:39.975264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2872
2025-10-02T09:35:39.975339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:39.975358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:39.975364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:39.975366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:39.975623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2872 sessionId:  describe result for acl check
2025-10-02T09:35:39.975646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:39.975651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:39.975652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:39.975654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:39.976002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:39.976656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:39.977633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:39.978125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:39.978285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:39.978293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:39.978299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:39.978331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:39.978355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555750681531608:10742]
2025-10-02T09:35:39.978702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:39.978885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:39.978912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:39.979088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:39.979099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:39.979106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:39.979108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555750757106149:5300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:39.979111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:39.979116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.979120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.979121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.979121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.979122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.979122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.979123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.979124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.979124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.979126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.979130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.979139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.979142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.979145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.979149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.979152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.979158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.979162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.979165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.979167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.979169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.979171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.979175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.979179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:39.979185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.979188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:39.979191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.979193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:39.979197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:39.979202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.979205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:39.979207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.979210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:39.979213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.979216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:39.979220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.979222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:39.979225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.979227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:39.979229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.979232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.979234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.979236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.979238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.979241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.979257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:39.986627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:39.988160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:39.988173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:39.988174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:39.988176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:39.988179Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2871 [2:7556555750681531608:10742]
2025-10-02T09:35:39.988185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:39.988193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:39.988195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.988196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.988197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.988206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:39.988209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:39.988213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:39.988238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.988243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.988244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.988246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:39.988247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:39.988283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:39.988288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.988294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:39.988299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:39.988309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:39.988322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757105982:2446], now have 1 active actors on pipe
2025-10-02T09:35:39.988328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555750757106194:5300], now have 1 active actors on pipe
2025-10-02T09:35:39.988331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.988332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.988334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.988340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:39.988349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:39.988354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:39.988356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:39.988357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:39.988359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:39.988360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:39.988352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2871
2025-10-02T09:35:39.988353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2871
2025-10-02T09:35:39.988374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.988379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:39.988380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:39.988388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.988393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.988420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:39.988426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:39.988428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:39.988429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:39.988434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:39.988443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:39.988451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.988544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:39.988549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:39.988556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:39.988611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2872 partition: 0 MaxSeqNo: 36 sessionId: src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0
2025-10-02T09:35:39.988794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5af0fbb-da13d0d7-60d5ab95-73ea2ace_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:39.991616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Write session: try to update token
2025-10-02T09:35:39.991627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:39.997444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:39.997456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:39.997457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:39.997458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:39.997462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.997466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.997468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555750681531603:10742]
2025-10-02T09:35:39.997487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:39.997492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:39.997493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:39.997494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:39.997495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:39.997497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:39.997650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.005394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId: src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.007463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.066843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052073500:7823]
2025-10-02T09:35:40.066966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2871, pipe: [1:7556555755052073500:7823]
2025-10-02T09:35:40.107768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.108042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.108051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.108063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073500:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.108185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.108236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052073500:7823]
2025-10-02T09:35:40.108243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.108257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:40.108307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2872 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0
2025-10-02T09:35:40.108434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2872 sessionId: src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0 is DEAD
2025-10-02T09:35:40.108582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:40.108595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Write session will restart in 0.005829s
2025-10-02T09:35:40.108621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Write session: Do CDS request
2025-10-02T09:35:40.108626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.115182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.115315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.115322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2873
2025-10-02T09:35:40.115406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.115424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.115429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.115432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.115744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2873 sessionId:  describe result for acl check
2025-10-02T09:35:40.115769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.115773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.115775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.115778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.116116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.117558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.117932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.119340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.119451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.119458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.119465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.119496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.119518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976499118:10745]
2025-10-02T09:35:40.119555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.119564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.119566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052073615:5297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.119569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.119866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.120031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.120054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.120336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.120374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.120378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.120378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.120379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.120379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.120380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.120380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.120381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.120381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.120382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.120382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.120383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.120386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.120391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.120393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.120395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.120397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.120399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.120402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.120404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.120406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.120408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.120410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.120411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.120417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.120420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.120423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.120426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.120428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.120431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.120433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.120436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.120438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.120441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.120443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.120446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.120448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.120451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.120452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.120455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.120457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.120459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.120461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.120464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.120466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.120468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.120470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.120472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.120504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.127920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.129394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.129406Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.129408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.129409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.129413Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2872 [2:7556555754976499118:10745]
2025-10-02T09:35:40.129419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.129428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.129434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.129435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.129436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.129444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.129447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.129451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.129478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.129483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.129484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.129486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.129487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.129523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.129527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.129534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.129539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.129550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.129564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073501:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.129570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073717:5297], now have 1 active actors on pipe
2025-10-02T09:35:40.129573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.129575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.129576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.129582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.129592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.129592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.129594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.129595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.129603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.129604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.129618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.129594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2872
2025-10-02T09:35:40.129623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.129607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2872
2025-10-02T09:35:40.129624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.129633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.129636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.129656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee775a31-e8682775-40a1119b-b426f2cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.129662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.129664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.129669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.129673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.129679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.129690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.129759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.129764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.129771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.129821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2873 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee775a31-e8682775-40a1119b-b426f2cb_0
2025-10-02T09:35:40.130062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82fdb0f-6880fe2b-ede9c2b0-5cd1959_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee775a31-e8682775-40a1119b-b426f2cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.132714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Write session: try to update token
2025-10-02T09:35:40.132730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.138574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.138593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.138595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.138597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.138602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.138605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.138608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976499113:10745]
2025-10-02T09:35:40.138627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.138630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.138632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.138633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.138634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.138634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.138745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.144748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId: src_id|ee775a31-e8682775-40a1119b-b426f2cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.146723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.208157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052073729:7823]
2025-10-02T09:35:40.208297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2872, pipe: [1:7556555755052073729:7823]
2025-10-02T09:35:40.247895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.248159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.248167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.248179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073729:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.248307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.248495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.248513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:40.248531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052073729:7823]
2025-10-02T09:35:40.248566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee775a31-e8682775-40a1119b-b426f2cb_0
2025-10-02T09:35:40.248705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2873 sessionId: src_id|ee775a31-e8682775-40a1119b-b426f2cb_0 is DEAD
2025-10-02T09:35:40.248894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:40.248910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Write session will restart in 0.009742s
2025-10-02T09:35:40.248932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Write session: Do CDS request
2025-10-02T09:35:40.248937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.259048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.260242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.260313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.260322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2874
2025-10-02T09:35:40.260419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.260438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.260444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.260447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.260459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.260597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.260605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.260612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.260643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.260665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976499342:10748]
2025-10-02T09:35:40.260705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2874 sessionId:  describe result for acl check
2025-10-02T09:35:40.260726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.260730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.260731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.260734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.261030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.261079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.261191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.261214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.261405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.261437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.261441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.261441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.261442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.261442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.261443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.261443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.261444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.261444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.261445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.261445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.261446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.261448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.261455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.261457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.261459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.261461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.261463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.261465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.261467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.261469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.261471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.261473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.261475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.261478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.261482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.261485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.261488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.261490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.261493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.261495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.261498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.261501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.261504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.261507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.261509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.261511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.261514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.261517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.261523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.261525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.261528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.261532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.261535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.261537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.261543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.261545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.261561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.262212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.266295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.266303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.266304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052073917:5321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.266308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.268981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.270518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.270530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.270532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.270534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.270537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2873 [2:7556555754976499342:10748]
2025-10-02T09:35:40.270544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.270554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.270557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.270558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.270560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.270570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.270587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.270592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.270630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.270635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.270636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.270638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.270639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.270672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.270677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.270684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.270690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.270697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.270711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073742:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.270717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073955:5321], now have 1 active actors on pipe
2025-10-02T09:35:40.270721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.270724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.270725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.270732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.270742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.270744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.270747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.270748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.270753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.270755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.270738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2873
2025-10-02T09:35:40.270742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2873
2025-10-02T09:35:40.270771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.270776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.270777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.270785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.270788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.270811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6daec014-cb1c521c-2095951e-8d45150a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.270819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.270821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.270822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.270827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.270833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.270841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.270924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.270929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.270936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.270991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2874 partition: 0 MaxSeqNo: 36 sessionId: src_id|6daec014-cb1c521c-2095951e-8d45150a_0
2025-10-02T09:35:40.271236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee775a31-e8682775-40a1119b-b426f2cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6daec014-cb1c521c-2095951e-8d45150a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.273526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Write session: try to update token
2025-10-02T09:35:40.273538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.279747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.279758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.279760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.279760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.279764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.279766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.279768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976499336:10748]
2025-10-02T09:35:40.279787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.279789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.279791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.279793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.279794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.279796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.279922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.285389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId: src_id|6daec014-cb1c521c-2095951e-8d45150a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.287438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.348503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052073982:7823]
2025-10-02T09:35:40.348840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2873, pipe: [1:7556555755052073982:7823]
2025-10-02T09:35:40.389864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.390095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.390104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.390117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073982:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.390324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:40.390333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:40.390336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.390364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.390365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052073982:7823]
2025-10-02T09:35:40.390372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2874 reason: error at write: Disconnected sessionId: src_id|6daec014-cb1c521c-2095951e-8d45150a_0
2025-10-02T09:35:40.390503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2874 sessionId: src_id|6daec014-cb1c521c-2095951e-8d45150a_0 is DEAD
2025-10-02T09:35:40.390657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:40.390670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Write session will restart in 0.008123s
2025-10-02T09:35:40.390694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Write session: Do CDS request
2025-10-02T09:35:40.390699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.400184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.400467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.400475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2875
2025-10-02T09:35:40.400563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.400581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.400585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.400588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.400643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.400861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2875 sessionId:  describe result for acl check
2025-10-02T09:35:40.400885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.400889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.400890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.400893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.401219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.402290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.402383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.402390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.402395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.402421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.402442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976499592:10763]
2025-10-02T09:35:40.402801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.402815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.402994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.403021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.403219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.403252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.403256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.403257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.403257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.403258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.403259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.403259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.403260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.403260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.403261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.403262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.403262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.403265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.403271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.403273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.403275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.403277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.403279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.403281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.403283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.403285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.403288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.403289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.403291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.403295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.403299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.403303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.403305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.403307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.403310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.403312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.403315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.403317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.403320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.403321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.403324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.403326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.403330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.403332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.403334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.403336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.403339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.403341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.403343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.403346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.403348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.403350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.403352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.403370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.407115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.407125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.407126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052074163:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.407130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.410729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.412243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.412254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.412255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.412257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.412260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2874 [2:7556555754976499592:10763]
2025-10-02T09:35:40.412267Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.412276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.412278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.412279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.412281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.412289Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.412296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.412300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.412329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.412333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.412334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.412337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.412338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.412372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.412377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.412383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.412388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.412401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.412419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052073988:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.412426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074202:5354], now have 1 active actors on pipe
2025-10-02T09:35:40.412431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.412437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.412438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.412431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2874
2025-10-02T09:35:40.412435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2874
2025-10-02T09:35:40.412444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.412457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.412460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.412462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.412463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.412468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.412473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.412495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.412500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.412508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.412516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.412528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.412531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.412536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.412538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.412539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.412544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.412549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.412563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.412663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.412670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.412679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.412732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2875 partition: 0 MaxSeqNo: 36 sessionId: src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0
2025-10-02T09:35:40.412983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6daec014-cb1c521c-2095951e-8d45150a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.415265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Write session: try to update token
2025-10-02T09:35:40.415278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.421494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.421507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.421507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.421508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.421512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.421513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.421515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976499586:10763]
2025-10-02T09:35:40.421534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.421540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.421541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.421541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.421545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.421547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.421648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.426688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId: src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.428822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.490270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052074209:7823]
2025-10-02T09:35:40.490450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2874, pipe: [1:7556555755052074209:7823]
2025-10-02T09:35:40.529853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.530150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.530159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.530173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074209:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.530293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.530309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052074209:7823]
2025-10-02T09:35:40.530331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:40.530386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0
2025-10-02T09:35:40.530409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.530511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2875 sessionId: src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0 is DEAD
2025-10-02T09:35:40.530667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:40.530680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Write session will restart in 0.007017s
2025-10-02T09:35:40.530701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Write session: Do CDS request
2025-10-02T09:35:40.530708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.539238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.539320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.539328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2876
2025-10-02T09:35:40.539445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.539464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.539468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.539471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.539772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2876 sessionId:  describe result for acl check
2025-10-02T09:35:40.539796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.539800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.539801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.539804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.540150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.541312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.541371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.542920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.543016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.543022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.543028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.543054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.543076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976499804:10765]
2025-10-02T09:35:40.543067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.543074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.543075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052074359:5366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.543078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.543408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.543911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.543953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.544150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.544177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.544181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.544182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.544182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.544183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.544183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.544184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.544184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.544185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.544186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.544186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.544187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.544190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.544196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.544198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.544200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.544202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.544204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.544206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.544208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.544210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.544212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.544214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.544216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.544220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.544227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.544230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.544232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.544235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.544238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.544243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.544245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.544248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.544250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.544252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.544255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.544257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.544259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.544262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.544265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.544269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.544272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.544274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.544277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.544279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.544282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.544285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.544300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.551670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.553199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.553211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.553212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.553214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.553217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2875 [2:7556555754976499804:10765]
2025-10-02T09:35:40.553223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.553231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.553233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.553234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.553236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.553245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.553248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.553252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.553279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.553284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.553285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.553287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.553288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.553321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.553325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.553332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.553337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.553345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.553358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074422:5366], now have 1 active actors on pipe
2025-10-02T09:35:40.553363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074211:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.553367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.553368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.553369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.553376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.553385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.553395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.553395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.553397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.553399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.553399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.553411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.553412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.553396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2875
2025-10-02T09:35:40.553411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2875
2025-10-02T09:35:40.553422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.553425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.553427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.553447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.553453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.553455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.553456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.553461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.553468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.553480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.553570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.553577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.553588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.553644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2876 partition: 0 MaxSeqNo: 36 sessionId: src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0
2025-10-02T09:35:40.553879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|912565ed-f619aceb-4d5a67c8-cd99121a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.556297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Write session: try to update token
2025-10-02T09:35:40.556313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.562667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.562676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.562678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.562679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.562683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.562685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.562687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976499798:10765]
2025-10-02T09:35:40.562705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.562710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.562711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.562739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.562753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.562758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.562822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.569553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId: src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.571666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.630552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052074433:7823]
2025-10-02T09:35:40.630748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2875, pipe: [1:7556555755052074433:7823]
2025-10-02T09:35:40.675424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.675737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.675746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.675758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074433:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.675897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:40.675906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:40.675919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.675932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.675947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2876 reason: error at write: Disconnected sessionId: src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0
2025-10-02T09:35:40.675949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052074433:7823]
2025-10-02T09:35:40.676082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2876 sessionId: src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0 is DEAD
2025-10-02T09:35:40.676265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:40.676279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Write session will restart in 0.006768s
2025-10-02T09:35:40.676301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Write session: Do CDS request
2025-10-02T09:35:40.676306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.684153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.684243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.684251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2877
2025-10-02T09:35:40.684372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.684391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.684397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.684400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.684654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2877 sessionId:  describe result for acl check
2025-10-02T09:35:40.684677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.684682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.684683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.684686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.685041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.686137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.687418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.687647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.687685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.687692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.687694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052074593:5372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.687698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.687738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.687745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.687753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.687794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.687825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976500018:10767]
2025-10-02T09:35:40.688164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.688346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.688371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.688546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.688574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.688578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.688578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.688579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.688580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.688580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.688581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.688582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.688582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.688583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.688583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.688584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.688586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.688593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.688595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.688597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.688599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.688601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.688603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.688605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.688607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.688610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.688611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.688613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.688617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.688621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.688627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.688630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.688633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.688635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.688638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.688640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.688642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.688645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.688650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.688652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.688655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.688657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.688659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.688662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.688665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.688667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.688673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.688675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.688678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.688679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.688682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.688699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.696106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.697610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.697620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.697622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.697624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.697627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2876 [2:7556555754976500018:10767]
2025-10-02T09:35:40.697634Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.697644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.697646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.697647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.697648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.697658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.697665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.697669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.697698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.697703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.697704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.697706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.697707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.697744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.697748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.697755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.697760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.697771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.697785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074434:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.697790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074647:5372], now have 1 active actors on pipe
2025-10-02T09:35:40.697794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.697798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.697800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.697807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.697817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2876
2025-10-02T09:35:40.697817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2876
2025-10-02T09:35:40.697818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.697820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.697822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.697823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.697831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.697832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.697849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.697851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.697852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.697859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.697861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.697968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.697976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.697978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.697980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.697985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.697991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.698008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.698118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.698125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.698135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.698191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2877 partition: 0 MaxSeqNo: 36 sessionId: src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0
2025-10-02T09:35:40.698457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f66e26-59d7921-1d4f1ab5-a0f5847a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.700964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Write session: try to update token
2025-10-02T09:35:40.700979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.706973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.706985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.706986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.706987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.706991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.706995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.706996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976500012:10767]
2025-10-02T09:35:40.707015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.707018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.707020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.707020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.707022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.707024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.707133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.713473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId: src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.715591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.775974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052074658:7823]
2025-10-02T09:35:40.776147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2876, pipe: [1:7556555755052074658:7823]
2025-10-02T09:35:40.818403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.818696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.818704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.818716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074658:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.818829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.818883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:40.818891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.818927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052074658:7823]
2025-10-02T09:35:40.818946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0
2025-10-02T09:35:40.819074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2877 sessionId: src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0 is DEAD
2025-10-02T09:35:40.819234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:40.819249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Write session will restart in 0.006480s
2025-10-02T09:35:40.819275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Write session: Do CDS request
2025-10-02T09:35:40.819281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.827218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.827298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.827305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2878
2025-10-02T09:35:40.827420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.827440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.827444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.827446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.827710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2878 sessionId:  describe result for acl check
2025-10-02T09:35:40.827733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.827738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.827739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.827742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.828093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.829543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.831098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.831194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.831201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.831203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052074776:5374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.831206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.831340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.831431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.831438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.831444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.831469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.831490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976500234:10769]
2025-10-02T09:35:40.831837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.832010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.832036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.832217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.832250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.832255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.832256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.832257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.832258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.832258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.832259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.832260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.832261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.832262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.832263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.832264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.832268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.832273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.832276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.832278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.832280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.832282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.832284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.832286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.832288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.832291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.832293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.832295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.832299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.832303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.832306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.832312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.832314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.832317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.832322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.832325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.832327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.832333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.832335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.832338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.832343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.832346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.832348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.832351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.832353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.832359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.832361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.832364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.832369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.832373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.832376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.832379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.832396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.839768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.841271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.841283Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.841284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.841286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.841289Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2877 [2:7556555754976500234:10769]
2025-10-02T09:35:40.841295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.841305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.841306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.841308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.841309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.841317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.841319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.841327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.841356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.841361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.841362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.841364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.841365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.841398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.841403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.841409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.841414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.841425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.841438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074872:5374], now have 1 active actors on pipe
2025-10-02T09:35:40.841444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074659:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.841447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.841448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.841449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.841459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.841470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.841471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.841478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.841480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.841463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2877
2025-10-02T09:35:40.841483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.841470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2877
2025-10-02T09:35:40.841486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.841506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.841512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.841519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.841527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.841536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.841547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.841554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.841556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.841557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.841562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.841569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.841584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.841672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.841682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.841695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.841753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2878 partition: 0 MaxSeqNo: 36 sessionId: src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0
2025-10-02T09:35:40.841995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd48ba-9c2a8d12-e7b4529a-133407d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.844473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Write session: try to update token
2025-10-02T09:35:40.844488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.850454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.850467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.850468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.850469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.850479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.850481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.850483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976500228:10769]
2025-10-02T09:35:40.850502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.850504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.850505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.850506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.850506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.850510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.850657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.857111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId: src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.859254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:40.919315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555755052074889:7823]
2025-10-02T09:35:40.919465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2877, pipe: [1:7556555755052074889:7823]
2025-10-02T09:35:40.959648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:40.959967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.959976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.959988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074889:7823], now have 1 active actors on pipe
2025-10-02T09:35:40.960105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:40.960138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:40.960146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:40.960150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:40.960178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555755052074889:7823]
2025-10-02T09:35:40.960191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2878 reason: error at write: Disconnected sessionId: src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0
2025-10-02T09:35:40.960313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2878 sessionId: src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0 is DEAD
2025-10-02T09:35:40.960470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:40.960485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Write session will restart in 0.009709s
2025-10-02T09:35:40.960509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Write session: Do CDS request
2025-10-02T09:35:40.960515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:40.970116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:40.971201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.971283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:40.971291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2879
2025-10-02T09:35:40.971406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:40.971426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:40.971431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:40.971434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:40.971612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:40.971689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2879 sessionId:  describe result for acl check
2025-10-02T09:35:40.971708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:40.971712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:40.971713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:40.971716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:40.971717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:40.971724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:40.971729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:40.971755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:40.971777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555754976500449:10771]
2025-10-02T09:35:40.972044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:40.972127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:40.972285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:40.972308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:40.972479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:40.972508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.972512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.972512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.972513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.972514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.972514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.972515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.972515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.972516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.972516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.972517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.972517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.972520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.972528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.972532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.972535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.972539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.972542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.972545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.972549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.972552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.972556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.972560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.972561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.972566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.972574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:40.972577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.972580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:40.972582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.972588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:40.972590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.972593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:40.972595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.972597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:40.972599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.972602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:40.972607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.972610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:40.972612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.972615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:40.972617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.972620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:40.972622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.972624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.972628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.972633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.972635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.972638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.972653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:40.973384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:40.977389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:40.977397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:40.977399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555755052075070:5391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:40.977402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:40.980051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:40.981689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:40.981701Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:40.981703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:40.981704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:40.981707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2878 [2:7556555754976500449:10771]
2025-10-02T09:35:40.981715Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:40.981727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:40.981732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.981734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.981735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.981745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:40.981754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:40.981763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:40.981795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.981800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.981801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.981803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:40.981804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:40.981840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:40.981844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.981851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:40.981858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:40.981869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:40.981883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052074890:2446], now have 1 active actors on pipe
2025-10-02T09:35:40.981888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555755052075111:5391], now have 1 active actors on pipe
2025-10-02T09:35:40.981891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.981892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.981894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.981900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:40.981910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:40.981913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:40.981915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:40.981916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:40.981920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:40.981921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:40.981922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2878
2025-10-02T09:35:40.981927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2878
2025-10-02T09:35:40.981934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.981939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:40.981947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:40.981953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.981955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.981973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4385209e-12203d32-3d4f6888-3ee4152f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:40.981980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:40.981983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:40.981984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:40.981989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:40.981993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:40.982003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.982093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:40.982100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:40.982108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:40.982175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2879 partition: 0 MaxSeqNo: 36 sessionId: src_id|4385209e-12203d32-3d4f6888-3ee4152f_0
2025-10-02T09:35:40.982409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993a513-4a6296f1-c3f99e08-1ff7f514_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4385209e-12203d32-3d4f6888-3ee4152f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:40.984829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Write session: try to update token
2025-10-02T09:35:40.984843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:40.990911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:40.990922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:40.990923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:40.990924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:40.990928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.990930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.990932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555754976500443:10771]
2025-10-02T09:35:40.990951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:40.990954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:40.990955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:40.990956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:40.990958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:40.990961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:40.991073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:40.996762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId: src_id|4385209e-12203d32-3d4f6888-3ee4152f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:40.998823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.060122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347042415:7823]
2025-10-02T09:35:41.060276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2878, pipe: [1:7556555759347042415:7823]
2025-10-02T09:35:41.100509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.100824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.100835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.100846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042415:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.100961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.100983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.101005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347042415:7823]
2025-10-02T09:35:41.101013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.101062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4385209e-12203d32-3d4f6888-3ee4152f_0
2025-10-02T09:35:41.101192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2879 sessionId: src_id|4385209e-12203d32-3d4f6888-3ee4152f_0 is DEAD
2025-10-02T09:35:41.101334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.101347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Write session will restart in 0.005356s
2025-10-02T09:35:41.101370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Write session: Do CDS request
2025-10-02T09:35:41.101376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.108181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.108286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.108293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2880
2025-10-02T09:35:41.108429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.108449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.108455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.108457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.108785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2880 sessionId:  describe result for acl check
2025-10-02T09:35:41.108820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.108825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.108826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.108828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.109171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.110983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.111617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.113114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.113232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.113239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.113245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.113272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.113294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271467964:10774]
2025-10-02T09:35:41.113331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.113339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.113341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347042503:5392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.113344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.113642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.113816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.113846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.114041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.114071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.114075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.114075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.114076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.114076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.114077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.114077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.114078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.114078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.114079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.114079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.114080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.114083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.114089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.114091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.114093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.114095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.114097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.114099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.114101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.114103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.114105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.114107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.114109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.114113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.114117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.114120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.114123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.114126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.114128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.114130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.114133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.114136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.114139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.114141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.114144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.114146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.114149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.114151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.114153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.114156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.114158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.114160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.114163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.114165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.114167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.114173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.114176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.114192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.121563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.123157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.123169Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.123170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.123172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.123175Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2879 [2:7556555759271467964:10774]
2025-10-02T09:35:41.123182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.123191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.123193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.123194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.123195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.123204Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.123207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.123211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.123243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.123247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.123248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.123250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.123251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.123285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.123290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.123297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.123302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.123310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.123321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.123326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.123327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.123331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.123338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.123339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.123346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.123347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.123348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.123349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.123355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042631:5392], now have 1 active actors on pipe
2025-10-02T09:35:41.123357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042416:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.123369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.123378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.123378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2879
2025-10-02T09:35:41.123391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.123384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2879
2025-10-02T09:35:41.123422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.123428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.123440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.123446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.123448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.123449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.123454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.123462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.123471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.123570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.123579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.123590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.123657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2880 partition: 0 MaxSeqNo: 36 sessionId: src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0
2025-10-02T09:35:41.123904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4385209e-12203d32-3d4f6888-3ee4152f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.126419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Write session: try to update token
2025-10-02T09:35:41.126436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.132241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:41.132252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.132255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.132278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:41.132280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:41.132516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:41.132632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:41.132739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:41.132870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:41.133021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:41.133045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:41.139137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId: src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.140572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.140584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.140585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.140586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.140590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.140592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.140594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271467958:10774]
2025-10-02T09:35:41.140612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.140615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.140615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.140616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.140618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.140619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.140729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.141437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.200917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347042643:7823]
2025-10-02T09:35:41.201114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2879, pipe: [1:7556555759347042643:7823]
2025-10-02T09:35:41.249459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.249793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.249803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.249815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042643:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.249939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.249970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.249985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347042643:7823]
2025-10-02T09:35:41.250020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.250077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0
2025-10-02T09:35:41.250216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2880 sessionId: src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0 is DEAD
2025-10-02T09:35:41.250381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.250397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Write session will restart in 0.009904s
2025-10-02T09:35:41.250418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Write session: Do CDS request
2025-10-02T09:35:41.250424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.260623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.261189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.261267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.261274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2881
2025-10-02T09:35:41.261395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.261414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.261417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.261420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.261682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2881 sessionId:  describe result for acl check
2025-10-02T09:35:41.261704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.261707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.261707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.261710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.262024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.262128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.262225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.262232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.262237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.262263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.262284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271468194:10777]
2025-10-02T09:35:41.262640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.262817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.262851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.263048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.263082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.263086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.263086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.263087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.263087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.263088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.263088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.263089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.263090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.263090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.263091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.263091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.263094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.263099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.263101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.263103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.263105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.263107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.263109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.263111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.263113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.263115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.263117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.263119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.263123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.263127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.263130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.263132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.263135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.263137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.263139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.263142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.263144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.263147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.263149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.263153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.263155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.263158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.263160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.263163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.263165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.263168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.263170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.263173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.263175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.263178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.263184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.263186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.263166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.263206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.267887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.267894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.267896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347042838:5411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.267899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.270549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.272100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.272110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.272112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.272113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.272116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2880 [2:7556555759271468194:10777]
2025-10-02T09:35:41.272124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.272133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.272136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.272137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.272138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.272146Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.272151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.272155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.272186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.272190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.272191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.272193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.272194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.272227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.272231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.272238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.272243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.272251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.272264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042877:5411], now have 1 active actors on pipe
2025-10-02T09:35:41.272269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042657:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.272272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.272273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.272274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.272283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.272291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.272296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.272298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.272299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.272304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.272296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2880
2025-10-02T09:35:41.272305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.272313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.272299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2880
2025-10-02T09:35:41.272315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.272317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.272329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.272335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.272353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.272359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.272361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.272362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.272367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.272371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.272476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.272587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.272594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.272604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.272658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2881 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0
2025-10-02T09:35:41.272901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447782a7-fe8f8c90-b6543e65-1ac58dce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.275331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Write session: try to update token
2025-10-02T09:35:41.275345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.281246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.281258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.281260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.281261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.281266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.281269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.281272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271468188:10777]
2025-10-02T09:35:41.281295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.281296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.281299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.281300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.281304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.281306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.281404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.287278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId: src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.289376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.349900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347042887:7823]
2025-10-02T09:35:41.350052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2880, pipe: [1:7556555759347042887:7823]
2025-10-02T09:35:41.393011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.393330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.393340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.393351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042887:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.393484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:41.393497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.393493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:41.393494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347042887:7823]
2025-10-02T09:35:41.393505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.393528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2881 reason: error at write: Disconnected sessionId: src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0
2025-10-02T09:35:41.393669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2881 sessionId: src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0 is DEAD
2025-10-02T09:35:41.393921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:41.393944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Write session will restart in 0.007150s
2025-10-02T09:35:41.393971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Write session: Do CDS request
2025-10-02T09:35:41.393977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.402163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.402326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.402334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2882
2025-10-02T09:35:41.402449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.402469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.402475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.402477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.402759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2882 sessionId:  describe result for acl check
2025-10-02T09:35:41.402781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.402785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.402786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.402789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.403094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.404049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.404465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.405645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.405760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.405768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.405776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.405818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.405843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271468452:10792]
2025-10-02T09:35:41.406062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.406069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.406071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347043067:5440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.406074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.406176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.406347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.406370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.406544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.406571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.406575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.406576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.406576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.406577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.406577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.406578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.406578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.406579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.406579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.406580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.406580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.406583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.406599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.406601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.406603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.406605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.406607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.406609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.406611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.406613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.406615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.406617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.406619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.406623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.406627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.406631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.406634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.406636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.406638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.406640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.406643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.406645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.406648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.406651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.406654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.406657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.406660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.406665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.406668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.406670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.406672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.406674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.406677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.406679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.406681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.406683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.406686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.406707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.414090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.417158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.417169Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.417171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.417172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.417175Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2881 [2:7556555759271468452:10792]
2025-10-02T09:35:41.417182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.417191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.417192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.417194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.417195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.417203Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.417205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.417209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.417237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.417242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.417243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.417245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.417246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.417282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.417286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.417293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.417298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.417310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.417323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347042910:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.417328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043126:5440], now have 1 active actors on pipe
2025-10-02T09:35:41.417331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.417333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.417334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.417341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.417352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.417352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.417355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.417357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.417361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.417363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.417355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2881
2025-10-02T09:35:41.417359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2881
2025-10-02T09:35:41.417376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.417381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.417383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.417392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.417397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.417422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.417432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.417434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.417435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.417440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.417445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.417454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.417569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.417578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.417590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.417650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2882 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0
2025-10-02T09:35:41.417883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cf1d7cc-a8fc778c-779e4236-4f82ab7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.420404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Write session: try to update token
2025-10-02T09:35:41.420417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.426854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.426865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.426866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.426867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.426870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.426872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.426874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271468446:10792]
2025-10-02T09:35:41.426892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.426899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.426898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.426900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.426901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.426903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.427006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.441081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId: src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.443208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.493784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347043138:7823]
2025-10-02T09:35:41.493938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2881, pipe: [1:7556555759347043138:7823]
2025-10-02T09:35:41.535608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.535816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.535831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.535844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043138:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.535987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.536004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347043138:7823]
2025-10-02T09:35:41.536022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.536023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.536077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0
2025-10-02T09:35:41.536194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2882 sessionId: src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0 is DEAD
2025-10-02T09:35:41.536287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.536292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Write session will restart in 0.009333s
2025-10-02T09:35:41.536312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Write session: Do CDS request
2025-10-02T09:35:41.536316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.546308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.546364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.546372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2883
2025-10-02T09:35:41.546500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.546520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.546525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.546528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.546575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.546819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2883 sessionId:  describe result for acl check
2025-10-02T09:35:41.546842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.546847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.546848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.546851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.547189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.548063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.548164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.548170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.548176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.548200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.548222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271468672:10794]
2025-10-02T09:35:41.548399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.548565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.548726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.548753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.548945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.548975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.548979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.548979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.548980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.548980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.548981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.548981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.548982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.548983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.548983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.548984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.548984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.548987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.548992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.548995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.548997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.548999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.549001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.549003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.549005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.549007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.549009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.549011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.549013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.549016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.549020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.549024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.549027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.549029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.549032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.549034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.549038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.549041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.549046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.549049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.549054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.549062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.549066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.549073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.549076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.549080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.549083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.549085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.549087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.549093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.549096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.549098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.549104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.549119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.552830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.552838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.552839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347043323:5442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.552843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.556463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.558110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.558123Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.558124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.558125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.558129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2882 [2:7556555759271468672:10794]
2025-10-02T09:35:41.558135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.558143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.558145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.558146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.558147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.558155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.558158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.558162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.558189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.558194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.558195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.558197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.558198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.558234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.558239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.558246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.558253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.558270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.558288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043362:5442], now have 1 active actors on pipe
2025-10-02T09:35:41.558295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043140:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.558298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.558300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.558301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.558311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2882
2025-10-02T09:35:41.558311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2882
2025-10-02T09:35:41.558309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.558320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.558321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.558323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.558324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.558327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.558328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.558341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.558346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.558348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.558356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.558361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.558385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.558391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.558394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.558395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.558400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.558408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.558420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.558496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.558501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.558508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.558561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2883 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0
2025-10-02T09:35:41.558799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa312a2-c29edc4-80fa7b52-8f4f3562_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.561042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Write session: try to update token
2025-10-02T09:35:41.561054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.567357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.567370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.567371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.567372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.567376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.567378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.567380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271468666:10794]
2025-10-02T09:35:41.567399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.567401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.567402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.567403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.567403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.567405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.567587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.575066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId: src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.577115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.636131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347043372:7823]
2025-10-02T09:35:41.636505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2882, pipe: [1:7556555759347043372:7823]
2025-10-02T09:35:41.676864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.677194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.677205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.677217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043372:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.677340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.677369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347043372:7823]
2025-10-02T09:35:41.677390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.677442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2883 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0
2025-10-02T09:35:41.677578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2883 sessionId: src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0 is DEAD
2025-10-02T09:35:41.677637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.677736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.677750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Write session will restart in 0.009136s
2025-10-02T09:35:41.677770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Write session: Do CDS request
2025-10-02T09:35:41.677775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.688223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.688300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.688334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.688345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2884
2025-10-02T09:35:41.688461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.688491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.688500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.688504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.688848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2884 sessionId:  describe result for acl check
2025-10-02T09:35:41.688872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.688876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.688877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.688880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.689225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.689866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.690013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.690020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.690026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.690054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.690081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271468893:10796]
2025-10-02T09:35:41.690434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.690631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.690659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.690721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.690846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.690880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.690886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.690887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.690888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.690889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.690890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.690891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.690892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.690893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.690894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.690894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.690895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.690898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.690904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.690906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.690908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.690910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.690912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.690914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.690916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.690918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.690920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.690922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.690924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.690929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.690933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.690936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.690939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.690941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.690944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.690946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.690949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.690951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.690954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.690956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.690958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.690960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.690963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.690968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.690971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.690973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.690979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.690981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.690984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.690986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.690992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.690994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.690998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.691016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.694804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.694811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.694813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347043558:5454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.694817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.698553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.700121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.700134Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.700135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.700137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.700141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2883 [2:7556555759271468893:10796]
2025-10-02T09:35:41.700148Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.700158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.700159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.700161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.700162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.700171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.700178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.700182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.700212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.700217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.700218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.700220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.700222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.700261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.700266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.700272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.700277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.700289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.700303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043373:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.700308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043596:5454], now have 1 active actors on pipe
2025-10-02T09:35:41.700312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.700313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.700314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.700322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.700330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.700325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2883
2025-10-02T09:35:41.700327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2883
2025-10-02T09:35:41.700339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.700339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.700342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.700342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.700343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.700360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.700369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.700377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.700380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.700382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.700405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.700412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.700414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.700415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.700420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.700426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.700436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.700534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.700540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.700551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.700605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2884 partition: 0 MaxSeqNo: 36 sessionId: src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0
2025-10-02T09:35:41.700858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea8987c-ccc046de-1ddb3b71-6359f21b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.703287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Write session: try to update token
2025-10-02T09:35:41.703303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.709789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.709800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.709802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.709803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.709807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.709809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.709811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271468888:10796]
2025-10-02T09:35:41.709831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.709834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.709836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.709839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.709839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.709842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.709950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.715392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId: src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.717489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.777444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347043603:7823]
2025-10-02T09:35:41.777602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2883, pipe: [1:7556555759347043603:7823]
2025-10-02T09:35:41.819592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.819922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.819932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.819943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043603:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.820076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.820098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347043603:7823]
2025-10-02T09:35:41.820119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.820125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.820173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0
2025-10-02T09:35:41.820307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2884 sessionId: src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0 is DEAD
2025-10-02T09:35:41.820451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.820486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Write session will restart in 0.008051s
2025-10-02T09:35:41.820510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Write session: Do CDS request
2025-10-02T09:35:41.820516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.829193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.829268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.829276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2885
2025-10-02T09:35:41.829398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.829418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.829424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.829427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.829664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2885 sessionId:  describe result for acl check
2025-10-02T09:35:41.829686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.829691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.829692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.829694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.830033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.831358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.831581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.833053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.833167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.833173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.833177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.833179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.833185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.833187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347043748:5459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.833190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.833207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.833230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271469117:10798]
2025-10-02T09:35:41.833562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.833729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.833751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.833926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.833955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.833959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.833960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.833960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.833961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.833961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.833962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.833963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.833963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.833964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.833964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.833965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.833967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.833973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.833975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.833978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.833980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.833982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.833984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.833986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.833987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.833989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.833991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.833993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.833997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.834001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.834004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.834007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.834009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.834012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.834014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.834017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.834020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.834022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.834024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.834027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.834029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.834032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.834034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.834037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.834039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.834042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.834045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.834048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.834050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.834054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.834056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.834058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.834076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.841551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.843104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.843116Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.843119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.843122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2884 [2:7556555759271469117:10798]
2025-10-02T09:35:41.843129Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.843139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.843142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.843143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.843145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.843154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.843159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.843164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.843198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.843203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.843204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.843206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.843207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.843246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.843250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.843256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.843261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.843273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.843287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043604:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.843292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043823:5459], now have 1 active actors on pipe
2025-10-02T09:35:41.843296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.843297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.843299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.843307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.843316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.843323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.843325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.843327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.843327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.843329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.843320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2884
2025-10-02T09:35:41.843323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2884
2025-10-02T09:35:41.843343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.843348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.843350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.843358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.843363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.843387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.843394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.843396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.843397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.843403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.843410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.843420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.843503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.843510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.843519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.843587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2885 partition: 0 MaxSeqNo: 36 sessionId: src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0
2025-10-02T09:35:41.843822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a5f2ee-1a64e691-f817e925-f3756b77_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.846337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Write session: try to update token
2025-10-02T09:35:41.846350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.852641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.852652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.852653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.852654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.852658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.852661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.852663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271469111:10798]
2025-10-02T09:35:41.852682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.852688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.852688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.852689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.852690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.852692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.852845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:41.858597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId: src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:41.860606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:41.920277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555759347043841:7823]
2025-10-02T09:35:41.920421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2884, pipe: [1:7556555759347043841:7823]
2025-10-02T09:35:41.962482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:41.962818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.962828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.962840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043841:7823], now have 1 active actors on pipe
2025-10-02T09:35:41.962959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:41.963003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:41.963021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:41.963041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555759347043841:7823]
2025-10-02T09:35:41.963077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2885 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0
2025-10-02T09:35:41.963211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2885 sessionId: src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0 is DEAD
2025-10-02T09:35:41.963317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:41.963323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Write session will restart in 0.008764s
2025-10-02T09:35:41.963338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Write session: Do CDS request
2025-10-02T09:35:41.963343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:41.973268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:41.973276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2886
2025-10-02T09:35:41.973374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.973573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:41.973594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:41.973600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:41.973603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:41.973919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2886 sessionId:  describe result for acl check
2025-10-02T09:35:41.973942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:41.973947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:41.973948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:41.973951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:41.974097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:41.974293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:41.975466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:41.975576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:41.975711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:41.975718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:41.975724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:41.975754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:41.975781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555759271469341:10800]
2025-10-02T09:35:41.976140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:41.976315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:41.976339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:41.976625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:41.976665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.976670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.976670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.976671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.976671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.976672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.976673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.976673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.976674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.976674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.976674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.976675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.976678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.976684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.976686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.976688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.976690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.976692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.976694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.976696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.976698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.976700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.976702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.976704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.976708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.976713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:41.976716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.976719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:41.976720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.976723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:41.976725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.976728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:41.976730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.976733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:41.976735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.976737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:41.976741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.976744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:41.976746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.976749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:41.976751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.976754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:41.976755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.976758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.976760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.976764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.976767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.976774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.976814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:41.976940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:41.976947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:41.976949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555759347044027:5476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:41.976952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:41.984211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:41.985712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:41.985725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:41.985726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:41.985728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:41.985731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2885 [2:7556555759271469341:10800]
2025-10-02T09:35:41.985737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:41.985747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:41.985748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.985750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.985751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.985759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:41.985762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:41.985766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:41.985806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.985813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.985815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.985817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:41.985818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:41.985852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:41.985857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.985864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:41.985869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:41.985877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:41.985889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347043842:2446], now have 1 active actors on pipe
2025-10-02T09:35:41.985894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555759347044070:5476], now have 1 active actors on pipe
2025-10-02T09:35:41.985897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.985898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.985900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.985907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:41.985917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:41.985923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:41.985926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:41.985927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:41.985928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:41.985930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:41.985927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2885
2025-10-02T09:35:41.985931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2885
2025-10-02T09:35:41.985944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.985949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:41.985951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:41.985964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.985969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.985987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:41.985994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:41.985996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:41.985997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:41.986001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:41.986006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:41.986017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.986100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:41.986105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:41.986112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:41.986168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2886 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0
2025-10-02T09:35:41.986386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40da537-b37c0e2e-6265034e-ca4b2e0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:41.988870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Write session: try to update token
2025-10-02T09:35:41.988883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:41.995034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:41.995045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:41.995047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:41.995048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:41.995051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.995053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.995055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555759271469335:10800]
2025-10-02T09:35:41.995074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:41.995077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:41.995080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:41.995080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:41.995081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:41.995082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:41.995218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.001059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId: src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.002997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.063130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642011374:7823]
2025-10-02T09:35:42.063268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2885, pipe: [1:7556555763642011374:7823]
2025-10-02T09:35:42.105601Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.105862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.105871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.105883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011374:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.106002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.106042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.106061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:42.106081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642011374:7823]
2025-10-02T09:35:42.106112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0
2025-10-02T09:35:42.106243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2886 sessionId: src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0 is DEAD
2025-10-02T09:35:42.106411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:42.106424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Write session will restart in 0.005785s
2025-10-02T09:35:42.106448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Write session: Do CDS request
2025-10-02T09:35:42.106454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.113135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.113290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.113299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2887
2025-10-02T09:35:42.113403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.113422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.113428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.113431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.113700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2887 sessionId:  describe result for acl check
2025-10-02T09:35:42.113720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.113724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.113725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.113728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.114083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.115990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.117458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.118886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.118893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.118895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642011443:5480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.118898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.118941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.119046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.119052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.119058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.119087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.119167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566436866:10803]
2025-10-02T09:35:42.119517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.119694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.119721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.119904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.119939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.119944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.119945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.119945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.119946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.119947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.119948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.119949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.119950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.119951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.119952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.119953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.119958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.119965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.119967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.119969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.119971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.119973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.119975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.119977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.119979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.119982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.119988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.119990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.119994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.119998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.120004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.120007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.120013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.120015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.120018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.120024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.120026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.120029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.120034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.120037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.120039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.120042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.120047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.120049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.120051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.120058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.120060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.120063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.120068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.120070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.120072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.120075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.120095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.127452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.129010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.129023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.129024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.129026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.129029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2886 [2:7556555763566436866:10803]
2025-10-02T09:35:42.129036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.129045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.129047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.129048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.129049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.129057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.129060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.129064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.129094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.129099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.129100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.129102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.129103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.129142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.129148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.129157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.129170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.129184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.129198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011596:5480], now have 1 active actors on pipe
2025-10-02T09:35:42.129200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011375:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.129204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.129207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.129208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.129215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.129226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.129228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.129230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.129218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2886
2025-10-02T09:35:42.129231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.129217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2886
2025-10-02T09:35:42.129241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.129243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.129271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.129278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.129286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.129295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.129304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.129314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.129321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.129323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.129324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.129328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.129336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.129348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.129440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.129450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.129462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.129522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2887 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0
2025-10-02T09:35:42.129790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cb86b4-bad86d04-503afb7e-b631f618_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.132077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Write session: try to update token
2025-10-02T09:35:42.132091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.138272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.138285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.138286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.138287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.138290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.138292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.138294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566436858:10803]
2025-10-02T09:35:42.138313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.138315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.138316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.138316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.138319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.138321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.138428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.144579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId: src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.146789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.205975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642011608:7823]
2025-10-02T09:35:42.206126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2886, pipe: [1:7556555763642011608:7823]
2025-10-02T09:35:42.247735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.247969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.247978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.247989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011608:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.248107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.248157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:42.248158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.248186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642011608:7823]
2025-10-02T09:35:42.248219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2887 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0
2025-10-02T09:35:42.248365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2887 sessionId: src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0 is DEAD
2025-10-02T09:35:42.248703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:42.248719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Write session will restart in 0.007093s
2025-10-02T09:35:42.248760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Write session: Do CDS request
2025-10-02T09:35:42.248766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.257183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.257282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.257290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2888
2025-10-02T09:35:42.257411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.257431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.257436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.257439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.257734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2888 sessionId:  describe result for acl check
2025-10-02T09:35:42.257753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.257757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.257758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.257761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.258089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.258669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.259636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.260290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.260404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.260411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.260417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.260449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.260473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566437103:10806]
2025-10-02T09:35:42.260824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.261188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.261230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.261471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.261505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.261510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.261510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.261511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.261511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.261512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.261512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.261513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.261513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.261514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.261514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.261515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.261518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.261524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.261528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.261532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.261534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.261536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.261538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.261540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.261542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.261544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.261547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.261552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.261555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.261558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.261560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.261564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.261566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.261568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.261571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.261573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.261575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.261578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.261580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.261583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.261586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.261588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.261590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.261593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.261595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.261597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.261599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.261604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.261606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.261609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.261605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.261611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.261614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642011806:5502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.261617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.261629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.269065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.270792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.270802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.270804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.270805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.270808Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2887 [2:7556555763566437103:10806]
2025-10-02T09:35:42.270817Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.270827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.270828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.270829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.270830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.270839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.270841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.270845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.270874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.270879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.270881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.270883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.270884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.270928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.270932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.270938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.270944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.270956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.270971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011846:5502], now have 1 active actors on pipe
2025-10-02T09:35:42.270976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011621:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.270980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.270981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.270982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.270990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.270983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2887
2025-10-02T09:35:42.270998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.271000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.270987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2887
2025-10-02T09:35:42.271002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.271003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.271007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.271008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.271032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.271036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.271043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.271049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.271058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.271065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.271068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.271070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.271071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.271077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.271082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.271095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.271201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.271208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.271217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.271268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2888 partition: 0 MaxSeqNo: 36 sessionId: src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0
2025-10-02T09:35:42.271605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d69265-9c264e3a-8cf55cf8-bfc253ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.274078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Write session: try to update token
2025-10-02T09:35:42.274093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.280219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.280230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.280231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.280232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.280236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.280238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.280240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566437097:10806]
2025-10-02T09:35:42.280260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.280263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.280266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.280267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.280268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.280268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.280411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.286640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId: src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.288753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.348315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642011857:7823]
2025-10-02T09:35:42.348485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2887, pipe: [1:7556555763642011857:7823]
2025-10-02T09:35:42.390314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.390563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.390572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.390584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011857:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.390730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.390763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642011857:7823]
2025-10-02T09:35:42.390774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:42.390779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:42.390816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2888 reason: error at write: Disconnected sessionId: src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0
2025-10-02T09:35:42.390950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2888 sessionId: src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0 is DEAD
2025-10-02T09:35:42.390959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.391122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:42.391137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Write session will restart in 0.009144s
2025-10-02T09:35:42.391159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Write session: Do CDS request
2025-10-02T09:35:42.391163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.401170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.401263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.401270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2889
2025-10-02T09:35:42.401359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.401378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.401383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.401386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.401593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2889 sessionId:  describe result for acl check
2025-10-02T09:35:42.401613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.401616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.401617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.401620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.401643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.401930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.403294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.403397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.403404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.403410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.403439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.403461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566437345:10815]
2025-10-02T09:35:42.403493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.403797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.403954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.403977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.404164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.404197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.404201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.404202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.404202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.404203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.404204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.404204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.404205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.404205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.404206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.404206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.404207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.404210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.404217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.404219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.404221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.404223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.404225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.404227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.404228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.404230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.404232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.404234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.404236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.404241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.404245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.404248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.404251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.404253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.404256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.404262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.404265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.404268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.404271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.404273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.404275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.404279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.404282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.404284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.404287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.404293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.404296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.404299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.404301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.404304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.404306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.404312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.404315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.404334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.408130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.408139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.408140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642012060:5521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.408144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.411758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.413381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.413392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.413393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.413395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.413398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2888 [2:7556555763566437345:10815]
2025-10-02T09:35:42.413405Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.413414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.413415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.413416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.413417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.413425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.413431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.413435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.413464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.413469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.413470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.413472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.413473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.413506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.413511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.413517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.413523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.413530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.413546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012099:5521], now have 1 active actors on pipe
2025-10-02T09:35:42.413550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642011872:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.413553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.413555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.413556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.413563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.413574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.413575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.413577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.413579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.413583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.413584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.413580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2888
2025-10-02T09:35:42.413596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2888
2025-10-02T09:35:42.413598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.413603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.413605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.413614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.413618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.413641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.413653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.413655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.413656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.413661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.413666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.413675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.413805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.413813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.413824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.413877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2889 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0
2025-10-02T09:35:42.414108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef70f50-8a755474-62c4d13f-6fab3e06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.416420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Write session: try to update token
2025-10-02T09:35:42.416434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.422781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.422792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.422794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.422794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.422798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.422800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.422802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566437338:10815]
2025-10-02T09:35:42.422821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.422827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.422828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.422828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.422833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.422836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.422945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.428121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId: src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.430281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.490652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642012116:7823]
2025-10-02T09:35:42.490844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2888, pipe: [1:7556555763642012116:7823]
2025-10-02T09:35:42.531179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.531450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.531460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.531472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012116:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.531592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.531645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:42.531654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:42.531660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642012116:7823]
2025-10-02T09:35:42.531674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.531970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2889 reason: error at write: Disconnected sessionId: src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0
2025-10-02T09:35:42.532101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2889 sessionId: src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0 is DEAD
2025-10-02T09:35:42.532212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:42.532221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Write session will restart in 0.008648s
2025-10-02T09:35:42.532242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Write session: Do CDS request
2025-10-02T09:35:42.532246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.542183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.542235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.542243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2890
2025-10-02T09:35:42.542304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.542408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.542428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.542434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.542437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.542704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2890 sessionId:  describe result for acl check
2025-10-02T09:35:42.542726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.542730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.542731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.542734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.543073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.543954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.544051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.544057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.544063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.544089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.544112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566437594:10823]
2025-10-02T09:35:42.544252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.544472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.544632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.544656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.544844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.544874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.544880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.544881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.544883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.544884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.544885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.544886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.544887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.544888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.544889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.544892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.544901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.544905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.544908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.544910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.544912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.544914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.544918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.544920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.544922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.544924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.544927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.544932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.544935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.544942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.544946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.544949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.544954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.544957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.544959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.544962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.544964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.544968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.544972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.544979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.544981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.544983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.544985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.544988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.544992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.544994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.544997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.544999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.545001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.545007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.545023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.548760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.548767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.548769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642012308:5530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.548773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.552433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.553919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.553931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.553932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.553934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.553938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2889 [2:7556555763566437594:10823]
2025-10-02T09:35:42.553944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.553953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.553955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.553957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.553957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.553966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.553969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.553973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.554001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.554006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.554007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.554009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.554010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.554046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.554051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.554058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.554063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.554073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.554086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012347:5530], now have 1 active actors on pipe
2025-10-02T09:35:42.554092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012118:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.554098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.554103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.554105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.554116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.554117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2889
2025-10-02T09:35:42.554123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2889
2025-10-02T09:35:42.554127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.554129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.554135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.554136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.554138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.554139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.554161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.554167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.554175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.554183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.554191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.554198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.554202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.554203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.554204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.554209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.554216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.554228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.554309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.554314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.554321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.554367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2890 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0
2025-10-02T09:35:42.554608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c12dc72-6f229527-6b9d20d-530fc6ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.557064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Write session: try to update token
2025-10-02T09:35:42.557079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.563386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.563397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.563398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.563399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.563403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.563405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.563407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566437588:10823]
2025-10-02T09:35:42.563426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.563429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.563431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.563433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.563433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.563434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.563544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.569462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId: src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.571544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.631960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642012354:7823]
2025-10-02T09:35:42.632127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2889, pipe: [1:7556555763642012354:7823]
2025-10-02T09:35:42.673322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.673532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.673542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.673554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012354:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.673695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:42.673703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:42.673725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642012354:7823]
2025-10-02T09:35:42.673730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.673738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.673744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2890 reason: error at write: Disconnected sessionId: src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0
2025-10-02T09:35:42.673879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2890 sessionId: src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0 is DEAD
2025-10-02T09:35:42.674061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:42.674075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Write session will restart in 0.005089s
2025-10-02T09:35:42.674095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Write session: Do CDS request
2025-10-02T09:35:42.674101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.680177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.680235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.680242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2891
2025-10-02T09:35:42.680352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.680373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.680379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.680381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.680654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2891 sessionId:  describe result for acl check
2025-10-02T09:35:42.680676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.680680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.680681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.680684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.681049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.683058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.685020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.685037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.685044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.685046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642012408:5538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.685050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.686548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.686666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.686673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.686679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.686708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.686733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566437824:10825]
2025-10-02T09:35:42.687068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.687231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.687254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.687428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.687455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.687459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.687459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.687460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.687460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.687461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.687462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.687462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.687463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.687463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.687464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.687464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.687468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.687476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.687479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.687483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.687486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.687489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.687492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.687495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.687498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.687503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.687508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.687510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.687515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.687518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.687526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.687528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.687531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.687533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.687535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.687542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.687544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.687547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.687548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.687551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.687553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.687556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.687561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.687564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.687566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.687569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.687571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.687573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.687576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.687579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.687582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.687585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.687600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.695064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.696611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.696623Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.696624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.696626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.696629Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2890 [2:7556555763566437824:10825]
2025-10-02T09:35:42.696639Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.696650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.696655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.696657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.696658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.696666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.696670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.696675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.696707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.696712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.696713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.696714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.696715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.696752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.696756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.696762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.696768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.696776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.696791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012355:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.696796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012581:5538], now have 1 active actors on pipe
2025-10-02T09:35:42.696813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.696814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.696815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.696824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.696834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.696836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.696838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.696840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.696845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.696846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.696861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.696866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.696867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.696838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2890
2025-10-02T09:35:42.696876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.696881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.696845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2890
2025-10-02T09:35:42.696908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|796a7fe-ad689202-1648da3-e7b75942_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.696916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.696918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.696919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.696924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.696929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.696939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.697037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.697042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.697050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.697105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2891 partition: 0 MaxSeqNo: 36 sessionId: src_id|796a7fe-ad689202-1648da3-e7b75942_0
2025-10-02T09:35:42.697374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9ac12-b8b0df6a-bf3153e1-d9d1352e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|796a7fe-ad689202-1648da3-e7b75942_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.699874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Write session: try to update token
2025-10-02T09:35:42.699889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.706113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.706125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.706127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.706128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.706131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.706134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.706136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566437817:10825]
2025-10-02T09:35:42.706156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.706158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.706159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.706160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.706161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.706162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.706279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.712435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId: src_id|796a7fe-ad689202-1648da3-e7b75942_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.714588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.773789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642012593:7823]
2025-10-02T09:35:42.773976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2890, pipe: [1:7556555763642012593:7823]
2025-10-02T09:35:42.816072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.816421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.816430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.816442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012593:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.816580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.816589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.816606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642012593:7823]
2025-10-02T09:35:42.816623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:42.816679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|796a7fe-ad689202-1648da3-e7b75942_0
2025-10-02T09:35:42.816817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2891 sessionId: src_id|796a7fe-ad689202-1648da3-e7b75942_0 is DEAD
2025-10-02T09:35:42.816979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:42.816991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Write session will restart in 0.005544s
2025-10-02T09:35:42.817018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Write session: Do CDS request
2025-10-02T09:35:42.817023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.823162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.823255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.823262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2892
2025-10-02T09:35:42.823364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.823384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.823390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.823392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.823698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2892 sessionId:  describe result for acl check
2025-10-02T09:35:42.823722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.823726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.823728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.823730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.824059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.825844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.827494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.829053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.829161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.829168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.829174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.829165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.829173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.829175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642012658:5550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.829179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.829201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.829223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566438053:10827]
2025-10-02T09:35:42.829558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.829713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.829737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.829924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.829952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.829956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.829957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.829957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.829958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.829959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.829959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.829960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.829960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.829961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.829961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.829962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.829965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.829970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.829972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.829975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.829977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.829979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.829981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.829983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.829985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.829987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.829989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.829991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.829994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.829998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.830001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.830004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.830006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.830009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.830011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.830013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.830015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.830018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.830020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.830022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.830025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.830027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.830029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.830032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.830034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.830036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.830038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.830041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.830043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.830046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.830048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.830051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.830066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.837450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.838947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.838958Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.838959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.838961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.838964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2891 [2:7556555763566438053:10827]
2025-10-02T09:35:42.838971Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.838980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.838981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.838983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.838984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.838992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.838997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.839001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.839031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.839036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.839038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.839040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.839041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.839075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.839079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.839085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.839090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.839098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.839111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012594:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.839118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.839119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.839121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.839128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.839137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012820:5550], now have 1 active actors on pipe
2025-10-02T09:35:42.839142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.839142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.839144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.839144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.839152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.839154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.839139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2891
2025-10-02T09:35:42.839140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2891
2025-10-02T09:35:42.839173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.839182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.839186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.839194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.839201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.839226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.839234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.839236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.839237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.839243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.839251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.839260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.839348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.839353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.839361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.839421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2892 partition: 0 MaxSeqNo: 36 sessionId: src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0
2025-10-02T09:35:42.839656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796a7fe-ad689202-1648da3-e7b75942_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.841967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Write session: try to update token
2025-10-02T09:35:42.841981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.848174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.848186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.848187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.848189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.848192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.848195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.848196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566438047:10827]
2025-10-02T09:35:42.848215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.848218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.848219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.848230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.848241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.848243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.848333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.854157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId: src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.856252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:42.916622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555763642012838:7823]
2025-10-02T09:35:42.916761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2891, pipe: [1:7556555763642012838:7823]
2025-10-02T09:35:42.957175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:42.957614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.957624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.957636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012838:7823], now have 1 active actors on pipe
2025-10-02T09:35:42.957754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:42.957782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:42.957770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:42.957784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:42.957786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555763642012838:7823]
2025-10-02T09:35:42.957827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2892 reason: error at write: Disconnected sessionId: src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0
2025-10-02T09:35:42.957958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2892 sessionId: src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0 is DEAD
2025-10-02T09:35:42.958114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:42.958137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Write session will restart in 0.006518s
2025-10-02T09:35:42.958158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Write session: Do CDS request
2025-10-02T09:35:42.958164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:42.966173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.966268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:42.966275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2893
2025-10-02T09:35:42.966384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:42.966403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:42.966409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:42.966412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:42.966706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2893 sessionId:  describe result for acl check
2025-10-02T09:35:42.966727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:42.966731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:42.966732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:42.966735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:42.967071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:42.968629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:42.968790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:42.970327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:42.970429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:42.970435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:42.970441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:42.970470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:42.970492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555763566438284:10829]
2025-10-02T09:35:42.970522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:42.970529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:42.970531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555763642012974:5560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:42.970535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:42.970845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:42.971006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:42.971030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:42.971218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:42.971252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.971256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.971256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.971257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.971257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.971258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.971259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.971259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.971260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.971260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.971261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.971262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.971265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.971270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.971272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.971274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.971276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.971278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.971280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.971282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.971284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.971286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.971288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.971290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.971293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.971298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:42.971301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.971304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:42.971306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.971309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:42.971311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.971314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:42.971316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.971319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:42.971321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.971324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:42.971328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.971330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:42.971332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.971335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:42.971337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.971340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:42.971342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.971345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.971347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.971349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.971352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.971354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.971377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:42.978774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:42.980388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:42.980399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:42.980400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:42.980402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:42.980405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2892 [2:7556555763566438284:10829]
2025-10-02T09:35:42.980411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:42.980420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:42.980421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.980423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.980424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.980432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:42.980434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:42.980440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:42.980471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.980476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.980477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.980478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:42.980480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:42.980512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:42.980517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.980523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:42.980528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:42.980540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:42.980554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642013067:5560], now have 1 active actors on pipe
2025-10-02T09:35:42.980559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555763642012842:2446], now have 1 active actors on pipe
2025-10-02T09:35:42.980562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.980563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.980565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.980572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:42.980579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:42.980585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:42.980587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:42.980588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:42.980592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:42.980595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:42.980590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2892
2025-10-02T09:35:42.980609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2892
2025-10-02T09:35:42.980615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.980622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:42.980622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:42.980634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.980639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.980661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2637046-e143fa90-1a870c29-b725a866_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:42.980668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:42.980670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:42.980671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:42.980676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:42.980683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:42.980693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.980773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:42.980778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:42.980787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:42.980841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2893 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2637046-e143fa90-1a870c29-b725a866_0
2025-10-02T09:35:42.981089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15556a7-adb33a1-bff2e3c0-e062ef18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2637046-e143fa90-1a870c29-b725a866_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:42.983567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Write session: try to update token
2025-10-02T09:35:42.983580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:42.989687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:42.989699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:42.989700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:42.989701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:42.989704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.989706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.989708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555763566438278:10829]
2025-10-02T09:35:42.989726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:42.989729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:42.989731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:42.989735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:42.989739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:42.989741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:42.989872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:42.996067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId: src_id|a2637046-e143fa90-1a870c29-b725a866_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:42.998202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.057942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936980378:7823]
2025-10-02T09:35:43.058070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2892, pipe: [1:7556555767936980378:7823]
2025-10-02T09:35:43.099793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.100085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.100094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.100107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980378:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.100225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.100227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936980378:7823]
2025-10-02T09:35:43.100241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:43.100243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:43.100245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.100290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2893 reason: error at write: Disconnected sessionId: src_id|a2637046-e143fa90-1a870c29-b725a866_0
2025-10-02T09:35:43.100420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2893 sessionId: src_id|a2637046-e143fa90-1a870c29-b725a866_0 is DEAD
2025-10-02T09:35:43.100569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:43.100583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Write session will restart in 0.008988s
2025-10-02T09:35:43.100605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Write session: Do CDS request
2025-10-02T09:35:43.100611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.110171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.110282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.110289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2894
2025-10-02T09:35:43.110384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.110404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.110409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.110411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.110673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2894 sessionId:  describe result for acl check
2025-10-02T09:35:43.110695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.110696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.110697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.110700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.111037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.111251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.112578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.112700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.112809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.112815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.112821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.112849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.112871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861405814:10832]
2025-10-02T09:35:43.113228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.113403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.113430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.113614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.113644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.113648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.113648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.113649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.113650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.113650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.113651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.113651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.113652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.113652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.113653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.113653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.113656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.113661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.113664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.113666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.113668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.113670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.113672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.113674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.113676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.113678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.113680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.113682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.113685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.113689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.113692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.113695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.113697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.113700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.113704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.113708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.113712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.113717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.113720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.113728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.113731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.113733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.113736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.113741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.113744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.113747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.113753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.113755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.113757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.113760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.113762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.113765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.113785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.114058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.114067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.114069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936980571:5577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.114072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.121178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.122786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.122797Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.122798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.122800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.122802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2893 [2:7556555767861405814:10832]
2025-10-02T09:35:43.122810Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.122818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.122820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.122821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.122822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.122830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.122832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.122837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.122866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.122871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.122872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.122873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.122875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.122909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.122913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.122921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.122930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.122943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.122958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.122964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.122965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.122970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.122976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.122978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.122979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.122979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.122986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.122991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.122997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980379:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.123001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980612:5577], now have 1 active actors on pipe
2025-10-02T09:35:43.123012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.123020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.123027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.123025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2893
2025-10-02T09:35:43.123039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2893
2025-10-02T09:35:43.123061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.123066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.123078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|158255aa-3e60311c-164e4f35-5e595d70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.123086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.123088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.123089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.123095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.123103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.123113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.123211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.123219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.123228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.123281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2894 partition: 0 MaxSeqNo: 36 sessionId: src_id|158255aa-3e60311c-164e4f35-5e595d70_0
2025-10-02T09:35:43.123520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2637046-e143fa90-1a870c29-b725a866_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|158255aa-3e60311c-164e4f35-5e595d70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.126026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Write session: try to update token
2025-10-02T09:35:43.126042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.132010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.132023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.132024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.132025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.132029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.132031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.132033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861405808:10832]
2025-10-02T09:35:43.132052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.132057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.132059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.132060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.132063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.132065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.132173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.138743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId: src_id|158255aa-3e60311c-164e4f35-5e595d70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.140770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.200274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936980620:7823]
2025-10-02T09:35:43.200418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2893, pipe: [1:7556555767936980620:7823]
2025-10-02T09:35:43.240075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.240271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.240280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.240292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980620:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.240392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.240417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:43.240426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:43.240432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.240465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936980620:7823]
2025-10-02T09:35:43.240465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2894 reason: error at write: Disconnected sessionId: src_id|158255aa-3e60311c-164e4f35-5e595d70_0
2025-10-02T09:35:43.240596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2894 sessionId: src_id|158255aa-3e60311c-164e4f35-5e595d70_0 is DEAD
2025-10-02T09:35:43.240753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:43.240766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Write session will restart in 0.009675s
2025-10-02T09:35:43.240789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Write session: Do CDS request
2025-10-02T09:35:43.240794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.251218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.251276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.251284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2895
2025-10-02T09:35:43.251427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.251446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.251452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.251455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.251598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.251702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2895 sessionId:  describe result for acl check
2025-10-02T09:35:43.251725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.251729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.251730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.251733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.252055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.253212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.253305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.253313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.253319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.253342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.253365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861406059:10835]
2025-10-02T09:35:43.253363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.253698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.253865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.253887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.254057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.254088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.254092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.254094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.254095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.254095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.254096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.254096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.254097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.254097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.254098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.254100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.254106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.254108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.254110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.254112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.254114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.254116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.254117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.254119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.254122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.254124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.254125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.254129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.254132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.254135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.254138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.254140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.254143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.254145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.254148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.254150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.254153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.254155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.254158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.254160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.254163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.254165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.254168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.254170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.254172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.254175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.254177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.254179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.254182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.254184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.254187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.254204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.257955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.257962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.257965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936980828:5592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.257968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.261559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.263096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.263108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.263109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.263111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.263114Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2894 [2:7556555767861406059:10835]
2025-10-02T09:35:43.263122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.263131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.263136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.263138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.263138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.263147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.263152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.263157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.263187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.263191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.263192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.263194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.263195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.263229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.263234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.263240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.263247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.263258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.263272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980633:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.263277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980867:5592], now have 1 active actors on pipe
2025-10-02T09:35:43.263280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.263282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.263282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.263290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.263300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.263304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.263306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.263307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.263310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.263312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.263307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2894
2025-10-02T09:35:43.263308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2894
2025-10-02T09:35:43.263325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.263329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.263331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.263347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.263352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.263368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a078d37-78ab2961-42522350-b2709b6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.263375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.263378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.263382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.263386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.263391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.263402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.263483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.263489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.263496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.263545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2895 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a078d37-78ab2961-42522350-b2709b6e_0
2025-10-02T09:35:43.263765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158255aa-3e60311c-164e4f35-5e595d70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a078d37-78ab2961-42522350-b2709b6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.266024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Write session: try to update token
2025-10-02T09:35:43.266037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.272298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.272310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.272312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.272312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.272316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.272318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.272320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861406053:10835]
2025-10-02T09:35:43.272339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.272344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.272346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.272347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.272351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.272353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.272509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.278012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId: src_id|7a078d37-78ab2961-42522350-b2709b6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.279980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.340561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936980876:7823]
2025-10-02T09:35:43.340713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2894, pipe: [1:7556555767936980876:7823]
2025-10-02T09:35:43.380456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.380891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.380901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.380913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980876:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.381024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.381044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.381070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:43.381078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936980876:7823]
2025-10-02T09:35:43.381115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2895 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a078d37-78ab2961-42522350-b2709b6e_0
2025-10-02T09:35:43.381253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2895 sessionId: src_id|7a078d37-78ab2961-42522350-b2709b6e_0 is DEAD
2025-10-02T09:35:43.381413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:43.381428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Write session will restart in 0.007091s
2025-10-02T09:35:43.381449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Write session: Do CDS request
2025-10-02T09:35:43.381455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.389187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.389279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.389287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2896
2025-10-02T09:35:43.389403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.389421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.389427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.389430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.389679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2896 sessionId:  describe result for acl check
2025-10-02T09:35:43.389701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.389705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.389706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.389709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.390045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.391898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.392462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.393966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.394064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.394070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.394076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.394102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.394124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861406294:10838]
2025-10-02T09:35:43.394138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.394145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.394147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936980985:5595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.394150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.394464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.394631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.394654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.394828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.394858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.394862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.394863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.394863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.394864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.394865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.394865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.394866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.394866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.394867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.394867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.394868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.394870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.394876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.394878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.394880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.394882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.394884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.394886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.394888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.394890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.394892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.394894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.394896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.394900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.394904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.394907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.394910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.394912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.394914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.394916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.394919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.394921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.394924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.394926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.394929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.394931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.394933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.394935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.394939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.394945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.394947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.394949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.394952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.394956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.394958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.394960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.394966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.394982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.402335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.403997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.404009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.404010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.404011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.404015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2895 [2:7556555767861406294:10838]
2025-10-02T09:35:43.404022Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.404031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.404036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.404037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.404038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.404047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.404050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.404055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.404085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.404089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.404090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.404092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.404093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.404134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.404138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.404146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.404151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.404162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.404173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981109:5595], now have 1 active actors on pipe
2025-10-02T09:35:43.404179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936980878:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.404182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.404183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.404184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.404192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.404200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.404192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2895
2025-10-02T09:35:43.404195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2895
2025-10-02T09:35:43.404206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.404209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.404210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.404210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.404212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.404235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.404239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.404247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.404253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.404265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.404268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.404271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.404273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.404274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.404279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.404284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.404295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.404387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.404392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.404400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.404467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2896 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0
2025-10-02T09:35:43.404728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a078d37-78ab2961-42522350-b2709b6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.407051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Write session: try to update token
2025-10-02T09:35:43.407066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.413156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.413168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.413170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.413171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.413174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.413176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.413178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861406288:10838]
2025-10-02T09:35:43.413197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.413203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.413204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.413215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.413226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.413228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.413318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.418756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId: src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.420792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.481381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936981142:7823]
2025-10-02T09:35:43.481523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2895, pipe: [1:7556555767936981142:7823]
2025-10-02T09:35:43.521118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.521396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.521404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.521415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981142:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.521551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.521569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936981142:7823]
2025-10-02T09:35:43.521586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.521598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:43.521653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2896 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0
2025-10-02T09:35:43.521783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2896 sessionId: src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0 is DEAD
2025-10-02T09:35:43.521935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:43.521950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Write session will restart in 0.005938s
2025-10-02T09:35:43.521971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Write session: Do CDS request
2025-10-02T09:35:43.521975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.529185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.529254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.529260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2897
2025-10-02T09:35:43.529607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.529628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.529634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.529637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.529972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2897 sessionId:  describe result for acl check
2025-10-02T09:35:43.529995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.529999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.530000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.530003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.530327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.532257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.533234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.534808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.534920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.534927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.534933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.534960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.534983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861406564:10852]
2025-10-02T09:35:43.535054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.535062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.535064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936981235:5623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.535067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.535320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.535476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.535498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.535668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.535697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.535701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.535701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.535702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.535703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.535703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.535704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.535704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.535705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.535705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.535706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.535707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.535709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.535715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.535717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.535719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.535721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.535723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.535725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.535727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.535728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.535731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.535732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.535734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.535738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.535742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.535745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.535748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.535750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.535752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.535754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.535757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.535762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.535764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.535766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.535770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.535773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.535775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.535778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.535780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.535787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.535790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.535792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.535796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.535799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.535816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.543139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.544619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.544632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.544633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.544635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.544638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2896 [2:7556555767861406564:10852]
2025-10-02T09:35:43.544645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.544655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.544659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.544660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.544661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.544670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.544674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.544678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.544709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.544714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.544715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.544716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.544718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.544832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2896
2025-10-02T09:35:43.544836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2896
2025-10-02T09:35:43.544901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.544907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.544913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.544919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.544929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.544944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981144:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.544950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981376:5623], now have 1 active actors on pipe
2025-10-02T09:35:43.544961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.544966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.544976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.544977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.544978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.544985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.544993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.544999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.545000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.545001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.545007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.545008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.545010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.545014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.545016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.545017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.545021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.545027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.545040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.545048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.545053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.545054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.545139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.545144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.545152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.545193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2897 partition: 0 MaxSeqNo: 36 sessionId: src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0
2025-10-02T09:35:43.545454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6f9c20-4b56b0ed-87f995f8-6c40095d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.547807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Write session: try to update token
2025-10-02T09:35:43.547821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.553904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:43.553921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.553927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.553950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:43.553953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:43.554101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:43.554237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.554722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.555132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.555699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:43.555728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:43.562102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.562115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.562116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.562117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.562121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.562122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.562125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861406559:10852]
2025-10-02T09:35:43.562142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.562146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.562147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.562147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.562150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.562152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.562260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.562391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId: src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.564762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.621660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936981387:7823]
2025-10-02T09:35:43.621838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2896, pipe: [1:7556555767936981387:7823]
2025-10-02T09:35:43.669698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.670039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.670047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.670060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981387:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.670203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.670249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.670261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:43.670282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936981387:7823]
2025-10-02T09:35:43.670318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2897 reason: status is not ok: tablet will be restarted right now sessionId: src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0
2025-10-02T09:35:43.670455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2897 sessionId: src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0 is DEAD
2025-10-02T09:35:43.670562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:43.670571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Write session will restart in 0.008576s
2025-10-02T09:35:43.670591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Write session: Do CDS request
2025-10-02T09:35:43.670595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.680208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.680293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.680301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2898
2025-10-02T09:35:43.680424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.680445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.680451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.680454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.680703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2898 sessionId:  describe result for acl check
2025-10-02T09:35:43.680721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.680727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.680729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.680733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.681095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.681408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.682525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.682925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.683019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.683026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.683031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.683056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.683079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861406800:10854]
2025-10-02T09:35:43.683409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.683572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.683595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.683766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.683794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.683798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.683799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.683799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.683800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.683800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.683801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.683801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.683802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.683802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.683803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.683803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.683806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.683812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.683814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.683816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.683818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.683821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.683822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.683824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.683827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.683829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.683831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.683832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.683836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.683839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.683843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.683845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.683848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.683851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.683856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.683862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.683865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.683867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.683870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.683872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.683875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.683877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.683883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.683885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.683888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.683890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.683892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.683896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.683899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.683901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.683904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.683922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.687668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.687676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.687678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936981583:5629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.687681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.691292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.693133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.693146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.693147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.693151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2897 [2:7556555767861406800:10854]
2025-10-02T09:35:43.693159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.693169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.693172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.693174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.693175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.693184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.693188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.693192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.693223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.693228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.693229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.693231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.693233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.693268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.693273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.693279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.693284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.693295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.693307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981388:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.693312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981626:5629], now have 1 active actors on pipe
2025-10-02T09:35:43.693316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.693317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.693318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.693327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.693337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.693341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.693343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.693345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.693345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.693347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.693352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2897
2025-10-02T09:35:43.693351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2897
2025-10-02T09:35:43.693363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.693368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.693369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.693377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.693382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.693406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.693413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.693416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.693417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.693421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.693429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.693438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.693539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.693544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.693552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.693610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2898 partition: 0 MaxSeqNo: 36 sessionId: src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0
2025-10-02T09:35:43.693861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891e4c5b-a46ca34f-eade2842-762df3c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.696657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Write session: try to update token
2025-10-02T09:35:43.696669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.702564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.702582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.702583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.702585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.702589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.702592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.702594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861406794:10854]
2025-10-02T09:35:43.702623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.702627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.702628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.702631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.702634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.702636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.702751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.709099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId: src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.711212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.770662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936981633:7823]
2025-10-02T09:35:43.770825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2897, pipe: [1:7556555767936981633:7823]
2025-10-02T09:35:43.812020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.812233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.812242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.812254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981633:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.812372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.812400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.812423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936981633:7823]
2025-10-02T09:35:43.812433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:43.812484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0
2025-10-02T09:35:43.812613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2898 sessionId: src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0 is DEAD
2025-10-02T09:35:43.812764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:43.812778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Write session will restart in 0.008892s
2025-10-02T09:35:43.812820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Write session: Do CDS request
2025-10-02T09:35:43.812827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.823268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.823322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.823333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2899
2025-10-02T09:35:43.823487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.823507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.823511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.823513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.823499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.823788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2899 sessionId:  describe result for acl check
2025-10-02T09:35:43.823812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.823816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.823817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.823820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.824157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.825052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.825148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.825154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.825160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.825186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.825209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861407037:10856]
2025-10-02T09:35:43.825547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.825702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.825724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.825729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.825897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.825925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.825929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.825929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.825930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.825930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.825931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.825931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.825932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.825932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.825933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.825933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.825934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.825936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.825942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.825944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.825947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.825949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.825951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.825952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.825954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.825956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.825959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.825960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.825962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.825966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.825969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.825973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.825975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.825977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.825980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.825982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.825985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.825987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.825990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.825992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.825995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.825997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.826000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.826002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.826005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.826007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.826010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.826011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.826014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.826020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.826023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.826025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.826028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.826045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.829807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.829815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.829817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936981833:5639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.829820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.833452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.834905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.834917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.834918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.834920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.834923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2898 [2:7556555767861407037:10856]
2025-10-02T09:35:43.834930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.834939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.834945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.834946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.834947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.834955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.834959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.834963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.834999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.835003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.835004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.835006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.835008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.835042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.835047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.835053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.835059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.835066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.835079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981634:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.835085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981872:5639], now have 1 active actors on pipe
2025-10-02T09:35:43.835089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.835090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.835091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.835098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.835109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.835112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.835114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.835115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.835117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.835119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.835108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2898
2025-10-02T09:35:43.835133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.835138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.835112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2898
2025-10-02T09:35:43.835139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.835149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.835154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.835178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.835184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.835187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.835188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.835192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.835199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.835208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.835292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.835297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.835304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.835364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2899 partition: 0 MaxSeqNo: 36 sessionId: src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0
2025-10-02T09:35:43.835618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1368e435-7eb4dd58-a7f6a0bd-80550454_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.838137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Write session: try to update token
2025-10-02T09:35:43.838151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.844359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.844371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.844372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.844373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.844377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.844379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.844381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861407031:10856]
2025-10-02T09:35:43.844401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.844402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.844405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.844407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.844407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.844408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.844607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:43.850343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId: src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.852392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.912473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555767936981885:7823]
2025-10-02T09:35:43.912608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2898, pipe: [1:7556555767936981885:7823]
2025-10-02T09:35:43.954466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:43.954672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.954680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.954692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981885:7823], now have 1 active actors on pipe
2025-10-02T09:35:43.954806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:43.954886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:43.954892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:43.954924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555767936981885:7823]
2025-10-02T09:35:43.954949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2899 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0
2025-10-02T09:35:43.955124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2899 sessionId: src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0 is DEAD
2025-10-02T09:35:43.955263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:43.955280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Write session will restart in 0.007794s
2025-10-02T09:35:43.955305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Write session: Do CDS request
2025-10-02T09:35:43.955311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:43.964153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.964241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:43.964248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2900
2025-10-02T09:35:43.964345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:43.964366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:43.964372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:43.964375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:43.964641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2900 sessionId:  describe result for acl check
2025-10-02T09:35:43.964663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:43.964667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:43.964668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:43.964671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:43.965016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:43.966469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:43.966558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:43.968021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:43.968116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:43.968122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:43.968128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:43.968153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:43.968175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555767861407275:10858]
2025-10-02T09:35:43.968185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:43.968192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:43.968193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555767936982042:5647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:43.968197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:43.968512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:43.968671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:43.968692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:43.968880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:43.968910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.968914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.968915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.968915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.968916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.968916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.968917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.968917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.968918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.968918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.968919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.968919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.968928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.968930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.968932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.968934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.968936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.968938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.968940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.968941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.968943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.968945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.968947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.968950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.968954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:43.968958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.968961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:43.968963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.968966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:43.968968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.968971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:43.968973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.968976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:43.968978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.968981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:43.968983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.968985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:43.968987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.968990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:43.968992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.968995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:43.968997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.969000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.969003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.969005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.969007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.969010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.969026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:43.976378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:43.977926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:43.977940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:43.977941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:43.977942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:43.977946Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2899 [2:7556555767861407275:10858]
2025-10-02T09:35:43.977952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:43.977961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:43.977963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.977964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.977965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.977974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:43.977978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:43.977986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:43.978015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.978020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.978020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.978022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:43.978024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:43.978117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2899
2025-10-02T09:35:43.978129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2899
2025-10-02T09:35:43.978151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:43.978157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.978163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:43.978168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:43.978177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:43.978192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936981891:2446], now have 1 active actors on pipe
2025-10-02T09:35:43.978197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555767936982123:5647], now have 1 active actors on pipe
2025-10-02T09:35:43.978208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.978213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.978223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.978227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.978228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.978235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:43.978245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:43.978249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:43.978251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:43.978252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:43.978255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:43.978256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:43.978265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2684821-978bda27-a8f61479-9c19aec4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:43.978271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:43.978273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:43.978274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:43.978279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:43.978285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:43.978300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.978307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:43.978313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.978315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:43.978398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.978403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.978412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:43.978476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2900 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2684821-978bda27-a8f61479-9c19aec4_0
2025-10-02T09:35:43.978752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e05b9e-e44144f3-96cd893d-c236b47c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2684821-978bda27-a8f61479-9c19aec4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:43.981086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Write session: try to update token
2025-10-02T09:35:43.981099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:43.987109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:43.987122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.987126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.987145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:43.987160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:43.987278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:43.987388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.987497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.987607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:43.987761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:43.987781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:43.992919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId: src_id|e2684821-978bda27-a8f61479-9c19aec4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:43.994900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:43.996136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:43.996152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:43.996162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:43.996163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:43.996164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:43.996165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:43.996169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.996171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.996173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555767861407269:10858]
2025-10-02T09:35:43.996196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:43.996196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:43.996199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:43.996201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:43.996202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:43.996204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:43.996303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.054807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231949434:7823]
2025-10-02T09:35:44.054934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2899, pipe: [1:7556555772231949434:7823]
2025-10-02T09:35:44.104422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.104619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:44.104639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949434:7823], now have 1 active actors on pipe
2025-10-02T09:35:44.104709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:44.104780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231949434:7823]
2025-10-02T09:35:44.104812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.116161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.116169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.116186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2900 reason: error at write: Disconnected sessionId: src_id|e2684821-978bda27-a8f61479-9c19aec4_0
2025-10-02T09:35:44.116294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2900 sessionId: src_id|e2684821-978bda27-a8f61479-9c19aec4_0 is DEAD
2025-10-02T09:35:44.116465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.116479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Write session will restart in 0.006067s
2025-10-02T09:35:44.116502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Write session: Do CDS request
2025-10-02T09:35:44.116508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.119113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.120787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.120974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.120984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.120991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.121024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.121047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156374812:10861]
2025-10-02T09:35:44.121388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.121550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.121572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.121748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.121777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.121781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.121782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.121782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.121783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.121783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.121784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.121784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.121786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.121786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.121789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.121796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.121798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.121800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.121802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.121804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.121806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.121808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.121810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.121812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.121814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.121816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.121820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.121823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.121827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.121830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.121832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.121835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.121837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.121840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.121842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.121845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.121847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.121849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.121852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.121854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.121856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.121859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.121861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.121863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.121865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.121868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.121870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.121873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.121876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.121878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.121894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.123199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.123252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.123260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2901
2025-10-02T09:35:44.123405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.123423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.123429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.123432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.123674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2901 sessionId:  describe result for acl check
2025-10-02T09:35:44.123695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.123720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.123725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.123728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.124055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.125534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.128691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.128698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.128699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231949642:5658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.128703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.129277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.130894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.130906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.130907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.130909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.130912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2900 [2:7556555772156374812:10861]
2025-10-02T09:35:44.130918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.130927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.130929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.130931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.130932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.130940Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.130946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.130950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.130983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.130987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.130988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.130990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.130991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.131029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.131034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.131040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.131045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.131053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.131066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949435:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.131071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949676:5658], now have 1 active actors on pipe
2025-10-02T09:35:44.131075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.131080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.131081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.131089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.131099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.131102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.131105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.131106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.131109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.131107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2900
2025-10-02T09:35:44.131110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.131110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2900
2025-10-02T09:35:44.131123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.131125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.131127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.131140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.131145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.131161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.131168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.131171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.131172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.131177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.131182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.131190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.131263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.131269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.131276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.131326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2901 partition: 0 MaxSeqNo: 36 sessionId: src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0
2025-10-02T09:35:44.131531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2684821-978bda27-a8f61479-9c19aec4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.133872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Write session: try to update token
2025-10-02T09:35:44.133887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.140224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.140239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.140240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.140242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.140245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.140247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.140249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156374807:10861]
2025-10-02T09:35:44.140267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.140270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.140271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.140273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.140284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.140288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.140414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.146649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId: src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.148650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.204831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231949684:7823]
2025-10-02T09:35:44.204981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2900, pipe: [1:7556555772231949684:7823]
2025-10-02T09:35:44.249791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.250155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.250164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.250176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949684:7823], now have 1 active actors on pipe
2025-10-02T09:35:44.250294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:44.250327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231949684:7823]
2025-10-02T09:35:44.250327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.250349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:44.250355Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:35:44.250396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2901 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0
2025-10-02T09:35:44.250439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2901 sessionId: src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0 is DEAD
2025-10-02T09:35:44.250500Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 is DEAD
2025-10-02T09:35:44.250597Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555712102387025:8406] disconnected; active server actors: 1
2025-10-02T09:35:44.250604Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555712102387025:8406] client user disconnected session shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:44.250656Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:35:44.250679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:44.250685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Write session will restart in 0.009263s
2025-10-02T09:35:44.250699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Write session: Do CDS request
2025-10-02T09:35:44.250703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.250775Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:44.250779Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:44.250802Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007693s
2025-10-02T09:35:44.259147Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:35:44.259373Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:35:44.259379Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 30
2025-10-02T09:35:44.259513Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 30 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:44.259547Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:44.259612Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 auth for : user
2025-10-02T09:35:44.259769Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 Handle describe topics response
2025-10-02T09:35:44.259787Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 auth is DEAD
2025-10-02T09:35:44.259788Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:35:44.259949Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:35:44.260060Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:44.260082Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555772231949846:5679] connected; active server actors: 1
2025-10-02T09:35:44.260121Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555772231949846:5679] session shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:44.260130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:35:44.260134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:35:44.260137Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_30_7150361532801312499_v1" (Sender=[1:7556555772231949818:5679], Pipe=[1:7556555772231949846:5679], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:44.260140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:35:44.260148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:35:44.260155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_30_7150361532801312499_v1" (Sender=[1:7556555772231949818:5679], Pipe=[1:7556555772231949846:5679], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:44.260164Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_30_7150361532801312499_v1" sender [1:7556555772231949818:5679] lock partition 0 for ReadingSession "shared/user_1_30_7150361532801312499_v1" (Sender=[1:7556555772231949818:5679], Pipe=[1:7556555772231949846:5679], Partitions=[], ActiveFamilyCount=1) generation 1 step 30
2025-10-02T09:35:44.260175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:35:44.260180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-02T09:35:44.260324Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 30 Session: "shared/user_1_30_7150361532801312499_v1" ClientId: "user" PipeClient { RawX1: 7556555772231949846 RawX2: 4503603922343471 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:35:44.260338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:35:44.261123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.261180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.261186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2902
2025-10-02T09:35:44.261252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.261267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.261272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.261275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.261453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2902 sessionId:  describe result for acl check
2025-10-02T09:35:44.261468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.261472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.261472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.261475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.261732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.261791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.263099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.263369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.263480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.263487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.263493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.263523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.263548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156375065:10864]
2025-10-02T09:35:44.263884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.264046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.264068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.264239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.264268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.264272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.264272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.264273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.264273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.264274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.264274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.264275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.264275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.264276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.264276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.264277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.264279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.264285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.264287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.264289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.264291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.264293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.264295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.264297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.264298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.264301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.264302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.264304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.264308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.264312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.264315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.264318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.264320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.264322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.264329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.264332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.264334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.264336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.264338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.264341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.264346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.264349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.264352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.264355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.264357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.264359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.264363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.264366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.264368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.264370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.264372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.264374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.264391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.268132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.268139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.268141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231949905:5670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.268145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.271793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.273365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.273376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.273377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.273379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.273382Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2901 [2:7556555772156375065:10864]
2025-10-02T09:35:44.273389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.273398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.273403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.273404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.273406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.273414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.273417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.273420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.273452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.273460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.273461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.273464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.273466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.273510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.273515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.273522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.273527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.273538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.273551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949870:5673], now have 1 active actors on pipe
2025-10-02T09:35:44.273557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949945:5670], now have 1 active actors on pipe
2025-10-02T09:35:44.273559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949697:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.273563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.273564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.273565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.273573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.273583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.273587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.273586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2901
2025-10-02T09:35:44.273591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.273592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.273590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2901, pipe: [1:7556555772231949870:5673]
2025-10-02T09:35:44.273595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.273603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2901
2025-10-02T09:35:44.273596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.273605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.273607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.273609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.273621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.273626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.273632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_30_7150361532801312499_v1 on pipe: [1:7556555772231949870:5673]
2025-10-02T09:35:44.273648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.273653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.273662Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_30_7150361532801312499_v1:1 with generation 2901
2025-10-02T09:35:44.273663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.273666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.273667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.273675Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:44.273676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.273693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.273700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:35:44.273707Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:35:44.277002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:35:44.277014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:35:44.277018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.277020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.277021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.277025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.277031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.277033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:35:44.277038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:35:44.277049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.277107Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397744273 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:35:44.277117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:35:44.277131Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 sending to client partition status
2025-10-02T09:35:44.277154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.277159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.277166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.277211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2902 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0
2025-10-02T09:35:44.277372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1770c3f-59fbdee8-8eb1893d-44370d41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.280134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Write session: try to update token
2025-10-02T09:35:44.280144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.282582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.282596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.282597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.282598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.282602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.282612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.282614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156375059:10864]
2025-10-02T09:35:44.282634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.282641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.282642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.282644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.282647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.282649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.282775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.292323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId: src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.294400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.393192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.393567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.393578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.393722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:44.393735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:44.393757Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:44.393738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231949870:5673]
2025-10-02T09:35:44.393744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.393748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.393758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.393804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2902 reason: error at write: Disconnected sessionId: src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0
2025-10-02T09:35:44.394069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2902 sessionId: src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0 is DEAD
2025-10-02T09:35:44.394197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.394209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Write session will restart in 0.005924s
2025-10-02T09:35:44.394227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Write session: Do CDS request
2025-10-02T09:35:44.394231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.401268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.401352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.401360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2903
2025-10-02T09:35:44.401436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.401455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.401461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.401464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.401724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2903 sessionId:  describe result for acl check
2025-10-02T09:35:44.401749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.401753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.401754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.401757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.402102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.404182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.405788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.405906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.405914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.405915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231950028:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.405919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.407355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.407455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.407462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.407468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.407494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.407518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156375311:10867]
2025-10-02T09:35:44.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.408153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.408412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.408448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.408453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.408453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.408454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.408455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.408455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.408456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.408457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.408458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.408458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.408461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.408461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.408466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.408474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.408476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.408478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.408480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.408483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.408485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.408487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.408489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.408491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.408494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.408496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.408500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.408505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.408508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.408511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.408513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.408516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.408518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.408521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.408524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.408526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.408532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.408535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.408538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.408541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.408543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.408546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.408551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.408554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.408557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.408560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.408563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.408567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.408569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.408572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.408589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.416056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.417839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.417854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.417855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.417857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.417860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2902 [2:7556555772156375311:10867]
2025-10-02T09:35:44.417868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.417878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.417884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.417885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.417887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.417896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.417901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.417905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.417997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.418002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.418003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.418004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.418006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.418044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.418049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.418056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.418062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.418074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.418088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950193:5692], now have 1 active actors on pipe
2025-10-02T09:35:44.418093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231949956:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.418097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.418098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.418099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.418108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.418119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.418120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.418122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.418123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.418131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.418133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.418121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2902
2025-10-02T09:35:44.418123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2902
2025-10-02T09:35:44.418149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.418154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.418155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.418167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.418172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.418197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.418204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.418206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.418208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.418213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.418222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.418234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.418316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.418321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.418329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.418383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2903 partition: 0 MaxSeqNo: 36 sessionId: src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0
2025-10-02T09:35:44.418575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fe81cf-eea676cd-ce46251d-6b7ecf26_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.421332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Write session: try to update token
2025-10-02T09:35:44.421346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.427481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.427496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.427497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.427498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.427502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.427505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.427507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156375305:10867]
2025-10-02T09:35:44.427528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.427535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.427537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.427538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.427539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.427541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.427693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.434838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId: src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.436912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.494101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231950227:5673]
2025-10-02T09:35:44.494247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2902, pipe: [1:7556555772231950227:5673]
2025-10-02T09:35:44.538244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.538445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.538453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.538466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950227:5673], now have 1 active actors on pipe
2025-10-02T09:35:44.538580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:44.538620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.538627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.538640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.538668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2903 reason: error at write: Disconnected sessionId: src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0
2025-10-02T09:35:44.538669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231950227:5673]
2025-10-02T09:35:44.538799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2903 sessionId: src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0 is DEAD
2025-10-02T09:35:44.538994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.539009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Write session will restart in 0.008696s
2025-10-02T09:35:44.539032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Write session: Do CDS request
2025-10-02T09:35:44.539036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.549210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.549242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.549253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2904
2025-10-02T09:35:44.549430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.549450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.549455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.549459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.549739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2904 sessionId:  describe result for acl check
2025-10-02T09:35:44.549762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.549766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.549767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.549770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.550134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.550808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.551445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.552590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.552685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.552691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.552697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.552723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.552749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156375586:10881]
2025-10-02T09:35:44.553104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.553274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.553298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.553343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.553351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.553353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231950421:5708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.553356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.553474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.553503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.553507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.553508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.553508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.553509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.553510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.553510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.553511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.553511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.553512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.553512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.553513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.553516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.553522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.553524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.553526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.553528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.553530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.553532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.553534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.553536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.553539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.553540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.553543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.553546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.553550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.553553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.553556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.553559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.553561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.553563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.553566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.553569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.553571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.553573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.553576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.553578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.553581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.553587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.553590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.553592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.553595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.553597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.553599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.553603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.553608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.553610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.553613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.553631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.561194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.562796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.562807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.562808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.562810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.562813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2903 [2:7556555772156375586:10881]
2025-10-02T09:35:44.562820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.562830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.562832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.562833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.562834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.562843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.562845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.562853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.562884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.562890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.562891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.562892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.562893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.562929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.562934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.562940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.562945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.562957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.562970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.562975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.562976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.562983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.562991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.562993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.562997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.562999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.563001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.563003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.563011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950229:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.563016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950470:5708], now have 1 active actors on pipe
2025-10-02T09:35:44.563031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.563039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.563035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2903
2025-10-02T09:35:44.563042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2903
2025-10-02T09:35:44.563052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.563081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.563086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.563100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.563106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.563109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.563111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.563117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.563125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.563135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.563270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.563275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.563282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.563340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2904 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0
2025-10-02T09:35:44.563534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93bb1a9-f61a8197-8bc79a3a-6f5fba0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.566368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Write session: try to update token
2025-10-02T09:35:44.566377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.576557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:44.576575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.576581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.576608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:44.576613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:44.576754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:44.576888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:44.577065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:44.577214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:44.577382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:44.577420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:44.578177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId: src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.580180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.580450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.580466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.580476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.580481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.580483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.580484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.580487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.580489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.580492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156375581:10881]
2025-10-02T09:35:44.580510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.580517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.580520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.580520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.580521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.580522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.580628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.639007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231950479:5673]
2025-10-02T09:35:44.639163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2903, pipe: [1:7556555772231950479:5673]
2025-10-02T09:35:44.688889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.689183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:44.689210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950479:5673], now have 1 active actors on pipe
2025-10-02T09:35:44.689294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:44.689379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231950479:5673]
2025-10-02T09:35:44.689402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.699371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.699379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.699395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2904 reason: error at write: Disconnected sessionId: src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0
2025-10-02T09:35:44.699504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2904 sessionId: src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0 is DEAD
2025-10-02T09:35:44.699599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.699609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Write session will restart in 0.007492s
2025-10-02T09:35:44.699622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Write session: Do CDS request
2025-10-02T09:35:44.699629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.703611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.705153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.705289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.705297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.705303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.705335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.705357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156375829:10883]
2025-10-02T09:35:44.705967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.706135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.706159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.706433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.706463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.706467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.706467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.706468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.706469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.706469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.706470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.706470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.706471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.706471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.706472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.706473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.706475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.706482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.706485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.706487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.706489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.706491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.706493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.706495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.706497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.706499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.706501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.706503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.706508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.706512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.706516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.706519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.706521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.706523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.706526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.706528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.706531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.706534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.706536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.706539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.706541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.706544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.706550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.706553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.706555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.706558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.706560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.706562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.706568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.706570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.706573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.706575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.706596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.708311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.708472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.708480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2905
2025-10-02T09:35:44.708589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.708607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.708613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.708616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.708895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2905 sessionId:  describe result for acl check
2025-10-02T09:35:44.708917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.708918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.708919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.708922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.709271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.710619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.713364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.713372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.713374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231950691:5710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.713377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.713992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.715511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.715523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.715525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.715526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.715530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2904 [2:7556555772156375829:10883]
2025-10-02T09:35:44.715537Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.715546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.715548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.715549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.715550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.715560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.715562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.715567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.715596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.715602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.715603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.715605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.715606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.715643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.715647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.715654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.715659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.715671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.715684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950725:5710], now have 1 active actors on pipe
2025-10-02T09:35:44.715689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950481:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.715693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.715694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.715695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.715702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.715714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.715714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.715716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.715714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2904
2025-10-02T09:35:44.715717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2904
2025-10-02T09:35:44.715717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.715724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.715726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.715740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.715745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.715746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.715756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.715761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.715835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a09557a-340b53e5-346c91aa-91347b71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.715843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.715845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.715846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.715851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.715855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.715867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.715945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.715949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.715957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.716010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2905 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a09557a-340b53e5-346c91aa-91347b71_0
2025-10-02T09:35:44.716220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ee2cf-1a4cc03d-6651fcfc-d528027d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a09557a-340b53e5-346c91aa-91347b71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.718841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Write session: try to update token
2025-10-02T09:35:44.718862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.724855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.724867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.724869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.724870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.724875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.724877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.724879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156375824:10883]
2025-10-02T09:35:44.724898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.724901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.724903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.724904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.724905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.724907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.725026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.731447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId: src_id|9a09557a-340b53e5-346c91aa-91347b71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.733478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.789529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231950732:5673]
2025-10-02T09:35:44.789689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2904, pipe: [1:7556555772231950732:5673]
2025-10-02T09:35:44.834232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.834487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.834496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.834508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950732:5673], now have 1 active actors on pipe
2025-10-02T09:35:44.834647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:44.834642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231950732:5673]
2025-10-02T09:35:44.834657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.834659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.834659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.834710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2905 reason: error at write: Disconnected sessionId: src_id|9a09557a-340b53e5-346c91aa-91347b71_0
2025-10-02T09:35:44.834843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2905 sessionId: src_id|9a09557a-340b53e5-346c91aa-91347b71_0 is DEAD
2025-10-02T09:35:44.835017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.835036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Write session will restart in 0.005652s
2025-10-02T09:35:44.835060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Write session: Do CDS request
2025-10-02T09:35:44.835065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.842128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.842227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.842235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2906
2025-10-02T09:35:44.842330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.842349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.842356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.842359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.842679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2906 sessionId:  describe result for acl check
2025-10-02T09:35:44.842697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.842702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.842703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.842707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.843054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.844973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.846568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.846726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.846735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.846737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231950812:5745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.846740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:44.848153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.848257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.848264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.848269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.848297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.848319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156376074:10885]
2025-10-02T09:35:44.848933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.849092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.849115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.849386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.849420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.849425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.849426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.849426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.849427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.849428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.849428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.849429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.849429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.849430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.849433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.849439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.849441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.849444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.849446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.849448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.849450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.849452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.849454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.849456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.849458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.849460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.849465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.849469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.849472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.849475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.849477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.849480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.849482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.849485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.849488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.849491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.849496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.849499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.849501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.849504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.849507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.849510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.849520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.849526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.849528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.849531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.849533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.849539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.849541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.849544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.849564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.856984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:44.858538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:44.858551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:44.858552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:44.858554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:44.858557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2905 [2:7556555772156376074:10885]
2025-10-02T09:35:44.858565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:44.858574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:44.858580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.858582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.858583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.858592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:44.858594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:44.858598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:44.858637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.858642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.858643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.858646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:44.858647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:44.858689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:44.858694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.858701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.858706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.858718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:44.858732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950735:2446], now have 1 active actors on pipe
2025-10-02T09:35:44.858738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950976:5745], now have 1 active actors on pipe
2025-10-02T09:35:44.858742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.858747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.858748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.858756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:44.858758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2905
2025-10-02T09:35:44.858768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:44.858771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:44.858777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:44.858773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2905
2025-10-02T09:35:44.858778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:44.858778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:44.858780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:44.858803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.858809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.858816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.858823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:44.858832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:44.858844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b662d436-a0deb59-33297fd2-d764a87c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:44.858851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:44.858853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:44.858854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:44.858860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:44.858869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:44.858883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.858966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.858971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.858978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:44.859031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2906 partition: 0 MaxSeqNo: 36 sessionId: src_id|b662d436-a0deb59-33297fd2-d764a87c_0
2025-10-02T09:35:44.859293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a09557a-340b53e5-346c91aa-91347b71_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b662d436-a0deb59-33297fd2-d764a87c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:44.861705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Write session: try to update token
2025-10-02T09:35:44.861720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:44.867921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:44.867933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:44.867934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:44.867935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:44.867939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.867944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.867945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156376068:10885]
2025-10-02T09:35:44.867965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:44.867966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:44.867968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:44.867970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:44.867971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.867972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:44.868083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:44.873487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId: src_id|b662d436-a0deb59-33297fd2-d764a87c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:44.875523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:44.934940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555772231950995:5673]
2025-10-02T09:35:44.935091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2905, pipe: [1:7556555772231950995:5673]
2025-10-02T09:35:44.979079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:44.979400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:44.979410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:44.979422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950995:5673], now have 1 active actors on pipe
2025-10-02T09:35:44.979550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555772231950995:5673]
2025-10-02T09:35:44.979560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:44.979571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:44.979573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:44.979617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2906 reason: error at write: Disconnected sessionId: src_id|b662d436-a0deb59-33297fd2-d764a87c_0
2025-10-02T09:35:44.979749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2906 sessionId: src_id|b662d436-a0deb59-33297fd2-d764a87c_0 is DEAD
2025-10-02T09:35:44.979905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:44.979918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Write session will restart in 0.008894s
2025-10-02T09:35:44.979941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Write session: Do CDS request
2025-10-02T09:35:44.979950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:44.980188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:44.990173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.990230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:44.990238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2907
2025-10-02T09:35:44.990350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:44.990368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:44.990374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:44.990376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:44.990659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2907 sessionId:  describe result for acl check
2025-10-02T09:35:44.990685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:44.990690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:44.990692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:44.990696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:44.991043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:44.991078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:44.992598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:44.992638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:44.992746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:44.992756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:44.992766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:44.992825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:44.992852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555772156376318:10887]
2025-10-02T09:35:44.993191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:44.993354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:44.993377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:44.993553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:44.993582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.993586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.993587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.993587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.993588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.993588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.993589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.993589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.993590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.993591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.993591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.993592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.993595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.993601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.993603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.993605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.993607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.993609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.993610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.993612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.993614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.993616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.993618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.993620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.993623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.993627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:44.993630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.993633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:44.993635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.993638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:44.993640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.993643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:44.993645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.993647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:44.993649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.993652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:44.993654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.993656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:44.993658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.993661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:44.993665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.993668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:44.993670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.993673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:44.993675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.993677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:44.993679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.993682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:44.993698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:44.995523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:44.995532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:44.995534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555772231951204:5740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:44.995537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.001117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.002767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.002779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.002780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.002782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.002786Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2906 [2:7556555772156376318:10887]
2025-10-02T09:35:45.002793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.002803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.002809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.002810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.002812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.002821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.002824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.002828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.002857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.002862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.002863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.002864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.002866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.002904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.002910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.002916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.002921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.002929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.002945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231951245:5740], now have 1 active actors on pipe
2025-10-02T09:35:45.002950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555772231950999:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.002954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.002956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.002957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.002965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.002975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.002977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.002980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.002981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.002986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.002988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.003002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.002975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2906
2025-10-02T09:35:45.003007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.002989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2906
2025-10-02T09:35:45.003008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.003017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.003019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.003043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.003050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.003052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.003054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.003058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.003067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.003080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.003182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.003186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.003194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.003246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2907 partition: 0 MaxSeqNo: 36 sessionId: src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0
2025-10-02T09:35:45.003514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b662d436-a0deb59-33297fd2-d764a87c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.006014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Write session: try to update token
2025-10-02T09:35:45.006031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.012840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.012860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.012863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.012864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.012872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.012878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.012882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555772156376312:10887]
2025-10-02T09:35:45.012910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.012911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.012916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.012917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.012921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.012923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.013047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.019212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId: src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.021332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.079835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526918549:5673]
2025-10-02T09:35:45.079995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2906, pipe: [1:7556555776526918549:5673]
2025-10-02T09:35:45.125858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.126195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.126204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.126216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526918549:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.126422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:45.126423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526918549:5673]
2025-10-02T09:35:45.126433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:45.126438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.126477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2907 reason: error at write: Disconnected sessionId: src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0
2025-10-02T09:35:45.126500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.126608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2907 sessionId: src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0 is DEAD
2025-10-02T09:35:45.126783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:45.126797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Write session will restart in 0.006010s
2025-10-02T09:35:45.126820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Write session: Do CDS request
2025-10-02T09:35:45.126825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.134180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.134258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.134264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2908
2025-10-02T09:35:45.134363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.134383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.134388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.134391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.134680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2908 sessionId:  describe result for acl check
2025-10-02T09:35:45.134705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.134710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.134711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.134714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.135062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.136951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.138480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.140113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.140210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.140217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.140222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.140222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.140230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.140232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526918628:5746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.140236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.140247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.140300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451343874:10890]
2025-10-02T09:35:45.140636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.140797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.140832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.141007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.141036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.141040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.141040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.141041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.141042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.141042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.141043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.141043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.141044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.141045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.141045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.141046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.141048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.141063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.141065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.141067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.141069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.141071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.141073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.141075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.141077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.141079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.141081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.141087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.141090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.141095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.141101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.141104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.141106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.141109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.141114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.141117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.141119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.141122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.141124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.141129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.141132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.141134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.141137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.141143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.141145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.141148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.141154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.141157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.141159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.141161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.141166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.141169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.141186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.148684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.150305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.150315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.150316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.150318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.150321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2907 [2:7556555776451343874:10890]
2025-10-02T09:35:45.150328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.150338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.150339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.150341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.150342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.150350Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.150357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.150360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.150394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.150399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.150400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.150402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.150403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.150438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.150443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.150450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.150456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.150464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.150477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526918793:5746], now have 1 active actors on pipe
2025-10-02T09:35:45.150482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526918550:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.150486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.150487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.150488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.150495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.150505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.150515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.150520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.150514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2907
2025-10-02T09:35:45.150537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2907
2025-10-02T09:35:45.150530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.150535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.150536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.150537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.150538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.150542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.150654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.150660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.150674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.150682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.150684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.150685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.150689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.150696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.150703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.151115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.151120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.151128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.151188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2908 partition: 0 MaxSeqNo: 36 sessionId: src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0
2025-10-02T09:35:45.151445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eff8f8f-c0634851-3af9fe8e-4218773f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.153799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Write session: try to update token
2025-10-02T09:35:45.153815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.159789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.159798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.159799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.159800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.159804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.159807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.159809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451343869:10890]
2025-10-02T09:35:45.159830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.159835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.159836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.159837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.159838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.159840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.159965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.166068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId: src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.168159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.226783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526918817:5673]
2025-10-02T09:35:45.226912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2907, pipe: [1:7556555776526918817:5673]
2025-10-02T09:35:45.272657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.272920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.272928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.272941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526918817:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.273141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.273163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:45.273166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:45.273178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526918817:5673]
2025-10-02T09:35:45.273217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2908 reason: error at write: Disconnected sessionId: src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0
2025-10-02T09:35:45.273248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.273360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2908 sessionId: src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0 is DEAD
2025-10-02T09:35:45.273523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:45.273537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Write session will restart in 0.008524s
2025-10-02T09:35:45.273562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Write session: Do CDS request
2025-10-02T09:35:45.273568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.283168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.283307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.283314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2909
2025-10-02T09:35:45.283448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.283470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.283476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.283479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.283762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2909 sessionId:  describe result for acl check
2025-10-02T09:35:45.283783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.283788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.283788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.283791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.284141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.285174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.285568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.286776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.286873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.286879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.286885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.286911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.286932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451344121:10893]
2025-10-02T09:35:45.287317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.287492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.287518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.287547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.287555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.287558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526919003:5750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.287561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.287693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.287722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.287726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.287726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.287727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.287727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.287728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.287729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.287729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.287730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.287730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.287731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.287731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.287734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.287740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.287742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.287744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.287746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.287748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.287750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.287752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.287754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.287756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.287758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.287760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.287764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.287768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.287771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.287774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.287776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.287779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.287781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.287784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.287786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.287789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.287791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.287794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.287796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.287799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.287801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.287804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.287806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.287808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.287811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.287813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.287815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.287818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.287822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.287826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.287842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.295254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.296772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.296782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.296784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.296786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.296790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2908 [2:7556555776451344121:10893]
2025-10-02T09:35:45.296796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.296820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.296821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.296823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.296824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.296833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.296837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.296841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.296872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.296878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.296879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.296881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.296882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.296996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2908
2025-10-02T09:35:45.297004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2908
2025-10-02T09:35:45.297050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.297056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.297063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.297070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.297083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.297098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919064:5750], now have 1 active actors on pipe
2025-10-02T09:35:45.297104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526918818:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.297112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.297117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.297128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.297133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.297134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.297142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.297153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.297155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.297156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.297157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.297164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.297166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.297174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.297181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.297183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.297184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.297189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.297197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.297214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.297222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.297230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.297231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.297313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.297318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.297326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.297378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2909 partition: 0 MaxSeqNo: 36 sessionId: src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0
2025-10-02T09:35:45.297643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be1e9bbd-5cce3d8c-f1e4a714-297003a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.299978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Write session: try to update token
2025-10-02T09:35:45.299993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.306368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:45.306378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.306384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.306408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:45.306410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:45.306580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:45.306718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:45.306887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:45.307004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:45.307165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:45.307199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:45.312586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId: src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.314781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.314792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.314794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.314793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.314795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.314799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.314801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.314803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451344116:10893]
2025-10-02T09:35:45.314822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.314824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.314826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.314827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.314827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.314829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.314945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.373212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526919076:5673]
2025-10-02T09:35:45.373383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2908, pipe: [1:7556555776526919076:5673]
2025-10-02T09:35:45.424766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.425226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.425236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.425249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919076:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.425371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.425408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526919076:5673]
2025-10-02T09:35:45.425429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.425438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:45.425486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2909 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0
2025-10-02T09:35:45.425614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2909 sessionId: src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0 is DEAD
2025-10-02T09:35:45.425738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:45.425747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Write session will restart in 0.007125s
2025-10-02T09:35:45.425762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Write session: Do CDS request
2025-10-02T09:35:45.425766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.434204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.434293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.434301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2910
2025-10-02T09:35:45.434411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.434430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.434436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.434439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.434710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2910 sessionId:  describe result for acl check
2025-10-02T09:35:45.434734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.434739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.434740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.434742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.435084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.436952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.438670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.438680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.438682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526919180:5767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.438685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.438736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.440325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.440424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.440430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.440436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.440462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.440486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451344372:10896]
2025-10-02T09:35:45.441119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.441292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.441316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.441592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.441622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.441626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.441626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.441627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.441627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.441628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.441628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.441629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.441629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.441630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.441630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.441631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.441634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.441639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.441642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.441644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.441646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.441648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.441650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.441652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.441654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.441656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.441658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.441660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.441664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.441668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.441671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.441674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.441676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.441679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.441681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.441683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.441686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.441688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.441690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.441693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.441695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.441698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.441700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.441702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.441704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.441706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.441709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.441711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.441713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.441716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.441718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.441720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.441737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.449110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.450574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.450585Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.450586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.450588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.450590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2909 [2:7556555776451344372:10896]
2025-10-02T09:35:45.450597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.450608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.450622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.450628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.450630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.450641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.450649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.450654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.450698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.450704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.450705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.450708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.450709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.450751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.450758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.450769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.450783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.450797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.450810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919321:5767], now have 1 active actors on pipe
2025-10-02T09:35:45.450816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919077:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.450820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.450821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.450822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.450830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.450819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2909
2025-10-02T09:35:45.450829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2909
2025-10-02T09:35:45.450841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.450843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.450845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.450846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.450852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.450853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.450877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.450882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.450889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.450896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.450904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.450915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.450922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.450924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.450925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.450930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.450938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.450953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.451043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.451048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.451055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.451113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2910 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0
2025-10-02T09:35:45.451359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c79b8e-d8de6cc0-72982ee3-5a1269ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.453716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Write session: try to update token
2025-10-02T09:35:45.453730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.460011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.460021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.460023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.460023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.460028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.460030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.460032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451344366:10896]
2025-10-02T09:35:45.460052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.460056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.460056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.460058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.460059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.460061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.460191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.465918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId: src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.468076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.525777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526919356:5673]
2025-10-02T09:35:45.525955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2909, pipe: [1:7556555776526919356:5673]
2025-10-02T09:35:45.571662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.571878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.571887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.571898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919356:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.572051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.572069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.572074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526919356:5673]
2025-10-02T09:35:45.572090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:45.572141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2910 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0
2025-10-02T09:35:45.572276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2910 sessionId: src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0 is DEAD
2025-10-02T09:35:45.572413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:45.572421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Write session will restart in 0.007546s
2025-10-02T09:35:45.572439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Write session: Do CDS request
2025-10-02T09:35:45.572443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.581202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.581288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.581297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2911
2025-10-02T09:35:45.581412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.581433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.581439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.581442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.581733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2911 sessionId:  describe result for acl check
2025-10-02T09:35:45.581756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.581760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.581761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.581764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.582104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.583877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.584241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.585865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.585965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.585973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.585978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.586006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.586036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451344656:10910]
2025-10-02T09:35:45.586178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.586185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.586187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526919491:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.586190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.586384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.586572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.586595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.586785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.586814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.586818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.586819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.586820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.586820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.586821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.586821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.586822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.586822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.586823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.586823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.586824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.586827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.586832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.586835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.586837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.586839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.586841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.586843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.586844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.586846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.586848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.586850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.586852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.586856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.586860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.586863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.586866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.586868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.586871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.586873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.586876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.586878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.586880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.586882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.586885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.586887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.586890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.586892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.586895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.586897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.586900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.586902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.586905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.586907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.586909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.586912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.586915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.586932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.594473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.595939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.595949Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.595951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.595953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.595956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2910 [2:7556555776451344656:10910]
2025-10-02T09:35:45.595963Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.595972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.595977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.595979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.595980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.595989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.595994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.595999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.596027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.596031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.596032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.596034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.596036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.596078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.596083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.596090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.596095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.596103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.596117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919603:5788], now have 1 active actors on pipe
2025-10-02T09:35:45.596122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919357:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.596126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.596127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.596128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.596136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.596146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.596149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.596151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.596152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.596140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2910
2025-10-02T09:35:45.596156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.596158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.596146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2910
2025-10-02T09:35:45.596175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.596181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.596182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.596260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.596266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.596291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.596298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.596300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.596301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.596307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.596315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.596328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.596413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.596418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.596425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.596479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2911 partition: 0 MaxSeqNo: 36 sessionId: src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0
2025-10-02T09:35:45.596686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8adaeb4-2dd7b8ad-298417e0-9b5456_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.599515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Write session: try to update token
2025-10-02T09:35:45.599526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.605383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.605395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.605396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.605397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.605401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.605404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.605406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451344651:10910]
2025-10-02T09:35:45.605427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.605430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.605431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.605434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.605438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.605440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.605565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.612467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId: src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.614636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.672228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526919614:5673]
2025-10-02T09:35:45.672404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2910, pipe: [1:7556555776526919614:5673]
2025-10-02T09:35:45.717890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.718370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.718379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.718392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919614:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.718540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.718559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:45.718569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:45.718575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.718606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526919614:5673]
2025-10-02T09:35:45.718621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2911 reason: error at write: Disconnected sessionId: src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0
2025-10-02T09:35:45.718759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2911 sessionId: src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0 is DEAD
2025-10-02T09:35:45.718908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:45.718917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Write session will restart in 0.007150s
2025-10-02T09:35:45.718934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Write session: Do CDS request
2025-10-02T09:35:45.718938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.727212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.727330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.727338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2912
2025-10-02T09:35:45.727457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.727482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.727489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.727492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.727834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2912 sessionId:  describe result for acl check
2025-10-02T09:35:45.727856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.727860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.727861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.727864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.728199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.729517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.730880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.732477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.732578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.732585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.732591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.732618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.732642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451344905:10912]
2025-10-02T09:35:45.732716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.732724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.732726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526919729:5803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.732729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.733017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.733191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.733215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.733426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.733478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.733484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.733484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.733485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.733486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.733487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.733489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.733490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.733490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.733491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.733493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.733493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.733497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.733507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.733510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.733513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.733517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.733521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.733524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.733527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.733531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.733535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.733539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.733542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.733548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.733556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.733562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.733572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.733576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.733581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.733586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.733591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.733600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.733604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.733612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.733617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.733625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.733629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.733634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.733639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.733645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.733649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.733655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.733660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.733666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.733671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.733679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.733684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.733723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.741352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.742893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.742904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.742905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.742908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.742911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2911 [2:7556555776451344905:10912]
2025-10-02T09:35:45.742920Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.742930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.742935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.742937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.742938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.742946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.742953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.742958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.742990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.742995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.742996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.742998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.742999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.743035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.743040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.743047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.743052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.743061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.743075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919862:5803], now have 1 active actors on pipe
2025-10-02T09:35:45.743080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919616:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.743084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.743085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.743086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.743094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.743103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.743104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.743109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.743110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.743112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.743113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.743112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2911
2025-10-02T09:35:45.743128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.743134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.743125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2911
2025-10-02T09:35:45.743135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.743143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.743145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.743171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.743178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.743180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.743181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.743185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.743193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.743202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.743292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.743297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.743305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.743364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2912 partition: 0 MaxSeqNo: 36 sessionId: src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0
2025-10-02T09:35:45.743581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134505ee-cf9659a2-405096d8-3eeb4e25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.746397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Write session: try to update token
2025-10-02T09:35:45.746409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.752613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.752628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.752630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.752632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.752639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.752643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.752646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451344900:10912]
2025-10-02T09:35:45.752672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.752676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.752678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.752681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.752681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.752683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.752837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.760378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId: src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.762547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.818651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526919874:5673]
2025-10-02T09:35:45.818821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2911, pipe: [1:7556555776526919874:5673]
2025-10-02T09:35:45.861670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:45.862139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.862148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.862161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919874:5673], now have 1 active actors on pipe
2025-10-02T09:35:45.862300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:45.862322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:45.862309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:45.862329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526919874:5673]
2025-10-02T09:35:45.862344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:45.862350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2912 reason: error at write: Disconnected sessionId: src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0
2025-10-02T09:35:45.862482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2912 sessionId: src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0 is DEAD
2025-10-02T09:35:45.862610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:45.862632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Write session will restart in 0.009820s
2025-10-02T09:35:45.862657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Write session: Do CDS request
2025-10-02T09:35:45.862662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:45.873136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.873268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:45.873276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2913
2025-10-02T09:35:45.873386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:45.873406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:45.873413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:45.873416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:45.873702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2913 sessionId:  describe result for acl check
2025-10-02T09:35:45.873725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:45.873730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:45.873731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:45.873733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:45.874077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:45.875062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:45.875304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:45.876757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:45.876873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:45.876881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:45.876887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:45.876919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:45.876943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555776451345155:10914]
2025-10-02T09:35:45.876953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:45.876962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:45.876964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555776526920076:5811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:45.876967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:45.877279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:45.877444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:45.877467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:45.877660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:45.877694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.877698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.877699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.877699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.877700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.877700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.877701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.877701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.877702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.877702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.877703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.877703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.877706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.877712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.877714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.877716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.877718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.877720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.877722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.877724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.877728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.877730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.877731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.877735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.877739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:45.877743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.877746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:45.877748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.877751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:45.877753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.877756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:45.877758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.877760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:45.877763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.877765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:45.877767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.877770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:45.877772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.877775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:45.877777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.877780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:45.877781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.877784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.877786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.877789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.877791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.877793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.877811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:45.885177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:45.886647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:45.886656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:45.886657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:45.886659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:45.886663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2912 [2:7556555776451345155:10914]
2025-10-02T09:35:45.886670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:45.886680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:45.886685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.886686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.886688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.886698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:45.886703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:45.886708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:45.886749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.886754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.886756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.886758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:45.886760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:45.886797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:45.886801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.886807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:45.886812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:45.886822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:45.886837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526920124:5811], now have 1 active actors on pipe
2025-10-02T09:35:45.886842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526919876:2446], now have 1 active actors on pipe
2025-10-02T09:35:45.886847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.886848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.886849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.886857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:45.886869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:45.886870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:45.886872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:45.886873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:45.886879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:45.886881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:45.886868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2912
2025-10-02T09:35:45.886869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2912
2025-10-02T09:35:45.886894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.886898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:45.886900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:45.886908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.886910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.886939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9171855a-cda5e815-c4099f18-be52b8f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:45.886946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:45.886948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:45.886949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:45.886955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:45.886960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:45.886971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.887056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:45.887060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:45.887067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:45.887129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2913 partition: 0 MaxSeqNo: 36 sessionId: src_id|9171855a-cda5e815-c4099f18-be52b8f4_0
2025-10-02T09:35:45.887368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd8e9e0-daa7527d-69bf05-dc3eb9cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9171855a-cda5e815-c4099f18-be52b8f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:45.890152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Write session: try to update token
2025-10-02T09:35:45.890163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:45.896008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:45.896020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:45.896022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:45.896024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:45.896029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.896031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.896034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555776451345150:10914]
2025-10-02T09:35:45.896060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:45.896066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:45.896068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:45.896080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:45.896091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:45.896095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:45.896180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:45.902030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId: src_id|9171855a-cda5e815-c4099f18-be52b8f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:45.904110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:45.962521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555776526920142:5673]
2025-10-02T09:35:45.962673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2912, pipe: [1:7556555776526920142:5673]
2025-10-02T09:35:46.006519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.006994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.007002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.007014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555776526920142:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.007140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.007155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.007164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.007167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.007194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555776526920142:5673]
2025-10-02T09:35:46.007207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2913 reason: error at write: Disconnected sessionId: src_id|9171855a-cda5e815-c4099f18-be52b8f4_0
2025-10-02T09:35:46.007335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2913 sessionId: src_id|9171855a-cda5e815-c4099f18-be52b8f4_0 is DEAD
2025-10-02T09:35:46.007435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.007442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Write session will restart in 0.007113s
2025-10-02T09:35:46.007457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Write session: Do CDS request
2025-10-02T09:35:46.007461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.015159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.015309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.015317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2914
2025-10-02T09:35:46.015422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.015443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.015451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.015454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.015758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2914 sessionId:  describe result for acl check
2025-10-02T09:35:46.015791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.015799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.015800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.015805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.016255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.018253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.019374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.021038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.021134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.021140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.021146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.021171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.021191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746312703:10916]
2025-10-02T09:35:46.021253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.021261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.021263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821887539:5820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.021266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.021543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.021721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.021747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.021941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.021972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.021975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.021976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.021977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.021977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.021978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.021978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.021979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.021979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.021980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.021980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.021981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.021983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.021989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.021991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.021993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.021995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.021997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.021999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.022001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.022003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.022005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.022007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.022009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.022012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.022016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.022020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.022022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.022024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.022027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.022029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.022031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.022034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.022037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.022038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.022041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.022043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.022046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.022048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.022050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.022052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.022055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.022057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.022060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.022062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.022065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.022067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.022069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.022086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.029478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.030939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.030950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.030951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.030953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.030956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2913 [2:7556555780746312703:10916]
2025-10-02T09:35:46.030962Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.030972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.030977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.030978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.030979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.030988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.030991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.030994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.031025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.031031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.031032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.031034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.031035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.031068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.031072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.031079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.031092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.031106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.031124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887442:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.031129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887691:5820], now have 1 active actors on pipe
2025-10-02T09:35:46.031134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.031136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.031137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.031145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.031156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.031158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.031160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.031161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.031166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.031167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.031156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2913
2025-10-02T09:35:46.031163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2913
2025-10-02T09:35:46.031180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.031185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.031186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.031196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.031201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.031225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e3f9f05-e8885b73-edd55828-4af86062_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.031231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.031233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.031234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.031240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.031248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.031260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.031364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.031371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.031379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.031447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2914 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e3f9f05-e8885b73-edd55828-4af86062_0
2025-10-02T09:35:46.031648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9171855a-cda5e815-c4099f18-be52b8f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e3f9f05-e8885b73-edd55828-4af86062_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.034421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Write session: try to update token
2025-10-02T09:35:46.034431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.040310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.040324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.040327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.040329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.040335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.040338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.040341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746312698:10916]
2025-10-02T09:35:46.040363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.040366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.040367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.040376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.040381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.040384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.040475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.047132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId: src_id|8e3f9f05-e8885b73-edd55828-4af86062_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.049304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.107421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821887703:5673]
2025-10-02T09:35:46.107574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2913, pipe: [1:7556555780821887703:5673]
2025-10-02T09:35:46.150738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.151241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.151249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.151261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887703:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.151585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.151595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.151589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821887703:5673]
2025-10-02T09:35:46.151614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.151653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2914 reason: error at write: Disconnected sessionId: src_id|8e3f9f05-e8885b73-edd55828-4af86062_0
2025-10-02T09:35:46.151764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.151793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2914 sessionId: src_id|8e3f9f05-e8885b73-edd55828-4af86062_0 is DEAD
2025-10-02T09:35:46.151917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.151926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Write session will restart in 0.009102s
2025-10-02T09:35:46.151941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Write session: Do CDS request
2025-10-02T09:35:46.151946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.162167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.162262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.162271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2915
2025-10-02T09:35:46.162357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.162376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.162382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.162385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.162681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2915 sessionId:  describe result for acl check
2025-10-02T09:35:46.162702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.162707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.162708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.162711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.163045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.163447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.164579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.164952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.165046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.165052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.165058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.165083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.165104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746312970:10920]
2025-10-02T09:35:46.165442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.165596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.165617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.165823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.165864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.165868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.165869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.165869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.165870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.165870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.165871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.165872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.165873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.165873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.165874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.165874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.165877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.165883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.165885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.165887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.165889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.165891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.165893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.165895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.165897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.165899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.165901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.165903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.165908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.165912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.165915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.165918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.165920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.165922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.165925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.165927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.165929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.165932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.165934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.165937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.165939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.165942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.165945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.165948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.165950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.165952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.165954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.165957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.165959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.165962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.165964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.165967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.165984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.166096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.166102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.166104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821887916:5828] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.166107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.173335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.174839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.174849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.174850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.174852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.174855Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2914 [2:7556555780746312970:10920]
2025-10-02T09:35:46.174861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.174871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.174875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.174877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.174878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.174887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.174894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.174898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.174925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.174930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.174931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.174933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.174934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.174968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.174973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.174979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.174986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.174997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.175010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887704:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.175016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887958:5828], now have 1 active actors on pipe
2025-10-02T09:35:46.175019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.175021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.175022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.175029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.175039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.175042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.175044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.175045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.175049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.175051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.175043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2914
2025-10-02T09:35:46.175063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.175047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2914
2025-10-02T09:35:46.175068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.175069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.175083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.175089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.175167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.175174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.175176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.175178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.175183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.175189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.175204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.175308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.175313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.175321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.175372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2915 partition: 0 MaxSeqNo: 36 sessionId: src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0
2025-10-02T09:35:46.175592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3f9f05-e8885b73-edd55828-4af86062_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.178382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Write session: try to update token
2025-10-02T09:35:46.178392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.184162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.184175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.184176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.184177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.184182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.184184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.184186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746312965:10920]
2025-10-02T09:35:46.184206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.184209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.184210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.184218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.184223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.184226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.184320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.191156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId: src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.193342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.251800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821887978:5673]
2025-10-02T09:35:46.252158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2914, pipe: [1:7556555780821887978:5673]
2025-10-02T09:35:46.293825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.294015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.294024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.294036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887978:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.294152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821887978:5673]
2025-10-02T09:35:46.294172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.294173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.294175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.294180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.294217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2915 reason: error at write: Disconnected sessionId: src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0
2025-10-02T09:35:46.294353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2915 sessionId: src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0 is DEAD
2025-10-02T09:35:46.294437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.294443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Write session will restart in 0.009268s
2025-10-02T09:35:46.294462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Write session: Do CDS request
2025-10-02T09:35:46.294465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.305190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.305249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.305260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2916
2025-10-02T09:35:46.305382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.305401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.305407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.305409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.305674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2916 sessionId:  describe result for acl check
2025-10-02T09:35:46.305693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.305697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.305698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.305701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.306044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.306594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.306881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.306979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.306987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.306995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.307027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.307049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746313224:10922]
2025-10-02T09:35:46.307385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.307473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.308404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.308428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.308624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.308653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.308657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.308658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.308658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.308659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.308659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.308660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.308660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.308661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.308661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.308662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.308662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.308665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.308671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.308673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.308675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.308677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.308679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.308681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.308683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.308685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.308688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.308690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.308692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.308695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.308699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.308702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.308705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.308708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.308710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.308713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.308715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.308717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.308720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.308722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.308724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.308728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.308731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.308733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.308736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.308738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.308741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.308742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.308745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.308747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.308750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.308754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.308757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.308773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.312528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.312536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.312538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821888195:5847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.312542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.316206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.317741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.317751Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.317752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.317754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.317758Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2915 [2:7556555780746313224:10922]
2025-10-02T09:35:46.317765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.317774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.317776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.317777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.317778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.317786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.317789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.317793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.317821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.317826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.317827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.317829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.317830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.317866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.317871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.317877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.317882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.317890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.317909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821887979:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.317915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888236:5847], now have 1 active actors on pipe
2025-10-02T09:35:46.317919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.317920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.317921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.317928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.317936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.317941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.317943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.317944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.317945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.317946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.317940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2915
2025-10-02T09:35:46.317942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2915
2025-10-02T09:35:46.317960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.317965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.317966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.317977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.317982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.318007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.318013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.318016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.318017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.318022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.318028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.318037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.318126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.318130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.318138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.318186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2916 partition: 0 MaxSeqNo: 36 sessionId: src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0
2025-10-02T09:35:46.318365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6cf50-cc4446f4-d9599a4b-62754fc8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.321153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Write session: try to update token
2025-10-02T09:35:46.321163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.327197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.327208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.327210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.327210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.327215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.327218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.327220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746313219:10922]
2025-10-02T09:35:46.327241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.327244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.327246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.327255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.327259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.327262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.327359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.334065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId: src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.336106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.394130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821888244:5673]
2025-10-02T09:35:46.394256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2915, pipe: [1:7556555780821888244:5673]
2025-10-02T09:35:46.436363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.436835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.436845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.436857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888244:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.437218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.437232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.437235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.437260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821888244:5673]
2025-10-02T09:35:46.437280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2916 reason: error at write: Disconnected sessionId: src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0
2025-10-02T09:35:46.437422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2916 sessionId: src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0 is DEAD
2025-10-02T09:35:46.437473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.437567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.437576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Write session will restart in 0.008724s
2025-10-02T09:35:46.437592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Write session: Do CDS request
2025-10-02T09:35:46.437596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.447157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.447248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.447257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2917
2025-10-02T09:35:46.447334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.447355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.447363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.447367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.447681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2917 sessionId:  describe result for acl check
2025-10-02T09:35:46.447708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.447712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.447713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.447716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.448062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.449263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.449430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.450938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.451039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.451046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.451052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.451089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.451113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746313481:10925]
2025-10-02T09:35:46.451121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.451129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.451131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821888416:5858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.451134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.451453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.451611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.451633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.451806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.451836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.451840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.451840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.451841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.451841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.451842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.451842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.451843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.451843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.451844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.451845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.451846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.451848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.451854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.451856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.451858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.451860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.451862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.451864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.451866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.451868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.451870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.451872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.451874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.451877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.451881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.451884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.451887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.451889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.451892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.451894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.451896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.451899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.451902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.451904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.451907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.451909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.451911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.451913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.451916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.451918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.451924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.451927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.451930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.451935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.451938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.451940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.451944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.451961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.459348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.460869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.460876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.460878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.460880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.460883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2916 [2:7556555780746313481:10925]
2025-10-02T09:35:46.460890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.460899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.460903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.460905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.460906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.460914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.460920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.460924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.460954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.460959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.460961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.460963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.460964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.460999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.461003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.461010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.461015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.461023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.461037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888497:5858], now have 1 active actors on pipe
2025-10-02T09:35:46.461042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888245:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.461045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.461046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.461048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.461055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.461067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.461077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.461077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.461079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.461081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.461082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.461084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2916
2025-10-02T09:35:46.461095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.461100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.461101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.461084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2916
2025-10-02T09:35:46.461116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.461121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.461139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d496e96a-9a18c644-a5c20194-826d47b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.461145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.461147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.461148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.461153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.461161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.461174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.461305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.461309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.461317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.461381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2917 partition: 0 MaxSeqNo: 36 sessionId: src_id|d496e96a-9a18c644-a5c20194-826d47b3_0
2025-10-02T09:35:46.461570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10af0e2e-903d12cb-1fb55e9c-52aa783a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d496e96a-9a18c644-a5c20194-826d47b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.464375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Write session: try to update token
2025-10-02T09:35:46.464385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.470231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.470241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.470242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.470243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.470248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.470250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.470252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746313476:10925]
2025-10-02T09:35:46.470274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.470276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.470277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.470287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.470297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.470300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.470396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.478137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId: src_id|d496e96a-9a18c644-a5c20194-826d47b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.480434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.537495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821888532:5673]
2025-10-02T09:35:46.537613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2916, pipe: [1:7556555780821888532:5673]
2025-10-02T09:35:46.581813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.582164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.582173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.582185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888532:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.582347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821888532:5673]
2025-10-02T09:35:46.582357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.582360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.582365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.582407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2917 reason: error at write: Disconnected sessionId: src_id|d496e96a-9a18c644-a5c20194-826d47b3_0
2025-10-02T09:35:46.582514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2917 sessionId: src_id|d496e96a-9a18c644-a5c20194-826d47b3_0 is DEAD
2025-10-02T09:35:46.582585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.582632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.582640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Write session will restart in 0.007524s
2025-10-02T09:35:46.582660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Write session: Do CDS request
2025-10-02T09:35:46.582665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.591138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.591260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.591268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2918
2025-10-02T09:35:46.591365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.591385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.591391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.591394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.591740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2918 sessionId:  describe result for acl check
2025-10-02T09:35:46.591760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.591765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.591765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.591768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.592110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.593801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.594289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.595881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.595984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.595990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.595996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.596023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.596046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746313773:10939]
2025-10-02T09:35:46.596305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.596313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.596315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821888668:5884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.596319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.596385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.596536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.596558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.596739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.596772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.596776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.596777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.596777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.596778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.596778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.596779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.596779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.596780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.596780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.596781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.596782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.596785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.596791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.596793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.596795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.596797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.596798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.596812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.596814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.596816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.596818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.596820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.596822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.596826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.596830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.596833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.596835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.596838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.596841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.596843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.596846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.596848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.596851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.596853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.596856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.596858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.596860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.596863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.596865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.596867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.596870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.596873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.596875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.596877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.596880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.596882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.596884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.596901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.604266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.605781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.605792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.605793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.605795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.605798Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2917 [2:7556555780746313773:10939]
2025-10-02T09:35:46.605804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.605813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.605815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.605816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.605817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.605825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.605831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.605835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.605863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.605868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.605869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.605871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.605872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.605906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.605912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.605919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.605924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.605936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.605950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888789:5884], now have 1 active actors on pipe
2025-10-02T09:35:46.605955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888536:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.605958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.605960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.605961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.605968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.605979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.605982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.605984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.605985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.605989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.605991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.605982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2917
2025-10-02T09:35:46.606004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.605984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2917
2025-10-02T09:35:46.606009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.606011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.606021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.606022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.606045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.606052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.606053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.606054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.606060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.606068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.606078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.606173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.606179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.606186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.606235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2918 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0
2025-10-02T09:35:46.606412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d496e96a-9a18c644-a5c20194-826d47b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.609165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Write session: try to update token
2025-10-02T09:35:46.609176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.615237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.615248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.615249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.615251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.615256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.615258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.615260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746313768:10939]
2025-10-02T09:35:46.615280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.615284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.615287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.615297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.615307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.615311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.615426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.622329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId: src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.624377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.682396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821888800:5673]
2025-10-02T09:35:46.682557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2917, pipe: [1:7556555780821888800:5673]
2025-10-02T09:35:46.726435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.726918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.726928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.726940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888800:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.727056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.727072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.727083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.727088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.727117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821888800:5673]
2025-10-02T09:35:46.727133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2918 reason: error at write: Disconnected sessionId: src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0
2025-10-02T09:35:46.727268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2918 sessionId: src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0 is DEAD
2025-10-02T09:35:46.727460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.727464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Write session will restart in 0.007415s
2025-10-02T09:35:46.727479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Write session: Do CDS request
2025-10-02T09:35:46.727483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.736144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.736298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.736310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2919
2025-10-02T09:35:46.736378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.736398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.736404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.736407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.736887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2919 sessionId:  describe result for acl check
2025-10-02T09:35:46.736909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.736913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.736914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.736918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.737274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.738986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.739716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.741283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.741392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.741399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.741405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.741395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.741404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.741406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821888940:5888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.741409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.741440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.741464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746314030:10941]
2025-10-02T09:35:46.741836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.741996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.742034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.742296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.742356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.742362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.742363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.742363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.742364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.742365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.742366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.742366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.742367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.742368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.742369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.742370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.742374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.742384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.742387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.742391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.742395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.742399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.742406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.742410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.742418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.742422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.742429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.742432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.742443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.742453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.742462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.742470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.742478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.742488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.742496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.742503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.742507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.742514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.742518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.742525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.742530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.742545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.742552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.742556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.742563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.742567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.742571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.742576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.742582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.742586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.742613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.750046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.751507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.751517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.751518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.751520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.751523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2918 [2:7556555780746314030:10941]
2025-10-02T09:35:46.751532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.751542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.751543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.751545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.751546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.751556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.751560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.751566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.751613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.751619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.751620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.751622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.751623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.751657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.751662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.751669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.751674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.751683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.751698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821888802:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.751703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821889056:5888], now have 1 active actors on pipe
2025-10-02T09:35:46.751708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.751709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.751710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.751718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.751728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.751730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.751732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.751733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.751736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.751737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.751737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2918
2025-10-02T09:35:46.751750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.751740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2918
2025-10-02T09:35:46.751755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.751762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.751769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.751771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.751845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.751852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.751855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.751856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.751861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.751867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.751882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.751997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.752002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.752010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.752063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2919 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0
2025-10-02T09:35:46.752368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2c253d-eaffa364-3731a64b-7035fc40_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.755135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Write session: try to update token
2025-10-02T09:35:46.755146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.760917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.760927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.760929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.760930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.760935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.760937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.760940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746314025:10941]
2025-10-02T09:35:46.760961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.760964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.760965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.760975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.760979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.760983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.761093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.767542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId: src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.769830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.827290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821889067:5673]
2025-10-02T09:35:46.827470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2918, pipe: [1:7556555780821889067:5673]
2025-10-02T09:35:46.870922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:46.871426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.871436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.871448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821889067:5673], now have 1 active actors on pipe
2025-10-02T09:35:46.871601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:46.871643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:46.871678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:46.871683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:46.871705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821889067:5673]
2025-10-02T09:35:46.871726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2919 reason: error at write: Disconnected sessionId: src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0
2025-10-02T09:35:46.871861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2919 sessionId: src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0 is DEAD
2025-10-02T09:35:46.871998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:46.872008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Write session will restart in 0.005713s
2025-10-02T09:35:46.872023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Write session: Do CDS request
2025-10-02T09:35:46.872028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:46.879109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.879213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:46.879221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2920
2025-10-02T09:35:46.879301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:46.879320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:46.879326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:46.879328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:46.879630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2920 sessionId:  describe result for acl check
2025-10-02T09:35:46.879659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:46.879666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:46.879667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:46.879671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:46.880120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:46.881780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:46.883501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:46.883511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:46.883514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555780821889145:5892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:46.883518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:46.884233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:46.885868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:46.885972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:46.885979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:46.885985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:46.886012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:46.886035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555780746314289:10943]
2025-10-02T09:35:46.886388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:46.886547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:46.886570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:46.886763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:46.886795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.886799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.886800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.886800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.886801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.886801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.886802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.886802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.886803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.886803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.886804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.886804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.886807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.886812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.886815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.886817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.886819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.886821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.886823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.886825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.886827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.886829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.886831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.886833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.886837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.886840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:46.886844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.886846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:46.886848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.886851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:46.886853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.886856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:46.886858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.886861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:46.886863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.886865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:46.886868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.886871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:46.886873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.886878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:46.886881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.886884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:46.886887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.886889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.886893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.886895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.886898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.886900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.886918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:46.894319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:46.895903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:46.895917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:46.895919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:46.895921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:46.895927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2919 [2:7556555780746314289:10943]
2025-10-02T09:35:46.895936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:46.895946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:46.895947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.895949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.895950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.895958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:46.895961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:46.895969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:46.895997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.896002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.896003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.896005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:46.896006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:46.896040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:46.896045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.896051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:46.896056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:46.896065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:46.896079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821889069:2446], now have 1 active actors on pipe
2025-10-02T09:35:46.896084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821889321:5892], now have 1 active actors on pipe
2025-10-02T09:35:46.896088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.896089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.896090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.896097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:46.896105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:46.896109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:46.896111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:46.896113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:46.896116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:46.896117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:46.896130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.896135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:46.896136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:46.896113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2919
2025-10-02T09:35:46.896129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2919
2025-10-02T09:35:46.896152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.896157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.896176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:46.896184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:46.896187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:46.896190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:46.896196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:46.896203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:46.896219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.896394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:46.896401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:46.896410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:46.896461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2920 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0
2025-10-02T09:35:46.896716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b594-c86074cd-c9a6e033-1f2e212b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:46.899279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Write session: try to update token
2025-10-02T09:35:46.899297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:46.905160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:46.905171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:46.905172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:46.905173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:46.905177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.905179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.905181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555780746314283:10943]
2025-10-02T09:35:46.905201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:46.905207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:46.905208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:46.905211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:46.905221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:46.905224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:46.905315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:46.911107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId: src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:46.913241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:46.971684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555780821889339:5673]
2025-10-02T09:35:46.971849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2919, pipe: [1:7556555780821889339:5673]
2025-10-02T09:35:47.016431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.017102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.017112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.017124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555780821889339:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.017243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.017279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555780821889339:5673]
2025-10-02T09:35:47.017287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.017290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.017304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.017332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2920 reason: error at write: Disconnected sessionId: src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0
2025-10-02T09:35:47.017476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2920 sessionId: src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0 is DEAD
2025-10-02T09:35:47.017652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.017666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Write session will restart in 0.008093s
2025-10-02T09:35:47.017690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Write session: Do CDS request
2025-10-02T09:35:47.017695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.027209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.027295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.027305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2921
2025-10-02T09:35:47.027425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.027446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.027453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.027455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.027752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2921 sessionId:  describe result for acl check
2025-10-02T09:35:47.027774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.027778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.027780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.027782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.028120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.029660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.030238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.031934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.032032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.032038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.032044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.032069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.032091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041281843:10945]
2025-10-02T09:35:47.032086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.032093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.032095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116856797:5899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.032098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.032455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.032620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.032648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.032849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.032889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.032895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.032896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.032896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.032898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.032899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.032899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.032900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.032901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.032902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.032903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.032904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.032908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.032917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.032919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.032921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.032923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.032925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.032927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.032929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.032930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.032933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.032934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.032936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.032940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.032947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.032950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.032953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.032955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.032958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.032960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.032963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.032967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.032969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.032972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.032974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.032977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.032980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.032984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.032986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.032988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.032991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.032993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.032995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.032999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.033001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.033004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.033006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.033024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.040508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.041942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.041952Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.041954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.041955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.041958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2920 [2:7556555785041281843:10945]
2025-10-02T09:35:47.041966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.041975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.041980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.041981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.041982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.041991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.041998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.042002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.042035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.042039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.042040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.042042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.042043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.042079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.042084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.042091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.042100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.042113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.042132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116856896:5899], now have 1 active actors on pipe
2025-10-02T09:35:47.042138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116856639:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.042142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.042143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.042145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.042153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.042148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2920
2025-10-02T09:35:47.042156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2920
2025-10-02T09:35:47.042164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.042170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.042173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.042174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.042174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.042176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.042196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.042201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.042211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.042219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.042233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.042233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.042240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.042242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.042243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.042248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.042253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.042268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.042344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.042352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.042361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.042409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2921 partition: 0 MaxSeqNo: 36 sessionId: src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0
2025-10-02T09:35:47.042648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4f4180-940f0a6f-1a81ba2b-8492dfe7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.044974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Write session: try to update token
2025-10-02T09:35:47.044988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.051335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.051344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.051346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.051346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.051350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.051352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.051354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041281838:10945]
2025-10-02T09:35:47.051372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.051378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.051379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.051384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.051394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.051397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.051510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.056881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId: src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.059183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.117599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116856907:5673]
2025-10-02T09:35:47.117941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2920, pipe: [1:7556555785116856907:5673]
2025-10-02T09:35:47.159319Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.159881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.159891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.159901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116856907:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.160222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116856907:5673]
2025-10-02T09:35:47.160236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.160238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.160241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.160275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2921 reason: error at write: Disconnected sessionId: src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0
2025-10-02T09:35:47.160405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2921 sessionId: src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0 is DEAD
2025-10-02T09:35:47.160448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.160554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.160568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Write session will restart in 0.009932s
2025-10-02T09:35:47.160590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Write session: Do CDS request
2025-10-02T09:35:47.160595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.171246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.171362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.171369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2922
2025-10-02T09:35:47.171487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.171510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.171519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.171522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.171783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2922 sessionId:  describe result for acl check
2025-10-02T09:35:47.171806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.171812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.171813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.171816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.172175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.172232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.173740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.174001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.174094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.174100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.174106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.174131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.174153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041282117:10949]
2025-10-02T09:35:47.174489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.174656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.174678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.174850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.174877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.174881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.174881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.174882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.174883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.174883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.174884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.174884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.174885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.174885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.174886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.174886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.174889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.174895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.174897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.174899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.174901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.174903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.174905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.174907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.174909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.174911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.174913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.174915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.174918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.174922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.174925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.174928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.174930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.174932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.174934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.174937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.174939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.174941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.174943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.174946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.174948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.174951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.174953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.174955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.174958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.174960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.174963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.174966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.174968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.174970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.174972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.174975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.174992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.175250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.175257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.175259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116857128:5914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.175262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.182379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.183833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.183844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.183845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.183847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.183850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2921 [2:7556555785041282117:10949]
2025-10-02T09:35:47.183858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.183867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.183872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.183873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.183874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.183883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.183886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.183890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.183918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.183923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.183923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.183925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.183926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.183967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.183971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.183977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.183983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.183991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.184004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857169:5914], now have 1 active actors on pipe
2025-10-02T09:35:47.184009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116856908:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.184012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.184014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.184015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.184022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.184032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.184033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.184035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.184036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.184042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.184043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.184035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2921
2025-10-02T09:35:47.184036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2921
2025-10-02T09:35:47.184057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.184062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.184063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.184071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.184076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.184101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66106375-5f44793d-2bd35438-ae8d8084_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.184108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.184110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.184111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.184116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.184122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.184133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.184213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.184217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.184224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.184286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2922 partition: 0 MaxSeqNo: 36 sessionId: src_id|66106375-5f44793d-2bd35438-ae8d8084_0
2025-10-02T09:35:47.184532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ecff34-c06954c8-b3fdb87a-889cc318_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66106375-5f44793d-2bd35438-ae8d8084_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.186964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Write session: try to update token
2025-10-02T09:35:47.186980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.193268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.193277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.193278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.193279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.193284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.193286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.193288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041282112:10949]
2025-10-02T09:35:47.193308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.193309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.193311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.193311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.193313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.193313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.193465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.200132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId: src_id|66106375-5f44793d-2bd35438-ae8d8084_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.202219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.260439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116857189:5673]
2025-10-02T09:35:47.260591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2921, pipe: [1:7556555785116857189:5673]
2025-10-02T09:35:47.302253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.302720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.302729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.302750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857189:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.302861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.302884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.302894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.302907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.302940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116857189:5673]
2025-10-02T09:35:47.302941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2922 reason: error at write: Disconnected sessionId: src_id|66106375-5f44793d-2bd35438-ae8d8084_0
2025-10-02T09:35:47.303063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2922 sessionId: src_id|66106375-5f44793d-2bd35438-ae8d8084_0 is DEAD
2025-10-02T09:35:47.303178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.303188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Write session will restart in 0.009895s
2025-10-02T09:35:47.303207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Write session: Do CDS request
2025-10-02T09:35:47.303211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.314218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.314319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.314327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2923
2025-10-02T09:35:47.314405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.314424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.314431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.314433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.314742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2923 sessionId:  describe result for acl check
2025-10-02T09:35:47.314768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.314772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.314773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.314776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.315110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.315922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.316656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.317592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.317697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.317704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.317710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.317737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.317760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041282378:10951]
2025-10-02T09:35:47.318101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.318273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.318296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.318471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.318500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.318505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.318506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.318507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.318508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.318509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.318509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.318510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.318511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.318512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.318512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.318513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.318518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.318526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.318529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.318533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.318536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.318541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.318544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.318547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.318550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.318555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.318558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.318563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.318568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.318574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.318580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.318585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.318593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.318597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.318602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.318604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.318608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.318610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.318616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.318618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.318620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.318623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.318636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.318619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.318633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.318640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.318637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116857405:5927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.318642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.318645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.318640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.318647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.318650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.318652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.318654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.318656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.318659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.318675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.326018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.327531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.327541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.327542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.327544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.327546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2922 [2:7556555785041282378:10951]
2025-10-02T09:35:47.327554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.327563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.327568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.327569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.327570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.327578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.327583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.327587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.327615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.327620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.327621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.327623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.327624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.327658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.327663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.327669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.327674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.327682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.327696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857452:5927], now have 1 active actors on pipe
2025-10-02T09:35:47.327701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857190:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.327705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.327707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.327709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.327716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.327727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.327728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.327730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.327731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.327737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.327738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.327735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2922
2025-10-02T09:35:47.327739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2922
2025-10-02T09:35:47.327751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.327756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.327757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.327766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.327770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.327797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.327804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.327806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.327807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.327812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.327820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.327829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.327918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.327923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.327930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.327982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2923 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0
2025-10-02T09:35:47.328213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66106375-5f44793d-2bd35438-ae8d8084_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.330591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Write session: try to update token
2025-10-02T09:35:47.330607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.336728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.336739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.336740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.336741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.336745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.336747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.336748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041282373:10951]
2025-10-02T09:35:47.336767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.336768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.336770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.336771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.336772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.336772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.336892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.342723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId: src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.344711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.403290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116857462:5673]
2025-10-02T09:35:47.403433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2922, pipe: [1:7556555785116857462:5673]
2025-10-02T09:35:47.444739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.445199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.445208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.445221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857462:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.445369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.445408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116857462:5673]
2025-10-02T09:35:47.445410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.445414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.445433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.445464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2923 reason: error at write: Disconnected sessionId: src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0
2025-10-02T09:35:47.445617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2923 sessionId: src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0 is DEAD
2025-10-02T09:35:47.445828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.445843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Write session will restart in 0.008720s
2025-10-02T09:35:47.445865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Write session: Do CDS request
2025-10-02T09:35:47.445870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.455176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.455233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.455242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2924
2025-10-02T09:35:47.455322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.455342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.455348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.455351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.455723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2924 sessionId:  describe result for acl check
2025-10-02T09:35:47.455752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.455758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.455759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.455763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.456218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.457803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.458465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.460172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.460271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.460278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.460283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.460330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041282642:10954]
2025-10-02T09:35:47.460349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.460358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.460360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116857604:5941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.460363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.460668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.460832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.460855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.461031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.461061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.461065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.461065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.461066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.461066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.461067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.461068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.461068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.461069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.461069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.461070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.461070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.461073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.461079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.461081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.461083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.461085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.461087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.461089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.461091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.461093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.461095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.461097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.461099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.461103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.461107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.461110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.461113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.461115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.461118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.461120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.461122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.461125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.461127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.461130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.461132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.461135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.461137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.461140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.461142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.461144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.461147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.461149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.461153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.461155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.461158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.461160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.461162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.461183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.468535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.469949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.469960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.469961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.469963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.469966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2923 [2:7556555785041282642:10954]
2025-10-02T09:35:47.469973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.469983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.469984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.469985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.469986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.469995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.470001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.470005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.470033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.470038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.470039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.470040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.470042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.470077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.470082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.470088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.470093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.470102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.470117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857463:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.470122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857722:5941], now have 1 active actors on pipe
2025-10-02T09:35:47.470126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.470127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.470128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.470135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.470145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.470147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.470149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.470150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.470154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.470156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.470153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2923
2025-10-02T09:35:47.470166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2923
2025-10-02T09:35:47.470168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.470173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.470174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.470188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.470193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.470210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.470216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.470218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.470220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.470224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.470230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.470242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.470342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.470346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.470353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.470409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2924 partition: 0 MaxSeqNo: 36 sessionId: src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0
2025-10-02T09:35:47.470615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1270495-20f98cb1-7e3d84cf-6246d75b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.472944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Write session: try to update token
2025-10-02T09:35:47.472966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.479075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.479086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.479087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.479088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.479091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.479093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.479095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041282637:10954]
2025-10-02T09:35:47.479114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.479116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.479119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.479119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.479121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.479121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.479238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.485360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId: src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.487665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.545617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116857747:5673]
2025-10-02T09:35:47.545754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2923, pipe: [1:7556555785116857747:5673]
2025-10-02T09:35:47.588374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.588835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.588845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.588861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857747:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.588973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.589011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.589013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:47.589047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116857747:5673]
2025-10-02T09:35:47.589073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0
2025-10-02T09:35:47.589189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2924 sessionId: src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0 is DEAD
2025-10-02T09:35:47.589297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:47.589310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Write session will restart in 0.008136s
2025-10-02T09:35:47.589333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Write session: Do CDS request
2025-10-02T09:35:47.589339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.598137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.598237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.598246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2925
2025-10-02T09:35:47.598361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.598383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.598389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.598391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.598703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2925 sessionId:  describe result for acl check
2025-10-02T09:35:47.598726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.598730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.598731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.598734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.599060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.600998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.601278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.602933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.603029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.603035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.603041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.603068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.603088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041282941:10968]
2025-10-02T09:35:47.603167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.603177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.603178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116857901:5963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.603182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.603424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.603593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.603615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.603790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.603819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.603823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.603823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.603824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.603824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.603825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.603825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.603826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.603826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.603827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.603827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.603828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.603830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.603836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.603838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.603840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.603842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.603844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.603846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.603848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.603850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.603852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.603854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.603856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.603859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.603863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.603866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.603869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.603871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.603874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.603876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.603879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.603882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.603885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.603887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.603889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.603893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.603895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.603897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.603900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.603902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.603905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.603907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.603910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.603913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.603916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.603917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.603920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.603936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.611268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.612815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.612824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.612825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.612827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.612830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2924 [2:7556555785041282941:10968]
2025-10-02T09:35:47.612838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.612848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.612852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.612854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.612855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.612864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.612868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.612871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.612903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.612907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.612908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.612910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.612911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.612946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.612951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.612957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.612962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.612970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.612983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116857757:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.612989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858017:5963], now have 1 active actors on pipe
2025-10-02T09:35:47.612992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.612993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.612994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.613002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.613009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.613013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.613015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.613017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.613019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.613020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.613034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.613021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2924
2025-10-02T09:35:47.613039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.613023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2924
2025-10-02T09:35:47.613040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.613050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.613054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.613208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.613217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.613220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.613221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.613225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.613231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.613246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.613361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.613366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.613374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.613439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2925 partition: 0 MaxSeqNo: 36 sessionId: src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0
2025-10-02T09:35:47.613692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d491970e-b1dea1a0-811f14c8-c43f88c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.615953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Write session: try to update token
2025-10-02T09:35:47.615966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.622110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.622119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.622120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.622122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.622126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.622129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.622130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041282936:10968]
2025-10-02T09:35:47.622150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.622151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.622152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.622153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.622154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.622156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.622278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.628213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId: src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.630584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.688999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116858028:5673]
2025-10-02T09:35:47.689178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2924, pipe: [1:7556555785116858028:5673]
2025-10-02T09:35:47.730307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.730500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.730509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.730520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858028:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.730639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.730656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.730675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.730678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.730688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116858028:5673]
2025-10-02T09:35:47.730729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2925 reason: error at write: Disconnected sessionId: src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0
2025-10-02T09:35:47.730881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2925 sessionId: src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0 is DEAD
2025-10-02T09:35:47.731043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.731056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Write session will restart in 0.005668s
2025-10-02T09:35:47.731077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Write session: Do CDS request
2025-10-02T09:35:47.731082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.738170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.738272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.738281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2926
2025-10-02T09:35:47.738408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.738427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.738433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.738435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.738764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2926 sessionId:  describe result for acl check
2025-10-02T09:35:47.738788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.738793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.738794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.738798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.739252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.741103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.743123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.743131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.743133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116858098:5967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.743136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.744007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.745572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.745668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.745676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.745682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.745708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.745729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041283206:10970]
2025-10-02T09:35:47.746063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.746226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.746258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.746440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.746470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.746474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.746475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.746475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.746476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.746476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.746477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.746477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.746478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.746478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.746479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.746479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.746482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.746488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.746491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.746493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.746495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.746497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.746498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.746500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.746502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.746505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.746507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.746509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.746512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.746516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.746519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.746522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.746524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.746527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.746529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.746532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.746534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.746538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.746540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.746543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.746545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.746548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.746550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.746552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.746555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.746557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.746563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.746566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.746568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.746574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.746576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.746579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.746603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.754027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.755594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.755605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.755606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.755609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.755612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2925 [2:7556555785041283206:10970]
2025-10-02T09:35:47.755619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.755628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.755632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.755634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.755634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.755643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.755646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.755650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.755683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.755687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.755689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.755691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.755692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.755728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.755733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.755740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.755745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.755756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.755769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858288:5967], now have 1 active actors on pipe
2025-10-02T09:35:47.755775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858030:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.755778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.755779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.755780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.755788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.755798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.755801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.755805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.755806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.755808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.755810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.755807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2925
2025-10-02T09:35:47.755826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.755810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2925
2025-10-02T09:35:47.755832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.755833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.755847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.755849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.755879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.755885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.755888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.755889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.755893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.755900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.755911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.756007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.756011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.756019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.756070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2926 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0
2025-10-02T09:35:47.756350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2938ae79-ab1cf538-c5d2db3c-2b408eb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.758688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Write session: try to update token
2025-10-02T09:35:47.758704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.764897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.764907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.764908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.764909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.764912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.764915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.764916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041283201:10970]
2025-10-02T09:35:47.764934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.764937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.764938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.764942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.764946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.764949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.765048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.770243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId: src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.772530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.830809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116858302:5673]
2025-10-02T09:35:47.830953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2925, pipe: [1:7556555785116858302:5673]
2025-10-02T09:35:47.873597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:47.873770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.873778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.873790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858302:5673], now have 1 active actors on pipe
2025-10-02T09:35:47.873930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:47.873949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:47.873956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:47.873959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:47.873990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116858302:5673]
2025-10-02T09:35:47.873999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2926 reason: error at write: Disconnected sessionId: src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0
2025-10-02T09:35:47.874120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2926 sessionId: src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0 is DEAD
2025-10-02T09:35:47.874269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:47.874284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Write session will restart in 0.006250s
2025-10-02T09:35:47.874306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Write session: Do CDS request
2025-10-02T09:35:47.874312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:47.881152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.881289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:47.881297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2927
2025-10-02T09:35:47.881423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:47.881446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:47.881452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:47.881455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:47.881731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2927 sessionId:  describe result for acl check
2025-10-02T09:35:47.881756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:47.881761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:47.881762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:47.881765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:47.882117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:47.883721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:47.885504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:47.885512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:47.885514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555785116858375:5983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:47.885517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:47.886801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:47.888394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:47.888488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:47.888494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:47.888499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:47.888523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:47.888544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555785041283469:10972]
2025-10-02T09:35:47.888895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:47.889055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:47.889076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:47.889243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:47.889273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.889277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.889277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.889278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.889278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.889279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.889279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.889280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.889280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.889281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.889282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.889282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.889285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.889291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.889293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.889295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.889297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.889299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.889301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.889303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.889305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.889307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.889309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.889311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.889314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.889317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:47.889320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.889323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:47.889325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.889327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:47.889329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.889332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:47.889334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.889337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:47.889339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.889341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:47.889343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.889346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:47.889348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.889350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:47.889352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.889356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:47.889358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.889361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.889363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.889365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.889367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.889370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.889386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:47.896750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:47.898308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:47.898319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:47.898320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:47.898322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:47.898325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2926 [2:7556555785041283469:10972]
2025-10-02T09:35:47.898333Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:47.898341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:47.898346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.898347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.898348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.898357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:47.898360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:47.898364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:47.898394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.898398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.898399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.898401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:47.898403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:47.898449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:47.898455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.898462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:47.898468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:47.898475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:47.898491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858548:5983], now have 1 active actors on pipe
2025-10-02T09:35:47.898493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858304:2446], now have 1 active actors on pipe
2025-10-02T09:35:47.898496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.898498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.898499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.898506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:47.898518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:47.898520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:47.898522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:47.898525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:47.898529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:47.898531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:47.898503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2926
2025-10-02T09:35:47.898509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2926
2025-10-02T09:35:47.898553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.898559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.898568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.898574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:47.898587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:47.898592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:47.898597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:47.898599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:47.898600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:47.898604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:47.898609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:47.898756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.898872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:47.898877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:47.898885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:47.898939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2927 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0
2025-10-02T09:35:47.899176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6647c5c-4c7f8baa-13c0146c-c71c6e47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:47.901549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Write session: try to update token
2025-10-02T09:35:47.901565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:47.907613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:47.907624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:47.907626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:47.907627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:47.907632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.907637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.907639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555785041283464:10972]
2025-10-02T09:35:47.907662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:47.907668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:47.907669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:47.907671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:47.907675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:47.907678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:47.907775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:47.913555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId: src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:47.915629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:47.974175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555785116858582:5673]
2025-10-02T09:35:47.974333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2926, pipe: [1:7556555785116858582:5673]
2025-10-02T09:35:48.016641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.016880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.016889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.016901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555785116858582:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.017024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.017070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.017077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555785116858582:5673]
2025-10-02T09:35:48.017092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:48.017094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:48.017137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2927 reason: error at write: Disconnected sessionId: src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0
2025-10-02T09:35:48.017277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2927 sessionId: src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0 is DEAD
2025-10-02T09:35:48.017440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:48.017453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Write session will restart in 0.005504s
2025-10-02T09:35:48.017479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Write session: Do CDS request
2025-10-02T09:35:48.017485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.024148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.024234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.024242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2928
2025-10-02T09:35:48.024356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.024376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.024382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.024384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.024699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2928 sessionId:  describe result for acl check
2025-10-02T09:35:48.024723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.024727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.024728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.024731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.025111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.026964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.028919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.028927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.028929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411825940:5997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.028932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.030167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.031647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.031738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.031744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.031750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.031774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.031796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336251031:10974]
2025-10-02T09:35:48.032144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.032300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.032322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.032494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.032524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.032528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.032529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.032529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.032530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.032530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.032531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.032531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.032532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.032532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.032533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.032533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.032536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.032542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.032544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.032546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.032548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.032550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.032552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.032554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.032556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.032558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.032560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.032562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.032565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.032569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.032572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.032574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.032576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.032579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.032581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.032583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.032585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.032588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.032590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.032592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.032595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.032598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.032600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.032602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.032605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.032608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.032610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.032612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.032614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.032617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.032619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.032622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.032639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.039988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.041557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.041568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.041569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.041571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.041574Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2927 [2:7556555789336251031:10974]
2025-10-02T09:35:48.041581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.041591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.041593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.041594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.041595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.041604Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.041607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.041611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.041639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.041644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.041645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.041647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.041648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.041682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.041687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.041693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.041699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.041709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.041723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411825882:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.041728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826130:5997], now have 1 active actors on pipe
2025-10-02T09:35:48.041731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.041733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.041734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.041740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.041753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.041753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.041755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.041756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.041763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.041765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.041757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2927
2025-10-02T09:35:48.041767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2927
2025-10-02T09:35:48.041780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.041785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.041786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.041796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.041801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.041825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.041833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.041838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.041839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.041844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.041849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.041860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.041939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.041946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.041953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.042003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2928 partition: 0 MaxSeqNo: 36 sessionId: src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0
2025-10-02T09:35:48.042253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5306b11-7faa49aa-e9ae0bdb-98e51a1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.044582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Write session: try to update token
2025-10-02T09:35:48.044597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.050756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.050766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.050767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.050768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.050772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.050774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.050776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336251026:10974]
2025-10-02T09:35:48.050794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.050797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.050798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.050799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.050801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.050804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.050924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.056200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId: src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.058281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.117019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411826157:5673]
2025-10-02T09:35:48.117155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2927, pipe: [1:7556555789411826157:5673]
2025-10-02T09:35:48.158509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.158706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.158715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.158726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826157:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.158841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.158884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411826157:5673]
2025-10-02T09:35:48.158895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:48.158904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.158945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2928 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0
2025-10-02T09:35:48.159081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2928 sessionId: src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0 is DEAD
2025-10-02T09:35:48.159242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:48.159259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Write session will restart in 0.009429s
2025-10-02T09:35:48.159281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Write session: Do CDS request
2025-10-02T09:35:48.159286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.170179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.170247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.170255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2929
2025-10-02T09:35:48.170364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.170384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.170390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.170392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.170649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2929 sessionId:  describe result for acl check
2025-10-02T09:35:48.170669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.170674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.170675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.170678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.170993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.171763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.172074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.173574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.173668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.173676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.173682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.173709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.173726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336251311:10978]
2025-10-02T09:35:48.173765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.173773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.173775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411826368:6008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.173778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.174061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.174220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.174242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.174412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.174440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.174444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.174444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.174445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.174446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.174446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.174447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.174447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.174448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.174448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.174449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.174449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.174452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.174458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.174460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.174462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.174463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.174465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.174467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.174469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.174471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.174473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.174475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.174477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.174481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.174484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.174488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.174490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.174492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.174496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.174498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.174501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.174503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.174505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.174507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.174510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.174512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.174514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.174516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.174518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.174520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.174523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.174525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.174527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.174529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.174532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.174534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.174536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.174556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.181935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.183369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.183379Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.183380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.183382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.183386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2928 [2:7556555789336251311:10978]
2025-10-02T09:35:48.183392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.183401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.183402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.183403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.183404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.183412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.183415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.183419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.183448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.183453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.183454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.183456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.183458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.183490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.183494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.183500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.183506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.183514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.183531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826422:6008], now have 1 active actors on pipe
2025-10-02T09:35:48.183539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826158:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.183544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.183547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.183549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.183560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.183570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.183572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.183566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2928
2025-10-02T09:35:48.183565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2928
2025-10-02T09:35:48.183577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.183578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.183579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.183581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.183593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.183595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.183596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.183604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.183608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.183747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a721c35e-74422f0c-3246018-6a43a4a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.183755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.183757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.183758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.183763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.183769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.183781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.183881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.183886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.183893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.183941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2929 partition: 0 MaxSeqNo: 36 sessionId: src_id|a721c35e-74422f0c-3246018-6a43a4a8_0
2025-10-02T09:35:48.184182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6267c683-d3ee3f15-d547151a-a9e253ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a721c35e-74422f0c-3246018-6a43a4a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.186478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Write session: try to update token
2025-10-02T09:35:48.186492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.192643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.192654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.192655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.192656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.192660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.192662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.192664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336251306:10978]
2025-10-02T09:35:48.192684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.192689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.192690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.192694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.192698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.192702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.192884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.198178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId: src_id|a721c35e-74422f0c-3246018-6a43a4a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.200492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.258847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411826446:5673]
2025-10-02T09:35:48.259005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2928, pipe: [1:7556555789411826446:5673]
2025-10-02T09:35:48.301306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.301522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.301531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.301543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826446:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.301676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.301700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:48.301712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:48.301758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2929 reason: error at write: Disconnected sessionId: src_id|a721c35e-74422f0c-3246018-6a43a4a8_0
2025-10-02T09:35:48.301764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.301790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411826446:5673]
2025-10-02T09:35:48.301893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2929 sessionId: src_id|a721c35e-74422f0c-3246018-6a43a4a8_0 is DEAD
2025-10-02T09:35:48.302028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:48.302041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Write session will restart in 0.008147s
2025-10-02T09:35:48.302066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Write session: Do CDS request
2025-10-02T09:35:48.302071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.311241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.311336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.311344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2930
2025-10-02T09:35:48.311483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.311506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.311512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.311515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.311806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2930 sessionId:  describe result for acl check
2025-10-02T09:35:48.311827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.311832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.311833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.311836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.312171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.313758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.314982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.316519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.316619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.316626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.316632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.316664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.316690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336251579:10980]
2025-10-02T09:35:48.316695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.316702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.316704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411826579:6024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.316707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.317048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.317206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.317231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.317405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.317446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.317452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.317453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.317453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.317454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.317455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.317456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.317457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.317458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.317458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.317459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.317460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.317464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.317472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.317475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.317478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.317481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.317484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.317487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.317490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.317493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.317497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.317500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.317503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.317509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.317515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.317520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.317524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.317530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.317532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.317535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.317537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.317539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.317542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.317546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.317548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.317551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.317553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.317555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.317558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.317560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.317563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.317566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.317569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.317574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.317577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.317579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.317582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.317599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.324972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.326350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.326360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.326361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.326363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.326367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2929 [2:7556555789336251579:10980]
2025-10-02T09:35:48.326374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.326382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.326387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.326389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.326390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.326399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.326402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.326405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.326483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.326488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.326489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.326491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.326492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.326527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.326532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.326538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.326543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.326555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.326568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826714:6024], now have 1 active actors on pipe
2025-10-02T09:35:48.326574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826447:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.326577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.326578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.326580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.326587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.326597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.326600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.326602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.326603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.326607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.326609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.326622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.326627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.326617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2929
2025-10-02T09:35:48.326620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2929
2025-10-02T09:35:48.326647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.326656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.326658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.326673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69017087-75208e9a-dd014dd-60d464b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.326680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.326682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.326683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.326688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.326696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.326704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.326798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.326803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.326810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.326865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2930 partition: 0 MaxSeqNo: 36 sessionId: src_id|69017087-75208e9a-dd014dd-60d464b3_0
2025-10-02T09:35:48.327131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a721c35e-74422f0c-3246018-6a43a4a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69017087-75208e9a-dd014dd-60d464b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.329427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Write session: try to update token
2025-10-02T09:35:48.329442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.335566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.335576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.335577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.335578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.335582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.335584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.335586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336251574:10980]
2025-10-02T09:35:48.335605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.335612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.335613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.335617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.335626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.335629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.335764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.341669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId: src_id|69017087-75208e9a-dd014dd-60d464b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.343969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.401686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411826726:5673]
2025-10-02T09:35:48.401820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2929, pipe: [1:7556555789411826726:5673]
2025-10-02T09:35:48.444168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.444360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.444369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.444381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826726:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.444527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.444533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.444548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:48.444551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:48.444561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411826726:5673]
2025-10-02T09:35:48.444592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2930 reason: error at write: Disconnected sessionId: src_id|69017087-75208e9a-dd014dd-60d464b3_0
2025-10-02T09:35:48.444721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2930 sessionId: src_id|69017087-75208e9a-dd014dd-60d464b3_0 is DEAD
2025-10-02T09:35:48.444881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:48.444896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Write session will restart in 0.007748s
2025-10-02T09:35:48.444926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Write session: Do CDS request
2025-10-02T09:35:48.444932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.454179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.454282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.454290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2931
2025-10-02T09:35:48.454400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.454421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.454426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.454429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.454729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2931 sessionId:  describe result for acl check
2025-10-02T09:35:48.454751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.454755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.454756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.454759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.455095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.456650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.457461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.459299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.459315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.459325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.459327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411826874:6025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.459331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.459409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.459416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.459421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.459446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.459469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336251850:10983]
2025-10-02T09:35:48.459832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.460007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.460041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.460222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.460250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.460253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.460254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.460254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.460255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.460256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.460256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.460257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.460257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.460257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.460258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.460259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.460261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.460267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.460269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.460271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.460273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.460275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.460277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.460279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.460281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.460283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.460285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.460287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.460290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.460294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.460304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.460307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.460310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.460312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.460314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.460317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.460319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.460322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.460324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.460327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.460330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.460333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.460335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.460338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.460340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.460343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.460346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.460348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.460351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.460353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.460356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.460359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.460375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.467658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.469100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.469110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.469111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.469113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.469115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2930 [2:7556555789336251850:10983]
2025-10-02T09:35:48.469122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.469130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.469132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.469133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.469134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.469142Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.469148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.469153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.469180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.469185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.469186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.469188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.469189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.469223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.469227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.469234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.469241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.469249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.469261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826993:6025], now have 1 active actors on pipe
2025-10-02T09:35:48.469268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411826727:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.469271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.469272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.469273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.469281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.469293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.469294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.469298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.469299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.469300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.469301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.469312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.469314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.469324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.469309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2930
2025-10-02T09:35:48.469336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.469341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.469309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2930
2025-10-02T09:35:48.469353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.469360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.469362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.469363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.469368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.469374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.469383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.469481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.469486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.469494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.469547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2931 partition: 0 MaxSeqNo: 36 sessionId: src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0
2025-10-02T09:35:48.469798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69017087-75208e9a-dd014dd-60d464b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.472676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Write session: try to update token
2025-10-02T09:35:48.472700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.478308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.478318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.478319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.478320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.478323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.478325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.478327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336251845:10983]
2025-10-02T09:35:48.478346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.478349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.478350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.478357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.478361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.478366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.478472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.490357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId: src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.492462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.544528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411827005:5673]
2025-10-02T09:35:48.544676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2930, pipe: [1:7556555789411827005:5673]
2025-10-02T09:35:48.588784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.589077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.589087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.589097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827005:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.589210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411827005:5673]
2025-10-02T09:35:48.589226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.589228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.589229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:48.589230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:48.589260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2931 reason: error at write: Disconnected sessionId: src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0
2025-10-02T09:35:48.589385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2931 sessionId: src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0 is DEAD
2025-10-02T09:35:48.589493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:48.589500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Write session will restart in 0.009874s
2025-10-02T09:35:48.589514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Write session: Do CDS request
2025-10-02T09:35:48.589519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.600195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.600319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.600327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2932
2025-10-02T09:35:48.600442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.600461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.600467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.600469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.600875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2932 sessionId:  describe result for acl check
2025-10-02T09:35:48.600897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.600898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.600899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.600902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.601200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.601799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.602581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.603549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.603642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.603649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.603654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.603680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.603701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336252155:10997]
2025-10-02T09:35:48.604031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.604207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.604231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.604248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.604255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.604258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411827261:6066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.604261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.604399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.604429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.604433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.604433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.604435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.604435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.604436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.604436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.604437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.604438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.604438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.604441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.604446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.604448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.604450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.604452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.604454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.604456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.604458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.604460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.604462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.604464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.604466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.604469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.604473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.604476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.604479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.604481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.604484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.604486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.604489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.604491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.604494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.604496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.604499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.604501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.604503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.604505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.604508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.604510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.604513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.604520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.604522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.604525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.604527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.604529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.604532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.604550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.611894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.613456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.613467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.613468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.613470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.613473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2931 [2:7556555789336252155:10997]
2025-10-02T09:35:48.613481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.613490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.613491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.613493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.613494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.613503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.613505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.613510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.613537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.613542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.613543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.613545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.613546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.613579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.613584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.613590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.613595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.613610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.613627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827297:6066], now have 1 active actors on pipe
2025-10-02T09:35:48.613638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827031:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.613644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.613645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.613647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.613657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.613665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.613672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.613673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.613656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2931
2025-10-02T09:35:48.613676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.613685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.613686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.613656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2931
2025-10-02T09:35:48.613696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.613701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.613708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.613716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.613728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.613733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94a26975-baed3ce3-cc439cae-1df7002a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.613737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.613739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.613740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.613745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.613750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.613762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.613832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.613837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.613845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.613886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2932 partition: 0 MaxSeqNo: 36 sessionId: src_id|94a26975-baed3ce3-cc439cae-1df7002a_0
2025-10-02T09:35:48.614111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08eee0c-1fa5ddd6-25b7eb9c-3a4c45a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94a26975-baed3ce3-cc439cae-1df7002a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.616880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Write session: try to update token
2025-10-02T09:35:48.616890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.622954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.622966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.622967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.622968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.622972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.622974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.622977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336252150:10997]
2025-10-02T09:35:48.622996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.622999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.623000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.623001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.623002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.623004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.623112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.629047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId: src_id|94a26975-baed3ce3-cc439cae-1df7002a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.630996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.689433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411827306:5673]
2025-10-02T09:35:48.689622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2931, pipe: [1:7556555789411827306:5673]
2025-10-02T09:35:48.732320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.732667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.732676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.732687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827306:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.732820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.732879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:48.732897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.732927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411827306:5673]
2025-10-02T09:35:48.732931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2932 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94a26975-baed3ce3-cc439cae-1df7002a_0
2025-10-02T09:35:48.733058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2932 sessionId: src_id|94a26975-baed3ce3-cc439cae-1df7002a_0 is DEAD
2025-10-02T09:35:48.733182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:48.733188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Write session will restart in 0.006903s
2025-10-02T09:35:48.733205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Write session: Do CDS request
2025-10-02T09:35:48.733209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.741206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.741268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.741279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2933
2025-10-02T09:35:48.741397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.741416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.741422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.741424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.741758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2933 sessionId:  describe result for acl check
2025-10-02T09:35:48.741774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.741778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.741779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.741782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.742115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.743925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.746140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.746148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.746150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411827393:6075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.746154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.746757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.748401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.748541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.748548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.748554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.748583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.748606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336252425:10999]
2025-10-02T09:35:48.748957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.749121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.749144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.749322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.749350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.749354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.749354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.749355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.749356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.749356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.749357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.749357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.749358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.749358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.749359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.749359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.749362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.749368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.749370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.749372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.749374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.749376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.749378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.749380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.749382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.749385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.749387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.749389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.749392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.749396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.749399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.749402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.749405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.749407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.749410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.749412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.749414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.749417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.749419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.749422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.749424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.749427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.749429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.749431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.749437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.749440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.749442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.749448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.749450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.749453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.749459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.749462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.749480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.756847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.758513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.758523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.758524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.758526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.758529Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2932 [2:7556555789336252425:10999]
2025-10-02T09:35:48.758536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.758546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.758550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.758552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.758553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.758562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.758567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.758571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.758601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.758606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.758607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.758609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.758610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.758655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.758660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.758666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.758671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.758683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.758697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827574:6075], now have 1 active actors on pipe
2025-10-02T09:35:48.758702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827308:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.758706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.758707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.758709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.758716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.758726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.758730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.758732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.758733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.758736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.758737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.758750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.758755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.758757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.758733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2932
2025-10-02T09:35:48.758738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2932
2025-10-02T09:35:48.758770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.758775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.758792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8733296-497143bb-8c1f88e9-13414121_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.758799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.758801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.758802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.758806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.758814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.758826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.758910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.758915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.758922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.758982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2933 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8733296-497143bb-8c1f88e9-13414121_0
2025-10-02T09:35:48.759221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a26975-baed3ce3-cc439cae-1df7002a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8733296-497143bb-8c1f88e9-13414121_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.761960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Write session: try to update token
2025-10-02T09:35:48.761970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.767861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.767873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.767874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.767875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.767879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.767881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.767883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336252420:10999]
2025-10-02T09:35:48.767902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.767903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.767905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.767906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.767907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.767907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.768026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.774737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId: src_id|d8733296-497143bb-8c1f88e9-13414121_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.776674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.833307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411827587:5673]
2025-10-02T09:35:48.833462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2932, pipe: [1:7556555789411827587:5673]
2025-10-02T09:35:48.877114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:48.877319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.877328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.877340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827587:5673], now have 1 active actors on pipe
2025-10-02T09:35:48.877490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:48.877498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:48.877504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:48.877535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2933 reason: error at write: Disconnected sessionId: src_id|d8733296-497143bb-8c1f88e9-13414121_0
2025-10-02T09:35:48.877543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411827587:5673]
2025-10-02T09:35:48.877657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2933 sessionId: src_id|d8733296-497143bb-8c1f88e9-13414121_0 is DEAD
2025-10-02T09:35:48.877784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:48.877790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Write session will restart in 0.008657s
2025-10-02T09:35:48.877805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Write session: Do CDS request
2025-10-02T09:35:48.877809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:48.877798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:48.887130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.887231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:48.887240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2934
2025-10-02T09:35:48.887328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:48.887347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:48.887353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:48.887355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:48.887629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2934 sessionId:  describe result for acl check
2025-10-02T09:35:48.887653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:48.887658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:48.887659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:48.887661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:48.888035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:48.889933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:48.891174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:48.891338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:48.891346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:48.891348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555789411827723:5494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:48.891351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:48.892827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:48.892922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:48.892929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:48.892935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:48.892961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:48.893023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555789336252696:11001]
2025-10-02T09:35:48.893376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:48.893541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:48.893564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:48.893741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:48.893771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.893775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.893775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.893776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.893776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.893777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.893777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.893778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.893778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.893779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.893779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.893780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.893783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.893788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.893790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.893793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.893795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.893797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.893799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.893801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.893802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.893805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.893807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.893809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.893812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.893816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:48.893820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.893823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:48.893826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.893829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:48.893831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.893834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:48.893836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.893839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:48.893841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.893844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:48.893846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.893848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:48.893850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.893854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:48.893858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.893861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:48.893863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.893866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.893872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.893875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.893876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.893879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.893895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:48.901220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:48.902853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:48.902864Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:48.902865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:48.902867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:48.902870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2933 [2:7556555789336252696:11001]
2025-10-02T09:35:48.902878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:48.902890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:48.902897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.902899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.902901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.902911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:48.902917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:48.902921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:48.902949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.902954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.902956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.902957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:48.902959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:48.902994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:48.902999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.903005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:48.903010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:48.903018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:48.903031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827589:2446], now have 1 active actors on pipe
2025-10-02T09:35:48.903035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827861:5494], now have 1 active actors on pipe
2025-10-02T09:35:48.903039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.903040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.903041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.903049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:48.903060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:48.903065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2933
2025-10-02T09:35:48.903062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:48.903077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2933
2025-10-02T09:35:48.903062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:48.903063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:48.903069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:48.903070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:48.903083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.903085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:48.903086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:48.903101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.903103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.903121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:48.903125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:48.903127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:48.903128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:48.903133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:48.903138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:48.903152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.903231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:48.903236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:48.903243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:48.903301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2934 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0
2025-10-02T09:35:48.903483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8733296-497143bb-8c1f88e9-13414121_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:48.906291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Write session: try to update token
2025-10-02T09:35:48.906303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:48.912342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:48.912356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:48.912358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:48.912359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:48.912363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.912366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.912369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555789336252690:11001]
2025-10-02T09:35:48.912389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:48.912395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:48.912395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:48.912397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:48.912398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:48.912400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:48.912519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:48.919295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId: src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:48.921372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:48.977679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555789411827878:5673]
2025-10-02T09:35:48.977825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2933, pipe: [1:7556555789411827878:5673]
2025-10-02T09:35:49.021595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.021949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.021958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.021970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555789411827878:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.022086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.022137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555789411827878:5673]
2025-10-02T09:35:49.022148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.022156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:49.022202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2934 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0
2025-10-02T09:35:49.022328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2934 sessionId: src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0 is DEAD
2025-10-02T09:35:49.022446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:49.022455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Write session will restart in 0.008637s
2025-10-02T09:35:49.022472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Write session: Do CDS request
2025-10-02T09:35:49.022476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.032198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.032298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.032306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2935
2025-10-02T09:35:49.032393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.032410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.032416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.032418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.032729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2935 sessionId:  describe result for acl check
2025-10-02T09:35:49.032752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.032757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.032760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.032763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.033125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.034766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.036171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.037799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.037891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.037899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.037897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.037903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.037902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706795312:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.037909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.037905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.037937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.037960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631220263:11003]
2025-10-02T09:35:49.038328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.038488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.038512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.038698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.038727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.038731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.038732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.038732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.038733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.038733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.038734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.038734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.038735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.038735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.038736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.038737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.038739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.038745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.038747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.038749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.038751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.038753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.038755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.038757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.038759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.038761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.038763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.038765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.038768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.038772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.038775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.038778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.038781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.038784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.038786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.038789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.038791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.038793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.038795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.038798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.038800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.038803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.038805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.038808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.038810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.038813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.038815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.038817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.038819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.038822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.038824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.038826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.038842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.046230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.047608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.047620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.047621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.047623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.047627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2934 [2:7556555793631220263:11003]
2025-10-02T09:35:49.047634Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.047643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.047645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.047646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.047647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.047656Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.047662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.047667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.047696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.047700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.047701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.047703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.047704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.047737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.047744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.047749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.047755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.047762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.047777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795178:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.047784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795449:6101], now have 1 active actors on pipe
2025-10-02T09:35:49.047790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.047793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.047795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.047805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.047815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.047819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.047821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.047823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.047815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2934
2025-10-02T09:35:49.047830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.047832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.047819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2934
2025-10-02T09:35:49.047853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.047862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.047866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.047873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.047880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.047913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.047923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.047928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.047929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.047935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.047946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.047962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.048063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.048072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.048083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.048139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2935 partition: 0 MaxSeqNo: 36 sessionId: src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0
2025-10-02T09:35:49.048390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45d5f9-4661aade-63879d30-d709b6a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.050896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Write session: try to update token
2025-10-02T09:35:49.050913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.056887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.056897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.056898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.056899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.057025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.057032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.057034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631220258:11003]
2025-10-02T09:35:49.057052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.057054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.057057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.057058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.057058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.057059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.057166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.062556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId: src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.064513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.122076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706795461:5673]
2025-10-02T09:35:49.122232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2934, pipe: [1:7556555793706795461:5673]
2025-10-02T09:35:49.165493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.165816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.165826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.165838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795461:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.166050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706795461:5673]
2025-10-02T09:35:49.166071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:49.166073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:49.166094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.166139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2935 reason: error at write: Disconnected sessionId: src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0
2025-10-02T09:35:49.166251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2935 sessionId: src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0 is DEAD
2025-10-02T09:35:49.166406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:49.166425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Write session will restart in 0.008222s
2025-10-02T09:35:49.166446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Write session: Do CDS request
2025-10-02T09:35:49.166452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.166893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.176133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.176256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.176264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2936
2025-10-02T09:35:49.176345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.176363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.176368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.176370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.176651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2936 sessionId:  describe result for acl check
2025-10-02T09:35:49.176674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.176678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.176679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.176682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.177030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.178439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.179537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.179813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.179900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.179907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.179912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.179935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.179961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631220550:11007]
2025-10-02T09:35:49.180234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.180242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.180245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706795614:6115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.180248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.180294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.180429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.180450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.180624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.180656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.180660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.180660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.180661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.180662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.180662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.180662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.180663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.180663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.180664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.180664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.180665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.180668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.180673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.180676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.180678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.180680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.180682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.180683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.180685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.180687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.180690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.180692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.180694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.180697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.180702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.180705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.180708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.180710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.180713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.180715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.180717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.180720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.180722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.180724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.180731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.180733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.180736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.180738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.180740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.180743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.180747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.180751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.180753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.180756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.180759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.180761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.180780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.188145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.189717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.189728Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.189729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.189731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.189734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2935 [2:7556555793631220550:11007]
2025-10-02T09:35:49.189740Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.189749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.189750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.189752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.189753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.189762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.189764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.189768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.189796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.189802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.189803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.189805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.189806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.189843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.189848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.189854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.189859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.189867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.189882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795462:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.189887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795734:6115], now have 1 active actors on pipe
2025-10-02T09:35:49.189891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.189893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.189894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.189902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.189912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.189918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.189920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.189921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.189922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.189924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.189916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2935
2025-10-02T09:35:49.189919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2935
2025-10-02T09:35:49.189938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.189943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.189944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.189958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.189963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.189980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.189988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.189994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.189995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.189999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.190005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.190019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.190095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.190100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.190108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.190172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2936 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0
2025-10-02T09:35:49.190432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfc44b8-3494ecc9-2b56aff0-9935663c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.193548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Write session: try to update token
2025-10-02T09:35:49.193562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.200750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.200763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.200764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.200766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.200771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.200773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.200777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631220545:11007]
2025-10-02T09:35:49.200798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.200816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.200816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.200818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.200822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.200824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.201009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.205522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId: src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.211016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.265935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706795758:5673]
2025-10-02T09:35:49.266071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2935, pipe: [1:7556555793706795758:5673]
2025-10-02T09:35:49.309750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.309957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.309969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.309983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795758:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.310105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.310144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706795758:5673]
2025-10-02T09:35:49.310194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:49.310202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:49.310245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2936 reason: error at write: Disconnected sessionId: src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0
2025-10-02T09:35:49.310378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2936 sessionId: src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0 is DEAD
2025-10-02T09:35:49.310490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:49.310499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Write session will restart in 0.007884s
2025-10-02T09:35:49.310515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Write session: Do CDS request
2025-10-02T09:35:49.310522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.311137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.319177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.319289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.319296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2937
2025-10-02T09:35:49.319412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.319430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.319436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.319438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.319685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2937 sessionId:  describe result for acl check
2025-10-02T09:35:49.319707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.319712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.319713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.319716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.320058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.320137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.320649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.320793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.320812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.320820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.320858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.320883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631220823:11009]
2025-10-02T09:35:49.321217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.321388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.321410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.321558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.321579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.321608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.321612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.321613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.321613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.321614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.321614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.321615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.321615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.321616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.321616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.321617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.321617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.321620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.321626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.321628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.321630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.321632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.321634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.321636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.321637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.321639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.321641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.321643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.321645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.321648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.321652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.321656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.321659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.321661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.321664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.321666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.321668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.321671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.321673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.321675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.321678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.321680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.321683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.321686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.321688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.321691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.321694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.321696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.321698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.321701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.321707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.321709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.321712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.321727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.325526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.325534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.325536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706796218:6123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.325539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.329122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.330790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.330799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.330800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.330802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.330806Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2936 [2:7556555793631220823:11009]
2025-10-02T09:35:49.330812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.330821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.330823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.330824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.330825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.330833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.330840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.330844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.330870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.330875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.330876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.330878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.330879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.330915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.330920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.330926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.330931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.330939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.330953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706795763:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.330957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796259:6123], now have 1 active actors on pipe
2025-10-02T09:35:49.330960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.330961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.330962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.330970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.330977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.330986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.330987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.330988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.330989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.330989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.331002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.331003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.330994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2936
2025-10-02T09:35:49.331003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2936
2025-10-02T09:35:49.331007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.331019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.331023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.331039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.331046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.331048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.331049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.331054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.331059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.331066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.331156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.331163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.331170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.331221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2937 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0
2025-10-02T09:35:49.331453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1a09eb-bfc3cc34-4c3fbe2-a70fc189_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.333845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Write session: try to update token
2025-10-02T09:35:49.333859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.339919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.339930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.339931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.339931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.339935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.339938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.339941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631220818:11009]
2025-10-02T09:35:49.339958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.339962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.339964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.339965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.339967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.339969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.340084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.345936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId: src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.348001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.410323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706796267:5673]
2025-10-02T09:35:49.410465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2936, pipe: [1:7556555793706796267:5673]
2025-10-02T09:35:49.447744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.448046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.448055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.448067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796267:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.448196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.448231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706796267:5673]
2025-10-02T09:35:49.448244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:49.448248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.448290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2937 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0
2025-10-02T09:35:49.448409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2937 sessionId: src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0 is DEAD
2025-10-02T09:35:49.448553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:49.448568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Write session will restart in 0.008886s
2025-10-02T09:35:49.448594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Write session: Do CDS request
2025-10-02T09:35:49.448599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.458139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.458224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.458230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2938
2025-10-02T09:35:49.458258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.458349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.458367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.458374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.458376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.458636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2938 sessionId:  describe result for acl check
2025-10-02T09:35:49.458674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.458678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.458679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.458682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.458780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.458898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.458905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.458911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.458945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.458966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631221100:11012]
2025-10-02T09:35:49.459026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.459299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.459526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.459548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.459726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.459755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.459759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.459759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.459760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.459760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.459761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.459761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.459762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.459763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.459763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.459764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.459764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.459767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.459773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.459775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.459777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.459779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.459781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.459783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.459785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.459787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.459789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.459791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.459793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.459797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.459801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.459804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.459806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.459808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.459811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.459813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.459816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.459818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.459824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.459826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.459829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.459831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.459834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.459836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.459840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.459842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.459844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.459846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.459849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.459851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.459857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.459859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.459861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.459878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.460267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.464538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.464545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.464548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706796724:6134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.464552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.467240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.468854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.468864Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.468865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.468867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.468870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2937 [2:7556555793631221100:11012]
2025-10-02T09:35:49.468878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.468887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.468888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.468889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.468890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.468900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.468902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.468906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.468938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.468943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.468944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.468946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.468947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.468983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.468987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.468994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.468999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.469007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.469020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796268:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.469026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796763:6134], now have 1 active actors on pipe
2025-10-02T09:35:49.469029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.469031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.469032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.469039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.469046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.469053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.469054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.469056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.469057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.469057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.469070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.469075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.469067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2937
2025-10-02T09:35:49.469067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2937
2025-10-02T09:35:49.469088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.469093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.469095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.469111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b419077-1f8d7769-f775a487-b7ef9281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.469117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.469120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.469121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.469126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.469132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.469142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.469237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.469242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.469249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.469305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2938 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b419077-1f8d7769-f775a487-b7ef9281_0
2025-10-02T09:35:49.469518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ce3b74-845d0499-f37ea8fe-2236e362_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b419077-1f8d7769-f775a487-b7ef9281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.471717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Write session: try to update token
2025-10-02T09:35:49.471729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.478098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.478109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.478110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.478111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.478116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.478118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.478120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631221095:11012]
2025-10-02T09:35:49.478138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.478141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.478142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.478144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.478147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.478149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.478255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.483135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId: src_id|2b419077-1f8d7769-f775a487-b7ef9281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.485218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.548566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706796770:5673]
2025-10-02T09:35:49.548732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2937, pipe: [1:7556555793706796770:5673]
2025-10-02T09:35:49.586971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.587241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.587250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.587273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796770:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.587386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.587470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706796770:5673]
2025-10-02T09:35:49.587487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:49.587532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2938 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b419077-1f8d7769-f775a487-b7ef9281_0
2025-10-02T09:35:49.587681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2938 sessionId: src_id|2b419077-1f8d7769-f775a487-b7ef9281_0 is DEAD
2025-10-02T09:35:49.587819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.587848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:49.587860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Write session will restart in 0.005699s
2025-10-02T09:35:49.587881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Write session: Do CDS request
2025-10-02T09:35:49.587886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.594115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.594239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.594257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2939
2025-10-02T09:35:49.594341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.594366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.594375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.594379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.594677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2939 sessionId:  describe result for acl check
2025-10-02T09:35:49.594703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.594709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.594710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.594715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.595119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.596728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.598029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.598595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.598703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.598709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.598716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.598743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.598767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631221389:11020]
2025-10-02T09:35:49.598849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.598859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.598862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706797044:6156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.598867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.599107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.599253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.599276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.599458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.599488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.599492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.599492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.599493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.599493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.599494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.599494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.599495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.599495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.599496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.599496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.599497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.599500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.599505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.599507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.599510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.599511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.599513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.599515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.599517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.599519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.599521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.599523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.599525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.599529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.599532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.599535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.599538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.599540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.599543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.599545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.599548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.599550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.599552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.599555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.599557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.599560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.599562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.599566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.599569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.599571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.599574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.599576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.599578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.599580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.599583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.599585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.599587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.599604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.606984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.608598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.608610Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.608611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.608613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.608616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2938 [2:7556555793631221389:11020]
2025-10-02T09:35:49.608624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.608633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.608639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.608640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.608641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.608649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.608652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.608657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.608687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.608692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.608693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.608694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.608695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.608730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.608735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.608742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.608747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.608757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.608772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706796778:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.608777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797275:6156], now have 1 active actors on pipe
2025-10-02T09:35:49.608780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.608781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.608782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.608789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.608814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.608818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.608820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.608821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.608825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.608826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.608839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.608844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.608827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2938
2025-10-02T09:35:49.608845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.608859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2938
2025-10-02T09:35:49.608889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.608894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.608906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8133042d-a8a3083b-257dab33-55082c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.608913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.608915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.608916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.608921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.608929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.608939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.609059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.609064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.609072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.609136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2939 partition: 0 MaxSeqNo: 36 sessionId: src_id|8133042d-a8a3083b-257dab33-55082c31_0
2025-10-02T09:35:49.609358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b419077-1f8d7769-f775a487-b7ef9281_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8133042d-a8a3083b-257dab33-55082c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.611613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Write session: try to update token
2025-10-02T09:35:49.611625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.617842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.617854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.617856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.617857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.617860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.617862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.617864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631221384:11020]
2025-10-02T09:35:49.617884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.617890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.617891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.617893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.617896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.617899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.618266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.625347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId: src_id|8133042d-a8a3083b-257dab33-55082c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.627401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.687844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706797297:5673]
2025-10-02T09:35:49.688034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2938, pipe: [1:7556555793706797297:5673]
2025-10-02T09:35:49.726842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.727385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.727395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.727408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797297:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.727521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.727561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.727592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:49.727644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2939 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8133042d-a8a3083b-257dab33-55082c31_0
2025-10-02T09:35:49.727740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706797297:5673]
2025-10-02T09:35:49.727787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2939 sessionId: src_id|8133042d-a8a3083b-257dab33-55082c31_0 is DEAD
2025-10-02T09:35:49.727934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:49.727947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Write session will restart in 0.007338s
2025-10-02T09:35:49.727970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Write session: Do CDS request
2025-10-02T09:35:49.727975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.736160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.736257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.736265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2940
2025-10-02T09:35:49.736386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.736405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.736411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.736414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.736895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2940 sessionId:  describe result for acl check
2025-10-02T09:35:49.736939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.736946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.736947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.736952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.737376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.737444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.737841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.737936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.737943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.737948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.737977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.738000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631221690:11028]
2025-10-02T09:35:49.738337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.738495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.738518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.738706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.738737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.738741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.738741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.738742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.738742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.738743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.738743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.738744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.738744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.738745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.738745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.738746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.738748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.738755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.738757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.738759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.738761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.738763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.738764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.738766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.738768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.738770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.738772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.738774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.738779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.738782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.738785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.738788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.738790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.738793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.738795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.738798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.738800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.738803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.738805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.738808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.738810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.738816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.738818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.738821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.738823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.738825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.738827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.738830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.738832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.738835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.738837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.738841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.738861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.739361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.744679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.744692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.744694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706797757:6161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.744700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.746267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.747936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.747945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.747946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.747948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.747951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2939 [2:7556555793631221690:11028]
2025-10-02T09:35:49.747958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.747968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.747969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.747971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.747972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.747981Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.747985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.747989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.748016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.748021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.748022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.748024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.748025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.748063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.748067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.748073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.748080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.748088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.748102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797301:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.748107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797798:6161], now have 1 active actors on pipe
2025-10-02T09:35:49.748111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.748112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.748113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.748121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.748129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.748130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2939
2025-10-02T09:35:49.748136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.748139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.748141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.748143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.748145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.748154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.748155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.748157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.748152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2939
2025-10-02T09:35:49.748171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.748177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.748312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.748321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.748323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.748324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.748330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.748335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.748351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.748458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.748463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.748471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.748522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2940 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0
2025-10-02T09:35:49.748777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8133042d-a8a3083b-257dab33-55082c31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.751167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Write session: try to update token
2025-10-02T09:35:49.751184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.757254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.757267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.757268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.757269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.757273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.757275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.757278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631221685:11028]
2025-10-02T09:35:49.757299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.757305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.757306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.757307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.757310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.757312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.757422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.763796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId: src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.765952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.828123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706797808:5673]
2025-10-02T09:35:49.828286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2939, pipe: [1:7556555793706797808:5673]
2025-10-02T09:35:49.865737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:49.866056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.866065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.866077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797808:5673], now have 1 active actors on pipe
2025-10-02T09:35:49.866209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:49.866235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706797808:5673]
2025-10-02T09:35:49.866255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:49.866304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:49.866312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2940 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0
2025-10-02T09:35:49.866443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2940 sessionId: src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0 is DEAD
2025-10-02T09:35:49.866595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:49.866609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Write session will restart in 0.007154s
2025-10-02T09:35:49.866630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Write session: Do CDS request
2025-10-02T09:35:49.866635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:49.875152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.875248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:49.875257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2941
2025-10-02T09:35:49.875384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:49.875410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:49.875418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:49.875421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:49.875716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2941 sessionId:  describe result for acl check
2025-10-02T09:35:49.875734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:49.875739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:49.875740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:49.875742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:49.876107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:49.876573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:49.877094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:49.877186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:49.877192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:49.877199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:49.877224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:49.877245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555793631221969:11030]
2025-10-02T09:35:49.877579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:49.877731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:49.877755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:49.877750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:49.877928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:49.877957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.877961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.877961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.877962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.877962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.877963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.877963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.877964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.877964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.877965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.877965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.877966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.877968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.877974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.877976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.877978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.877980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.877982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.877984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.877986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.877988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.877991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.877993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.877995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.877998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.878002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:49.878005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.878008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:49.878010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.878013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:49.878015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.878018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:49.878020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.878022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:49.878024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.878027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:49.878029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.878031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:49.878034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.878036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:49.878038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.878041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:49.878043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.878046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.878048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.878051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.878053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.878055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.878071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:49.882796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:49.882808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:49.882811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555793706798265:6172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:49.882817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:49.885387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:49.886864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:49.886875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:49.886876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:49.886878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:49.886882Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2940 [2:7556555793631221969:11030]
2025-10-02T09:35:49.886888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:49.886897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:49.886900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.886901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.886902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.886911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:49.886915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:49.886919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:49.886944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.886950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.886952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.886954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:49.886956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:49.887005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:49.887011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.887022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:49.887033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:49.887047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:49.887061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706797809:2446], now have 1 active actors on pipe
2025-10-02T09:35:49.887067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706798307:6172], now have 1 active actors on pipe
2025-10-02T09:35:49.887070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.887072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.887073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.887081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:49.887080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2940
2025-10-02T09:35:49.887089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:49.887097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:49.887099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:49.887099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:49.887100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:49.887101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:49.887120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.887127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:49.887121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2940
2025-10-02T09:35:49.887131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:49.887269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.887276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.887295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:49.887302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:49.887305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:49.887306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:49.887311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:49.887316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:49.887323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.887431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:49.887436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:49.887443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:49.887494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2941 partition: 0 MaxSeqNo: 36 sessionId: src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0
2025-10-02T09:35:49.887728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c2d3e8-2fbddd5b-5dd2a4f4-c1f0cddf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:49.889996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Write session: try to update token
2025-10-02T09:35:49.890011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:49.896051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:49.896062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:49.896063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:49.896064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:49.896068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.896070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.896074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555793631221964:11030]
2025-10-02T09:35:49.896092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:49.896098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:49.896098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:49.896099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:49.896101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:49.896103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:49.896245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:49.901808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId: src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:49.903888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:49.966368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555793706798322:5673]
2025-10-02T09:35:49.966507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2940, pipe: [1:7556555793706798322:5673]
2025-10-02T09:35:50.004441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.004779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.004788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.004811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555793706798322:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.004934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:50.004976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.005007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555793706798322:5673]
2025-10-02T09:35:50.005035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.005246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2941 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0
2025-10-02T09:35:50.005401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2941 sessionId: src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0 is DEAD
2025-10-02T09:35:50.005553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:50.005567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Write session will restart in 0.005811s
2025-10-02T09:35:50.005588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Write session: Do CDS request
2025-10-02T09:35:50.005594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.012212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.012293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.012302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2942
2025-10-02T09:35:50.012454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.012482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.012490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.012493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.012915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2942 sessionId:  describe result for acl check
2025-10-02T09:35:50.012955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.012957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.012958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.012962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.013409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.015166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.016197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.016775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.016887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.016894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.016900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.016928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.016953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926189546:11032]
2025-10-02T09:35:50.017031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.017041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.017043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001765891:6175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.017049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.017302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.017478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.017501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.017679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.017711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.017715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.017715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.017716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.017716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.017717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.017718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.017718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.017719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.017719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.017720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.017720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.017723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.017730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.017732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.017734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.017736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.017738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.017740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.017742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.017744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.017746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.017748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.017750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.017755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.017759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.017763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.017766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.017768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.017771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.017773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.017776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.017778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.017781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.017783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.017785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.017788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.017791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.017793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.017796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.017798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.017801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.017803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.017806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.017808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.017812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.017815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.017818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.017835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.025418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.026979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.026991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.026992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.026994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.026997Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2941 [2:7556555797926189546:11032]
2025-10-02T09:35:50.027004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.027014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.027015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.027017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.027018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.027027Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.027034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.027039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.027069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.027074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.027075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.027077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.027078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.027115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.027120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.027126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.027131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.027139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.027153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001765622:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.027160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.027162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.027163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.027168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.027172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766117:6175], now have 1 active actors on pipe
2025-10-02T09:35:50.027178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.027179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.027180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.027181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.027186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.027187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.027202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.027187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2941
2025-10-02T09:35:50.027207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.027208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.027226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2941
2025-10-02T09:35:50.027261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.027266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.027280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.027287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.027289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.027290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.027295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.027302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.027309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.027432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.027437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.027445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.027502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2942 partition: 0 MaxSeqNo: 36 sessionId: src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0
2025-10-02T09:35:50.027772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49da4749-4ef41a4e-7bb5867a-e5a7fa39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.030063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Write session: try to update token
2025-10-02T09:35:50.030079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.036451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.036463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.036465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.036466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.036470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.036472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.036474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926189540:11032]
2025-10-02T09:35:50.036493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.036498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.036499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.036501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.036504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.036506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.036661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.042040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId: src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.044150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.105250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001766129:5673]
2025-10-02T09:35:50.105410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2941, pipe: [1:7556555798001766129:5673]
2025-10-02T09:35:50.146918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.147252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.147262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.147275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766129:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.147391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:50.147461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.147526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001766129:5673]
2025-10-02T09:35:50.147560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.147659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2942 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0
2025-10-02T09:35:50.147823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2942 sessionId: src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0 is DEAD
2025-10-02T09:35:50.147984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:50.147997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Write session will restart in 0.006451s
2025-10-02T09:35:50.148019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Write session: Do CDS request
2025-10-02T09:35:50.148024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.155185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.155289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.155301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2943
2025-10-02T09:35:50.155458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.155485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.155493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.155498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.155898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2943 sessionId:  describe result for acl check
2025-10-02T09:35:50.155933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.155940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.155941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.155946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.156404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.157325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.157752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.158001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.158103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.158110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.158115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.158170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.158191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926189840:11036]
2025-10-02T09:35:50.158529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.158707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.158729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.158902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.158931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.158936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.158936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.158937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.158937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.158938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.158938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.158939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.158939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.158940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.158940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.158941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.158943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.158949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.158951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.158954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.158956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.158958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.158960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.158962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.158963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.158966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.158968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.158969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.158973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.158977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.158980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.158983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.158985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.158987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.158989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.158992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.158994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.158997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.158999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.159001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.159004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.159007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.159009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.159011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.159014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.159017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.159019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.159022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.159025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.159028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.159030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.159033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.159048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.162863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.162875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.162877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001766551:6193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.162882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.166387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.168029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.168040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.168042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.168044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.168048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2942 [2:7556555797926189840:11036]
2025-10-02T09:35:50.168054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.168063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.168068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.168070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.168071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.168080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.168083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.168089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.168117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.168122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.168123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.168124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.168126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.168159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.168164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.168170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.168175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.168183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.168198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766130:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.168204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766630:6193], now have 1 active actors on pipe
2025-10-02T09:35:50.168208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.168209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.168210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.168217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.168227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.168230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.168232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.168233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.168237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.168239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.168226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2942
2025-10-02T09:35:50.168245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2942
2025-10-02T09:35:50.168255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.168260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.168261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.168270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.168274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.168301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.168307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.168309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.168310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.168315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.168323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.168335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.168416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.168421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.168428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.168485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2943 partition: 0 MaxSeqNo: 36 sessionId: src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0
2025-10-02T09:35:50.168757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eaf7b5-96525401-ec15af43-53ea0bf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.171052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Write session: try to update token
2025-10-02T09:35:50.171067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.177207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.177218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.177220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.177221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.177224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.177226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.177228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926189835:11036]
2025-10-02T09:35:50.177247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.177248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.177250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.177251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.177252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.177252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.177357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.183359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId: src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.185487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.247457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001766650:5673]
2025-10-02T09:35:50.247634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2942, pipe: [1:7556555798001766650:5673]
2025-10-02T09:35:50.287006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.287350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.287359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.287371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766650:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.287490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:50.287512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001766650:5673]
2025-10-02T09:35:50.287535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.287592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2943 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0
2025-10-02T09:35:50.287600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.287728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2943 sessionId: src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0 is DEAD
2025-10-02T09:35:50.287952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:50.287966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Write session will restart in 0.007962s
2025-10-02T09:35:50.287986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Write session: Do CDS request
2025-10-02T09:35:50.287991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.297223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.297378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.297387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2944
2025-10-02T09:35:50.297507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.297533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.297540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.297543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.297887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2944 sessionId:  describe result for acl check
2025-10-02T09:35:50.297924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.297931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.297932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.297937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.297957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.298399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.298706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.298831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.298838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.298843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.298872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.298896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926190122:11038]
2025-10-02T09:35:50.299335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.299494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.299516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.299693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.299722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.299726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.299727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.299727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.299728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.299728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.299729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.299730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.299730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.299731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.299731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.299732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.299735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.299741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.299743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.299745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.299747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.299749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.299751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.299753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.299755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.299758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.299760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.299762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.299766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.299770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.299773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.299776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.299778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.299781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.299783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.299786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.299788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.299791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.299793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.299796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.299798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.299801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.299803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.299805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.299808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.299810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.299812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.299815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.299819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.299821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.299823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.299826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.299847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.300108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.304814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.304824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.304827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001767112:6202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.304834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.307543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.309283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.309294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.309295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.309297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.309300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2943 [2:7556555797926190122:11038]
2025-10-02T09:35:50.309307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.309316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.309318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.309319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.309320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.309329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.309336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.309339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.309368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.309373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.309374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.309376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.309377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.309412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.309417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.309424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.309429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.309437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.309451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767152:6202], now have 1 active actors on pipe
2025-10-02T09:35:50.309456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001766651:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.309460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.309462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.309463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.309471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.309482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.309485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.309487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.309488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.309492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.309483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2943
2025-10-02T09:35:50.309494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.309508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.309510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.309511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.309520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.309510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2943
2025-10-02T09:35:50.309525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.309550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.309556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.309559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.309560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.309564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.309570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.309579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.309669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.309675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.309683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.309741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2944 partition: 0 MaxSeqNo: 36 sessionId: src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0
2025-10-02T09:35:50.309985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e03e9-345dee27-2add1cba-9f88ebe7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.312303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Write session: try to update token
2025-10-02T09:35:50.312314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.318781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.318792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.318792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.318793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.318798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.318800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.318802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926190117:11038]
2025-10-02T09:35:50.318821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.318821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.318824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.318824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.318825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.318827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.318928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.324051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId: src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.326181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.387731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001767164:5673]
2025-10-02T09:35:50.387878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2943, pipe: [1:7556555798001767164:5673]
2025-10-02T09:35:50.429962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.430180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.430188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.430215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767164:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.430342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:50.430401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.430444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001767164:5673]
2025-10-02T09:35:50.430468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2944 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0
2025-10-02T09:35:50.430486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.430602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2944 sessionId: src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0 is DEAD
2025-10-02T09:35:50.430751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:50.430765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Write session will restart in 0.006175s
2025-10-02T09:35:50.430787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Write session: Do CDS request
2025-10-02T09:35:50.430792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.438168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.438259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.438267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2945
2025-10-02T09:35:50.438415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.438439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.438446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.438450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.438758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2945 sessionId:  describe result for acl check
2025-10-02T09:35:50.438783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.438787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.438788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.438792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.439140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.440541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.441205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.441774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.441921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.441929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.441935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.441967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.441990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926190406:11041]
2025-10-02T09:35:50.442325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.442477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.442500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.442553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.442568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.442571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001767496:6206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.442578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.442682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.442711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.442715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.442715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.442717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.442718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.442718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.442719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.442719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.442723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.442729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.442731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.442733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.442735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.442737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.442739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.442741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.442743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.442745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.442747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.442749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.442752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.442756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.442760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.442763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.442765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.442767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.442769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.442772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.442774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.442777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.442779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.442781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.442783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.442786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.442788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.442791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.442794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.442797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.442798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.442801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.442803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.442805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.442808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.442810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.442827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.450118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.451646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.451656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.451658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.451660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.451667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2944 [2:7556555797926190406:11041]
2025-10-02T09:35:50.451674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.451684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.451686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.451688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.451689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.451698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.451704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.451709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.451736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.451741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.451742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.451744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.451745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.451779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.451784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.451790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.451796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.451804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.451818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767165:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.451824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767665:6206], now have 1 active actors on pipe
2025-10-02T09:35:50.451827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.451829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.451830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.451838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.451848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.451849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.451852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.451853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.451850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2944
2025-10-02T09:35:50.451856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.451858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.451871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.451876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.451877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.451898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2944
2025-10-02T09:35:50.451911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.451916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.451930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.451936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.451938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.451939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.451944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.451949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.451958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.452056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.452061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.452068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.452120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2945 partition: 0 MaxSeqNo: 36 sessionId: src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0
2025-10-02T09:35:50.452366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5566c70c-bf00357c-ed4d6a91-7ecf492a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.454679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Write session: try to update token
2025-10-02T09:35:50.454695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.460980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:50.460990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.460994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.461018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:50.461018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:50.461169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:50.461298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.461449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.461577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.461749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:50.461774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:50.466614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId: src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.468693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.469333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.469348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.469358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.469360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.469361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.469362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.469366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.469369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.469372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926190401:11041]
2025-10-02T09:35:50.469392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.469395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.469398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.469399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.469400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.469402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.469509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.530766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001767675:5673]
2025-10-02T09:35:50.530955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2944, pipe: [1:7556555798001767675:5673]
2025-10-02T09:35:50.578310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.578670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:50.578698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767675:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.578864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.578961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001767675:5673]
2025-10-02T09:35:50.578988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:50.578989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.578997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:50.579062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2945 reason: error at write: Disconnected sessionId: src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0
2025-10-02T09:35:50.579210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2945 sessionId: src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0 is DEAD
2025-10-02T09:35:50.579338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:50.579351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Write session will restart in 0.007414s
2025-10-02T09:35:50.579372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Write session: Do CDS request
2025-10-02T09:35:50.579377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.588143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.588240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.588250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2946
2025-10-02T09:35:50.588415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.588441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.588448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.588452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.588842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2946 sessionId:  describe result for acl check
2025-10-02T09:35:50.588886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.588895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.588896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.588902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.589301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.589469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.589959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.590057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.590063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.590069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.590095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.590116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926190690:11043]
2025-10-02T09:35:50.590472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.590628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.590663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.590951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.590980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.590991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.590995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.590996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.590997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.590997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.590997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.590998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.590998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.590999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.590999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.591000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.591000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.591003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.591009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.591011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.591013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.591015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.591017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.591019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.591021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.591023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.591025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.591027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.591029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.591032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.591037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.591041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.591043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.591045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.591048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.591050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.591052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.591055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.591057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.591059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.591062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.591064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.591067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.591069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.591071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.591073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.591076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.591078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.591081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.591083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.591085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.591087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.591090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.591109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.595901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.595913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.595916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001768138:6210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.595921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.598492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.600149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.600162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.600163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.600166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.600170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2945 [2:7556555797926190690:11043]
2025-10-02T09:35:50.600179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.600192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.600198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.600201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.600202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.600211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.600214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.600218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.600246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.600251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.600252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.600254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.600255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.600291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.600296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.600302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.600307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.600315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.600326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001767676:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.600331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768179:6210], now have 1 active actors on pipe
2025-10-02T09:35:50.600335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.600337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.600338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.600345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.600352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.600357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.600359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.600360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.600363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.600364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.600377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.600386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.600388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.600378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2945
2025-10-02T09:35:50.600383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2945
2025-10-02T09:35:50.600407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.600412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.600426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e07bf21a-2782396b-be66bcf9-1f730780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.600433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.600435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.600436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.600441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.600446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.600455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.600541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.600546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.600553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.600613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2946 partition: 0 MaxSeqNo: 36 sessionId: src_id|e07bf21a-2782396b-be66bcf9-1f730780_0
2025-10-02T09:35:50.600860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86aaa760-c3a2d1cf-418d733e-15b6417a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e07bf21a-2782396b-be66bcf9-1f730780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.603242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Write session: try to update token
2025-10-02T09:35:50.603257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.609320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:50.609331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.609334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.609355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:50.609356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:50.609488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:50.609604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.609720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.609834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:50.609993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:50.610015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:50.615151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId: src_id|e07bf21a-2782396b-be66bcf9-1f730780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.617232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.617544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.617558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.617567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.617569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.617570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.617571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.617574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.617576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.617580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926190685:11043]
2025-10-02T09:35:50.617598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.617604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.617606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.617606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.617608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.617608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.617717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.679057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001768209:5673]
2025-10-02T09:35:50.679187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2945, pipe: [1:7556555798001768209:5673]
2025-10-02T09:35:50.728798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.729261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:50.729286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768209:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.729366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.729442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:50.729448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:50.729452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001768209:5673]
2025-10-02T09:35:50.729478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.729497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2946 reason: error at write: Disconnected sessionId: src_id|e07bf21a-2782396b-be66bcf9-1f730780_0
2025-10-02T09:35:50.729607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2946 sessionId: src_id|e07bf21a-2782396b-be66bcf9-1f730780_0 is DEAD
2025-10-02T09:35:50.729749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:50.729763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Write session will restart in 0.005797s
2025-10-02T09:35:50.729783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Write session: Do CDS request
2025-10-02T09:35:50.729789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.736121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.736234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.736243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2947
2025-10-02T09:35:50.736353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.736378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.736385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.736388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.736758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2947 sessionId:  describe result for acl check
2025-10-02T09:35:50.736779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.736784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.736786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.736790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.737252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.739710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.739992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.740624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.740770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.740777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.740784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.740826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.740849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926191010:11057]
2025-10-02T09:35:50.741186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.741323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.741346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.741422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.741434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.741437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001768469:6232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.741443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.741523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.741553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.741557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.741557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.741558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.741558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.741559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.741559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.741560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.741560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.741561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.741561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.741562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.741565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.741571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.741574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.741576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.741578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.741580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.741582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.741583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.741585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.741587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.741589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.741591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.741595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.741599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.741602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.741605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.741607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.741610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.741612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.741615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.741618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.741621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.741623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.741626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.741628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.741631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.741634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.741636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.741638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.741641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.741643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.741646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.741648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.741650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.741653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.741655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.741672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.749025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.750659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.750670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.750671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.750674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.750677Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2946 [2:7556555797926191010:11057]
2025-10-02T09:35:50.750685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.750695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.750700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.750702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.750703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.750712Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.750715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.750720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.750751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.750757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.750758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.750760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.750761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.750798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.750803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.750810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.750815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.750823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.750836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768210:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.750841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768712:6232], now have 1 active actors on pipe
2025-10-02T09:35:50.750845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.750846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.750847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.750855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.750863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.750868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.750870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.750872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.750873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.750875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.750889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.750894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.750896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.750885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2946
2025-10-02T09:35:50.750904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2946
2025-10-02T09:35:50.750915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.750921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.750938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b8daae4-737ddecc-9b138846-debd6432_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.750944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.750947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.750948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.750954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.750959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.750967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.751057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.751063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.751070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.751131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2947 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b8daae4-737ddecc-9b138846-debd6432_0
2025-10-02T09:35:50.751388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07bf21a-2782396b-be66bcf9-1f730780_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b8daae4-737ddecc-9b138846-debd6432_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.753721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Write session: try to update token
2025-10-02T09:35:50.753736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.760026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.760042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.760044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.760045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.760051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.760055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.760058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926191005:11057]
2025-10-02T09:35:50.760081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.760086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.760087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.760090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.760094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.760098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.760199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.765887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId: src_id|5b8daae4-737ddecc-9b138846-debd6432_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.767987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.829598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001768721:5673]
2025-10-02T09:35:50.829776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2946, pipe: [1:7556555798001768721:5673]
2025-10-02T09:35:50.870193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:50.870557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.870566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.870579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768721:5673], now have 1 active actors on pipe
2025-10-02T09:35:50.870750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:50.870752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001768721:5673]
2025-10-02T09:35:50.870771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:50.871428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:50.871511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b8daae4-737ddecc-9b138846-debd6432_0
2025-10-02T09:35:50.871676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2947 sessionId: src_id|5b8daae4-737ddecc-9b138846-debd6432_0 is DEAD
2025-10-02T09:35:50.871829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:50.871843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Write session will restart in 0.005825s
2025-10-02T09:35:50.871867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Write session: Do CDS request
2025-10-02T09:35:50.871873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:50.879131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.879222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:50.879231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2948
2025-10-02T09:35:50.879375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:50.879401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:50.879409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:50.879412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:50.879777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2948 sessionId:  describe result for acl check
2025-10-02T09:35:50.879817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:50.879825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:50.879827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:50.879833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:50.880281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:50.881288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:50.881850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:50.881947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:50.882045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:50.882052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:50.882058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:50.882118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:50.882140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555797926191296:11059]
2025-10-02T09:35:50.882476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:50.882643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:50.882676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:50.882852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:50.882882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.882886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.882887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.882887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.882888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.882888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.882890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.882890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.882901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.882903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.882905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.882907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.882909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.882911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.882913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.882915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.882917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.882919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.882921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.882924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.882928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:50.882931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.882934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:50.882936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.882939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:50.882941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.882944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:50.882946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.882949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:50.882951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.882953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:50.882956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.882959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:50.882961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.882965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:50.882967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.882969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:50.882971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.882974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.882976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.882980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.882982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.882985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.883002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:50.886833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:50.886847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:50.886850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555798001769146:6239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:50.886858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:50.890379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:50.891840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:50.891851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:50.891852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:50.891854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:50.891858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2947 [2:7556555797926191296:11059]
2025-10-02T09:35:50.891865Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:50.891874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:50.891880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.891882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.891883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.891892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:50.891899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:50.891902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:50.891931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.891936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.891937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.891939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:50.891940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:50.891974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:50.891980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.891986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:50.891991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:50.891999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:50.892010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001769228:6239], now have 1 active actors on pipe
2025-10-02T09:35:50.892015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001768723:2446], now have 1 active actors on pipe
2025-10-02T09:35:50.892019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.892021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.892022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.892029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:50.892037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:50.892041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:50.892043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:50.892044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:50.892048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:50.892036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2947
2025-10-02T09:35:50.892050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:50.892064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.892066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:50.892067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:50.892076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.892077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.892082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2947
2025-10-02T09:35:50.892210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|849b31ec-98577c36-b1191726-4ceb076_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:50.892219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:50.892221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:50.892222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:50.892227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:50.892233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:50.892250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.892368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:50.892373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:50.892381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:50.892436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2948 partition: 0 MaxSeqNo: 36 sessionId: src_id|849b31ec-98577c36-b1191726-4ceb076_0
2025-10-02T09:35:50.892685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8daae4-737ddecc-9b138846-debd6432_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|849b31ec-98577c36-b1191726-4ceb076_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:50.895034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Write session: try to update token
2025-10-02T09:35:50.895047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:50.901019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:50.901030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:50.901031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:50.901032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:50.901037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.901039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.901042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555797926191291:11059]
2025-10-02T09:35:50.901061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:50.901064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:50.901067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:50.901067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:50.901069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:50.901070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:50.901178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:50.907045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId: src_id|849b31ec-98577c36-b1191726-4ceb076_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:50.909136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:50.970911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555798001769242:5673]
2025-10-02T09:35:50.971070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2947, pipe: [1:7556555798001769242:5673]
2025-10-02T09:35:51.011143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.011558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.011568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.011581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555798001769242:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.011703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.011741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555798001769242:5673]
2025-10-02T09:35:51.011764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:51.011795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.011816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2948 reason: status is not ok: tablet will be restarted right now sessionId: src_id|849b31ec-98577c36-b1191726-4ceb076_0
2025-10-02T09:35:51.011957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2948 sessionId: src_id|849b31ec-98577c36-b1191726-4ceb076_0 is DEAD
2025-10-02T09:35:51.012118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:51.012134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Write session will restart in 0.007823s
2025-10-02T09:35:51.012156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Write session: Do CDS request
2025-10-02T09:35:51.012162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.021229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.021313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.021322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2949
2025-10-02T09:35:51.021438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.021456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.021462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.021464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.022027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.022055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2949 sessionId:  describe result for acl check
2025-10-02T09:35:51.022094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.022101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.022102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.022107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.022558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.022866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.022997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.023005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.023010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.023040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.023062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221158880:11061]
2025-10-02T09:35:51.023400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.023567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.023589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.023785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.023825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.023830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.023830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.023831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.023832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.023832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.023833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.023833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.023834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.023834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.023835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.023835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.023838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.023847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.023851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.023854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.023856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.023859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.023862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.023865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.023869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.023872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.023876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.023879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.023883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.023889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.023895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.023903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.023906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.023914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.023917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.023925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.023929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.023939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.023942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.023946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.023949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.023953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.023956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.023962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.023965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.023968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.023974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.023978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.023983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.023987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.023992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.023996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.023989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.024023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.028732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.028740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.028741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296737009:6253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.028746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.031429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.033067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.033077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.033078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.033081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.033084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2948 [2:7556555802221158880:11061]
2025-10-02T09:35:51.033091Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.033103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.033108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.033110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.033111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.033121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.033127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.033131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.033159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.033164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.033165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.033167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.033169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.033204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.033209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.033216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.033221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.033232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.033245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.033249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.033251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.033255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.033261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.033263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737048:6253], now have 1 active actors on pipe
2025-10-02T09:35:51.033265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296736543:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.033268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.033270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.033270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.033277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.033279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.033293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.033301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.033301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2948
2025-10-02T09:35:51.033303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2948
2025-10-02T09:35:51.033312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.033357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.033362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.033377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.033383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.033385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.033387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.033392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.033397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.033405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.033510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.033516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.033524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.033576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2949 partition: 0 MaxSeqNo: 36 sessionId: src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0
2025-10-02T09:35:51.033832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849b31ec-98577c36-b1191726-4ceb076_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.036248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Write session: try to update token
2025-10-02T09:35:51.036263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.042227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:51.042239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.042244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.042265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:51.042273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:51.042470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:51.042624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.042785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.042933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.043142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:51.043164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:51.048711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId: src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.050775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.050788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.050789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.050791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.050797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.050800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.050803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221158875:11061]
2025-10-02T09:35:51.050824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.050828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.050831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.050831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.050832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.050834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.050883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.050944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.111706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296737055:5673]
2025-10-02T09:35:51.111856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2948, pipe: [1:7556555802296737055:5673]
2025-10-02T09:35:51.160396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.160687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.160702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.160715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737055:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.160881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:51.160891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:51.160933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2949 reason: error at write: Disconnected sessionId: src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0
2025-10-02T09:35:51.161067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2949 sessionId: src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0 is DEAD
2025-10-02T09:35:51.161150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296737055:5673]
2025-10-02T09:35:51.161175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.161218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:51.161234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Write session will restart in 0.007392s
2025-10-02T09:35:51.161234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.161259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Write session: Do CDS request
2025-10-02T09:35:51.161265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.170169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.170304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.170312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2950
2025-10-02T09:35:51.170448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.170496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.170506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.170511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.170859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2950 sessionId:  describe result for acl check
2025-10-02T09:35:51.170890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.170891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.170892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.170896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.171341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.172017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.172633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.172760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.172767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.172774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.172817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.172838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221159182:11065]
2025-10-02T09:35:51.173173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.173171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.173324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.173345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.173521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.173549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.173553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.173554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.173554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.173555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.173555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.173556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.173556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.173556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.173557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.173557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.173558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.173561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.173568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.173570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.173572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.173574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.173576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.173578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.173580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.173582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.173584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.173586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.173588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.173592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.173596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.173601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.173606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.173610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.173614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.173621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.173625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.173629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.173633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.173640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.173644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.173652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.173655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.173660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.173664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.173667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.173670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.173672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.173675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.173680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.173683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.173685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.173687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.173703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.177438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.177447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.177450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296737520:6261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.177454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.181030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.182695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.182706Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.182707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.182709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.182712Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2949 [2:7556555802221159182:11065]
2025-10-02T09:35:51.182719Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.182728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.182730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.182732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.182733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.182742Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.182748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.182752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.182778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.182783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.182784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.182786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.182788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.182823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.182829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.182836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.182841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.182849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.182862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737564:6261], now have 1 active actors on pipe
2025-10-02T09:35:51.182868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737056:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.182871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.182873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.182874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.182881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.182888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.182894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.182896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.182897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.182899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.182900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.182914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.182901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2949
2025-10-02T09:35:51.182922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2949
2025-10-02T09:35:51.182918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.182931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.182934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.182936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.182953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.182959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.182961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.182963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.182967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.182973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.182981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.183090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.183096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.183103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.183165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2950 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0
2025-10-02T09:35:51.183423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fdecb-5cd0ef6b-864be758-5b0efb35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.185715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Write session: try to update token
2025-10-02T09:35:51.185727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.191816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.191827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.191830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.191831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.191836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.191837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.191839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221159176:11065]
2025-10-02T09:35:51.191857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.191859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.191862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.191863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.191864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.191865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.191983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.197529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId: src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.199804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.261235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296737583:5673]
2025-10-02T09:35:51.261397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2949, pipe: [1:7556555802296737583:5673]
2025-10-02T09:35:51.302256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.302459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.302468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.302481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737583:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.302643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.302700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.302707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:51.302742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296737583:5673]
2025-10-02T09:35:51.302797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2950 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0
2025-10-02T09:35:51.302977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2950 sessionId: src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0 is DEAD
2025-10-02T09:35:51.303131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:51.303142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Write session will restart in 0.007043s
2025-10-02T09:35:51.303162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Write session: Do CDS request
2025-10-02T09:35:51.303167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.311135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.311243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.311257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2951
2025-10-02T09:35:51.311342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.311365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.311368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.311371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.311653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2951 sessionId:  describe result for acl check
2025-10-02T09:35:51.311682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.311689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.311690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.311693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.312048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.313579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.314705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.314976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.315073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.315080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.315086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.315113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.315135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221159472:11067]
2025-10-02T09:35:51.315322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.315333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.315334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296737956:6274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.315339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.315474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.315643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.315666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.315841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.315870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.315874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.315875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.315875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.315876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.315876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.315877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.315877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.315878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.315878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.315879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.315879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.315882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.315888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.315890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.315892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.315894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.315896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.315898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.315900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.315902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.315904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.315906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.315908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.315913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.315917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.315920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.315923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.315926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.315929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.315931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.315934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.315936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.315939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.315941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.315943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.315946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.315949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.315951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.315953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.315957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.315959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.315962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.315964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.315966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.315969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.315971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.315973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.315990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.323378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.325050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.325061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.325063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.325065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.325068Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2950 [2:7556555802221159472:11067]
2025-10-02T09:35:51.325075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.325084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.325086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.325087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.325088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.325097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.325104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.325109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.325135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.325140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.325141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.325143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.325144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.325179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.325184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.325190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.325195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.325205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.325215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.325220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.325221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.325226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.325231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.325233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.325235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.325236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296737584:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.325241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738090:6274], now have 1 active actors on pipe
2025-10-02T09:35:51.325245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.325254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.325262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.325282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.325293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.325279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2950
2025-10-02T09:35:51.325311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2950
2025-10-02T09:35:51.325309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.325354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.325359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.325375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.325383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.325385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.325387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.325393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.325399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.325410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.325529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.325534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.325541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.325600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2951 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0
2025-10-02T09:35:51.325899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f8fdef2-435c067c-793d1b07-1d5f64f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.328318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Write session: try to update token
2025-10-02T09:35:51.328333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.334222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.334235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.334236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.334237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.334240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.334242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.334245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221159467:11067]
2025-10-02T09:35:51.334264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.334267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.334270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.334271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.334273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.334275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.334391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.340474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId: src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.342790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.403076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296738102:5673]
2025-10-02T09:35:51.403280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2950, pipe: [1:7556555802296738102:5673]
2025-10-02T09:35:51.442153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.442444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.442454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.442466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738102:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.442578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.442633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:51.442638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.442685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296738102:5673]
2025-10-02T09:35:51.442708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2951 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0
2025-10-02T09:35:51.442833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2951 sessionId: src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0 is DEAD
2025-10-02T09:35:51.442995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:51.443008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Write session will restart in 0.007177s
2025-10-02T09:35:51.443031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Write session: Do CDS request
2025-10-02T09:35:51.443036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.451354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.451384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.451370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2952
2025-10-02T09:35:51.451578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.451610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.451615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.451619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.451922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2952 sessionId:  describe result for acl check
2025-10-02T09:35:51.451947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.451951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.451952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.451955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.452310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.453644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.453812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.454433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.454525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.454532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.454538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.454563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.454637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221159764:11070]
2025-10-02T09:35:51.455040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.455225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.455248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.455421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.455452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.455455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.455456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.455456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.455457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.455457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.455458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.455458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.455459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.455459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.455460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.455460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.455463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.455469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.455471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.455473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.455474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.455476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.455478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.455480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.455482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.455485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.455487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.455489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.455492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.455496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.455499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.455502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.455504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.455506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.455508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.455511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.455513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.455515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.455518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.455520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.455522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.455525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.455530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.455533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.455535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.455538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.455541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.455544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.455546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.455552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.455554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.455556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.455573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.455630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.455638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.455639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296738519:6285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.455643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.462904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.464557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.464567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.464569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.464571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.464574Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2951 [2:7556555802221159764:11070]
2025-10-02T09:35:51.464580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.464590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.464592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.464593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.464594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.464603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.464610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.464614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.464641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.464646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.464647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.464649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.464650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.464683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.464687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.464693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.464698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.464709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.464717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.464722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.464723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.464728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.464733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.464735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.464735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738103:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.464736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.464737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738610:6285], now have 1 active actors on pipe
2025-10-02T09:35:51.464742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.464749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.464751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.464764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.464771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.464784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.464784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2951
2025-10-02T09:35:51.464838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2951
2025-10-02T09:35:51.464862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.464867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.464882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca20139-f31e9c23-65099852-4db60995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.464886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.464893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.464895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.464899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.464904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.464914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.465062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.465067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.465074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.465146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2952 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca20139-f31e9c23-65099852-4db60995_0
2025-10-02T09:35:51.465525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bea9ab-32544d68-80a1479c-553a3fa1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca20139-f31e9c23-65099852-4db60995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.467938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Write session: try to update token
2025-10-02T09:35:51.467956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.473633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:51.473645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.473649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.473670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:51.473674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:51.473833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:51.473968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.474108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.474238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:51.474420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:51.474440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:51.480459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId: src_id|ca20139-f31e9c23-65099852-4db60995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.481843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.481855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.481856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.481857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.481861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.481863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.481865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221159758:11070]
2025-10-02T09:35:51.481883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.481889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.481891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.481891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.481892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.481895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.482045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.482910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.542862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296738620:5673]
2025-10-02T09:35:51.543070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2951, pipe: [1:7556555802296738620:5673]
2025-10-02T09:35:51.590708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.591144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.591155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.591168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738620:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.591299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.591338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296738620:5673]
2025-10-02T09:35:51.591351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:51.591357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.591358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:51.591429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2952 reason: error at write: Disconnected sessionId: src_id|ca20139-f31e9c23-65099852-4db60995_0
2025-10-02T09:35:51.591569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2952 sessionId: src_id|ca20139-f31e9c23-65099852-4db60995_0 is DEAD
2025-10-02T09:35:51.591698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:51.591711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Write session will restart in 0.005082s
2025-10-02T09:35:51.591732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Write session: Do CDS request
2025-10-02T09:35:51.591738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.598105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.598200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.598212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2953
2025-10-02T09:35:51.598302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.598327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.598335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.598338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.598709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2953 sessionId:  describe result for acl check
2025-10-02T09:35:51.598737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.598744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.598745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.598750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.599223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.600792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.602549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.603408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.603516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.603522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.603529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.603556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.603578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221160054:11072]
2025-10-02T09:35:51.603598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.603607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.603609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296738861:6296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.603613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.603947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.604124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.604150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.604339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.604372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.604376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.604377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.604377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.604378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.604378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.604379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.604379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.604380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.604380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.604381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.604382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.604385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.604391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.604394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.604396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.604398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.604400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.604402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.604404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.604406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.604408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.604410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.604412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.604416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.604420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.604423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.604426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.604429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.604432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.604438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.604442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.604446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.604450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.604456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.604461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.604469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.604473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.604479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.604485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.604493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.604495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.604497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.604503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.604506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.604509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.604512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.604528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.612121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.613709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.613722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.613723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.613725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.613729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2952 [2:7556555802221160054:11072]
2025-10-02T09:35:51.613736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.613745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.613747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.613748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.613749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.613758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.613761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.613766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.613795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.613800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.613801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.613803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.613805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.613841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.613846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.613852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.613858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.613866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.613877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739130:6296], now have 1 active actors on pipe
2025-10-02T09:35:51.613882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296738624:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.613886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.613887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.613888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.613896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.613903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.613904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.613906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.613908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.613911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.613912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.613926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.613929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.613932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.613912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2952
2025-10-02T09:35:51.613940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.613943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.613938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2952
2025-10-02T09:35:51.613979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.613987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.613989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.613991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.613996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.614001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.614014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.614093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.614098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.614106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.614160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2953 partition: 0 MaxSeqNo: 36 sessionId: src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0
2025-10-02T09:35:51.614435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca20139-f31e9c23-65099852-4db60995_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.616710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Write session: try to update token
2025-10-02T09:35:51.616723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.622992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.623004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.623005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.623006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.623010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.623013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.623015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221160048:11072]
2025-10-02T09:35:51.623034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.623037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.623038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.623040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.623043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.623044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.623153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.628414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId: src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.630764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.691290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296739164:5673]
2025-10-02T09:35:51.691404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2952, pipe: [1:7556555802296739164:5673]
2025-10-02T09:35:51.733792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.734184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.734194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.734206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739164:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.734342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.734436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:51.734436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296739164:5673]
2025-10-02T09:35:51.734467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.734550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2953 reason: status is not ok: tablet will be restarted right now sessionId: src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0
2025-10-02T09:35:51.734714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2953 sessionId: src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0 is DEAD
2025-10-02T09:35:51.734861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:51.734875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Write session will restart in 0.006127s
2025-10-02T09:35:51.734896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Write session: Do CDS request
2025-10-02T09:35:51.734901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.742149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.742222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.742235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2954
2025-10-02T09:35:51.742324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.742351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.742356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.742359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.742692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2954 sessionId:  describe result for acl check
2025-10-02T09:35:51.742717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.742724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.742725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.742730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.743677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.745457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.746375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.746590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.746755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.746763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.746769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.746799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.746821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221160381:11086]
2025-10-02T09:35:51.747178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.747379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.747403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.747600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.747592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.747604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.747606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296739492:6325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.747611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.747643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.747648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.747649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.747649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.747650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.747651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.747652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.747652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.747653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.747653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.747654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.747654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.747657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.747664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.747666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.747668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.747670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.747672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.747674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.747676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.747678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.747681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.747683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.747685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.747688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.747693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.747696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.747699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.747700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.747703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.747705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.747708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.747710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.747713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.747715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.747718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.747720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.747722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.747725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.747728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.747730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.747732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.747734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.747737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.747739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.747741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.747743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.747746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.747763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.755179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.756797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.756822Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.756824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.756826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.756829Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2953 [2:7556555802221160381:11086]
2025-10-02T09:35:51.756836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.756846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.756848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.756850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.756850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.756861Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.756864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.756870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.756899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.756904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.756905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.756907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.756908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.756941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.756946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.756952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.756957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.756967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.756980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739674:6325], now have 1 active actors on pipe
2025-10-02T09:35:51.756985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739165:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.756989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.756990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.756991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.756998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.757008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.757015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.757017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.757019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.757024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.757026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.757032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.757034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.757035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.757057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2953
2025-10-02T09:35:51.757061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2953
2025-10-02T09:35:51.757110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.757115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.757135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.757141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.757144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.757145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.757150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.757156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.757168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.757304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.757310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.757320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.757380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2954 partition: 0 MaxSeqNo: 36 sessionId: src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0
2025-10-02T09:35:51.757664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579cc8fb-ca55b112-dcf0a23-1348d3ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.759957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Write session: try to update token
2025-10-02T09:35:51.759971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.766044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.766057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.766059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.766059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.766062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.766065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.766066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221160376:11086]
2025-10-02T09:35:51.766087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.766089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.766090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.766090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.766093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.766095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.766205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.771767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId: src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.774144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.834681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296739683:5673]
2025-10-02T09:35:51.834868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2953, pipe: [1:7556555802296739683:5673]
2025-10-02T09:35:51.874196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:51.874527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.874537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.874550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739683:5673], now have 1 active actors on pipe
2025-10-02T09:35:51.874712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:51.874743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296739683:5673]
2025-10-02T09:35:51.874748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:51.874777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:51.874856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2954 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0
2025-10-02T09:35:51.875008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2954 sessionId: src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0 is DEAD
2025-10-02T09:35:51.875144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:51.875157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Write session will restart in 0.007353s
2025-10-02T09:35:51.875181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Write session: Do CDS request
2025-10-02T09:35:51.875186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:51.883146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.883217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:51.883227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2955
2025-10-02T09:35:51.883336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:51.883359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:51.883368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:51.883371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:51.883670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2955 sessionId:  describe result for acl check
2025-10-02T09:35:51.883694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:51.883700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:51.883701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:51.883705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:51.884261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:51.885959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:51.886135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:51.886783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:51.886919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:51.886926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:51.886932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:51.886962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:51.886984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555802221160674:11088]
2025-10-02T09:35:51.887323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:51.887513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:51.887536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:51.887710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:51.887739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.887743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.887744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.887745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.887745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.887743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:51.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.887747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.887754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:51.887747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.887757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555802296740044:6330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:51.887748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.887762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:51.887749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.887749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.887752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.887759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.887761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.887763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.887765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.887767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.887769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.887771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.887773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.887775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.887777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.887779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.887782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.887786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:51.887789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.887792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:51.887794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.887797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:51.887799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.887802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:51.887804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.887807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:51.887809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.887812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:51.887814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.887817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:51.887819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.887822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:51.887824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.887827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:51.887829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.887831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.887834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.887836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.887838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.887841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.887857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:51.895218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:51.896650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:51.896661Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:51.896662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:51.896664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:51.896667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2954 [2:7556555802221160674:11088]
2025-10-02T09:35:51.896674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:51.896684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:51.896685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.896687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.896688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.896697Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:51.896704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:51.896708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:51.896738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.896743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.896744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.896745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:51.896747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:51.896783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:51.896787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.896793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:51.896798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:51.896823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:51.896837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296740196:6330], now have 1 active actors on pipe
2025-10-02T09:35:51.896842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296739685:2446], now have 1 active actors on pipe
2025-10-02T09:35:51.896846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.896847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.896848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.896856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:51.896866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:51.896872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:51.896874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:51.896876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:51.896877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:51.896879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:51.896892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.896897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:51.896898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:51.896909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2954
2025-10-02T09:35:51.896912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2954
2025-10-02T09:35:51.897059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.897067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.897084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:51.897091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:51.897093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:51.897094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:51.897099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:51.897108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:51.897118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.897233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:51.897238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:51.897246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:51.897310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2955 partition: 0 MaxSeqNo: 36 sessionId: src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0
2025-10-02T09:35:51.897575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bf1cae-35a4b932-8682df45-755d3cdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:51.899862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Write session: try to update token
2025-10-02T09:35:51.899875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:51.905859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:51.905871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:51.905872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:51.905873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:51.905877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.905879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.905881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555802221160668:11088]
2025-10-02T09:35:51.905901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:51.905904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:51.905905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:51.905908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:51.905911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:51.905913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:51.906010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:51.911704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId: src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:51.914004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:51.974976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555802296740212:5673]
2025-10-02T09:35:51.975196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2954, pipe: [1:7556555802296740212:5673]
2025-10-02T09:35:52.015536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.015911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.015922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.015934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555802296740212:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.016102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.016168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.016173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555802296740212:5673]
2025-10-02T09:35:52.016199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.016284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2955 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0
2025-10-02T09:35:52.016433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2955 sessionId: src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0 is DEAD
2025-10-02T09:35:52.016563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.016577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Write session will restart in 0.008858s
2025-10-02T09:35:52.016597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Write session: Do CDS request
2025-10-02T09:35:52.016602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.026152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.026308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.026322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2956
2025-10-02T09:35:52.026421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.026451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.026461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.026464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.026846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2956 sessionId:  describe result for acl check
2025-10-02T09:35:52.026880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.026890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.026891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.026895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.027289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.027326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.028025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.028167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.028175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.028181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.028211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.028232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516128264:11090]
2025-10-02T09:35:52.028581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.028737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.028762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.028765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.028963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.028995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.028999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.029000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.029000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.029001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.029001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.029002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.029002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.029003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.029003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.029004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.029004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.029007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.029014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.029016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.029018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.029020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.029022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.029024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.029026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.029028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.029030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.029031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.029033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.029038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.029042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.029046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.029049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.029051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.029054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.029056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.029059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.029061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.029063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.029069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.029072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.029074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.029076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.029078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.029084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.029087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.029089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.029091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.029094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.029099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.029102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.029105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.029107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.029123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.033875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.033887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.033890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591707985:6359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.033895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.036501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.038009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.038023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.038024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.038026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.038030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2955 [2:7556555806516128264:11090]
2025-10-02T09:35:52.038038Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.038048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.038053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.038055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.038056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.038065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.038068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.038076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.038105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.038109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.038111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.038113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.038114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.038149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.038153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.038159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.038168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.038176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.038191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708026:6359], now have 1 active actors on pipe
2025-10-02T09:35:52.038196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591707513:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.038200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.038201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.038202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.038210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.038221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.038221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.038223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.038224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.038231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.038233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.038247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.038252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.038250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2955
2025-10-02T09:35:52.038252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2955
2025-10-02T09:35:52.038269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.038420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.038428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.038451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f623a4-d2954f0-7de63d3e-847177e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.038455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.038458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.038459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.038464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.038469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.038477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.038585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.038590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.038598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.038664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2956 partition: 0 MaxSeqNo: 36 sessionId: src_id|41f623a4-d2954f0-7de63d3e-847177e9_0
2025-10-02T09:35:52.038933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c900ef8a-58dee167-2d2b9dbf-e7668a41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41f623a4-d2954f0-7de63d3e-847177e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.041404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Write session: try to update token
2025-10-02T09:35:52.041417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.047224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.047236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.047237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.047238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.047242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.047244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.047246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516128258:11090]
2025-10-02T09:35:52.047265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.047266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.047267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.047268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.047269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.047270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.047389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.053665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId: src_id|41f623a4-d2954f0-7de63d3e-847177e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.056004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.116291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591708033:5673]
2025-10-02T09:35:52.116465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2955, pipe: [1:7556555806591708033:5673]
2025-10-02T09:35:52.155894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.156254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.156264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.156276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708033:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.156389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.156505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.156505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591708033:5673]
2025-10-02T09:35:52.156542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.156634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2956 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41f623a4-d2954f0-7de63d3e-847177e9_0
2025-10-02T09:35:52.156839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2956 sessionId: src_id|41f623a4-d2954f0-7de63d3e-847177e9_0 is DEAD
2025-10-02T09:35:52.156963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.156975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Write session will restart in 0.008287s
2025-10-02T09:35:52.156998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Write session: Do CDS request
2025-10-02T09:35:52.157003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.166212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.166303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.166316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2957
2025-10-02T09:35:52.166411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.166437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.166449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.166453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.166886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2957 sessionId:  describe result for acl check
2025-10-02T09:35:52.166921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.166930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.166931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.166936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.167354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.167757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.168435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.168532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.168539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.168545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.168571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.168636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516128573:11094]
2025-10-02T09:35:52.169002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.169103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.169188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.169213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.169391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.169422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.169426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.169426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.169427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.169427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.169428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.169428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.169429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.169430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.169430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.169431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.169431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.169434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.169441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.169443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.169445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.169447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.169449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.169451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.169453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.169455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.169457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.169459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.169461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.169465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.169468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.169472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.169475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.169477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.169479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.169482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.169484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.169486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.169489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.169493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.169496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.169498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.169501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.169506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.169509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.169511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.169514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.169516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.169518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.169524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.169526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.169536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.169542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.169559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.173425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.173439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.173442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591708506:6356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.173468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.176976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.178574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.178586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.178587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.178589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.178592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2956 [2:7556555806516128573:11094]
2025-10-02T09:35:52.178599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.178609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.178614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.178616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.178617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.178625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.178630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.178636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.178675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.178680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.178681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.178684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.178685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.178720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.178725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.178732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.178737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.178745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.178760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708548:6356], now have 1 active actors on pipe
2025-10-02T09:35:52.178766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708034:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.178770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.178771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.178773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.178780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.178790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.178796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.178799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.178799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.178800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.178800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.178813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.178821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.178827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.178811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2956
2025-10-02T09:35:52.178814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2956
2025-10-02T09:35:52.178847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.178852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.178868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.178875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.178877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.178879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.178884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.178889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.178900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.179025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.179030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.179038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.179106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2957 partition: 0 MaxSeqNo: 36 sessionId: src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0
2025-10-02T09:35:52.179351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f623a4-d2954f0-7de63d3e-847177e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.181802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Write session: try to update token
2025-10-02T09:35:52.181817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.191542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:52.191553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.191557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.191578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:52.191585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:52.191713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:52.191888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:52.192003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:52.192114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:52.192279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:52.192303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:52.193961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId: src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.195924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.195937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.195938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.195939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.195943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.195944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.195947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516128567:11094]
2025-10-02T09:35:52.195965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.195968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.195968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.195969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.195971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.195973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.196074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.196328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.256591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591708568:5673]
2025-10-02T09:35:52.256754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2956, pipe: [1:7556555806591708568:5673]
2025-10-02T09:35:52.304155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.304515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.304525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.304538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708568:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.304677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.304743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.304743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591708568:5673]
2025-10-02T09:35:52.304766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.304855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2957 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0
2025-10-02T09:35:52.305010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2957 sessionId: src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0 is DEAD
2025-10-02T09:35:52.305128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.305145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Write session will restart in 0.005254s
2025-10-02T09:35:52.305165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Write session: Do CDS request
2025-10-02T09:35:52.305171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.311133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.311232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.311249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2958
2025-10-02T09:35:52.311341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.311368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.311377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.311380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.311742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2958 sessionId:  describe result for acl check
2025-10-02T09:35:52.311767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.311774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.311776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.311780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.312216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.314134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.315805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.315816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.315819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591708737:6365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.315835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.316766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.317640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.317789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.317797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.317804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.317839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.317865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516128870:11096]
2025-10-02T09:35:52.318270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.318446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.318470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.318654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.318699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.318703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.318703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.318704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.318705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.318705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.318706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.318706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.318707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.318707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.318708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.318709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.318711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.318718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.318720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.318722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.318724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.318726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.318728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.318730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.318733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.318735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.318737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.318739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.318743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.318747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.318752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.318754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.318757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.318761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.318764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.318767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.318769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.318771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.318774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.318776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.318779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.318781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.318784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.318787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.318790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.318792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.318795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.318797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.318801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.318804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.318807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.318823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.326375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.328059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.328070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.328071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.328074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.328077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2957 [2:7556555806516128870:11096]
2025-10-02T09:35:52.328085Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.328094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.328099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.328101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.328102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.328111Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.328117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.328121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.328152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.328156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.328158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.328160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.328162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.328196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.328201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.328208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.328213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.328221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.328235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591708569:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.328240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709078:6365], now have 1 active actors on pipe
2025-10-02T09:35:52.328244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.328245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.328247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.328256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.328263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.328273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.328275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.328276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.328281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.328282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.328293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.328295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.328296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.328309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2957
2025-10-02T09:35:52.328309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2957
2025-10-02T09:35:52.328344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.328352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.328367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.328374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.328376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.328377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.328382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.328387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.328394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.328532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.328537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.328544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.328611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2958 partition: 0 MaxSeqNo: 36 sessionId: src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0
2025-10-02T09:35:52.328894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357ebf6-2754d4cd-591e8ab1-c3ff99e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.331171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Write session: try to update token
2025-10-02T09:35:52.331184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.337486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.337498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.337499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.337500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.337504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.337506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.337509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516128865:11096]
2025-10-02T09:35:52.337527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.337534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.337534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.337535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.337536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.337538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.337650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.342820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId: src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.345062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.405059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591709094:5673]
2025-10-02T09:35:52.405259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2957, pipe: [1:7556555806591709094:5673]
2025-10-02T09:35:52.446073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.446461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.446470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.446484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709094:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.446594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.446672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591709094:5673]
2025-10-02T09:35:52.446692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.446698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.446752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2958 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0
2025-10-02T09:35:52.446884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2958 sessionId: src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0 is DEAD
2025-10-02T09:35:52.447052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.447067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Write session will restart in 0.006100s
2025-10-02T09:35:52.447088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Write session: Do CDS request
2025-10-02T09:35:52.447093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.454118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.454221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.454235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2959
2025-10-02T09:35:52.454336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.454362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.454372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.454375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.454719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2959 sessionId:  describe result for acl check
2025-10-02T09:35:52.454748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.454755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.454757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.454762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.455189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.456794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.458137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.458969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.459079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.459088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.459095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.459111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.459119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.459121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591709387:6382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.459125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.459124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.459147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516129168:11099]
2025-10-02T09:35:52.459515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.459688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.459712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.459914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.459949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.459953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.459954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.459954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.459955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.459955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.459956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.459956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.459957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.459957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.459958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.459958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.459961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.459968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.459970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.459972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.459974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.459976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.459978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.459979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.459981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.459983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.459985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.459987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.459991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.459996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.459999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.460002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.460004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.460007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.460009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.460011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.460014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.460016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.460018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.460021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.460023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.460025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.460027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.460030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.460032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.460035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.460037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.460040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.460042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.460044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.460046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.460049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.460064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.467418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.468954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.468964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.468965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.468967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.468971Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2958 [2:7556555806516129168:11099]
2025-10-02T09:35:52.468981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.468992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.468999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.469002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.469003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.469012Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.469017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.469020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.469050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.469055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.469056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.469058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.469059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.469097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.469101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.469108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.469115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.469123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.469137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709095:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.469142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709607:6382], now have 1 active actors on pipe
2025-10-02T09:35:52.469146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.469147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.469148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.469155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.469165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.469167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.469169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.469170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.469173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.469174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.469187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.469192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.469184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2958
2025-10-02T09:35:52.469197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.469211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2958
2025-10-02T09:35:52.469234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.469239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.469253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.469259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.469261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.469261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.469266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.469271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.469281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.469396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.469401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.469408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.469476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2959 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0
2025-10-02T09:35:52.469721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60200b57-fcfd62b5-25facdcc-5d9c256a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.472065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Write session: try to update token
2025-10-02T09:35:52.472079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.478083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.478094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.478095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.478096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.478100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.478102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.478104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516129162:11099]
2025-10-02T09:35:52.478122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.478124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.478125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.478127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.478129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.478131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.478237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.483795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId: src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.486094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.546872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591709619:5673]
2025-10-02T09:35:52.547086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2958, pipe: [1:7556555806591709619:5673]
2025-10-02T09:35:52.590379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.590978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.590988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.591001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709619:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.591115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.591151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.591156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591709619:5673]
2025-10-02T09:35:52.591183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.591266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2959 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0
2025-10-02T09:35:52.591442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2959 sessionId: src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0 is DEAD
2025-10-02T09:35:52.591593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.591606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Write session will restart in 0.006130s
2025-10-02T09:35:52.591630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Write session: Do CDS request
2025-10-02T09:35:52.591635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.599183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.599284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.599297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2960
2025-10-02T09:35:52.599383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.599408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.599418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.599422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.599774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2960 sessionId:  describe result for acl check
2025-10-02T09:35:52.599803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.599807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.599808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.599812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.600162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.601756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.602465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.603342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.603439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.603448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.603456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.603485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.603506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516129465:11101]
2025-10-02T09:35:52.603526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.603534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.603536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591709972:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.603539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.603874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.604033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.604058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.604266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.604301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.604305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.604306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.604306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.604307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.604307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.604308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.604308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.604309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.604309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.604310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.604310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.604313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.604319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.604321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.604323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.604324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.604326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.604328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.604330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.604332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.604335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.604337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.604339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.604343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.604346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.604350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.604352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.604355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.604358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.604360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.604362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.604365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.604367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.604369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.604372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.604374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.604377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.604379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.604381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.604384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.604386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.604388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.604391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.604393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.604396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.604398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.604401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.604418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.611811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.613242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.613255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.613256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.613258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.613261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2959 [2:7556555806516129465:11101]
2025-10-02T09:35:52.613268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.613278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.613282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.613283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.613285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.613293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.613298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.613305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.613333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.613337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.613338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.613340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.613341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.613382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.613388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.613396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.613401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.613412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.613427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710133:6390], now have 1 active actors on pipe
2025-10-02T09:35:52.613432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591709620:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.613435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.613436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.613437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.613445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.613453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.613461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.613461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.613463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.613465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.613466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.613478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.613468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2959
2025-10-02T09:35:52.613482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.613485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.613495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.613500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.613519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.613526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.613497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2959
2025-10-02T09:35:52.613527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.613529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.613533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.613540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.613555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.613690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.613697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.613706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.613773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2960 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0
2025-10-02T09:35:52.614038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29764-b2c57b64-48d4ee0e-e34aba1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.616299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Write session: try to update token
2025-10-02T09:35:52.616311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.622417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.622427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.622428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.622429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.622432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.622435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.622436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516129459:11101]
2025-10-02T09:35:52.622455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.622458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.622459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.622460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.622463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.622466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.622574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.627781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId: src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.630067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.691231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591710149:5673]
2025-10-02T09:35:52.691392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2959, pipe: [1:7556555806591710149:5673]
2025-10-02T09:35:52.734116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.734630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.734640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.734652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710149:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.734796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.734838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591710149:5673]
2025-10-02T09:35:52.734867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.735413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.735486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2960 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0
2025-10-02T09:35:52.735638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2960 sessionId: src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0 is DEAD
2025-10-02T09:35:52.735757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.735769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Write session will restart in 0.008220s
2025-10-02T09:35:52.735787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Write session: Do CDS request
2025-10-02T09:35:52.735792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.745177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.745251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.745262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2961
2025-10-02T09:35:52.745342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.745368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.745371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.745375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.745752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2961 sessionId:  describe result for acl check
2025-10-02T09:35:52.745790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.745799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.745800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.745804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.745827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.746252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.746760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.746868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.746875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.746880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.746908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.746931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516129799:11115]
2025-10-02T09:35:52.747288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.747455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.747483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.747677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.747711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.747715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.747716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.747716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.747717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.747717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.747718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.747718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.747719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.747719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.747720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.747720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.747723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.747729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.747732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.747734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.747736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.747738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.747740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.747742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.747744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.747746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.747748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.747749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.747753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.747757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.747760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.747763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.747765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.747767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.747770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.747772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.747775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.747777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.747780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.747783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.747785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.747788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.747790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.747792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.747794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.747797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.747799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.747802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.747804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.747807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.747811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.747816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.747847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.748577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.753605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.753617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.753619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591710649:6422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.753626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.755224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.756658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.756671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.756672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.756674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.756678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2960 [2:7556555806516129799:11115]
2025-10-02T09:35:52.756685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.756694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.756695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.756697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.756698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.756706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.756710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.756714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.756823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.756829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.756830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.756832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.756833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.756868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.756873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.756879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.756884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.756893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.756907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710685:6422], now have 1 active actors on pipe
2025-10-02T09:35:52.756912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710171:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.756916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.756917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.756918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.756926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.756937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.756936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.756939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.756940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.756946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.756947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.756960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.756967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.756970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.756963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2960
2025-10-02T09:35:52.756988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.756964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2960
2025-10-02T09:35:52.756993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.757008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.757015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.757017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.757018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.757024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.757032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.757043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.757176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.757183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.757192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.757256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2961 partition: 0 MaxSeqNo: 36 sessionId: src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0
2025-10-02T09:35:52.757508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b0e029-9ab7ad83-541f193a-ed4e9352_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.759980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Write session: try to update token
2025-10-02T09:35:52.759994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.765937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.765950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.765951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.765952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.765955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.765957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.765959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516129794:11115]
2025-10-02T09:35:52.765977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.765980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.765981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.765981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.765983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.765985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.766099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.771985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId: src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.774271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.835124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591710692:5673]
2025-10-02T09:35:52.835336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2960, pipe: [1:7556555806591710692:5673]
2025-10-02T09:35:52.876562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:52.877109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.877122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.877135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710692:5673], now have 1 active actors on pipe
2025-10-02T09:35:52.877261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:52.877342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591710692:5673]
2025-10-02T09:35:52.877369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:52.877519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:52.877596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0
2025-10-02T09:35:52.877741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2961 sessionId: src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0 is DEAD
2025-10-02T09:35:52.877862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:52.877875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Write session will restart in 0.009208s
2025-10-02T09:35:52.877899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Write session: Do CDS request
2025-10-02T09:35:52.877904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:52.888151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.888264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:52.888279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2962
2025-10-02T09:35:52.888377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:52.888404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:52.888413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:52.888416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:52.888869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2962 sessionId:  describe result for acl check
2025-10-02T09:35:52.888901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:52.888907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:52.888921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:52.888931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:52.889016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:52.889340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:52.889990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:52.890123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:52.890133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:52.890142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:52.890183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:52.890213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555806516130099:11117]
2025-10-02T09:35:52.890709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:52.890908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:52.890942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:52.891005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:52.891166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:52.891218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.891223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.891224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.891225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.891225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.891227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.891227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.891228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.891229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.891230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.891230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.891231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.891235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.891243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.891247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.891251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.891253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.891257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.891260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.891263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.891265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.891268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.891273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.891276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.891281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.891291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:52.891300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.891305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:52.891308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.891314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:52.891317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.891323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:52.891327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.891332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:52.891336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.891341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:52.891345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.891352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:52.891356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.891360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:52.891364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.891370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:52.891373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.891379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.891382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.891388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.891393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.891402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.891430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:52.895251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:52.895262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:52.895264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555806591711175:6436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:52.895269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:52.898829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:52.900507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:52.900520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:52.900521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:52.900523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:52.900526Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2961 [2:7556555806516130099:11117]
2025-10-02T09:35:52.900535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:52.900545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:52.900550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.900551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.900552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.900560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:52.900563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:52.900567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:52.900597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.900602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.900603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.900604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:52.900605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:52.900639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:52.900644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.900650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:52.900656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:52.900667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:52.900683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591711214:6436], now have 1 active actors on pipe
2025-10-02T09:35:52.900690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591710694:2446], now have 1 active actors on pipe
2025-10-02T09:35:52.900694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.900696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.900698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.900707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:52.900721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:52.900724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:52.900726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:52.900727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:52.900736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:52.900740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:52.900733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2961
2025-10-02T09:35:52.900756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.900762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:52.900735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2961
2025-10-02T09:35:52.900763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:52.900775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.900782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.900818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:52.900825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:52.900827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:52.900828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:52.900832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:52.900837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:52.900848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.900964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:52.900969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:52.900976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:52.901031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2962 partition: 0 MaxSeqNo: 36 sessionId: src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0
2025-10-02T09:35:52.901313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30cc3ac-ee2cb505-80a31013-8c1c45ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:52.903577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Write session: try to update token
2025-10-02T09:35:52.903591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:52.909826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:52.909839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:52.909841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:52.909842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:52.909846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.909849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.909851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555806516130094:11117]
2025-10-02T09:35:52.909871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:52.909873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:52.909874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:52.909878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:52.909881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:52.909883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:52.910042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:52.915487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId: src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:52.917893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:52.977447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555806591711226:5673]
2025-10-02T09:35:52.977614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2961, pipe: [1:7556555806591711226:5673]
2025-10-02T09:35:53.021004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.021590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.021601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.021613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555806591711226:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.021751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.021784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:53.021790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:53.021799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.021824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555806591711226:5673]
2025-10-02T09:35:53.021837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2962 reason: error at write: Disconnected sessionId: src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0
2025-10-02T09:35:53.021958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2962 sessionId: src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0 is DEAD
2025-10-02T09:35:53.022122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:53.022136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Write session will restart in 0.006745s
2025-10-02T09:35:53.022155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Write session: Do CDS request
2025-10-02T09:35:53.022161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.030160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.030242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.030251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2963
2025-10-02T09:35:53.030371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.030391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.030397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.030399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.030731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2963 sessionId:  describe result for acl check
2025-10-02T09:35:53.030765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.030772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.030774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.030778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.031205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.033023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.033561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.034345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.034444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.034451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.034456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.034482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.034511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811097696:11119]
2025-10-02T09:35:53.034581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.034595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.034598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886678898:6439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.034602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.034898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.035075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.035100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.035296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.035340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.035345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.035346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.035346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.035347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.035348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.035348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.035349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.035349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.035350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.035350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.035351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.035354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.035360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.035362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.035365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.035367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.035369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.035371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.035373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.035375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.035377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.035379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.035381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.035385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.035388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.035392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.035394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.035396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.035400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.035402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.035404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.035406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.035409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.035411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.035414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.035416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.035419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.035421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.035424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.035426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.035429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.035431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.035434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.035436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.035439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.035441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.035444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.035459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.042822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.044390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.044401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.044402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.044404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.044407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2962 [2:7556555810811097696:11119]
2025-10-02T09:35:53.044414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.044423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.044428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.044430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.044431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.044440Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.044442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.044446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.044475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.044480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.044480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.044482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.044483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.044518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.044523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.044530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.044535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.044543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.044557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886678527:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.044563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679051:6439], now have 1 active actors on pipe
2025-10-02T09:35:53.044566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.044567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.044568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.044575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.044586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.044591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.044593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.044594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.044597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.044598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.044611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.044616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.044618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.044616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2962
2025-10-02T09:35:53.044628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2962
2025-10-02T09:35:53.044695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.044700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.044714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.044721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.044723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.044724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.044729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.044736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.044743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.044909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.044915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.044922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.044992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2963 partition: 0 MaxSeqNo: 36 sessionId: src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0
2025-10-02T09:35:53.045226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee0a1-f5ebc34-6ee2bd99-e48f5505_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.047564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Write session: try to update token
2025-10-02T09:35:53.047578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.053610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.053622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.053623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.053624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.053628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.053630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.053632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811097691:11119]
2025-10-02T09:35:53.053650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.053653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.053654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.053659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.053670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.053672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.053766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.059453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId: src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.061751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.121860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886679063:5673]
2025-10-02T09:35:53.122035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2962, pipe: [1:7556555810886679063:5673]
2025-10-02T09:35:53.162696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.163260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.163273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.163287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679063:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.163405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.163501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:53.163503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886679063:5673]
2025-10-02T09:35:53.163526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.163696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2963 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0
2025-10-02T09:35:53.163847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2963 sessionId: src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0 is DEAD
2025-10-02T09:35:53.163972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:53.163984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Write session will restart in 0.005210s
2025-10-02T09:35:53.164004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Write session: Do CDS request
2025-10-02T09:35:53.164008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.170114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.170216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.170231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2964
2025-10-02T09:35:53.170322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.170345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.170355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.170358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.170700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2964 sessionId:  describe result for acl check
2025-10-02T09:35:53.170732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.170737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.170739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.170743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.171168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.173165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.175451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.175460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.175463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886679251:6448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.175467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.175628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.176369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.176514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.176522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.176528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.176559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.176580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811098013:11123]
2025-10-02T09:35:53.176943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.177140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.177183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.177394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.177426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.177430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.177431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.177431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.177432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.177433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.177433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.177434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.177435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.177435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.177436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.177437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.177440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.177447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.177449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.177451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.177453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.177455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.177458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.177460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.177462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.177465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.177467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.177469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.177474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.177478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.177482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.177485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.177487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.177490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.177492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.177495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.177498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.177504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.177507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.177509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.177512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.177515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.177517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.177520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.177522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.177528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.177530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.177534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.177536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.177539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.177541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.177544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.177563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.184883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.186469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.186480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.186481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.186483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.186487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2963 [2:7556555810811098013:11123]
2025-10-02T09:35:53.186493Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.186502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.186507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.186509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.186510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.186519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.186522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.186526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.186552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.186557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.186558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.186560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.186561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.186594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.186599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.186606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.186611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.186619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.186633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679064:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.186639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679580:6448], now have 1 active actors on pipe
2025-10-02T09:35:53.186643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.186644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.186646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.186654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.186673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.186674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.186681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.186682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.186682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.186683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.186699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.186705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.186697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2963
2025-10-02T09:35:53.186705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2963
2025-10-02T09:35:53.186721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.186743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.186748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.186762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.186769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.186771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.186772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.186777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.186784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.186791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.186919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.186924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.186931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.186990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2964 partition: 0 MaxSeqNo: 36 sessionId: src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0
2025-10-02T09:35:53.187188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11560af-ce22880c-5691b5ca-fa909c1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.189396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Write session: try to update token
2025-10-02T09:35:53.189410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.195629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.195642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.195643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.195644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.195648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.195650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.195652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811098008:11123]
2025-10-02T09:35:53.195670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.195672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.195674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.195675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.195676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.195677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.195780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.200912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId: src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.203164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.263698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886679605:5673]
2025-10-02T09:35:53.263881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2963, pipe: [1:7556555810886679605:5673]
2025-10-02T09:35:53.304740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.305128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.305138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.305149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679605:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.305288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.305297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886679605:5673]
2025-10-02T09:35:53.305316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:53.305318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:53.305344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.305371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2964 reason: error at write: Disconnected sessionId: src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0
2025-10-02T09:35:53.305525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2964 sessionId: src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0 is DEAD
2025-10-02T09:35:53.305789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:53.305803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Write session will restart in 0.008403s
2025-10-02T09:35:53.305826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Write session: Do CDS request
2025-10-02T09:35:53.305832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.315276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.315341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.315348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2965
2025-10-02T09:35:53.315459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.315477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.315483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.315485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.315737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2965 sessionId:  describe result for acl check
2025-10-02T09:35:53.315760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.315765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.315766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.315770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.316129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.316732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.317773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.317840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.317945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.317953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.317959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.317986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.318008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811098315:11125]
2025-10-02T09:35:53.318347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.318555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.318582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.318775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.318803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.318807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.318808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.318809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.318809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.318810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.318810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.318811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.318811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.318812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.318813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.318813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.318816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.318822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.318824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.318826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.318828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.318830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.318832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.318834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.318836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.318838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.318840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.318842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.318846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.318849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.318852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.318855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.318857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.318860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.318862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.318864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.318867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.318869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.318872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.318875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.318877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.318880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.318882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.318885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.318887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.318890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.318892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.318895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.318897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.318900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.318902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.318905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.318922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.322732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.322742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.322744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886680085:6461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.322749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.326311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.327882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.327895Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.327896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.327898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.327901Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2964 [2:7556555810811098315:11125]
2025-10-02T09:35:53.327908Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.327918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.327920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.327921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.327922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.327931Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.327935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.327939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.327968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.327973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.327974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.327976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.327977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.328011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.328016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.328022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.328027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.328037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.328051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680130:6461], now have 1 active actors on pipe
2025-10-02T09:35:53.328057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886679606:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.328060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.328062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.328063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.328071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.328081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.328087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.328090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.328091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.328092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.328093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.328082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2964
2025-10-02T09:35:53.328106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.328088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2964
2025-10-02T09:35:53.328111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.328112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.328119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.328121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.328144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f04472dd-1dcd03ea-2850a160-daf73912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.328150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.328152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.328153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.328159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.328164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.328176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.328263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.328268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.328275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.328329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2965 partition: 0 MaxSeqNo: 36 sessionId: src_id|f04472dd-1dcd03ea-2850a160-daf73912_0
2025-10-02T09:35:53.328599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ccf559-2a5cdeb3-f3232509-ab24a791_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f04472dd-1dcd03ea-2850a160-daf73912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.330977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Write session: try to update token
2025-10-02T09:35:53.330991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.337163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.337177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.337178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.337179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.337183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.337185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.337188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811098309:11125]
2025-10-02T09:35:53.337207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.337209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.337211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.337212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.337215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.337217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.337370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.343586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId: src_id|f04472dd-1dcd03ea-2850a160-daf73912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.345724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.405472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886680138:5673]
2025-10-02T09:35:53.405637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2964, pipe: [1:7556555810886680138:5673]
2025-10-02T09:35:53.446751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.446979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.446988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.446999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680138:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.447126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.447157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.447169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886680138:5673]
2025-10-02T09:35:53.447185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:53.447241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2965 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f04472dd-1dcd03ea-2850a160-daf73912_0
2025-10-02T09:35:53.447383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2965 sessionId: src_id|f04472dd-1dcd03ea-2850a160-daf73912_0 is DEAD
2025-10-02T09:35:53.447541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:53.447557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Write session will restart in 0.009715s
2025-10-02T09:35:53.447579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Write session: Do CDS request
2025-10-02T09:35:53.447584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.458155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.458397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.458406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2966
2025-10-02T09:35:53.458530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.458551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.458557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.458560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.458830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2966 sessionId:  describe result for acl check
2025-10-02T09:35:53.458850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.458854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.458855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.458858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.459209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.459425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.460304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.460409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.460416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.460422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.460449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.460476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811098621:11128]
2025-10-02T09:35:53.460591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.460862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.461044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.461070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.461249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.461279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.461283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.461283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.461284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.461284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.461285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.461286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.461286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.461287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.461287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.461288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.461288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.461291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.461297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.461299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.461301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.461303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.461305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.461307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.461309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.461311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.461313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.461315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.461317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.461320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.461324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.461327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.461330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.461332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.461335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.461337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.461339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.461341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.461344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.461346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.461349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.461351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.461353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.461355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.461358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.461360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.461363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.461367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.461369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.461371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.461374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.461377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.461383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.461400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.465138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.465145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.465147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886680622:6469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.465150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.468790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.470269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.470281Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.470282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.470284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.470287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2965 [2:7556555810811098621:11128]
2025-10-02T09:35:53.470294Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.470304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.470308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.470310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.470311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.470320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.470323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.470328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.470361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.470366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.470367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.470368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.470369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.470403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.470409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.470415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.470420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.470428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.470442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680139:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.470449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680662:6469], now have 1 active actors on pipe
2025-10-02T09:35:53.470454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.470459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.470461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.470469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.470473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2965
2025-10-02T09:35:53.470483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.470483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.470485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.470486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.470497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.470499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.470496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2965
2025-10-02T09:35:53.470524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.470530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.470539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.470548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.470560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.470567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60d1c976-5e3edda0-67409b62-372d82a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.470571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.470573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.470574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.470580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.470588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.470602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.470708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.470714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.470721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.470774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2966 partition: 0 MaxSeqNo: 36 sessionId: src_id|60d1c976-5e3edda0-67409b62-372d82a8_0
2025-10-02T09:35:53.471019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04472dd-1dcd03ea-2850a160-daf73912_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60d1c976-5e3edda0-67409b62-372d82a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.473321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Write session: try to update token
2025-10-02T09:35:53.473338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.480238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.480261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.480264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.480266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.480274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.480277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.480280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811098616:11128]
2025-10-02T09:35:53.480306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.480312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.480315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.480317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.480319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.480321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.480546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.486447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId: src_id|60d1c976-5e3edda0-67409b62-372d82a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.488930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.547321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886680670:5673]
2025-10-02T09:35:53.547539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2965, pipe: [1:7556555810886680670:5673]
2025-10-02T09:35:53.591482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.591677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.591687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.591699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680670:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.591816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.591828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.591832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886680670:5673]
2025-10-02T09:35:53.591848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:53.591850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:53.591897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2966 reason: error at write: Disconnected sessionId: src_id|60d1c976-5e3edda0-67409b62-372d82a8_0
2025-10-02T09:35:53.592025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2966 sessionId: src_id|60d1c976-5e3edda0-67409b62-372d82a8_0 is DEAD
2025-10-02T09:35:53.592214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:53.592227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Write session will restart in 0.008127s
2025-10-02T09:35:53.592249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Write session: Do CDS request
2025-10-02T09:35:53.592255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.601182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.601296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.601307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2967
2025-10-02T09:35:53.601433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.601461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.601468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.601472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.601793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2967 sessionId:  describe result for acl check
2025-10-02T09:35:53.601820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.601826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.601827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.601831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.602272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.603538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.604993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.605083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.605185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.605194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.605218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.605251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.605273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811098935:11130]
2025-10-02T09:35:53.605455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.605462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.605464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886681088:6484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.605473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.605702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.605892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.605918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.606095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.606125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.606129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.606130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.606130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.606131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.606131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.606132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.606132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.606133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.606134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.606134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.606135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.606138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.606143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.606145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.606147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.606149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.606151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.606153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.606155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.606157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.606159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.606161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.606163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.606167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.606171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.606174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.606176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.606179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.606181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.606184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.606186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.606189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.606191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.606193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.606196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.606198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.606201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.606203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.606206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.606208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.606210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.606212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.606215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.606218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.606222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.606224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.606227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.606248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.613554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.615180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.615191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.615192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.615193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.615196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2966 [2:7556555810811098935:11130]
2025-10-02T09:35:53.615201Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.615210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.615211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.615213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.615214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.615222Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.615225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.615228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.615257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.615262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.615263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.615265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.615266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.615301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.615305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.615312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.615317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.615326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.615342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886680671:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.615349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681194:6484], now have 1 active actors on pipe
2025-10-02T09:35:53.615354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.615355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.615357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.615367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.615379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.615380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.615386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.615387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.615391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.615393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.615374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2966
2025-10-02T09:35:53.615391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2966
2025-10-02T09:35:53.615412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.615419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.615422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.615428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.615434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.615456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3009245a-bd377d19-4e308dc1-1466e72b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.615462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.615464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.615466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.615472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.615478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.615487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.615580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.615586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.615593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.615650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2967 partition: 0 MaxSeqNo: 36 sessionId: src_id|3009245a-bd377d19-4e308dc1-1466e72b_0
2025-10-02T09:35:53.615888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d1c976-5e3edda0-67409b62-372d82a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3009245a-bd377d19-4e308dc1-1466e72b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.618153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Write session: try to update token
2025-10-02T09:35:53.618166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.624363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.624375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.624376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.624377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.624381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.624383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.624384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811098925:11130]
2025-10-02T09:35:53.624404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.624405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.624408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.624410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.624410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.624412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.624546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.630005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId: src_id|3009245a-bd377d19-4e308dc1-1466e72b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.632385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.692225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886681205:5673]
2025-10-02T09:35:53.692418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2966, pipe: [1:7556555810886681205:5673]
2025-10-02T09:35:53.736034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.736382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.736392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.736404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681205:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.736566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.736609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886681205:5673]
2025-10-02T09:35:53.736627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:53.736629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:53.736674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2967 reason: error at write: Disconnected sessionId: src_id|3009245a-bd377d19-4e308dc1-1466e72b_0
2025-10-02T09:35:53.736865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2967 sessionId: src_id|3009245a-bd377d19-4e308dc1-1466e72b_0 is DEAD
2025-10-02T09:35:53.737008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:53.737021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Write session will restart in 0.008762s
2025-10-02T09:35:53.737041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Write session: Do CDS request
2025-10-02T09:35:53.737046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.737270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.740889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.741466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.741562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.741569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.741575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.741602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.741627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811099004:11138]
2025-10-02T09:35:53.741967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.742316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.742360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.742708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.742745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.742749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.742749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.742750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.742751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.742751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.742752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.742752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.742753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.742753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.742754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.742755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.742759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.742764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.742766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.742769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.742771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.742773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.742775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.742777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.742779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.742782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.742784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.742786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.742790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.742794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.742797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.742801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.742803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.742806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.742809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.742812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.742814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.742817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.742819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.742821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.742823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.742828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.742831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.742833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.742835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.742837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.742840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.742843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.742846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.742848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.742850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.742867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.747209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.747295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.747304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2968
2025-10-02T09:35:53.747448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.747470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.747476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.747479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.747733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2968 sessionId:  describe result for acl check
2025-10-02T09:35:53.747757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.747761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.747762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.747765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.748046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.749308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.750354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.750958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.750965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.750967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886681256:6507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.750971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.752037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.752049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.752050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.752052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.752056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2967 [2:7556555810811099004:11138]
2025-10-02T09:35:53.752063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.752072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.752077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.752078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.752080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.752089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.752092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.752096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.752128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.752133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.752134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.752136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.752138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.752173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.752178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.752185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.752190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.752209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.752228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681220:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.752222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2967
2025-10-02T09:35:53.752234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681287:6507], now have 1 active actors on pipe
2025-10-02T09:35:53.752239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.752241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.752242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.752249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.752242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2967
2025-10-02T09:35:53.752253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.752258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.752260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.752261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.752270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.752277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.752290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.752297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.752317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.752325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.752336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|614772fe-55595252-3ae835f3-b34f424c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.752337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.752343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.752345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.752347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.752351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.752357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.752374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.752466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.752473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.752481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.752531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2968 partition: 0 MaxSeqNo: 36 sessionId: src_id|614772fe-55595252-3ae835f3-b34f424c_0
2025-10-02T09:35:53.752750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3009245a-bd377d19-4e308dc1-1466e72b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|614772fe-55595252-3ae835f3-b34f424c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.755152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Write session: try to update token
2025-10-02T09:35:53.755167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.761179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:53.761190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.761194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.761214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:53.761215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:53.761356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:53.761471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:53.761581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:53.761695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:53.761846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:53.761870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:53.767465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId: src_id|614772fe-55595252-3ae835f3-b34f424c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.770113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.770130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.770132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.770134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.770140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.770144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.770147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811098999:11138]
2025-10-02T09:35:53.770170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.770171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.770176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.770177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.770178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.770179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.770179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.770302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.836593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886681295:5673]
2025-10-02T09:35:53.836767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2967, pipe: [1:7556555810886681295:5673]
2025-10-02T09:35:53.878511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:53.878896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.878905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.878919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681295:5673], now have 1 active actors on pipe
2025-10-02T09:35:53.879054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:53.879074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:53.879078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886681295:5673]
2025-10-02T09:35:53.879094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:53.879147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2968 reason: status is not ok: tablet will be restarted right now sessionId: src_id|614772fe-55595252-3ae835f3-b34f424c_0
2025-10-02T09:35:53.879300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2968 sessionId: src_id|614772fe-55595252-3ae835f3-b34f424c_0 is DEAD
2025-10-02T09:35:53.879444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:53.879458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Write session will restart in 0.008409s
2025-10-02T09:35:53.879483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Write session: Do CDS request
2025-10-02T09:35:53.879488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:53.883567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:53.884182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:53.884280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:53.884286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:53.884292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:53.884318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:53.884341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555810811099085:11146]
2025-10-02T09:35:53.884683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:53.884857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:53.884880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:53.885057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:53.885087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.885091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.885091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.885093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.885093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.885094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.885094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.885095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.885097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.885098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.885098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.885101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.885107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.885109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.885112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.885114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.885116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.885117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.885119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.885121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.885125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.885127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.885132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.885136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:53.885139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.885142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:53.885144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.885147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:53.885149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.885152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:53.885159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.885162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:53.885164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.885167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:53.885169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.885172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:53.885174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.885176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:53.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:53.885184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.885187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.885190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.885196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.885198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.885201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.885217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:53.889106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.889300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:53.889310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2969
2025-10-02T09:35:53.889436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:53.889456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:53.889462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:53.889465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:53.889726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2969 sessionId:  describe result for acl check
2025-10-02T09:35:53.889746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:53.889750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:53.889751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:53.889754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:53.890070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:53.891174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:53.892611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:53.893289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:53.893296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:53.893297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555810886681321:6528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:53.893317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:53.894133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:53.894148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:53.894149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:53.894151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:53.894156Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2968 [2:7556555810811099085:11146]
2025-10-02T09:35:53.894163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:53.894178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:53.894184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.894186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.894187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.894196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:53.894202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:53.894206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:53.894239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.894245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.894246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.894247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:53.894249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:53.894287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:53.894292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.894298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:53.894303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:53.894315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:53.894331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681355:6528], now have 1 active actors on pipe
2025-10-02T09:35:53.894338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681297:2446], now have 1 active actors on pipe
2025-10-02T09:35:53.894342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.894348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.894350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.894361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:53.894360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2968
2025-10-02T09:35:53.894375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2968
2025-10-02T09:35:53.894373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:53.894374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:53.894382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:53.894384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:53.894386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:53.894388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:53.894406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.894414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:53.894415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:53.894423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.894428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.894455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:53.894463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:53.894465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:53.894468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:53.894473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:53.894479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:53.894491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.894609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:53.894614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:53.894622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:53.894685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2969 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0
2025-10-02T09:35:53.894906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614772fe-55595252-3ae835f3-b34f424c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:53.897249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Write session: try to update token
2025-10-02T09:35:53.897262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:53.903468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:53.903482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:53.903483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:53.903484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:53.903487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.903491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.903493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555810811099080:11146]
2025-10-02T09:35:53.903511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:53.903515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:53.903517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:53.903518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:53.903519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:53.903521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:53.903630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:53.909987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId: src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:53.912356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:53.979441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555810886681368:5673]
2025-10-02T09:35:53.979609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2968, pipe: [1:7556555810886681368:5673]
2025-10-02T09:35:54.013357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.013650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.013660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.013672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555810886681368:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.013843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555810886681368:5673]
2025-10-02T09:35:54.013856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.013870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:54.013876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:54.013921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2969 reason: error at write: Disconnected sessionId: src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0
2025-10-02T09:35:54.013976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.014061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2969 sessionId: src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0 is DEAD
2025-10-02T09:35:54.014245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:54.014258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Write session will restart in 0.008222s
2025-10-02T09:35:54.014278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Write session: Do CDS request
2025-10-02T09:35:54.014294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.018136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.018681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.018778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.018785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.018791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.018816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.018842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066440:11148]
2025-10-02T09:35:54.019188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.019351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.019373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.019548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.019578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.019583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.019583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.019584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.019585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.019585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.019586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.019587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.019588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.019588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.019589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.019589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.019592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.019599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.019601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.019604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.019606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.019608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.019610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.019612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.019614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.019617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.019619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.019621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.019625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.019629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.019633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.019636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.019638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.019641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.019643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.019646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.019648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.019651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.019653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.019655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.019658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.019660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.019663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.019665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.019667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.019670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.019673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.019675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.019678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.019680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.019682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.019685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.019702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.023161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.023277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.023287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2970
2025-10-02T09:35:54.023422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.023444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.023447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.023449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.023714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2970 sessionId:  describe result for acl check
2025-10-02T09:35:54.023738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.023744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.023745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.023749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.024088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.025355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.026859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.026867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.026869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181648693:6535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.026872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.027105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.028630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.028642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.028644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.028646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.028651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2969 [2:7556555815106066440:11148]
2025-10-02T09:35:54.028660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.028672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.028676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.028680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.028681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.028690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.028693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.028697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.028726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.028733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.028734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.028736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.028737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.028774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.028779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.028786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.028791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.028798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.028831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648727:6535], now have 1 active actors on pipe
2025-10-02T09:35:54.028838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648668:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.028842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.028847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.028849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.028848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2969
2025-10-02T09:35:54.028860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.028852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2969
2025-10-02T09:35:54.028869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.028873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.028878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.028879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.028885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.028888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.028912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.028917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.028924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.028932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.028939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.028950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.028957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.028960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.028964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.028969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.028976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.028992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.029086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.029093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.029100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.029166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2970 partition: 0 MaxSeqNo: 36 sessionId: src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0
2025-10-02T09:35:54.029406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d969cb-e58c99cf-411d2f02-6308e062_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.031729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Write session: try to update token
2025-10-02T09:35:54.031742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.037952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.037965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.037966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.037967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.037971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.037973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.037977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066435:11148]
2025-10-02T09:35:54.037999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.038005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.038006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.038007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.038011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.038013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.038114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.043117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId: src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.045516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.114105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181648736:5673]
2025-10-02T09:35:54.114276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2969, pipe: [1:7556555815181648736:5673]
2025-10-02T09:35:54.147392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.147612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.147621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.147633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648736:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.147764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.147836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181648736:5673]
2025-10-02T09:35:54.147838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:54.147858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.147895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2970 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0
2025-10-02T09:35:54.148067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2970 sessionId: src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0 is DEAD
2025-10-02T09:35:54.148205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:54.148220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Write session will restart in 0.006009s
2025-10-02T09:35:54.148243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Write session: Do CDS request
2025-10-02T09:35:54.148248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.151955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.152591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.152696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.152703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.152709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.152734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.152759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066514:11152]
2025-10-02T09:35:54.153113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.153284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.153308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.153483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.153514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.153518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.153519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.153519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.153520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.153521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.153522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.153522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.153523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.153524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.153524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.153525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.153528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.153535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.153537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.153539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.153541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.153543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.153545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.153547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.153549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.153552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.153554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.153556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.153560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.153564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.153567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.153570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.153572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.153574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.153577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.153580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.153582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.153585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.153587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.153590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.153592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.153595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.153597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.153600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.153602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.153604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.153606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.153609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.153611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.153614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.153620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.153622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.153639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.155133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.155241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.155249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2971
2025-10-02T09:35:54.155369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.155388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.155391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.155397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.155656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2971 sessionId:  describe result for acl check
2025-10-02T09:35:54.155680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.155685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.155686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.155689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.155979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.157320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.160416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.160424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.160425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181648763:6546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.160430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.161048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.162515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.162530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.162531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.162533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.162536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2970 [2:7556555815106066514:11152]
2025-10-02T09:35:54.162545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.162559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.162564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.162566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.162567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.162575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.162581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.162586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.162618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.162623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.162624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.162626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.162627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.162662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.162676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.162683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.162691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.162703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.162717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648808:6546], now have 1 active actors on pipe
2025-10-02T09:35:54.162724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648737:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.162728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.162733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.162735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.162745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.162757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.162759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.162764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.162765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.162770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.162773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.162754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2970
2025-10-02T09:35:54.162772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2970
2025-10-02T09:35:54.162792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.162798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.162799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.162810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.162817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.162843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.162850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.162852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.162855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.162860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.162868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.162880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.162993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.162998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.163006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.163067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2971 partition: 0 MaxSeqNo: 36 sessionId: src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0
2025-10-02T09:35:54.163293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8909d44a-db524ccf-fb9fdb0e-7fbb57d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.165568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Write session: try to update token
2025-10-02T09:35:54.165580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.171854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.171867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.171868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.171869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.171872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.171874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.171876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066509:11152]
2025-10-02T09:35:54.171895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.171895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.171898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.171900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.171901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.171904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.172030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.178251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId: src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.180498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.248249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181648831:5673]
2025-10-02T09:35:54.248440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2970, pipe: [1:7556555815181648831:5673]
2025-10-02T09:35:54.282853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.283072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.283082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.283095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648831:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.283226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.283234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181648831:5673]
2025-10-02T09:35:54.283242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:54.283244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:54.283255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.283288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2971 reason: error at write: Disconnected sessionId: src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0
2025-10-02T09:35:54.283419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2971 sessionId: src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0 is DEAD
2025-10-02T09:35:54.283568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:54.283582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Write session will restart in 0.009525s
2025-10-02T09:35:54.283605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Write session: Do CDS request
2025-10-02T09:35:54.283611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.287454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.288145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.288240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.288247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.288253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.288279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.288303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066575:11154]
2025-10-02T09:35:54.288642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.288817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.288839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.289015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.289044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.289049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.289049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.289050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.289050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.289051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.289051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.289052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.289052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.289053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.289053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.289054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.289056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.289063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.289065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.289067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.289069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.289071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.289073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.289075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.289077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.289079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.289081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.289083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.289088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.289092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.289095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.289098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.289100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.289103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.289106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.289109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.289114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.289118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.289120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.289126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.289128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.289131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.289133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.289137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.289139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.289142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.289144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.289148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.289153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.289155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.289157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.289160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.289176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.294155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.294337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.294344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2972
2025-10-02T09:35:54.294444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.294464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.294470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.294473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.294745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2972 sessionId:  describe result for acl check
2025-10-02T09:35:54.294765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.294769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.294770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.294773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.295102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.296537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.296646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.297987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.297999Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.298001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.298003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.298006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2971 [2:7556555815106066575:11154]
2025-10-02T09:35:54.298013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.298024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.298029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.298030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.298031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.298040Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.298043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.298050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.298081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.298086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.298087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.298089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.298090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.298125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.298130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.298136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.298141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.298152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.298166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648832:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.298173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.298174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.298175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.298182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.298178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2971
2025-10-02T09:35:54.298179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.298183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.298185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181648859:6554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.298193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.298188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.298196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.298198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.298199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.298204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.298207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.298224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.298231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.298235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.298307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648894:6554], now have 1 active actors on pipe
2025-10-02T09:35:54.298319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2971
2025-10-02T09:35:54.298349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.298354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.298366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.298373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.298375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.298376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.298381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.298389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.298398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.298501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.298506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.298513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.298559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2972 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0
2025-10-02T09:35:54.298781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8776ed6e-cd5a2cb0-9f2d5ff3-691e722c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.301137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Write session: try to update token
2025-10-02T09:35:54.301152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.307030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:54.307041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.307044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.307064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:54.307072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:54.307197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:54.307308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:54.307414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:54.307525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:54.307672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:54.307692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:54.312994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId: src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.315156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.315383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.315396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.315405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.315407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.315410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.315412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.315415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.315416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.315419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066570:11154]
2025-10-02T09:35:54.315439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.315444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.315446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.315446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.315447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.315448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.315560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.383401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181648905:5673]
2025-10-02T09:35:54.383561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2971, pipe: [1:7556555815181648905:5673]
2025-10-02T09:35:54.423587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.423832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:54.423854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648905:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.423938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:54.423980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181648905:5673]
2025-10-02T09:35:54.424003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.424008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:54.424010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:54.424062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2972 reason: error at write: Disconnected sessionId: src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0
2025-10-02T09:35:54.424216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2972 sessionId: src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0 is DEAD
2025-10-02T09:35:54.424346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:54.424354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Write session will restart in 0.006397s
2025-10-02T09:35:54.424370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Write session: Do CDS request
2025-10-02T09:35:54.424377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.428916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.429668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.429771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.429779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.429785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.429811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.429838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066638:11157]
2025-10-02T09:35:54.430185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.430350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.430373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.430551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.430586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.430586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.430587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.430588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.430588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.430589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.430590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.430590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.430591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.430591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.430592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.430597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.430604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.430606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.430608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.430610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.430612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.430614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.430616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.430618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.430621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.430623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.430625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.430630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.430634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.430637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.430640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.430642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.430645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.430647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.430650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.430652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.430658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.430660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.430663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.430665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.430678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.430683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.430686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.430688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.430690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.430693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.430700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.430702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.430705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.430710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.430712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.430730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.432287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.432342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.432349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2973
2025-10-02T09:35:54.432570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.432588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.432590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.432593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.432916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2973 sessionId:  describe result for acl check
2025-10-02T09:35:54.432941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.432946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.432948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.432953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.433360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.434944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.437702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.437710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.437712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181648934:6564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.437716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.438306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.439785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.439798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.439801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.439803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.439806Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2972 [2:7556555815106066638:11157]
2025-10-02T09:35:54.439814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.439826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.439828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.439830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.439831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.439839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.439842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.439846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.439877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.439882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.439883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.439886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.439887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.439922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.439927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.439933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.439940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.439951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.439966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648969:6564], now have 1 active actors on pipe
2025-10-02T09:35:54.439971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648906:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.439975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.439977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.439978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.439987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.439999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.440001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.439996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2972
2025-10-02T09:35:54.440003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.440004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.440009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.440001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2972
2025-10-02T09:35:54.440011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.440032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.440037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.440044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.440050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.440061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.440070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.440073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.440075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.440076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.440081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.440088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.440098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.440189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.440194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.440201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.440246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2973 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0
2025-10-02T09:35:54.440471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7f8a1c-84bf768d-91870b44-e665761f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.443184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Write session: try to update token
2025-10-02T09:35:54.443194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.449174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.449190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.449191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.449194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.449200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.449202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.449203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066633:11157]
2025-10-02T09:35:54.449222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.449228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.449229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.449229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.449231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.449234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.449344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.455829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId: src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.458004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.524203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181648976:5673]
2025-10-02T09:35:54.524392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2972, pipe: [1:7556555815181648976:5673]
2025-10-02T09:35:54.557292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.557601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.557612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.557624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648976:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.557754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.557874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181648976:5673]
2025-10-02T09:35:54.557890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.557898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:54.557951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2973 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0
2025-10-02T09:35:54.558085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2973 sessionId: src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0 is DEAD
2025-10-02T09:35:54.558211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:54.558220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Write session will restart in 0.006372s
2025-10-02T09:35:54.558235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Write session: Do CDS request
2025-10-02T09:35:54.558239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.562046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.562784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.562884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.562891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.562896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.562921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.562946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066701:11159]
2025-10-02T09:35:54.563359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.563522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.563545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.563716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.563749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.563753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.563753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.563756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.563756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.563757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.563757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.563758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.563758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.563759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.563759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.563760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.563763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.563769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.563771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.563773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.563775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.563777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.563779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.563781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.563783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.563786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.563788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.563790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.563794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.563798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.563801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.563804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.563808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.563811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.563813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.563816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.563818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.563822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.563825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.563828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.563830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.563833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.563835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.563838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.563841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.563844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.563847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.563849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.563853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.563856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.563858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.563860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.563878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.565230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.565298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.565306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2974
2025-10-02T09:35:54.565398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.565417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.565423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.565425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.565734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2974 sessionId:  describe result for acl check
2025-10-02T09:35:54.565756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.565761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.565762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.565765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.566149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.567617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.570695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.570703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.570706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181649007:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.570710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.571353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.572907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.572920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.572921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.572923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.572927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2973 [2:7556555815106066701:11159]
2025-10-02T09:35:54.572936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.572947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.572953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.572957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.572958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.572971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.572979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.572985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.573022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.573028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.573029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.573031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.573032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.573071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.573076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.573082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.573087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.573098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.573113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649041:6581], now have 1 active actors on pipe
2025-10-02T09:35:54.573118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181648978:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.573122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.573128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.573128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.573136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.573148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.573150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.573151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.573143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2973
2025-10-02T09:35:54.573147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2973
2025-10-02T09:35:54.573153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.573158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.573160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.573179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.573185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.573185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.573196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.573201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.573228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.573234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.573240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.573243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.573248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.573254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.573266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.573353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.573357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.573365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.573415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2974 partition: 0 MaxSeqNo: 36 sessionId: src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0
2025-10-02T09:35:54.573648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f16bf7f-7adba4a7-bfc895ba-5522820_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.576309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Write session: try to update token
2025-10-02T09:35:54.576326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.582249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.582259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.582260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.582261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.582264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.582267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.582269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066696:11159]
2025-10-02T09:35:54.582289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.582296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.582297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.582302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.582306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.582309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.582415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.588352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId: src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.590427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.657828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181649048:5673]
2025-10-02T09:35:54.657982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2973, pipe: [1:7556555815181649048:5673]
2025-10-02T09:35:54.691172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.691417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.691425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.691438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649048:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.691559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.691620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:54.691632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181649048:5673]
2025-10-02T09:35:54.691683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2974 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0
2025-10-02T09:35:54.691729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.691806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2974 sessionId: src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0 is DEAD
2025-10-02T09:35:54.691930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:54.691938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Write session will restart in 0.006481s
2025-10-02T09:35:54.691957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Write session: Do CDS request
2025-10-02T09:35:54.691962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.696284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.697014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.697135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.697142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.697147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.697175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.697201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066764:11161]
2025-10-02T09:35:54.697545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.697700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.697722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.697897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.697926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.697930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.697931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.697932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.697932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.697933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.697934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.697934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.697935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.697936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.697936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.697937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.697940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.697946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.697948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.697951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.697953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.697955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.697956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.697958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.697960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.697963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.697965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.697966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.697971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.697975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.697978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.697981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.697983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.697986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.697989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.697991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.697994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.697996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.697998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.698001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.698003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.698006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.698008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.698011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.698017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.698020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.698022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.698028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.698031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.698033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.698035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.698041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.698057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.699120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.699217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.699226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2975
2025-10-02T09:35:54.699299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.699316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.699322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.699325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.699584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2975 sessionId:  describe result for acl check
2025-10-02T09:35:54.699602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.699606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.699608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.699611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.699962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.701212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.704849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.704857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.704859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181649079:6584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.704866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.705404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.706872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.706882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.706883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.706885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.706889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2974 [2:7556555815106066764:11161]
2025-10-02T09:35:54.706896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.706907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.706913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.706915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.706916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.706924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.706928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.706932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.706962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.706967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.706969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.706971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.706972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.707006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.707011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.707017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.707022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.707033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.707047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649115:6584], now have 1 active actors on pipe
2025-10-02T09:35:54.707053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649049:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.707056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.707057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.707058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.707066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.707065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2974
2025-10-02T09:35:54.707071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2974
2025-10-02T09:35:54.707076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.707084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.707086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.707087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.707093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.707094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.707109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.707114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.707122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.707130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.707142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.707144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.707148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.707149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.707150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.707155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.707160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.707175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.707274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.707281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.707287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.707338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2975 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0
2025-10-02T09:35:54.707531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5649b-67eb0874-24fbc540-e7c577f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.710246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Write session: try to update token
2025-10-02T09:35:54.710255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.716292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.716304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.716305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.716306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.716311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.716315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.716317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066759:11161]
2025-10-02T09:35:54.716339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.716345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.716346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.716347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.716351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.716353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.716717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.722886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId: src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.724986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.792077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181649144:5673]
2025-10-02T09:35:54.792204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2974, pipe: [1:7556555815181649144:5673]
2025-10-02T09:35:54.826314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.826542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.826550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.826562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649144:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.826680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.826734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.826742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181649144:5673]
2025-10-02T09:35:54.826760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:54.826812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2975 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0
2025-10-02T09:35:54.826941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2975 sessionId: src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0 is DEAD
2025-10-02T09:35:54.827070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:54.827080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Write session will restart in 0.005303s
2025-10-02T09:35:54.827097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Write session: Do CDS request
2025-10-02T09:35:54.827101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.831317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.832018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.832111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.832117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.832123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.832147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.832171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066865:11175]
2025-10-02T09:35:54.832511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.832720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.832743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.832929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.832960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.832964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.832965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.832965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.832966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.832966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.832967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.832967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.832968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.832969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.832969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.832970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.832973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.832979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.832981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.832983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.832985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.832988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.832990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.832992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.832993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.832996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.832998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.833001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.833005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.833009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.833012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.833015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.833018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.833021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.833024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.833027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.833029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.833032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.833034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.833036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.833039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.833043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.833048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.833051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.833053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.833056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.833059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.833061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.833063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.833066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.833068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.833070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.833088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.833157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.833359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.833366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2976
2025-10-02T09:35:54.833443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.833461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.833466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.833468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.833717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2976 sessionId:  describe result for acl check
2025-10-02T09:35:54.833738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.833743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.833745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.833748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.834079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.835321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.839268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.839279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.839283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181649176:6609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.839288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.840480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.841875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.841885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.841886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.841888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.841892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2975 [2:7556555815106066865:11175]
2025-10-02T09:35:54.841899Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.841910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.841915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.841917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.841918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.841927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.841929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.841934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.841962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.841967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.841968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.841969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.841971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.842046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.842051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.842057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.842062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.842070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.842084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649145:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.842089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649210:6609], now have 1 active actors on pipe
2025-10-02T09:35:54.842093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.842094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.842095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.842099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.842075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2975
2025-10-02T09:35:54.842106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.842107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.842077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2975
2025-10-02T09:35:54.842108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.842109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.842116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.842118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.842131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.842136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.842154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.842162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.842169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.842172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.842176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.842178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.842179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.842183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.842188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.842204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.842295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.842301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.842308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.842349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2976 partition: 0 MaxSeqNo: 36 sessionId: src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0
2025-10-02T09:35:54.842546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a67ff74-4b6afe6e-a36b1273-1d1f1842_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.845384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Write session: try to update token
2025-10-02T09:35:54.845395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.851321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.851333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.851334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.851336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.851342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.851344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.851346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066860:11175]
2025-10-02T09:35:54.851367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.851368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.851371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.851374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.851376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.851376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.851479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.857475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId: src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.859609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:54.927131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555815181649224:5673]
2025-10-02T09:35:54.927314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2975, pipe: [1:7556555815181649224:5673]
2025-10-02T09:35:54.961476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:54.961709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.961717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.961729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649224:5673], now have 1 active actors on pipe
2025-10-02T09:35:54.961849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:54.961891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:54.961947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555815181649224:5673]
2025-10-02T09:35:54.961964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:54.961969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:54.962014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2976 reason: error at write: Disconnected sessionId: src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0
2025-10-02T09:35:54.962141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2976 sessionId: src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0 is DEAD
2025-10-02T09:35:54.962260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:54.962265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Write session will restart in 0.006184s
2025-10-02T09:35:54.962281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Write session: Do CDS request
2025-10-02T09:35:54.962285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:54.967183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:54.967801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:54.967893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:54.967900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:54.967905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:54.967931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:54.967954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555815106066931:11177]
2025-10-02T09:35:54.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:54.968464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:54.968487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:54.968661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:54.968690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.968693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.968694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.968696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.968698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.968698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.968699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.968699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.968700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.968701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.968703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.968710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.968712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.968714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.968716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.968718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.968720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.968722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.968724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.968726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.968728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.968730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.968733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.968738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:54.968741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.968744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:54.968746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.968749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:54.968751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.968758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:54.968760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.968763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:54.968766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.968772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:54.968774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.968777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:54.968780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.968783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:54.968785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.968788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:54.968790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.968793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.968796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.968798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.968811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.968817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.968835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:54.969137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.969202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:54.969211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2977
2025-10-02T09:35:54.969279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:54.969296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:54.969302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:54.969304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:54.969585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2977 sessionId:  describe result for acl check
2025-10-02T09:35:54.969607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:54.969608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:54.969609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:54.969612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:54.969950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:54.971589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:54.975777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:54.975786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:54.975789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555815181649257:6629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:54.975792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:54.976390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:54.978078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:54.978092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:54.978094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:54.978098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:54.978103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2976 [2:7556555815106066931:11177]
2025-10-02T09:35:54.978114Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:54.978128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:54.978137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.978140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.978142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.978154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:54.978163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:54.978169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:54.978216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.978223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.978225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.978228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:54.978230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:54.978282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:54.978289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.978299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:54.978307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:54.978319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:54.978335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649291:6629], now have 1 active actors on pipe
2025-10-02T09:35:54.978342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555815181649225:2446], now have 1 active actors on pipe
2025-10-02T09:35:54.978349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.978355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.978356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.978368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:54.978377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:54.978381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:54.978382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:54.978383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:54.978394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:54.978401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:54.978378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2976
2025-10-02T09:35:54.978382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2976
2025-10-02T09:35:54.978433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.978440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.978446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.978451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:54.978459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:54.978470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:54.978474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:54.978476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:54.978477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:54.978483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:54.978489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:54.978501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.978622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:54.978629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:54.978638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:54.978713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2977 partition: 0 MaxSeqNo: 36 sessionId: src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0
2025-10-02T09:35:54.978909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d317ab-941af5cb-ceab831e-e56b9a45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:54.981752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Write session: try to update token
2025-10-02T09:35:54.981762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:54.988223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:54.988243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:54.988246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:54.988248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:54.988257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.988266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.988271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555815106066926:11177]
2025-10-02T09:35:54.988313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:54.988316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:54.988321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:54.988323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:54.988325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:54.988325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:54.988528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:54.994090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId: src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:54.996363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.062328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476616599:5673]
2025-10-02T09:35:55.062751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2976, pipe: [1:7556555819476616599:5673]
2025-10-02T09:35:55.098659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.098874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.098882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.098894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616599:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.099062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.099071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:55.099079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.099082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:55.099109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476616599:5673]
2025-10-02T09:35:55.099128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2977 reason: error at write: Disconnected sessionId: src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0
2025-10-02T09:35:55.099282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2977 sessionId: src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0 is DEAD
2025-10-02T09:35:55.099389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:55.099398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Write session will restart in 0.008414s
2025-10-02T09:35:55.099416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Write session: Do CDS request
2025-10-02T09:35:55.099420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.104275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.105072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.105180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.105186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.105192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.105218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.105244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034295:11179]
2025-10-02T09:35:55.105711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.105886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.105909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.106088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.106119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.106123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.106123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.106124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.106124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.106125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.106126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.106127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.106128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.106129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.106129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.106130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.106132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.106140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.106143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.106145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.106147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.106150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.106152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.106154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.106156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.106159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.106161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.106163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.106168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.106171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.106175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.106178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.106180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.106183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.106188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.106191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.106194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.106197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.106202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.106205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.106207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.106210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.106212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.106215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.106221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.106224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.106226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.106230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.106235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.106238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.106240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.106243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.106264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.109277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.109331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.109340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2978
2025-10-02T09:35:55.109496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.109515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.109521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.109524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.109792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2978 sessionId:  describe result for acl check
2025-10-02T09:35:55.109812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.109813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.109814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.109816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.110172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.111884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.113911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.113920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.113922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476616633:6637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.113936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.113972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.115450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.115462Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.115464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.115466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.115470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2977 [2:7556555819401034295:11179]
2025-10-02T09:35:55.115476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.115487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.115491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.115493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.115495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.115504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.115508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.115513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.115549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.115554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.115555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.115557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.115559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.115594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.115599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.115605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.115610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.115622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.115639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616668:6637], now have 1 active actors on pipe
2025-10-02T09:35:55.115646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616600:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.115650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.115653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.115655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.115666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.115667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2977
2025-10-02T09:35:55.115678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.115685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2977
2025-10-02T09:35:55.115679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.115683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.115685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.115690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.115693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.115719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.115726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.115736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.115745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.115753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.115764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.115771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.115773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.115774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.115783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.115789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.115804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.115902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.115908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.115916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.115977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2978 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0
2025-10-02T09:35:55.116217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda64b3-fb44f56c-d20fea68-f30bae3a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.118890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Write session: try to update token
2025-10-02T09:35:55.118903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.124920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.124929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.124930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.124931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.124935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.124937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.124941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034288:11179]
2025-10-02T09:35:55.124963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.124969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.124970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.124972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.124975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.124978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.125092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.131529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId: src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.133930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.199039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476616675:5673]
2025-10-02T09:35:55.199246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2977, pipe: [1:7556555819476616675:5673]
2025-10-02T09:35:55.235065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.235371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.235386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.235403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616675:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.235568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.235599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476616675:5673]
2025-10-02T09:35:55.235611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:55.235602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.235616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:55.235659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2978 reason: error at write: Disconnected sessionId: src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0
2025-10-02T09:35:55.235786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2978 sessionId: src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0 is DEAD
2025-10-02T09:35:55.236004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:55.236019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Write session will restart in 0.006556s
2025-10-02T09:35:55.236039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Write session: Do CDS request
2025-10-02T09:35:55.236045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.239858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.240472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.240571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.240577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.240582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.240611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.240634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034374:11183]
2025-10-02T09:35:55.240981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.241138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.241161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.241336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.241378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.241382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.241383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.241383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.241384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.241385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.241385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.241386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.241386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.241387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.241387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.241388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.241391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.241398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.241400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.241402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.241404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.241406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.241408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.241410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.241412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.241414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.241418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.241419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.241423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.241427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.241430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.241433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.241436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.241438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.241440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.241445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.241447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.241449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.241451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.241454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.241456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.241459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.241461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.241463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.241469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.241472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.241474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.241478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.241480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.241483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.241488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.241490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.241507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.243187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.243277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.243286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2979
2025-10-02T09:35:55.243378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.243396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.243399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.243401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.243640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2979 sessionId:  describe result for acl check
2025-10-02T09:35:55.243662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.243667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.243667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.243671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.243971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.245328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.248328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.248337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.248339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476616723:6640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.248343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.248935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.250333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.250343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.250346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.250348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.250354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2978 [2:7556555819401034374:11183]
2025-10-02T09:35:55.250364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.250378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.250382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.250384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.250385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.250394Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.250400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.250404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.250438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.250442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.250443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.250445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.250446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.250532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.250539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.250549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.250543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2978
2025-10-02T09:35:55.250562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.250567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2978
2025-10-02T09:35:55.250581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.250601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616757:6640], now have 1 active actors on pipe
2025-10-02T09:35:55.250608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616677:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.250617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.250623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.250634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.250638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.250639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.250647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.250658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.250659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.250664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.250665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.250667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.250669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.250689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|387e269a-5068171e-437603c-be90925a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.250696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.250698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.250699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.250704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.250713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.250733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.250740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.250748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.250748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.250845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.250851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.250859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.250909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2979 partition: 0 MaxSeqNo: 36 sessionId: src_id|387e269a-5068171e-437603c-be90925a_0
2025-10-02T09:35:55.251376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a104ae-32221d24-69e3bdd5-e631d8c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|387e269a-5068171e-437603c-be90925a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.253806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Write session: try to update token
2025-10-02T09:35:55.253822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.264142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:55.264153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.264158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.264178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:55.264179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:55.264310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:55.264422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:55.264536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:55.264657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:55.264913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:55.264936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:55.267020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId: src_id|387e269a-5068171e-437603c-be90925a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.268551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.268562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.268563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.268565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.268569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.268572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.268574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034369:11183]
2025-10-02T09:35:55.268593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.268594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.268598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.268599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.268600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.268601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.268712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.269421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.335924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476616767:5673]
2025-10-02T09:35:55.336086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2978, pipe: [1:7556555819476616767:5673]
2025-10-02T09:35:55.376220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.376566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.376575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.376587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616767:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.376741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.376738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.376750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476616767:5673]
2025-10-02T09:35:55.376768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:55.376770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:55.376821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2979 reason: error at write: Disconnected sessionId: src_id|387e269a-5068171e-437603c-be90925a_0
2025-10-02T09:35:55.376931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2979 sessionId: src_id|387e269a-5068171e-437603c-be90925a_0 is DEAD
2025-10-02T09:35:55.377054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:55.377070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Write session will restart in 0.005966s
2025-10-02T09:35:55.377091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Write session: Do CDS request
2025-10-02T09:35:55.377097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.381055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.381721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.381814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.381820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.381826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.381854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.381881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034443:11185]
2025-10-02T09:35:55.382353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.382547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.382585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.382870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.382921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.382927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.382928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.382930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.382931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.382932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.382933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.382934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.382935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.382936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.382937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.382938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.382944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.382953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.382957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.382961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.382965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.382970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.382974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.382982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.382990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.382999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.383006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.383010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.383022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.383033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.383042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.383051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.383060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.383068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.383076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.383083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.383091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.383098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.383105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.383110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.383119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.383127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.383131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.383140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.383147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.383153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.383162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.383170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.383178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.383186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.383194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.383202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.383240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.384168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.384241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.384251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2980
2025-10-02T09:35:55.384369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.384389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.384396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.384398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.384642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2980 sessionId:  describe result for acl check
2025-10-02T09:35:55.384660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.384664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.384665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.384668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.385038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.386196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.390111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.390121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.390123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476616804:6653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.390127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.390617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.392173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.392183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.392184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.392186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.392190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2979 [2:7556555819401034443:11185]
2025-10-02T09:35:55.392197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.392208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.392213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.392215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.392217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.392227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.392231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.392235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.392265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.392270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.392271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.392273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.392274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.392307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.392312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.392319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.392324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.392332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.392346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616769:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.392351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616839:6653], now have 1 active actors on pipe
2025-10-02T09:35:55.392355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.392357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.392358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.392365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.392376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.392376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.392378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.392379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.392371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2979
2025-10-02T09:35:55.392386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.392382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2979
2025-10-02T09:35:55.392389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.392403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.392408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.392409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.392418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.392422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.392450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e99f803-8f20c077-f622f460-b15829d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.392456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.392458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.392460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.392464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.392473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.392490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.392581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.392585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.392593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.392646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2980 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e99f803-8f20c077-f622f460-b15829d8_0
2025-10-02T09:35:55.392922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387e269a-5068171e-437603c-be90925a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e99f803-8f20c077-f622f460-b15829d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.395349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Write session: try to update token
2025-10-02T09:35:55.395363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.401444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.401454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.401455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.401456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.401459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.401462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.401464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034438:11185]
2025-10-02T09:35:55.401485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.401487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.401489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.401491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.401491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.401492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.401602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.409228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId: src_id|2e99f803-8f20c077-f622f460-b15829d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.411349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.477035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476616846:5673]
2025-10-02T09:35:55.477196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2979, pipe: [1:7556555819476616846:5673]
2025-10-02T09:35:55.511468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.511697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.511705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.511717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616846:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.511838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.511893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.511906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476616846:5673]
2025-10-02T09:35:55.511925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:55.511980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2980 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e99f803-8f20c077-f622f460-b15829d8_0
2025-10-02T09:35:55.512106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2980 sessionId: src_id|2e99f803-8f20c077-f622f460-b15829d8_0 is DEAD
2025-10-02T09:35:55.512236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:55.512245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Write session will restart in 0.005894s
2025-10-02T09:35:55.512265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Write session: Do CDS request
2025-10-02T09:35:55.512269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.516264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.516896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.517018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.517025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.517030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.517059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.517083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034515:11188]
2025-10-02T09:35:55.517427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.517595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.517618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.517795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.517825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.517829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.517830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.517830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.517831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.517831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.517832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.517833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.517833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.517834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.517834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.517835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.517838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.517845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.517847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.517850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.517853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.517855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.517857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.517859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.517861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.517863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.517865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.517867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.517871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.517875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.517879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.517881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.517885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.517887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.517890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.517897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.517900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.517906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.517908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.517911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.517916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.517919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.517921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.517924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.517929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.517932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.517934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.517940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.517942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.517945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.517948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.517953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.517972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.519211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.519280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.519286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2981
2025-10-02T09:35:55.519381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.519401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.519406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.519409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.519654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2981 sessionId:  describe result for acl check
2025-10-02T09:35:55.519675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.519676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.519676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.519679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.520016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.521413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.524766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.524773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.524775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476616883:6665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.524779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.525371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.526847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.526858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.526859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.526861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.526864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2980 [2:7556555819401034515:11188]
2025-10-02T09:35:55.526873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.526883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.526889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.526890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.526891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.526900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.526906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.526910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.526944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.526948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.526950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.526952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.526953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.526986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.526991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.526997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.527002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.527014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.527032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616847:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.527039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616917:6665], now have 1 active actors on pipe
2025-10-02T09:35:55.527044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.527045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.527046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.527056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.527067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.527071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.527073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.527075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.527081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.527084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.527060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2980
2025-10-02T09:35:55.527072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2980
2025-10-02T09:35:55.527115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.527121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.527128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.527136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.527144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.527156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|205e8836-bf5777f9-789df0e1-93ebc927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.527162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.527165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.527167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.527173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.527181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.527193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.527294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.527300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.527307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.527366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2981 partition: 0 MaxSeqNo: 36 sessionId: src_id|205e8836-bf5777f9-789df0e1-93ebc927_0
2025-10-02T09:35:55.527596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e99f803-8f20c077-f622f460-b15829d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|205e8836-bf5777f9-789df0e1-93ebc927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.530023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Write session: try to update token
2025-10-02T09:35:55.530037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.536172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.536183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.536184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.536185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.536189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.536193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.536195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034510:11188]
2025-10-02T09:35:55.536214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.536215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.536217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.536219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.536222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.536226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.536334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.542401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId: src_id|205e8836-bf5777f9-789df0e1-93ebc927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.544663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.612212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476616926:5673]
2025-10-02T09:35:55.612379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2980, pipe: [1:7556555819476616926:5673]
2025-10-02T09:35:55.646122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.646328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.646338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.646350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616926:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.646494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.646520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476616926:5673]
2025-10-02T09:35:55.646584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.646611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:55.646668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2981 reason: status is not ok: tablet will be restarted right now sessionId: src_id|205e8836-bf5777f9-789df0e1-93ebc927_0
2025-10-02T09:35:55.646829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2981 sessionId: src_id|205e8836-bf5777f9-789df0e1-93ebc927_0 is DEAD
2025-10-02T09:35:55.646997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:55.647013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Write session will restart in 0.008027s
2025-10-02T09:35:55.647035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Write session: Do CDS request
2025-10-02T09:35:55.647041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.651106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.651923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.652020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.652027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.652032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.652059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.652084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034586:11190]
2025-10-02T09:35:55.652443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.652598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.652620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.652817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.652853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.652857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.652858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.652858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.652859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.652859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.652860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.652860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.652861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.652861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.652862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.652862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.652865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.652871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.652874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.652876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.652878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.652880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.652882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.652884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.652886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.652888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.652890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.652892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.652897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.652901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.652904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.652907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.652909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.652912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.652914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.652917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.652919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.652921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.652923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.652926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.652929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.652932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.652934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.652937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.652939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.652942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.652948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.652950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.652953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.652956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.652959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.652976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.656173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.656269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.656278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2982
2025-10-02T09:35:55.656410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.656430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.656436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.656438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.656695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2982 sessionId:  describe result for acl check
2025-10-02T09:35:55.656718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.656722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.656723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.656726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.657090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.658581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.660132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.660140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.660142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476616964:6669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.660146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.660459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.661907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.661920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.661921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.661924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.661927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2981 [2:7556555819401034586:11190]
2025-10-02T09:35:55.661934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.661947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.661948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.661950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.661952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.661961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.661964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.661969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.662016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.662022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.662023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.662025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.662026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.662064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.662071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.662078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.662084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.662099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.662115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616927:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.662122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476616998:6669], now have 1 active actors on pipe
2025-10-02T09:35:55.662126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.662128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.662129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.662125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2981
2025-10-02T09:35:55.662140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.662141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2981
2025-10-02T09:35:55.662149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.662155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.662156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.662157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.662166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.662174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.662201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.662206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.662213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.662218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.662224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.662234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.662241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.662243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.662245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.662250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.662258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.662275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.662368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.662374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.662381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.662437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2982 partition: 0 MaxSeqNo: 36 sessionId: src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0
2025-10-02T09:35:55.662649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205e8836-bf5777f9-789df0e1-93ebc927_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.665441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Write session: try to update token
2025-10-02T09:35:55.665452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.671507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.671521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.671522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.671523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.671529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.671531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.671534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034581:11190]
2025-10-02T09:35:55.671556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.671559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.671559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.671561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.671562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.671564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.671680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.677790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId: src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.680219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.746881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476617007:5673]
2025-10-02T09:35:55.747087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2981, pipe: [1:7556555819476617007:5673]
2025-10-02T09:35:55.784798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.785039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.785052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.785065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617007:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.785229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476617007:5673]
2025-10-02T09:35:55.785249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:55.785250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:55.785309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2982 reason: error at write: Disconnected sessionId: src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0
2025-10-02T09:35:55.785453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2982 sessionId: src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0 is DEAD
2025-10-02T09:35:55.785551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.785607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:55.785616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Write session will restart in 0.007765s
2025-10-02T09:35:55.785632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Write session: Do CDS request
2025-10-02T09:35:55.785636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.785723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.790465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.791199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.791361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.791370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.791379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.791432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.791465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034670:11198]
2025-10-02T09:35:55.792009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.792209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.792252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.792540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.792600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.792606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.792607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.792608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.792609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.792610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.792611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.792612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.792613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.792614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.792615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.792616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.792621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.792630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.792634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.792638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.792641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.792649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.792653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.792660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.792666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.792675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.792682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.792686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.792695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.792701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.792710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.792719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.792726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.792736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.792741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.792748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.792755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.792763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.792767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.792776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.792781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.792786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.792790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.792796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.792816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.792825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.792833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.792838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.792846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.792854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.792862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.792870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.792904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.794194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.794313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.794320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2983
2025-10-02T09:35:55.794403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.794420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.794426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.794428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.794639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2983 sessionId:  describe result for acl check
2025-10-02T09:35:55.794655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.794659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.794660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.794665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.794966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.796358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.799711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.799719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.799721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476617059:6089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.799724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.800376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.801975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.801991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.801996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.801998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.802003Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2982 [2:7556555819401034670:11198]
2025-10-02T09:35:55.802017Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.802032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.802039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.802043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.802049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.802060Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.802068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.802073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.802117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.802124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.802125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.802128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.802130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.802180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.802186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.802198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.802213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.802235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.802222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2982
2025-10-02T09:35:55.802239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2982
2025-10-02T09:35:55.802253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617021:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.802261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617093:6089], now have 1 active actors on pipe
2025-10-02T09:35:55.802265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.802267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.802269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.802279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.802287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.802293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.802294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.802303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.802309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.802321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.802337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.802344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.802372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.802381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.802388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.802390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.802397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.802407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.802416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.802426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.802430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.802443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.802555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.802569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.802583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.802625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2983 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0
2025-10-02T09:35:55.802868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7741d3-1644d2d6-3e2f1b7-956e88b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.805467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Write session: try to update token
2025-10-02T09:35:55.805482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.811432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.811444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.811445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.811446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.811449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.811453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.811455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034665:11198]
2025-10-02T09:35:55.811474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.811480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.811480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.811481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.811483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.811485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.811604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.817583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId: src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.819859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:55.885625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555819476617111:5673]
2025-10-02T09:35:55.885817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2982, pipe: [1:7556555819476617111:5673]
2025-10-02T09:35:55.920701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:55.920974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.920983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.920996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617111:5673], now have 1 active actors on pipe
2025-10-02T09:35:55.921177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555819476617111:5673]
2025-10-02T09:35:55.921177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:55.921197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:55.921201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:55.921244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2983 reason: error at write: Disconnected sessionId: src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0
2025-10-02T09:35:55.921362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2983 sessionId: src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0 is DEAD
2025-10-02T09:35:55.921488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:55.921495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Write session will restart in 0.009106s
2025-10-02T09:35:55.921513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Write session: Do CDS request
2025-10-02T09:35:55.921520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:55.922065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:55.926272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:55.927381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:55.927500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:55.927507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:55.927513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:55.927543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:55.927607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555819401034764:11206]
2025-10-02T09:35:55.927958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:55.928142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:55.928167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:55.928345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:55.928373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.928377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.928378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.928379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.928379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.928380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.928381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.928382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.928382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.928383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.928383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.928384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.928387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.928393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.928395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.928397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.928399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.928402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.928403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.928405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.928407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.928411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.928413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.928414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.928419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.928422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:55.928428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.928430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:55.928432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.928435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:55.928438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.928440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:55.928443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.928445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:55.928447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.928450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:55.928453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.928456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:55.928458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.928461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:55.928464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.928466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:55.928468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.928470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.928472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.928475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.928478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.928482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.928498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:55.931196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.931269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:55.931278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2984
2025-10-02T09:35:55.931375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:55.931393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:55.931399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:55.931402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:55.931698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2984 sessionId:  describe result for acl check
2025-10-02T09:35:55.931716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:55.931721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:55.931723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:55.931726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:55.932051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:55.933760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:55.935696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:55.935704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:55.935706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555819476617158:6709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:55.935709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:55.935978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:55.937457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:55.937468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:55.937469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:55.937471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:55.937475Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2983 [2:7556555819401034764:11206]
2025-10-02T09:35:55.937484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:55.937496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:55.937501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.937504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.937506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.937514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:55.937517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:55.937521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:55.937551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.937557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.937558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.937560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:55.937561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:55.937596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:55.937601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.937607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:55.937612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:55.937620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:55.937634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617192:6709], now have 1 active actors on pipe
2025-10-02T09:35:55.937640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555819476617119:2446], now have 1 active actors on pipe
2025-10-02T09:35:55.937644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.937645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.937646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.937655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:55.937665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:55.937669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:55.937672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:55.937673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:55.937679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:55.937681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:55.937699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.937696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2983
2025-10-02T09:35:55.937706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2983
2025-10-02T09:35:55.937712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:55.937723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:55.937764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.937770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.937792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1266d279-1d56c938-248fabde-1b37d4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:55.937799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:55.937802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:55.937803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:55.937809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:55.937817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:55.937826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.937947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:55.937950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:55.937958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:55.938031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2984 partition: 0 MaxSeqNo: 36 sessionId: src_id|1266d279-1d56c938-248fabde-1b37d4b_0
2025-10-02T09:35:55.938255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c41ba92-2663159e-4f1f1090-4c8d67a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1266d279-1d56c938-248fabde-1b37d4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:55.941156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Write session: try to update token
2025-10-02T09:35:55.941166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:55.947566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:55.947581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:55.947583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:55.947585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:55.947592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.947595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.947599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555819401034759:11206]
2025-10-02T09:35:55.947622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:55.947628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:55.947630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:55.947632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:55.947633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:55.947635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:55.947760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:55.954531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId: src_id|1266d279-1d56c938-248fabde-1b37d4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:55.956636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.021284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584499:5673]
2025-10-02T09:35:56.021501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2983, pipe: [1:7556555823771584499:5673]
2025-10-02T09:35:56.059543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.059773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.059782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.059793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584499:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.060106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.060115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.060140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.060157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2984 reason: error at write: Disconnected sessionId: src_id|1266d279-1d56c938-248fabde-1b37d4b_0
2025-10-02T09:35:56.060172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584499:5673]
2025-10-02T09:35:56.060283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2984 sessionId: src_id|1266d279-1d56c938-248fabde-1b37d4b_0 is DEAD
2025-10-02T09:35:56.060426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.060466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.060480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Write session will restart in 0.009959s
2025-10-02T09:35:56.060502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Write session: Do CDS request
2025-10-02T09:35:56.060508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.065344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.066313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.066410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.066416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.066422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.066447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.066471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002133:11208]
2025-10-02T09:35:56.066847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.067019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.067044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.067220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.067249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.067252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.067253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.067254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.067255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.067255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.067256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.067257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.067257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.067258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.067259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.067259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.067262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.067269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.067272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.067276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.067278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.067280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.067281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.067283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.067285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.067287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.067289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.067291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.067295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.067299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.067302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.067304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.067307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.067309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.067311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.067315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.067317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.067320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.067322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.067325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.067329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.067332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.067334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.067337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.067339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.067342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.067348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.067351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.067353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.067356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.067358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.067361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.067378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.071190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.071226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.071233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2985
2025-10-02T09:35:56.071417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.071437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.071443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.071446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.071700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2985 sessionId:  describe result for acl check
2025-10-02T09:35:56.071721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.071725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.071726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.071730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.072068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.073362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.074730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.074862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.074869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.074872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771584542:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.074881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.076254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.076267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.076270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.076273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.076278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2984 [2:7556555823696002133:11208]
2025-10-02T09:35:56.076290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.076303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.076307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.076309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.076310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.076319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.076325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.076330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.076364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.076368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.076369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.076371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.076372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.076406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.076411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.076417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.076422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.076433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.076447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584577:6725], now have 1 active actors on pipe
2025-10-02T09:35:56.076452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584502:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.076455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.076456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.076457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.076465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.076475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.076477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.076479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.076473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2984
2025-10-02T09:35:56.076479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.076475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2984
2025-10-02T09:35:56.076484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.076487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.076500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.076505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.076506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.076514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.076518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.076543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f45a9621-ea9ee99b-b28307a-34ba395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.076552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.076558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.076559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.076563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.076571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.076583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.076664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.076669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.076677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.076737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2985 partition: 0 MaxSeqNo: 36 sessionId: src_id|f45a9621-ea9ee99b-b28307a-34ba395_0
2025-10-02T09:35:56.076926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266d279-1d56c938-248fabde-1b37d4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f45a9621-ea9ee99b-b28307a-34ba395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.079781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Write session: try to update token
2025-10-02T09:35:56.079792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.086305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.086321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.086322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.086324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.086330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.086334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.086337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002128:11208]
2025-10-02T09:35:56.086358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.086365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.086366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.086367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.086372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.086374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.086567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.092208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId: src_id|f45a9621-ea9ee99b-b28307a-34ba395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.094294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.160560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584584:5673]
2025-10-02T09:35:56.160765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2984, pipe: [1:7556555823771584584:5673]
2025-10-02T09:35:56.196503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.196737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.196746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.196758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584584:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.196899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.196959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.196959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.196962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.196999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584584:5673]
2025-10-02T09:35:56.197011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2985 reason: error at write: Disconnected sessionId: src_id|f45a9621-ea9ee99b-b28307a-34ba395_0
2025-10-02T09:35:56.197144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2985 sessionId: src_id|f45a9621-ea9ee99b-b28307a-34ba395_0 is DEAD
2025-10-02T09:35:56.197272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.197280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Write session will restart in 0.006023s
2025-10-02T09:35:56.197297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Write session: Do CDS request
2025-10-02T09:35:56.197302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.201183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.201873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.201975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.201984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.201990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.202017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.202041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002222:11212]
2025-10-02T09:35:56.202386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.202553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.202575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.202763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.202793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.202797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.202798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.202799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.202799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.202800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.202801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.202801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.202802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.202803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.202803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.202804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.202807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.202814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.202816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.202818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.202820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.202822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.202824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.202826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.202830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.202832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.202834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.202836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.202840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.202844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.202847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.202850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.202852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.202855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.202857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.202860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.202865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.202868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.202870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.202873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.202875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.202881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.202884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.202887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.202892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.202895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.202898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.202904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.202906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.202909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.202914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.202916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.202934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.204202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.204293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.204302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2986
2025-10-02T09:35:56.204394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.204414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.204420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.204422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.204679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2986 sessionId:  describe result for acl check
2025-10-02T09:35:56.204701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.204707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.204708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.204712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.205071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.206474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.209759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.209767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.209770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771584635:6724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.209773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.210354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.211839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.211850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.211853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.211856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.211859Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2985 [2:7556555823696002222:11212]
2025-10-02T09:35:56.211866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.211880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.211884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.211887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.211888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.211897Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.211902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.211907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.211940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.211945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.211946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.211948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.211950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.211987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.211992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.211998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.212003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.212013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.212026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584669:6724], now have 1 active actors on pipe
2025-10-02T09:35:56.212033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584585:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.212038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.212044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.212045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.212046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2985
2025-10-02T09:35:56.212063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2985
2025-10-02T09:35:56.212057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.212072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.212071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.212073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.212074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.212083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.212085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.212097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.212103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.212127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.212135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.212143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d886fea7-59aa5008-b95374da-8ef3015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.212147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.212150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.212152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.212153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.212158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.212164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.212188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.212293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.212299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.212306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.212351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2986 partition: 0 MaxSeqNo: 36 sessionId: src_id|d886fea7-59aa5008-b95374da-8ef3015_0
2025-10-02T09:35:56.212574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45a9621-ea9ee99b-b28307a-34ba395_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d886fea7-59aa5008-b95374da-8ef3015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.215435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Write session: try to update token
2025-10-02T09:35:56.215446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.221768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.221780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.221782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.221783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.221791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.221795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.221798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002217:11212]
2025-10-02T09:35:56.221826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.221827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.221831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.221833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.221834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.221836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.221953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.228430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId: src_id|d886fea7-59aa5008-b95374da-8ef3015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.230562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.297243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584689:5673]
2025-10-02T09:35:56.297436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2985, pipe: [1:7556555823771584689:5673]
2025-10-02T09:35:56.333975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.334190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.334199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.334211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584689:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.334401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584689:5673]
2025-10-02T09:35:56.334404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.334409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.334427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.334461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2986 reason: error at write: Disconnected sessionId: src_id|d886fea7-59aa5008-b95374da-8ef3015_0
2025-10-02T09:35:56.334600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2986 sessionId: src_id|d886fea7-59aa5008-b95374da-8ef3015_0 is DEAD
2025-10-02T09:35:56.334601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.334855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.334878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Write session will restart in 0.009539s
2025-10-02T09:35:56.334904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Write session: Do CDS request
2025-10-02T09:35:56.334912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.339087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.339742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.339836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.339843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.339849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.339874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.339897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002296:11214]
2025-10-02T09:35:56.340237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.340414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.340439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.340622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.340652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.340656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.340656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.340657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.340658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.340658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.340659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.340659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.340660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.340660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.340661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.340661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.340664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.340671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.340673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.340675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.340677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.340679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.340681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.340683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.340685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.340688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.340690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.340692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.340696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.340700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.340703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.340706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.340709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.340712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.340714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.340717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.340719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.340721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.340723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.340726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.340728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.340731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.340733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.340736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.340738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.340740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.340742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.340745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.340747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.340749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.340752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.340756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.340773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.345174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.345260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.345268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2987
2025-10-02T09:35:56.345375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.345394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.345400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.345403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.345671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2987 sessionId:  describe result for acl check
2025-10-02T09:35:56.345691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.345696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.345697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.345701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.346028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.347275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.348134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.348759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.348767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.348769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771584734:6741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.348772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.349642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.349654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.349655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.349658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.349663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2986 [2:7556555823696002296:11214]
2025-10-02T09:35:56.349672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.349681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.349686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.349688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.349689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.349698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.349704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.349708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.349740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.349746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.349747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.349749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.349750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.349787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.349792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.349799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.349805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.349816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.349831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584769:6741], now have 1 active actors on pipe
2025-10-02T09:35:56.349837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584692:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.349840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.349841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.349842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.349849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.349851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2986
2025-10-02T09:35:56.349857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.349855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2986
2025-10-02T09:35:56.349863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.349865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.349866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.349868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.349869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.349884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.349889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.349890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.349900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.349904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.349928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.349935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.349972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.349976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.349981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.349986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.350002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.350125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.350131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.350140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.350198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2987 partition: 0 MaxSeqNo: 36 sessionId: src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0
2025-10-02T09:35:56.350469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d886fea7-59aa5008-b95374da-8ef3015_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.353000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Write session: try to update token
2025-10-02T09:35:56.353017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.358920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.358931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.358932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.358933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.358936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.358938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.358940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002291:11214]
2025-10-02T09:35:56.358959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.358965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.358966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.358973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.358981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.358983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.359069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.364985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId: src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.367292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.434475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584777:5673]
2025-10-02T09:35:56.434655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2986, pipe: [1:7556555823771584777:5673]
2025-10-02T09:35:56.469351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.469623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.469632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.469644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584777:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.469773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.469778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.469797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584777:5673]
2025-10-02T09:35:56.469810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:56.469861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2987 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0
2025-10-02T09:35:56.469984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2987 sessionId: src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0 is DEAD
2025-10-02T09:35:56.470159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:56.470173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Write session will restart in 0.008431s
2025-10-02T09:35:56.470194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Write session: Do CDS request
2025-10-02T09:35:56.470199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.474533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.475318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.475425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.475432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.475439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.475471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.475504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002374:11217]
2025-10-02T09:35:56.475909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.476081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.476104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.476279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.476311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.476315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.476315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.476316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.476316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.476317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.476317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.476318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.476319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.476319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.476320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.476320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.476325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.476331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.476334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.476336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.476338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.476340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.476342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.476344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.476346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.476348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.476350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.476352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.476357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.476361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.476364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.476367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.476369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.476372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.476373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.476377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.476379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.476381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.476384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.476386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.476388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.476391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.476392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.476395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.476397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.476400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.476402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.476405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.476407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.476410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.476412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.476415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.476447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.479241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.479306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.479313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2988
2025-10-02T09:35:56.479439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.479456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.479462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.479466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.479742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2988 sessionId:  describe result for acl check
2025-10-02T09:35:56.479763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.479767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.479768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.479771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.480150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.481391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.483266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.483273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.483275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771584821:6763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.483278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.483864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.485327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.485337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.485339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.485341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.485344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2987 [2:7556555823696002374:11217]
2025-10-02T09:35:56.485352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.485362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.485363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.485365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.485366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.485375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.485381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.485385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.485417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.485422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.485423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.485426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.485427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.485466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.485471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.485477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.485482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.485493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.485512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584855:6763], now have 1 active actors on pipe
2025-10-02T09:35:56.485519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584778:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.485523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.485529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.485530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.485523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2987
2025-10-02T09:35:56.485540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.485541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2987
2025-10-02T09:35:56.485549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.485553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.485556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.485557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.485564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.485567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.485590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.485596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.485604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.485612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.485620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.485627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c339095c-7e495325-438d67e1-c331cabd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.485630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.485634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.485637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.485641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.485646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.485686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.485784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.485790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.485798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.485855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2988 partition: 0 MaxSeqNo: 36 sessionId: src_id|c339095c-7e495325-438d67e1-c331cabd_0
2025-10-02T09:35:56.486306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255bd4c-56ff0cbc-aedb9084-cf397ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c339095c-7e495325-438d67e1-c331cabd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.488617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Write session: try to update token
2025-10-02T09:35:56.488632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.494599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.494610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.494612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.494615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.494619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.494621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.494622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002369:11217]
2025-10-02T09:35:56.494640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.494643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.494644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.494646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.494648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.494650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.494781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.501209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId: src_id|c339095c-7e495325-438d67e1-c331cabd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.503587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.570175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584864:5673]
2025-10-02T09:35:56.570393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2987, pipe: [1:7556555823771584864:5673]
2025-10-02T09:35:56.605001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.605235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.605244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.605257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584864:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.605381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.605412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.605413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584864:5673]
2025-10-02T09:35:56.605429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.605431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.605473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2988 reason: error at write: Disconnected sessionId: src_id|c339095c-7e495325-438d67e1-c331cabd_0
2025-10-02T09:35:56.605568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2988 sessionId: src_id|c339095c-7e495325-438d67e1-c331cabd_0 is DEAD
2025-10-02T09:35:56.605724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.605738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Write session will restart in 0.008745s
2025-10-02T09:35:56.605764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Write session: Do CDS request
2025-10-02T09:35:56.605770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.610325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.611160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.611258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.611264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.611270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.611296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.611322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002451:11219]
2025-10-02T09:35:56.611670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.611833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.611856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.612031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.612059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.612063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.612064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.612064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.612065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.612065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.612066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.612066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.612067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.612067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.612068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.612069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.612071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.612078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.612080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.612083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.612085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.612087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.612089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.612091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.612093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.612096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.612098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.612100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.612103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.612107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.612110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.612114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.612117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.612119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.612121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.612124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.612126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.612129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.612131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.612134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.612136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.612138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.612141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.612143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.612149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.612151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.612155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.612158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.612162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.612165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.612167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.612172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.612205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.615171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.615247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.615255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2989
2025-10-02T09:35:56.615383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.615402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.615408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.615411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.615717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2989 sessionId:  describe result for acl check
2025-10-02T09:35:56.615740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.615741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.615742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.615745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.616116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.617601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.619108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.619116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.619118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771584912:6760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.619121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.619640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.621162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.621173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.621174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.621176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.621179Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2988 [2:7556555823696002451:11219]
2025-10-02T09:35:56.621188Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.621199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.621204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.621206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.621208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.621217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.621221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.621226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.621259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.621264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.621265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.621267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.621268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.621304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.621309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.621315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.621322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.621330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.621345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584868:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.621352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584946:6760], now have 1 active actors on pipe
2025-10-02T09:35:56.621357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.621362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.621364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.621375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.621375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2988
2025-10-02T09:35:56.621386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.621388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.621392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.621394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.621399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.621402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.621394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2988
2025-10-02T09:35:56.621428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.621436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.621444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.621449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.621456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.621469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.621477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.621479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.621483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.621489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.621494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.621509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.621646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.621651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.621658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.621714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2989 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0
2025-10-02T09:35:56.621947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c339095c-7e495325-438d67e1-c331cabd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.624376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Write session: try to update token
2025-10-02T09:35:56.624390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.630451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.630462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.630463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.630464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.630467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.630469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.630471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002446:11219]
2025-10-02T09:35:56.630492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.630495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.630497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.630498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.630499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.630500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.630635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.636023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId: src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.638378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.705347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771584958:5673]
2025-10-02T09:35:56.705553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2988, pipe: [1:7556555823771584958:5673]
2025-10-02T09:35:56.741260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.741548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.741557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.741570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584958:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.741742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.741747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771584958:5673]
2025-10-02T09:35:56.741775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.741778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.741824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2989 reason: error at write: Disconnected sessionId: src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0
2025-10-02T09:35:56.741831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.741986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2989 sessionId: src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0 is DEAD
2025-10-02T09:35:56.742133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.742146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Write session will restart in 0.007430s
2025-10-02T09:35:56.742170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Write session: Do CDS request
2025-10-02T09:35:56.742175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.746289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.747244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.747373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.747379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.747384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.747412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.747437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002529:11221]
2025-10-02T09:35:56.747800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.747962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.747985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.748164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.748194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.748198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.748199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.748200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.748200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.748201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.748201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.748202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.748202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.748203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.748203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.748204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.748206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.748214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.748216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.748218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.748220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.748222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.748224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.748226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.748228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.748231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.748232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.748234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.748241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.748245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.748248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.748251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.748253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.748256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.748258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.748261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.748263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.748266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.748268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.748270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.748273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.748276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.748278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.748281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.748284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.748287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.748289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.748291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.748293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.748296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.748298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.748300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.748318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.750205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.750301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.750309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2990
2025-10-02T09:35:56.750437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.750457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.750463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.750466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.750734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2990 sessionId:  describe result for acl check
2025-10-02T09:35:56.750758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.750763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.750764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.750767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.751123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.752221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.755091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.755102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.755104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771585006:6774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.755108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.755701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.757155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.757165Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.757166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.757169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.757172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2989 [2:7556555823696002529:11221]
2025-10-02T09:35:56.757179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.757189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.757194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.757197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.757198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.757206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.757212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.757216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.757246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.757249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.757251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.757252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.757254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.757290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.757298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.757305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.757310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.757318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.757329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771585040:6774], now have 1 active actors on pipe
2025-10-02T09:35:56.757335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771584960:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.757340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.757341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.757343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.757353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.757366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.757366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.757368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.757369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.757368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2989
2025-10-02T09:35:56.757382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.757385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.757389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2989
2025-10-02T09:35:56.757407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.757414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.757424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.757434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.757441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.757454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.757461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.757465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.757467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.757472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.757477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.757529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.757672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.757678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.757687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.757747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2990 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0
2025-10-02T09:35:56.757999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7eb5de-4b788264-cfa39df4-36b37e5e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.760429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Write session: try to update token
2025-10-02T09:35:56.760443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.766623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.766635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.766636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.766637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.766642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.766644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.766648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002524:11221]
2025-10-02T09:35:56.766668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.766671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.766674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.766674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.766675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.766676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.766810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.772447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId: src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.774813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.842003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771585061:5673]
2025-10-02T09:35:56.842145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2989, pipe: [1:7556555823771585061:5673]
2025-10-02T09:35:56.881348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:56.881573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.881582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.881594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771585061:5673], now have 1 active actors on pipe
2025-10-02T09:35:56.881721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:56.881725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:56.881727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:56.881746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:56.881767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771585061:5673]
2025-10-02T09:35:56.881770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2990 reason: error at write: Disconnected sessionId: src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0
2025-10-02T09:35:56.881905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2990 sessionId: src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0 is DEAD
2025-10-02T09:35:56.882058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:56.882073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Write session will restart in 0.005125s
2025-10-02T09:35:56.882094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Write session: Do CDS request
2025-10-02T09:35:56.882099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:56.886131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:56.886967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:56.887064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:56.887070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:56.887075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:56.887100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:56.887123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555823696002645:11235]
2025-10-02T09:35:56.887466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:56.887621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:56.887642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:56.887813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:56.887842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.887846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.887846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.887847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.887848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.887848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.887850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.887851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.887851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.887852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.887852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.887853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.887855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.887862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.887864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.887866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.887868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.887870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.887872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.887874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.887876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.887878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.887880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.887882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.887886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.887891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:56.887894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.887897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:56.887899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.887902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:56.887904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.887907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:56.887909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.887912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:56.887914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.887917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:56.887919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.887923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:56.887926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.887928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:56.887931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.887933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:56.887935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.887938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.887940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.887943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.887950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.887953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.887970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:56.888146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.888265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:56.888274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2991
2025-10-02T09:35:56.888401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:56.888419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:56.888425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:56.888427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:56.888716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2991 sessionId:  describe result for acl check
2025-10-02T09:35:56.888736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:56.888741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:56.888742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:56.888744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:56.889088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:56.890590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:56.894871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:56.894879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:56.894881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555823771585118:6799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:56.894886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:56.895342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:56.896923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:56.896933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:56.896934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:56.896936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:56.896939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2990 [2:7556555823696002645:11235]
2025-10-02T09:35:56.896947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:56.896956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:56.896961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.896963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.896966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.896975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:56.896982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:56.896987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:56.897019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.897024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.897024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.897026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:56.897027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:56.897063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:56.897067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.897073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:56.897078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:56.897088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:56.897103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771585072:2446], now have 1 active actors on pipe
2025-10-02T09:35:56.897110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771585152:6799], now have 1 active actors on pipe
2025-10-02T09:35:56.897115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.897116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.897118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.897129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:56.897140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:56.897142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:56.897147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:56.897148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:56.897153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:56.897156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:56.897142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2990
2025-10-02T09:35:56.897149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2990
2025-10-02T09:35:56.897175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.897181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:56.897182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:56.897195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.897201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.897225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:56.897232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:56.897236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:56.897239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:56.897245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:56.897257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:56.897265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.897367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:56.897372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:56.897380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:56.897433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2991 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0
2025-10-02T09:35:56.897672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd98014-4fbf8d9a-47176d37-e203931e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:56.900033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Write session: try to update token
2025-10-02T09:35:56.900048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:56.906226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:56.906236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:56.906237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:56.906238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:56.906242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.906244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.906246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555823696002640:11235]
2025-10-02T09:35:56.906265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:56.906265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:56.906268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:56.906270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:56.906272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:56.906274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:56.906385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:56.911890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId: src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:56.914259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:56.981805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555823771585167:5673]
2025-10-02T09:35:56.981997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2990, pipe: [1:7556555823771585167:5673]
2025-10-02T09:35:57.015227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.015506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.015514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.015527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555823771585167:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.015667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.015729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.015749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555823771585167:5673]
2025-10-02T09:35:57.015763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:57.015766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:57.015810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2991 reason: error at write: Disconnected sessionId: src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0
2025-10-02T09:35:57.015953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2991 sessionId: src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0 is DEAD
2025-10-02T09:35:57.016129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:57.016144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Write session will restart in 0.008999s
2025-10-02T09:35:57.016167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Write session: Do CDS request
2025-10-02T09:35:57.016172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.020345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.021123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.021252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.021258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.021265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.021296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.021320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970022:11237]
2025-10-02T09:35:57.021732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.021897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.021919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.022094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.022122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.022126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.022127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.022128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.022128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.022129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.022129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.022130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.022130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.022131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.022131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.022132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.022135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.022142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.022144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.022146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.022148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.022150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.022152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.022154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.022155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.022158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.022159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.022161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.022166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.022170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.022173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.022176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.022179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.022181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.022184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.022187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.022189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.022192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.022195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.022197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.022200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.022202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.022205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.022207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.022210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.022212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.022215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.022217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.022220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.022222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.022224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.022226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.022243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.026195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.026316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.026326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2992
2025-10-02T09:35:57.026456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.026476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.026482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.026485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.026761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2992 sessionId:  describe result for acl check
2025-10-02T09:35:57.026782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.026787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.026788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.026791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.027155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.028734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.029724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.030831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.030839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.030841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552514:6820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.030845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.031254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.031267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.031269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.031270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.031274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2991 [2:7556555827990970022:11237]
2025-10-02T09:35:57.031280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.031290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.031295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.031297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.031298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.031307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.031313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.031318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.031351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.031356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.031357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.031359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.031361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.031398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.031402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.031409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.031414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.031426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.031444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552467:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.031451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552548:6820], now have 1 active actors on pipe
2025-10-02T09:35:57.031456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.031459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.031461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.031458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2991
2025-10-02T09:35:57.031472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2991
2025-10-02T09:35:57.031472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.031482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.031484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.031489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.031490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.031497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.031500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.031525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.031530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.031537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.031544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.031554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.031560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.031565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.031569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.031571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.031576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.031582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.031595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.031696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.031702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.031709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.031767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2992 partition: 0 MaxSeqNo: 36 sessionId: src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0
2025-10-02T09:35:57.031988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c220ad-5ce85bae-22f302fd-7b156848_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.034256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Write session: try to update token
2025-10-02T09:35:57.034269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.040532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.040543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.040545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.040546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.040549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.040551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.040553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970017:11237]
2025-10-02T09:35:57.040572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.040573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.040575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.040577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.040579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.040580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.040684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.045753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId: src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.048116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.115956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066552557:5673]
2025-10-02T09:35:57.116121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2991, pipe: [1:7556555828066552557:5673]
2025-10-02T09:35:57.148660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.148917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.148926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.148938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552557:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.149076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.149315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.149318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066552557:5673]
2025-10-02T09:35:57.149331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.149361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2992 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0
2025-10-02T09:35:57.149490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2992 sessionId: src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0 is DEAD
2025-10-02T09:35:57.149623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.149647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Write session will restart in 0.007682s
2025-10-02T09:35:57.149672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Write session: Do CDS request
2025-10-02T09:35:57.149678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.153956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.154702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.154818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.154825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.154831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.154865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.154890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970116:11240]
2025-10-02T09:35:57.155232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.155403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.155437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.155662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.155693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.155697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.155697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.155698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.155699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.155699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.155700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.155700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.155701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.155701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.155702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.155703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.155707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.155713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.155715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.155718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.155721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.155723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.155725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.155727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.155728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.155730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.155732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.155735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.155738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.155742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.155745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.155748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.155750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.155753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.155755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.155757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.155759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.155762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.155764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.155766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.155772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.155774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.155776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.155778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.155780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.155783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.155789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.155792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.155794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.155797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.155798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.155801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.155818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.158138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.158256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.158265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2993
2025-10-02T09:35:57.158381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.158402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.158408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.158411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.158666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2993 sessionId:  describe result for acl check
2025-10-02T09:35:57.158699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.158704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.158705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.158708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.159011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.160093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.162575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.162583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.162586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552606:6845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.162589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.163174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.164638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.164648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.164650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.164652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.164656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2992 [2:7556555827990970116:11240]
2025-10-02T09:35:57.164664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.164674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.164678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.164680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.164681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.164690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.164696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.164700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.164730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.164734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.164735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.164739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.164740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.164780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.164784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.164790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.164796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.164819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.164834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552641:6845], now have 1 active actors on pipe
2025-10-02T09:35:57.164839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552558:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.164843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.164844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.164845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.164855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.164853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2992
2025-10-02T09:35:57.164865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.164871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.164873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.164866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2992
2025-10-02T09:35:57.164875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.164876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.164877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.164899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.164904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.164913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.164920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.164932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.164935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.164938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.164940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.164941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.164946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.164952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.164968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.165046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.165051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.165058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.165117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2993 partition: 0 MaxSeqNo: 36 sessionId: src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0
2025-10-02T09:35:57.165361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99ac07dc-61aca8f8-27abbb91-b5937be0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.167721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Write session: try to update token
2025-10-02T09:35:57.167735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.173900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.173910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.173912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.173912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.173917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.173920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.173922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970100:11240]
2025-10-02T09:35:57.173941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.173946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.173946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.173947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.173949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.173952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.174056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.179637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId: src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.181806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.249558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066552661:5673]
2025-10-02T09:35:57.249680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2992, pipe: [1:7556555828066552661:5673]
2025-10-02T09:35:57.282213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.282442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.282451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.282462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552661:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.282581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.282602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.282623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.282642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066552661:5673]
2025-10-02T09:35:57.282675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2993 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0
2025-10-02T09:35:57.282817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2993 sessionId: src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0 is DEAD
2025-10-02T09:35:57.282981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.282994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Write session will restart in 0.006366s
2025-10-02T09:35:57.283015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Write session: Do CDS request
2025-10-02T09:35:57.283033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.287214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.287925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.288022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.288031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.288036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.288063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.288088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970200:11243]
2025-10-02T09:35:57.288423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.288585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.288607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.288780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.288823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.288827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.288827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.288828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.288828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.288829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.288830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.288830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.288831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.288831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.288832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.288832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.288835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.288842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.288844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.288846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.288848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.288850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.288852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.288854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.288856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.288858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.288860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.288862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.288867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.288871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.288876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.288879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.288884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.288887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.288889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.288892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.288898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.288902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.288904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.288906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.288909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.288911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.288915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.288917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.288919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.288922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.288924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.288926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.288928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.288931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.288933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.288935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.288952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.290161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.290271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.290290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2994
2025-10-02T09:35:57.290386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.290412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.290422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.290429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.290752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2994 sessionId:  describe result for acl check
2025-10-02T09:35:57.290775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.290780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.290781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.290784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.291117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.292624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.295738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.295747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.295749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552711:6848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.295753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.296245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.297717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.297727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.297728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.297732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.297735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2993 [2:7556555827990970200:11243]
2025-10-02T09:35:57.297745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.297760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.297764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.297766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.297767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.297776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.297778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.297784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.297818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.297822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.297824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.297826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.297827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.297863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.297867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.297874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.297879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.297887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.297896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.297900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.297901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.297906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.297914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.297925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.297927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.297929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.297930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.297930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.297948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552745:6848], now have 1 active actors on pipe
2025-10-02T09:35:57.297953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552662:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.297955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.297957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.297967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.297987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2993
2025-10-02T09:35:57.298017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2993
2025-10-02T09:35:57.298028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.298034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.298050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.298058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.298060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.298061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.298066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.298074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.298082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.298216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.298220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.298227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.298291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2994 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0
2025-10-02T09:35:57.298498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3140f45c-c4e10681-c23fbdb8-b30f970_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.300752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Write session: try to update token
2025-10-02T09:35:57.300764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.306904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.306914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.306915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.306916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.306920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.306922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.306924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970195:11243]
2025-10-02T09:35:57.306942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.306948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.306948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.306949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.306951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.306953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.307092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.312351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId: src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.314617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.382714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066552756:5673]
2025-10-02T09:35:57.382908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2993, pipe: [1:7556555828066552756:5673]
2025-10-02T09:35:57.415431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.415641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.415652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.415665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552756:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.415781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.415854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066552756:5673]
2025-10-02T09:35:57.415872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.415879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.415936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2994 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0
2025-10-02T09:35:57.416063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2994 sessionId: src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0 is DEAD
2025-10-02T09:35:57.416226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.416244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Write session will restart in 0.007560s
2025-10-02T09:35:57.416266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Write session: Do CDS request
2025-10-02T09:35:57.416272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.420924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.421682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.421778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.421784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.421790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.421814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.421839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970285:11246]
2025-10-02T09:35:57.422253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.422413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.422438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.422610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.422638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.422642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.422643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.422643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.422643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.422644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.422645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.422645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.422646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.422646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.422647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.422648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.422650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.422658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.422660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.422662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.422664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.422666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.422668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.422670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.422672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.422674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.422676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.422678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.422681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.422685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.422695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.422698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.422701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.422704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.422706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.422709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.422711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.422714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.422716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.422719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.422721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.422724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.422727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.422729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.422732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.422734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.422737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.422739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.422745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.422748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.422750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.422752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.422773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.425210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.425300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.425314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2995
2025-10-02T09:35:57.425417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.425445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.425457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.425461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.425849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2995 sessionId:  describe result for acl check
2025-10-02T09:35:57.425882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.425891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.425893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.425897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.426364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.427759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.429651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.429660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.429662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552807:6860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.429667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.430114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.431597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.431608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.431609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.431611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.431615Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2994 [2:7556555827990970285:11246]
2025-10-02T09:35:57.431622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.431631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.431636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.431638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.431639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.431650Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.431656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.431662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.431696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.431700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.431702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.431704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.431705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.431775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.431781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.431787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.431792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.431801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.431815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552757:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.431811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2994
2025-10-02T09:35:57.431821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552842:6860], now have 1 active actors on pipe
2025-10-02T09:35:57.431825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.431826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.431828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.431834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.431840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.431842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.431843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.431845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.431837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2994
2025-10-02T09:35:57.431854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.431855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.431867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.431872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.431892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.431900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.431907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.431911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.431915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.431917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.431919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.431923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.431929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.431951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.432078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.432084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.432091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.432181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2995 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0
2025-10-02T09:35:57.432418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e197dc9-38c841fb-eb1444ff-afa8093b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.434721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Write session: try to update token
2025-10-02T09:35:57.434736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.440989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.440999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.441000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.441001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.441005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.441007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.441009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970280:11246]
2025-10-02T09:35:57.441028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.441033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.441035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.441035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.441039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.441041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.441146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.446493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId: src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.448883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.515829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066552849:5673]
2025-10-02T09:35:57.516024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2994, pipe: [1:7556555828066552849:5673]
2025-10-02T09:35:57.548613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.548828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.548837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.548849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552849:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.548964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.549016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.549022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066552849:5673]
2025-10-02T09:35:57.549039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.549107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2995 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0
2025-10-02T09:35:57.549241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2995 sessionId: src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0 is DEAD
2025-10-02T09:35:57.549376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.549390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Write session will restart in 0.007985s
2025-10-02T09:35:57.549431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Write session: Do CDS request
2025-10-02T09:35:57.549436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.553974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.554767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.554864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.554870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.554876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.554900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.554923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970370:11248]
2025-10-02T09:35:57.555293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.555459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.555482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.555662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.555691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.555695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.555696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.555696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.555697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.555698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.555700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.555701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.555701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.555702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.555702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.555702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.555705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.555712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.555714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.555716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.555718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.555720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.555722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.555724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.555725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.555728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.555729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.555731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.555735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.555739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.555742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.555745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.555747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.555749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.555751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.555754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.555757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.555759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.555763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.555766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.555768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.555772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.555775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.555778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.555780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.555783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.555785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.555788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.555790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.555793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.555795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.555798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.555815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.558217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.558274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.558288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2996
2025-10-02T09:35:57.558425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.558452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.558461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.558465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.558790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2996 sessionId:  describe result for acl check
2025-10-02T09:35:57.558816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.558821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.558822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.558825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.559174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.560952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.562767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.562776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.562778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552902:6861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.562782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.563176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.564639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.564650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.564651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.564653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.564658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2995 [2:7556555827990970370:11248]
2025-10-02T09:35:57.564665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.564675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.564680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.564682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.564683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.564692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.564695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.564700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.564733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.564738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.564739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.564741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.564743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.564840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.564845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.564852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.564859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.564860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2995
2025-10-02T09:35:57.564870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.564874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2995
2025-10-02T09:35:57.564884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552937:6861], now have 1 active actors on pipe
2025-10-02T09:35:57.564890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552851:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.564894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.564895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.564896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.564901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.564907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.564908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.564912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.564913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.564916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.564917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.564928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.564933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.564956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.564963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.564972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35cc343-55d507f2-a4cc292f-9375cba4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.564972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.564979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.564981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.564982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.564989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.564995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.565015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.565132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.565137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.565146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.565209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2996 partition: 0 MaxSeqNo: 36 sessionId: src_id|35cc343-55d507f2-a4cc292f-9375cba4_0
2025-10-02T09:35:57.565417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf031dec-45b8eb0e-a354ed54-2b186eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35cc343-55d507f2-a4cc292f-9375cba4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.567824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Write session: try to update token
2025-10-02T09:35:57.567837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.574015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.574025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.574026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.574027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.574030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.574033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.574035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970365:11248]
2025-10-02T09:35:57.574054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.574055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.574057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.574059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.574060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.574061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.574175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.579710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId: src_id|35cc343-55d507f2-a4cc292f-9375cba4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.581955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.648962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066552944:5673]
2025-10-02T09:35:57.649189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2995, pipe: [1:7556555828066552944:5673]
2025-10-02T09:35:57.683173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.683430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.683439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.683451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552944:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.683567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.683633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.683656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066552944:5673]
2025-10-02T09:35:57.683687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.683703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2996 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35cc343-55d507f2-a4cc292f-9375cba4_0
2025-10-02T09:35:57.683841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2996 sessionId: src_id|35cc343-55d507f2-a4cc292f-9375cba4_0 is DEAD
2025-10-02T09:35:57.683984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.683992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Write session will restart in 0.007011s
2025-10-02T09:35:57.684008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Write session: Do CDS request
2025-10-02T09:35:57.684013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.688306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.689156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.689254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.689261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.689267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.689292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.689315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970457:11250]
2025-10-02T09:35:57.689717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.689885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.689909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.690086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.690115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.690118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.690119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.690119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.690120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.690121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.690121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.690122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.690122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.690123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.690123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.690124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.690127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.690134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.690136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.690138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.690141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.690143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.690145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.690147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.690149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.690151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.690153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.690155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.690159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.690163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.690166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.690168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.690170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.690173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.690175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.690178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.690180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.690183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.690185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.690188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.690190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.690195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.690197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.690199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.690201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.690204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.690206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.690208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.690212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.690215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.690216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.690219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.690235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.692193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.692306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.692321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2997
2025-10-02T09:35:57.692448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.692474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.692484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.692488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.692856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2997 sessionId:  describe result for acl check
2025-10-02T09:35:57.692891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.692898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.692900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.692906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.693368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.695013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.697167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.697177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.697179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066552997:6872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.697185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.697664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.699234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.699244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.699246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.699248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.699252Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2996 [2:7556555827990970457:11250]
2025-10-02T09:35:57.699258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.699268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.699273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.699275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.699276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.699285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.699292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.699296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.699328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.699332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.699334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.699336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.699337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.699385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.699391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.699398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.699407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.699419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.699434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553031:6872], now have 1 active actors on pipe
2025-10-02T09:35:57.699439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066552945:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.699443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.699446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.699447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.699454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.699465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.699468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.699470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.699471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.699475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.699476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.699472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2996
2025-10-02T09:35:57.699493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.699475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2996
2025-10-02T09:35:57.699497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.699499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.699506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.699511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.699537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.699544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.699547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.699548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.699553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.699558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.699570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.699689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.699694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.699702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.699766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2997 partition: 0 MaxSeqNo: 36 sessionId: src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0
2025-10-02T09:35:57.699987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cc343-55d507f2-a4cc292f-9375cba4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.702422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Write session: try to update token
2025-10-02T09:35:57.702437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.708553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.708565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.708566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.708567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.708571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.708573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.708575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970452:11250]
2025-10-02T09:35:57.708597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.708601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.708603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.708616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.708626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.708629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.708713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.714866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId: src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.717135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.783583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066553039:5673]
2025-10-02T09:35:57.783787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2996, pipe: [1:7556555828066553039:5673]
2025-10-02T09:35:57.816711Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.816953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.816965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.816978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553039:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.817120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.817162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066553039:5673]
2025-10-02T09:35:57.817175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:57.817179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:57.817243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.817254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2997 reason: error at write: Disconnected sessionId: src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0
2025-10-02T09:35:57.817411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2997 sessionId: src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0 is DEAD
2025-10-02T09:35:57.817575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:57.817591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Write session will restart in 0.005211s
2025-10-02T09:35:57.817617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Write session: Do CDS request
2025-10-02T09:35:57.817624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.821859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.822642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.822747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.822754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.822760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.822795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.822820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970543:11252]
2025-10-02T09:35:57.823227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.823396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.823418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.823603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.823636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.823640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.823641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.823641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.823642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.823643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.823643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.823644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.823646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.823646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.823647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.823648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.823650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.823657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.823659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.823661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.823663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.823665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.823667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.823669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.823671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.823673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.823675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.823677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.823681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.823685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.823691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.823694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.823697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.823699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.823701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.823704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.823707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.823709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.823714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.823720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.823722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.823725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.823727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.823730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.823733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.823735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.823740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.823743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.823745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.823751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.823753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.823756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.823778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.824179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.824305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.824317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2998
2025-10-02T09:35:57.824401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.824426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.824435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.824438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.824748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2998 sessionId:  describe result for acl check
2025-10-02T09:35:57.824776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.824781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.824782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.824786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.825150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.826683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.830624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.830633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.830635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066553092:6883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.830639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.831138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.832632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.832643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.832644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.832648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.832651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2997 [2:7556555827990970543:11252]
2025-10-02T09:35:57.832658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.832667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.832672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.832674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.832675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.832684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.832687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.832691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.832721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.832726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.832727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.832729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.832730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.832766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.832770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.832777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.832782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.832792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.832819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553126:6883], now have 1 active actors on pipe
2025-10-02T09:35:57.832824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553040:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.832828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.832829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.832831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.832838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.832848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.832852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.832855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.832856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.832846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2997
2025-10-02T09:35:57.832858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.832861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.832854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2997
2025-10-02T09:35:57.832874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.832878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.832880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.832890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.832895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.832920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.832928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.832930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.832931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.832936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.832941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.832950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.833060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.833065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.833075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.833142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2998 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0
2025-10-02T09:35:57.833408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219d75cb-b7b62ee2-e62a3339-469fce04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.836244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Write session: try to update token
2025-10-02T09:35:57.836255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.841996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.842010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.842012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.842013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.842019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.842021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.842023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970537:11252]
2025-10-02T09:35:57.842046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.842052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.842052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.842054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.842055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.842057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.842189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.848901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId: src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.851034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:57.917226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555828066553160:5673]
2025-10-02T09:35:57.917404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2997, pipe: [1:7556555828066553160:5673]
2025-10-02T09:35:57.952879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:57.953224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.953233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.953246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553160:5673], now have 1 active actors on pipe
2025-10-02T09:35:57.953390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:57.953425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:57.953451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555828066553160:5673]
2025-10-02T09:35:57.953459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:57.953518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0
2025-10-02T09:35:57.953658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2998 sessionId: src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0 is DEAD
2025-10-02T09:35:57.953805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:57.953818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Write session will restart in 0.005933s
2025-10-02T09:35:57.953841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Write session: Do CDS request
2025-10-02T09:35:57.953847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:57.958348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:57.959114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:57.959230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:57.959237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:57.959243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:57.959271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:57.959297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555827990970667:11266]
2025-10-02T09:35:57.959668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:57.959837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:57.959861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:57.960040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:57.960070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.960074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.960075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.960076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.960077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.960077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.960078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.960078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.960079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.960080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.960082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.960082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.960085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.960092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.960094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.960097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.960099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.960101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.960103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.960105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.960107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.960109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.960111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.960113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.960116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.960120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:57.960123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.960126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:57.960129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.960131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:57.960133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.960136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:57.960139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.960141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:57.960144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.960147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:57.960149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.960152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:57.960154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.960157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:57.960160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.960163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:57.960165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.960168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.960171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.960173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.960175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.960178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.960199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:57.961151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.961221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:57.961234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2999
2025-10-02T09:35:57.961354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:57.961380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:57.961388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:57.961391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:57.961718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2999 sessionId:  describe result for acl check
2025-10-02T09:35:57.961747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:57.961751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:57.961753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:57.961756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:57.962101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:57.964085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:57.967294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:57.967303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:57.967305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555828066553222:6910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:57.967309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:57.967641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:57.969110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:57.969121Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:57.969122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:57.969124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:57.969128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2998 [2:7556555827990970667:11266]
2025-10-02T09:35:57.969136Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:57.969146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:57.969151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.969152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.969153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.969162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:57.969166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:57.969171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:57.969201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.969207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.969208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.969211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:57.969212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:57.969246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:57.969250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.969257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:57.969262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:57.969273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:57.969288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553168:2446], now have 1 active actors on pipe
2025-10-02T09:35:57.969293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555828066553253:6910], now have 1 active actors on pipe
2025-10-02T09:35:57.969296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.969297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.969298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.969305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:57.969314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:57.969305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2998
2025-10-02T09:35:57.969317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:57.969319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:57.969313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2998
2025-10-02T09:35:57.969320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:57.969324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:57.969326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:57.969346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.969351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.969358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.969366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:57.969373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:57.969384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:57.969387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:57.969393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:57.969394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:57.969399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:57.969404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:57.969446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.969578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:57.969584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:57.969592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:57.969657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2999 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0
2025-10-02T09:35:57.969882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd9baa1d-2574be89-851ec35f-d81ad859_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:57.972371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Write session: try to update token
2025-10-02T09:35:57.972384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:57.978301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:57.978312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:57.978314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:57.978314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:57.978319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.978321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.978322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555827990970662:11266]
2025-10-02T09:35:57.978340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:57.978342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:57.978345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:57.978346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:57.978347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:57.978348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:57.978461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:57.984132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId: src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:57.986427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.053414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361520561:5673]
2025-10-02T09:35:58.053607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2998, pipe: [1:7556555832361520561:5673]
2025-10-02T09:35:58.086590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.086879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.086888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.086901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520561:5673], now have 1 active actors on pipe
2025-10-02T09:35:58.087046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.087066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:58.087077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:58.087086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361520561:5673]
2025-10-02T09:35:58.087113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.087129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2999 reason: error at write: Disconnected sessionId: src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0
2025-10-02T09:35:58.087264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2999 sessionId: src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0 is DEAD
2025-10-02T09:35:58.087405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:58.087420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Write session will restart in 0.006055s
2025-10-02T09:35:58.087441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Write session: Do CDS request
2025-10-02T09:35:58.087447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.092005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.092789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.092929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.092936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.092942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.092973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.092996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938052:11268]
2025-10-02T09:35:58.093438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.093630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.093654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.093858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.093894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.093898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.093898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.093901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.093901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.093902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.093902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.093903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.093903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.093904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.093905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.093905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.093908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.093915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.093917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.093919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.093921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.093923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.093925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.093927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.093929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.093931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.093932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.093934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.093938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.093942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.093945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.093951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.093953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.093956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.093958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.093960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.093963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.093965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.093968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.093972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.093974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.093977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.093979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.093982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.093984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.093987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.093991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.093994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.093996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.093999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.094001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.094005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.094023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.094171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.094268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.094282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3000
2025-10-02T09:35:58.094389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.094414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.094424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.094427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.094739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3000 sessionId:  describe result for acl check
2025-10-02T09:35:58.094763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.094767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.094768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.094771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.095112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.096985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.100889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.100899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.100901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361520617:6917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.100905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.101367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.102871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.102883Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.102884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.102886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.102890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2999 [2:7556555832285938052:11268]
2025-10-02T09:35:58.102897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.102905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.102907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.102908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.102910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.102918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.102923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.102927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.102956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.102963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.102964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.102967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.102968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.103012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.103017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.103023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.103028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.103037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.103051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520562:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.103057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520650:6917], now have 1 active actors on pipe
2025-10-02T09:35:58.103060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.103062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.103062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.103070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.103080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.103082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.103084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.103085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.103091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.103093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.103090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2999
2025-10-02T09:35:58.103094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2999
2025-10-02T09:35:58.103106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.103110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.103112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.103126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.103130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.103151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4454238e-e29d2f0-dc133d4f-eee01864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.103157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.103160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.103161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.103167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.103175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.103189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.103314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.103319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.103326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.103395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3000 partition: 0 MaxSeqNo: 36 sessionId: src_id|4454238e-e29d2f0-dc133d4f-eee01864_0
2025-10-02T09:35:58.103622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b9562a-d23a64d9-cd7b5528-b6ff7b26_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4454238e-e29d2f0-dc133d4f-eee01864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.105898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Write session: try to update token
2025-10-02T09:35:58.105911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.112026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.112037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.112038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.112039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.112043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.112045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.112047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938047:11268]
2025-10-02T09:35:58.112066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.112067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.112069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.112072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.112073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.112082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.112187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.117085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId: src_id|4454238e-e29d2f0-dc133d4f-eee01864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.119450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.187045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361520658:5673]
2025-10-02T09:35:58.187236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2999, pipe: [1:7556555832361520658:5673]
2025-10-02T09:35:58.220943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.221193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.221202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.221214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520658:5673], now have 1 active actors on pipe
2025-10-02T09:35:58.221366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.221385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:58.221400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361520658:5673]
2025-10-02T09:35:58.221401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:58.221415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.221485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3000 reason: error at write: Disconnected sessionId: src_id|4454238e-e29d2f0-dc133d4f-eee01864_0
2025-10-02T09:35:58.221670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3000 sessionId: src_id|4454238e-e29d2f0-dc133d4f-eee01864_0 is DEAD
2025-10-02T09:35:58.221809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:58.221822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Write session will restart in 0.006508s
2025-10-02T09:35:58.221843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Write session: Do CDS request
2025-10-02T09:35:58.221849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.227137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.227888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.227984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.227991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.227996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.228046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938155:11272]
2025-10-02T09:35:58.228495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.228661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.228683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.228866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.228895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.228899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.228899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.228900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.228901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.228901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.228902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.228902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.228903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.228903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.228904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.228904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.228907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.228914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.228916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.228918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.228920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.228922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.228924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.228926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.228928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.228930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.228932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.228934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.228937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.228942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.228946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.228948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.228952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.228955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.228957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.228960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.228962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.228965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.228967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.228970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.228972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.228975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.228977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.228980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.228982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.228984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.228987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.228989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.228991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.228995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.228997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.229000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.229017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.229103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.229229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.229241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3001
2025-10-02T09:35:58.229332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.229356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.229366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.229369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.229730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3001 sessionId:  describe result for acl check
2025-10-02T09:35:58.229760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.229768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.229769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.229774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.230228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.232059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.235860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.235869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.235871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361520716:6937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.235876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.236329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.237773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.237785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.237786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.237788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.237792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3000 [2:7556555832285938155:11272]
2025-10-02T09:35:58.237798Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.237807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.237812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.237813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.237814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.237825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.237831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.237835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.237864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.237869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.237870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.237872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.237873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.237910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.237917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.237923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.237928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.237936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.237946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520660:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.237952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520751:6937], now have 1 active actors on pipe
2025-10-02T09:35:58.237956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.237957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.237958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.237966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.237974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.237977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.237979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.237980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.237985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.237986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.238000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.238005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.237981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3000
2025-10-02T09:35:58.238006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.238002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3000
2025-10-02T09:35:58.238022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.238027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.238046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4abe05f2-d4b635b2-94c82912-4645398d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.238053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.238055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.238057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.238062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.238070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.238083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.238184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.238190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.238197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.238261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3001 partition: 0 MaxSeqNo: 36 sessionId: src_id|4abe05f2-d4b635b2-94c82912-4645398d_0
2025-10-02T09:35:58.238489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4454238e-e29d2f0-dc133d4f-eee01864_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4abe05f2-d4b635b2-94c82912-4645398d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.241392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Write session: try to update token
2025-10-02T09:35:58.241404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.247420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.247434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.247436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.247437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.247442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.247445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.247447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938150:11272]
2025-10-02T09:35:58.247468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.247469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.247475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.247476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.247477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.247478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.247642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.253904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId: src_id|4abe05f2-d4b635b2-94c82912-4645398d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.256269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.321701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361520772:5673]
2025-10-02T09:35:58.321950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3000, pipe: [1:7556555832361520772:5673]
2025-10-02T09:35:58.355953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.356189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.356198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.356210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520772:5673], now have 1 active actors on pipe
2025-10-02T09:35:58.356336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.356528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.356542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361520772:5673]
2025-10-02T09:35:58.356562Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:35:58.356568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:58.356648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3001 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4abe05f2-d4b635b2-94c82912-4645398d_0
2025-10-02T09:35:58.356705Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 30 consumer shared/user session shared/user_1_30_7150361532801312499_v1 is DEAD
2025-10-02T09:35:58.356851Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:35:58.356825Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555772231949846:5679] disconnected; active server actors: 1
2025-10-02T09:35:58.356833Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555772231949846:5679] client user disconnected session shared/user_1_30_7150361532801312499_v1
2025-10-02T09:35:58.356839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3001 sessionId: src_id|4abe05f2-d4b635b2-94c82912-4645398d_0 is DEAD
2025-10-02T09:35:58.356913Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:58.356916Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:58.356922Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008649s
2025-10-02T09:35:58.356986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:58.356999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Write session will restart in 0.007019s
2025-10-02T09:35:58.357019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Write session: Do CDS request
2025-10-02T09:35:58.357025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.362020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.362930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.363028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.363034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.363040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.363065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.363090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938246:11274]
2025-10-02T09:35:58.363456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.363616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.363639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.363815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.363846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.363850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.363851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.363851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.363852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.363852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.363853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.363854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.363854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.363855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.363855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.363856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.363859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.363865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.363867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.363869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.363872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.363874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.363876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.363878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.363880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.363882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.363884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.363886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.363890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.363893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.363897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.363900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.363902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.363905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.363907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.363910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.363912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.363915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.363917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.363920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.363922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.363925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.363927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.363933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.363936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.363938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.363941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.363943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.363949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.363952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.363954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.363958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.363975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.365189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.365247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.365260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3002
2025-10-02T09:35:58.365411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.365437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.365447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.365450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.365809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3002 sessionId:  describe result for acl check
2025-10-02T09:35:58.365835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.365840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.365841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.365845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.366088Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:35:58.366175Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:35:58.366182Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 31
2025-10-02T09:35:58.366289Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 31 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:58.366302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.366319Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:58.366372Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 auth for : user
2025-10-02T09:35:58.366459Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 Handle describe topics response
2025-10-02T09:35:58.366475Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 auth is DEAD
2025-10-02T09:35:58.366491Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:35:58.366645Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:35:58.366693Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_31_12091325694439449584_v1
2025-10-02T09:35:58.366750Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555832361520839:6970] connected; active server actors: 1
2025-10-02T09:35:58.366765Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555832361520839:6970] session shared/user_1_31_12091325694439449584_v1
2025-10-02T09:35:58.366783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:35:58.366794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:35:58.366800Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_31_12091325694439449584_v1" (Sender=[1:7556555832361520831:6970], Pipe=[1:7556555832361520839:6970], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:58.366802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:35:58.366810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:35:58.366821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_31_12091325694439449584_v1" (Sender=[1:7556555832361520831:6970], Pipe=[1:7556555832361520839:6970], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:58.366827Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_31_12091325694439449584_v1" sender [1:7556555832361520831:6970] lock partition 0 for ReadingSession "shared/user_1_31_12091325694439449584_v1" (Sender=[1:7556555832361520831:6970], Pipe=[1:7556555832361520839:6970], Partitions=[], ActiveFamilyCount=1) generation 1 step 31
2025-10-02T09:35:58.366834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:35:58.366841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000024s
2025-10-02T09:35:58.366963Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 31 Session: "shared/user_1_31_12091325694439449584_v1" ClientId: "user" PipeClient { RawX1: 7556555832361520839 RawX2: 4503603922344762 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:35:58.366977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:35:58.367767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.371050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.371059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.371060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361520830:6963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.371065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.371569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.373034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.373044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.373046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.373048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.373051Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3001 [2:7556555832285938246:11274]
2025-10-02T09:35:58.373058Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.373068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.373073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.373074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.373075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.373086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.373090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.373094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.373125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.373130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.373131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.373133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.373134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.373207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.373212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.373219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.373224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.373235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.373250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520851:6976], now have 1 active actors on pipe
2025-10-02T09:35:58.373255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520773:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.373256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520871:6963], now have 1 active actors on pipe
2025-10-02T09:35:58.373259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.373261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.373253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3001, pipe: [1:7556555832361520851:6976]
2025-10-02T09:35:58.373262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.373256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3001
2025-10-02T09:35:58.373270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.373264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3001
2025-10-02T09:35:58.373277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.373286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.373288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.373290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.373293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.373294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.373311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.373316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.373322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_31_12091325694439449584_v1 on pipe: [1:7556555832361520851:6976]
2025-10-02T09:35:58.373337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.373341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.373344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.373349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.373358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.373360Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_31_12091325694439449584_v1:1 with generation 3001
2025-10-02T09:35:58.373362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.373365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.373366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.373373Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_31_12091325694439449584_v1
2025-10-02T09:35:58.373374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.373391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.373397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:35:58.373404Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:35:58.375778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:35:58.375791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:35:58.375795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.375801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.375802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.375807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.375815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.375820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:35:58.375826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:35:58.375837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.375914Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397758372 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:35:58.375923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:35:58.375945Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 sending to client partition status
2025-10-02T09:35:58.375980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.375986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.375996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.376053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3002 partition: 0 MaxSeqNo: 36 sessionId: src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0
2025-10-02T09:35:58.376223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abe05f2-d4b635b2-94c82912-4645398d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.378716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Write session: try to update token
2025-10-02T09:35:58.378729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.382355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.382366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.382367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.382368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.382373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.382375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.382377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938241:11274]
2025-10-02T09:35:58.382394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.382396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.382399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.382400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.382401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.382402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.382514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.390593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId: src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.392967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.490818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.491093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.491102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.491234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_31_12091325694439449584_v1
2025-10-02T09:35:58.491246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.491264Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_31_12091325694439449584_v1
2025-10-02T09:35:58.491268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.491304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:58.491310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361520851:6976]
2025-10-02T09:35:58.491361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3002 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0
2025-10-02T09:35:58.491556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3002 sessionId: src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0 is DEAD
2025-10-02T09:35:58.491651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:58.491671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Write session will restart in 0.008326s
2025-10-02T09:35:58.491691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Write session: Do CDS request
2025-10-02T09:35:58.491707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.496753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.497612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.497708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.497715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.497721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.497748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.497772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938342:11277]
2025-10-02T09:35:58.498192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.498346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.498367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.498538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.498568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.498572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.498573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.498573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.498576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.498576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.498577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.498578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.498578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.498579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.498579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.498580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.498582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.498589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.498591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.498593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.498595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.498597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.498599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.498601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.498603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.498605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.498607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.498609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.498614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.498618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.498621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.498624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.498626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.498629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.498631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.498633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.498635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.498639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.498641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.498644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.498647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.498649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.498651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.498653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.498655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.498658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.498662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.498668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.498670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.498673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.498675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.498704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.501210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.501296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.501309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3003
2025-10-02T09:35:58.501442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.501475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.501486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.501489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.501805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3003 sessionId:  describe result for acl check
2025-10-02T09:35:58.501830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.501835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.501836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.501839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.502185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.504029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.505935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.505944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.505948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361520939:6968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.505951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.506105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.507656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.507668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.507669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.507671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.507674Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3002 [2:7556555832285938342:11277]
2025-10-02T09:35:58.507681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.507690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.507695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.507698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.507699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.507708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.507714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.507718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.507748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.507753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.507754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.507756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.507757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.507791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.507797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.507803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.507808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.507816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.507830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520881:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.507836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520973:6968], now have 1 active actors on pipe
2025-10-02T09:35:58.507842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.507847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.507849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.507861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.507871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.507874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.507867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3002
2025-10-02T09:35:58.507877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.507879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.507886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.507892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.507884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3002
2025-10-02T09:35:58.507919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.507926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.507938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.507948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.507955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.507970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.507979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.507982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.507983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.507987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.507993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.508006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.508120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.508128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.508138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.508229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3003 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0
2025-10-02T09:35:58.508463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23bdb5d-23769d7c-d9647f19-910d57ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.511294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Write session: try to update token
2025-10-02T09:35:58.511305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.517149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.517162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.517163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.517164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.517169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.517171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.517173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938337:11277]
2025-10-02T09:35:58.517194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.517200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.517202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.517202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.517205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.517208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.517325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.523158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId: src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.525726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.591566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361520982:6976]
2025-10-02T09:35:58.591808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3002, pipe: [1:7556555832361520982:6976]
2025-10-02T09:35:58.626311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.626597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.626607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.626619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520982:6976], now have 1 active actors on pipe
2025-10-02T09:35:58.626763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.626837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.626849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361520982:6976]
2025-10-02T09:35:58.626877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:58.626963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3003 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0
2025-10-02T09:35:58.627155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3003 sessionId: src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0 is DEAD
2025-10-02T09:35:58.627294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:58.627302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Write session will restart in 0.009223s
2025-10-02T09:35:58.627323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Write session: Do CDS request
2025-10-02T09:35:58.627328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.633306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.634347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.634465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.634472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.634477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.634506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.634530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938435:11279]
2025-10-02T09:35:58.634891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.635079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.635102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.635330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.635365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.635369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.635369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.635370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.635371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.635371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.635372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.635373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.635373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.635374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.635374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.635375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.635378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.635385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.635388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.635390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.635392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.635394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.635396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.635398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.635400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.635402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.635404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.635406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.635410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.635414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.635418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.635420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.635423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.635425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.635427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.635430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.635433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.635435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.635438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.635440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.635442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.635444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.635446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.635449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.635455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.635457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.635459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.635461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.635464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.635470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.635472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.635475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.635491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.637178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.637656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.637671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3004
2025-10-02T09:35:58.637790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.637815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.637821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.637826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.638148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3004 sessionId:  describe result for acl check
2025-10-02T09:35:58.638176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.638181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.638182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.638185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.638536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.640340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.642643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.642652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.642654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361521042:6994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.642658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.642976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.644414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.644426Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.644427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.644429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.644432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3003 [2:7556555832285938435:11279]
2025-10-02T09:35:58.644439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.644449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.644454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.644456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.644457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.644466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.644470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.644473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.644506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.644511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.644512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.644514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.644517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.644556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.644561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.644567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.644572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.644586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.644605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521077:6994], now have 1 active actors on pipe
2025-10-02T09:35:58.644611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361520983:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.644616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.644620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.644622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.644633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.644646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.644630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3003
2025-10-02T09:35:58.644640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3003
2025-10-02T09:35:58.644647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.644649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.644651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.644661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.644663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.644688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.644693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.644700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.644705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.644717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.644722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.644727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.644730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.644731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.644738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.644746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.644758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.644888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.644896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.644906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.644971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3004 partition: 0 MaxSeqNo: 36 sessionId: src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0
2025-10-02T09:35:58.645184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa44a8f7-dd4cbe33-7f42253-3861e6e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.647665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Write session: try to update token
2025-10-02T09:35:58.647677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.653882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.653894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.653895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.653896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.653899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.653902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.653903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938430:11279]
2025-10-02T09:35:58.653924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.653926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.653928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.653944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.653953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.653955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.654042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.660032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId: src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.662313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.727221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361521085:6976]
2025-10-02T09:35:58.727457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3003, pipe: [1:7556555832361521085:6976]
2025-10-02T09:35:58.763397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.763630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.763639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.763651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521085:6976], now have 1 active actors on pipe
2025-10-02T09:35:58.763793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.763861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:58.763871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.763875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:58.763917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361521085:6976]
2025-10-02T09:35:58.763951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3004 reason: error at write: Disconnected sessionId: src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0
2025-10-02T09:35:58.764119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3004 sessionId: src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0 is DEAD
2025-10-02T09:35:58.764226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:58.764235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Write session will restart in 0.006252s
2025-10-02T09:35:58.764259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Write session: Do CDS request
2025-10-02T09:35:58.764264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.769827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.770814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.770954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.770961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.770967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.770999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.771025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938528:11281]
2025-10-02T09:35:58.771178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.771254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.771266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3005
2025-10-02T09:35:58.771369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.771462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.771495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.771507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.771511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.771553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.771580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.771776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.771812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.771816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.771816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.771817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.771817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.771818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.771819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.771819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.771820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.771820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.771821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.771821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.771824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.771831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.771833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.771835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.771837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.771840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.771842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.771844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.771846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.771848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.771850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.771852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.771858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.771862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.771865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.771868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.771870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.771873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.771875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.771878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.771884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.771887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.771889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.771895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.771897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.771900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.771902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.771906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.771909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.771912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.771914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.771916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.771920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.771922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.771924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.771927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.771944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.771936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3005 sessionId:  describe result for acl check
2025-10-02T09:35:58.771966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.771968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.771970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.771976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.772541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.774446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.778861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.778874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.778877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361521144:6997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.778882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.779353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.780778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.780791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.780792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.780794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.780797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3004 [2:7556555832285938528:11281]
2025-10-02T09:35:58.780818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.780835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.780840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.780842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.780843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.780852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.780859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.780863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.780893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.780898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.780900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.780902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.780904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.780940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.780945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.780952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.780957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.780968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.780987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521181:6997], now have 1 active actors on pipe
2025-10-02T09:35:58.780994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521086:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.780998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.781000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.781003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.781017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.781028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.781029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.781035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.781036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.781040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.781042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.781040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3004
2025-10-02T09:35:58.781043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3004
2025-10-02T09:35:58.781059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.781065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.781066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.781077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.781082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.781130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|558853f3-4a372e55-dba5d246-eac57235_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.781137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.781139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.781140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.781145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.781151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.781161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.781281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.781287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.781297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.781374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3005 partition: 0 MaxSeqNo: 36 sessionId: src_id|558853f3-4a372e55-dba5d246-eac57235_0
2025-10-02T09:35:58.781619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abec6c3-774e5112-5dd654ba-66cf4afa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|558853f3-4a372e55-dba5d246-eac57235_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.784481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Write session: try to update token
2025-10-02T09:35:58.784493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.790412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.790426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.790427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.790428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.790433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.790435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.790437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938523:11281]
2025-10-02T09:35:58.790459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.790465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.790464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.790468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.790468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.790470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.790595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.796693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId: src_id|558853f3-4a372e55-dba5d246-eac57235_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.799137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:58.863931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555832361521188:6976]
2025-10-02T09:35:58.864099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3004, pipe: [1:7556555832361521188:6976]
2025-10-02T09:35:58.899752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:58.900019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.900033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.900045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521188:6976], now have 1 active actors on pipe
2025-10-02T09:35:58.900159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:58.900253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:58.900369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3005 reason: status is not ok: tablet will be restarted right now sessionId: src_id|558853f3-4a372e55-dba5d246-eac57235_0
2025-10-02T09:35:58.900529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3005 sessionId: src_id|558853f3-4a372e55-dba5d246-eac57235_0 is DEAD
2025-10-02T09:35:58.900669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:58.900683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Write session will restart in 0.008474s
2025-10-02T09:35:58.900698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Write session: Do CDS request
2025-10-02T09:35:58.900702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:58.900740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:58.900790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555832361521188:6976]
2025-10-02T09:35:58.905951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:58.906984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:58.907112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:58.907119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:58.907125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:58.907159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:58.907182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555832285938660:11293]
2025-10-02T09:35:58.907521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:58.907681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:58.907706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:58.907909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:58.907942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.907946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.907947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.907947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.907948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.907950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.907951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.907951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.907952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.907952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.907953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.907954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.907956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.907962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.907964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.907966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.907968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.907970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.907972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.907974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.907976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.907978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.907981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.907983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.907986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.907990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:58.907993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.907996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:58.907998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.908001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:58.908003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.908006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:58.908009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.908012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:58.908014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.908017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:58.908019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.908022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:58.908024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.908027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:58.908031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.908033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:58.908035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.908039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.908041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.908044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.908049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.908053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.908073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:58.910138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.910226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:58.910237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3006
2025-10-02T09:35:58.910334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:58.910361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:58.910370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:58.910373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:58.910866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3006 sessionId:  describe result for acl check
2025-10-02T09:35:58.910894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:58.910900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:58.910902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:58.910907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:58.911428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:58.912970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:58.915285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:58.915296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:58.915298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555832361521279:7030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:58.915303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:58.915521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:58.917168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:58.917181Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:58.917182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:58.917184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:58.917187Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3005 [2:7556555832285938660:11293]
2025-10-02T09:35:58.917195Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:58.917204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:58.917209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.917211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.917213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.917222Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:58.917226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:58.917230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:58.917261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.917266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.917267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.917269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:58.917270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:58.917327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:58.917332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.917339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:58.917345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:58.917363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:58.917382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521203:2446], now have 1 active actors on pipe
2025-10-02T09:35:58.917389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555832361521309:7030], now have 1 active actors on pipe
2025-10-02T09:35:58.917394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.917399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.917401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.917411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:58.917400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3005
2025-10-02T09:35:58.917416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3005
2025-10-02T09:35:58.917424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:58.917423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:58.917425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:58.917426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:58.917440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:58.917445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:58.917466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.917472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.917481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.917489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:58.917503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:58.917504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:58.917512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:58.917514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:58.917515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:58.917519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:58.917525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:58.917539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.917670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:58.917677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:58.917688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:58.917766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3006 partition: 0 MaxSeqNo: 36 sessionId: src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0
2025-10-02T09:35:58.917967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558853f3-4a372e55-dba5d246-eac57235_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:58.920746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Write session: try to update token
2025-10-02T09:35:58.920756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:58.926783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:58.926797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:58.926798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:58.926799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:58.926803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.926806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.926808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555832285938648:11293]
2025-10-02T09:35:58.926829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:58.926833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:58.926834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:58.926836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:58.926839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:58.926841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:58.927041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:58.933140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId: src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:58.935600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.001133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656488618:6976]
2025-10-02T09:35:59.001344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3005, pipe: [1:7556555836656488618:6976]
2025-10-02T09:35:59.036644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.036908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.036916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.036929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488618:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.037066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.037115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656488618:6976]
2025-10-02T09:35:59.037121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:59.037139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.037215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3006 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0
2025-10-02T09:35:59.037400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3006 sessionId: src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0 is DEAD
2025-10-02T09:35:59.037547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:59.037555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Write session will restart in 0.006679s
2025-10-02T09:35:59.037571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Write session: Do CDS request
2025-10-02T09:35:59.037575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.042432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.043278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.043379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.043385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.043391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.043417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.043439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906051:11297]
2025-10-02T09:35:59.043822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.043981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.044003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.044177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.044205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.044209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.044210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.044210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.044211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.044211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.044212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.044212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.044213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.044213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.044214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.044214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.044217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.044224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.044226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.044228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.044230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.044232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.044235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.044237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.044239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.044241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.044243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.044245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.044249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.044253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.044256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.044259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.044261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.044264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.044266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.044269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.044271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.044274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.044276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.044278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.044280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.044283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.044285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.044288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.044290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.044293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.044295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.044298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.044299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.044302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.044304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.044307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.044325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.045177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.045227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.045238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3007
2025-10-02T09:35:59.045388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.045416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.045427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.045430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.045760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3007 sessionId:  describe result for acl check
2025-10-02T09:35:59.045784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.045789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.045791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.045795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.046265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.047749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.051191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.051204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.051206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656488682:7041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.051211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.051687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.053167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.053177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.053179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.053181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.053184Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3006 [2:7556555836580906051:11297]
2025-10-02T09:35:59.053191Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.053201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.053203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.053205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.053206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.053214Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.053219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.053223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.053253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.053258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.053259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.053261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.053262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.053297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.053302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.053308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.053314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.053322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.053335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488619:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.053341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488717:7041], now have 1 active actors on pipe
2025-10-02T09:35:59.053345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.053346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.053347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.053355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.053366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.053369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.053371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.053372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.053373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.053374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.053370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3006
2025-10-02T09:35:59.053391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3006
2025-10-02T09:35:59.053389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.053394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.053395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.053410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.053414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.053434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff081034-a928ed45-619ee5c2-93d144fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.053441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.053442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.053443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.053449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.053454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.053467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.053594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.053599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.053607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.053686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3007 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff081034-a928ed45-619ee5c2-93d144fe_0
2025-10-02T09:35:59.053938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85b4422-4b30cdd6-14ac11c5-c4cdec45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff081034-a928ed45-619ee5c2-93d144fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.056728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Write session: try to update token
2025-10-02T09:35:59.056738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.062504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.062517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.062518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.062520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.062524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.062527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.062529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906046:11297]
2025-10-02T09:35:59.062549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.062553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.062555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.062564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.062573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.062575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.062676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.068681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId: src_id|ff081034-a928ed45-619ee5c2-93d144fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.071093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.137333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656488724:6976]
2025-10-02T09:35:59.137526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3006, pipe: [1:7556555836656488724:6976]
2025-10-02T09:35:59.171565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.171781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.171789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.171802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488724:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.171914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.171963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.172022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656488724:6976]
2025-10-02T09:35:59.172149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:59.172205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3007 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff081034-a928ed45-619ee5c2-93d144fe_0
2025-10-02T09:35:59.172348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3007 sessionId: src_id|ff081034-a928ed45-619ee5c2-93d144fe_0 is DEAD
2025-10-02T09:35:59.172492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:59.172505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Write session will restart in 0.006045s
2025-10-02T09:35:59.172528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Write session: Do CDS request
2025-10-02T09:35:59.172534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.177036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.177906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.178005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.178013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.178018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.178043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.178066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906162:11301]
2025-10-02T09:35:59.178412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.178601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.178626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.178841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.178888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.178893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.178893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.178894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.178894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.178895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.178896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.178896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.178897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.178897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.178898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.178898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.178901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.178910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.178913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.178915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.178917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.178919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.178921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.178923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.178925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.178929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.178933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.178938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.178941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.178944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.178946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.178949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.178953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.178955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.178958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.178961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.178963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.178965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.178970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.178973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.178975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.178978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.178980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.178982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.178985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.178987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.178990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.178993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.178997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.179014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.179200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.179256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.179272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3008
2025-10-02T09:35:59.179462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.179486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.179495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.179498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.179829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3008 sessionId:  describe result for acl check
2025-10-02T09:35:59.179856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.179862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.179864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.179867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.180223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.181908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.186109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.186121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.186123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656488788:7047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.186127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.186601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.188165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.188175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.188176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.188179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.188182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3007 [2:7556555836580906162:11301]
2025-10-02T09:35:59.188189Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.188199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.188204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.188205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.188207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.188218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.188221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.188225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.188253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.188258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.188259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.188261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.188262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.188340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.188345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.188352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.188357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.188365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.188363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3007
2025-10-02T09:35:59.188371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3007
2025-10-02T09:35:59.188378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488725:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.188383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488822:7047], now have 1 active actors on pipe
2025-10-02T09:35:59.188387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.188388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.188389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.188394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.188400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.188402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.188402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.188403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.188410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.188413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.188423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.188428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.188448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.188456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.188464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87af98f5-fabe9ad7-27911933-22fb834f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.188465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.188472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.188475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.188476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.188481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.188488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.188509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.188627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.188632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.188639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.188702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3008 partition: 0 MaxSeqNo: 36 sessionId: src_id|87af98f5-fabe9ad7-27911933-22fb834f_0
2025-10-02T09:35:59.188998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff081034-a928ed45-619ee5c2-93d144fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87af98f5-fabe9ad7-27911933-22fb834f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.191610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Write session: try to update token
2025-10-02T09:35:59.191623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.197483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.197494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.197495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.197496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.197499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.197500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.197502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906157:11301]
2025-10-02T09:35:59.197521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.197523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.197524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.197525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.197526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.197529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.197652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.203479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId: src_id|87af98f5-fabe9ad7-27911933-22fb834f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.205809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.271990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656488843:6976]
2025-10-02T09:35:59.272202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3007, pipe: [1:7556555836656488843:6976]
2025-10-02T09:35:59.310340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.310558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.310566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.310578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488843:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.310714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.310745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.310773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656488843:6976]
2025-10-02T09:35:59.310793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:59.310874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87af98f5-fabe9ad7-27911933-22fb834f_0
2025-10-02T09:35:59.311024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3008 sessionId: src_id|87af98f5-fabe9ad7-27911933-22fb834f_0 is DEAD
2025-10-02T09:35:59.311395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:59.311402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Write session will restart in 0.005568s
2025-10-02T09:35:59.311422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Write session: Do CDS request
2025-10-02T09:35:59.311428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.315779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.316651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.316750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.316757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.316763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.316789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.316823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906259:11303]
2025-10-02T09:35:59.317162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.317334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.317360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.317549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.317579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.317583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.317584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.317584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.317585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.317585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.317586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.317587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.317587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.317588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.317588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.317589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.317592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.317598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.317600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.317602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.317604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.317606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.317608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.317610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.317612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.317614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.317616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.317618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.317622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.317626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.317629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.317632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.317636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.317642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.317645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.317647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.317651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.317654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.317656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.317659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.317664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.317667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.317669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.317671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.317676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.317679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.317681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.317684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.317686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.317689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.317691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.317697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.317713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.318146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.318232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.318246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3009
2025-10-02T09:35:59.318384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.318408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.318416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.318419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.318751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3009 sessionId:  describe result for acl check
2025-10-02T09:35:59.318780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.318785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.318786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.318789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.319139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.320779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.324565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.324576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.324578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656488910:7056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.324581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.325105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.326689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.326699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.326709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.326711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.326715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3008 [2:7556555836580906259:11303]
2025-10-02T09:35:59.326724Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.326734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.326740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.326741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.326742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.326751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.326753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.326757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.326787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.326792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.326794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.326795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.326797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.326833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.326839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.326845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.326850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.326858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.326873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488844:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.326878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488944:7056], now have 1 active actors on pipe
2025-10-02T09:35:59.326882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.326883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.326884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.326893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.326903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.326904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.326906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.326907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.326914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.326915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.326915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3008
2025-10-02T09:35:59.326931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.326935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.326937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.326966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3008
2025-10-02T09:35:59.327012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.327018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.327032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.327036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.327039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.327041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.327046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.327053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.327060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.327203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.327207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.327214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.327282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3009 partition: 0 MaxSeqNo: 36 sessionId: src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0
2025-10-02T09:35:59.327529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87af98f5-fabe9ad7-27911933-22fb834f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.330444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Write session: try to update token
2025-10-02T09:35:59.330454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.341310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:59.341325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.341331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.341357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:59.341359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:59.341494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:59.341608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:59.341719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:59.341830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:59.341983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:59.342009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:59.342720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId: src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.344555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.344572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.344577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.344579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.344584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.344592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.344595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906254:11303]
2025-10-02T09:35:59.344614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.344620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.344623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.344625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.344627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.344627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.344754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.345206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.410750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656488953:6976]
2025-10-02T09:35:59.410961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3008, pipe: [1:7556555836656488953:6976]
2025-10-02T09:35:59.452839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.453090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.453098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.453111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488953:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.453248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.453283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.453300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656488953:6976]
2025-10-02T09:35:59.453322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:59.453382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3009 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0
2025-10-02T09:35:59.453518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3009 sessionId: src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0 is DEAD
2025-10-02T09:35:59.453648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:59.453657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Write session will restart in 0.009123s
2025-10-02T09:35:59.453674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Write session: Do CDS request
2025-10-02T09:35:59.453679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.458521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.459381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.459480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.459487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.459492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.459516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.459542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906360:11306]
2025-10-02T09:35:59.459917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.460077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.460101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.460275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.460304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.460308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.460310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.460310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.460311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.460311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.460312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.460312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.460313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.460313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.460316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.460323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.460325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.460327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.460329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.460331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.460333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.460335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.460337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.460339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.460341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.460343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.460347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.460351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.460356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.460359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.460362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.460364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.460367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.460369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.460371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.460374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.460375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.460378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.460380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.460384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.460386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.460391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.460393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.460395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.460397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.460400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.460402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.460408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.460410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.460413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.460430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.464190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.464282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.464294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3010
2025-10-02T09:35:59.464414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.464440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.464448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.464452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.464837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3010 sessionId:  describe result for acl check
2025-10-02T09:35:59.464867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.464872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.464874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.464878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.465342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.467065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.467806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.468945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.468955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.468957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656489019:7076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.468962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.469475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.469486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.469487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.469489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.469492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3009 [2:7556555836580906360:11306]
2025-10-02T09:35:59.469499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.469511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.469515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.469517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.469518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.469527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.469530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.469533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.469566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.469571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.469572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.469574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.469575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.469608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.469613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.469621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.469627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.469638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.469652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656488954:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.469655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489054:7076], now have 1 active actors on pipe
2025-10-02T09:35:59.469659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.469660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.469661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.469669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.469677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.469682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.469684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.469685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.469675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3009
2025-10-02T09:35:59.469685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.469683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3009
2025-10-02T09:35:59.469687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.469701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.469706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.469707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.469717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.469722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.469747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2526d0c9-947d70a4-d259a816-2468f471_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.469754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.469757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.469757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.469763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.469771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.469779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.469893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.469898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.469905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.469966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3010 partition: 0 MaxSeqNo: 36 sessionId: src_id|2526d0c9-947d70a4-d259a816-2468f471_0
2025-10-02T09:35:59.470163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62d72caa-300eeee9-28ea9ff-bf2055a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2526d0c9-947d70a4-d259a816-2468f471_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.472616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Write session: try to update token
2025-10-02T09:35:59.472628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.478736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.478746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.478747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.478747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.478751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.478753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.478755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906355:11306]
2025-10-02T09:35:59.478773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.478776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.478777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.478777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.478779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.478781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.478880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.484705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId: src_id|2526d0c9-947d70a4-d259a816-2468f471_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.487093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.553570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656489062:6976]
2025-10-02T09:35:59.553768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3009, pipe: [1:7556555836656489062:6976]
2025-10-02T09:35:59.588388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.588692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.588702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.588714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489062:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.588861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.588897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:59.588931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656489062:6976]
2025-10-02T09:35:59.588962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.588964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3010 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2526d0c9-947d70a4-d259a816-2468f471_0
2025-10-02T09:35:59.589111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3010 sessionId: src_id|2526d0c9-947d70a4-d259a816-2468f471_0 is DEAD
2025-10-02T09:35:59.589259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:59.589265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Write session will restart in 0.008390s
2025-10-02T09:35:59.589289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Write session: Do CDS request
2025-10-02T09:35:59.589294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.594684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.595632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.595736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.595743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.595748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.595776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.595802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906459:11308]
2025-10-02T09:35:59.596224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.596388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.596413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.596593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.596623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.596627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.596628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.596629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.596629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.596630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.596631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.596631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.596632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.596634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.596635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.596635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.596638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.596645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.596647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.596649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.596651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.596653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.596655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.596657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.596659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.596661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.596663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.596665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.596669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.596673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.596676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.596679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.596682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.596685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.596687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.596690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.596693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.596695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.596697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.596699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.596701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.596704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.596706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.596709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.596712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.596714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.596716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.596719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.596723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.596726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.596728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.596730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.596749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.599167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.599273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.599289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3011
2025-10-02T09:35:59.599406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.599431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.599438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.599441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.599747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3011 sessionId:  describe result for acl check
2025-10-02T09:35:59.599774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.599780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.599781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.599785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.600144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.601728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.603717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.603727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.603730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656489129:7074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.603735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.604240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.605701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.605712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.605713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.605715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.605719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3010 [2:7556555836580906459:11308]
2025-10-02T09:35:59.605726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.605737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.605738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.605740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.605741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.605750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.605752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.605757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.605791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.605797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.605797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.605799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.605801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.605834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.605839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.605845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.605851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.605861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.605873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489164:7074], now have 1 active actors on pipe
2025-10-02T09:35:59.605878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489063:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.605882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.605884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.605885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.605894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.605901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.605907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.605909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.605910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.605911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.605912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.605925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.605911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3010
2025-10-02T09:35:59.605927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.605929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.605953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3010
2025-10-02T09:35:59.605979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.605985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.605998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.606006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.606010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.606011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.606016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.606021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.606028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.606175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.606180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.606188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.606257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3011 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0
2025-10-02T09:35:59.606498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2526d0c9-947d70a4-d259a816-2468f471_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.609350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Write session: try to update token
2025-10-02T09:35:59.609362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.615101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.615112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.615114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.615115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.615119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.615122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.615124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906454:11308]
2025-10-02T09:35:59.615144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.615147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.615149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.615150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.615155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.615157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.615261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.621110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId: src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.623545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.689262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656489172:6976]
2025-10-02T09:35:59.689417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3010, pipe: [1:7556555836656489172:6976]
2025-10-02T09:35:59.725094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.725365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.725373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.725387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489172:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.725530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.725549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.725584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656489172:6976]
2025-10-02T09:35:59.725583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:59.725588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:59.725674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3011 reason: error at write: Disconnected sessionId: src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0
2025-10-02T09:35:59.725832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3011 sessionId: src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0 is DEAD
2025-10-02T09:35:59.725982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:59.725990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Write session will restart in 0.008167s
2025-10-02T09:35:59.726006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Write session: Do CDS request
2025-10-02T09:35:59.726010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.731455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.732341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.732440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.732446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.732452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.732476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.732501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906561:11310]
2025-10-02T09:35:59.732883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.733062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.733085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.733260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.733289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.733293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.733293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.733294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.733294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.733295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.733296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.733296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.733297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.733297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.733298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.733298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.733301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.733308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.733310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.733312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.733314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.733316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.733318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.733320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.733322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.733324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.733326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.733328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.733332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.733336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.733339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.733341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.733344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.733346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.733348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.733351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.733353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.733356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.733358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.733361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.733364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.733367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.733369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.733371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.733373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.733376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.733378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.733380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.733382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.733385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.733387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.733389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.733409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.735181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.735294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.735307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3012
2025-10-02T09:35:59.735437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.735463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.735468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.735471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.735811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3012 sessionId:  describe result for acl check
2025-10-02T09:35:59.735842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.735848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.735848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.735852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.736211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.737897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.740272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.740282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.740284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656489242:7098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.740288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.740860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.742290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.742301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.742303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.742305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.742308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3011 [2:7556555836580906561:11310]
2025-10-02T09:35:59.742315Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.742325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.742326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.742330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.742331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.742339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.742342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.742346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.742377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.742383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.742384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.742386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.742387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.742461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.742466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.742473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.742479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.742488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.742500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489277:7098], now have 1 active actors on pipe
2025-10-02T09:35:59.742505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489175:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.742509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.742511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.742512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.742519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.742505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3011
2025-10-02T09:35:59.742528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.742524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3011
2025-10-02T09:35:59.742536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.742537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.742538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.742538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.742539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.742557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.742563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.742571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.742571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.742576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.742598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.742606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.742608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.742610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.742615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.742622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.742632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.742757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.742762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.742770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.742835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3012 partition: 0 MaxSeqNo: 36 sessionId: src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0
2025-10-02T09:35:59.743066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d33dc42-f768d0bc-130a315b-66162cf6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.745865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Write session: try to update token
2025-10-02T09:35:59.745875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.752511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.752533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.752537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.752540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.752548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.752553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.752559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906556:11310]
2025-10-02T09:35:59.752589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.752599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.752601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.752603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.752607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.752610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.752846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.758218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId: src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.760677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.825994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656489289:6976]
2025-10-02T09:35:59.826216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3011, pipe: [1:7556555836656489289:6976]
2025-10-02T09:35:59.861616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.861860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.861868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.861881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489289:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.862047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:59.862053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.862070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:59.862076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:59.862103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656489289:6976]
2025-10-02T09:35:59.862168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3012 reason: error at write: Disconnected sessionId: src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0
2025-10-02T09:35:59.862357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3012 sessionId: src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0 is DEAD
2025-10-02T09:35:59.862482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:59.862492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Write session will restart in 0.007159s
2025-10-02T09:35:59.862507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Write session: Do CDS request
2025-10-02T09:35:59.862512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.867547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:59.868405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:59.868512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:59.868519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:59.868524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:59.868549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:59.868573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555836580906663:11312]
2025-10-02T09:35:59.868932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:59.869093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:59.869117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:59.869291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:59.869321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.869324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.869325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.869326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.869326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.869327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.869328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.869328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.869328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.869329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.869330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.869330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.869333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.869339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.869342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.869344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.869346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.869348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.869350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.869352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.869354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.869356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.869358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.869360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.869364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.869368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:59.869371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.869374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:59.869376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.869379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:59.869381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.869384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:59.869387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.869390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:59.869392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.869395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:59.869398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.869401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:59.869403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.869407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:59.869409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.869412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:59.869414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.869416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.869418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.869421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.869423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.869426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.869442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:59.870129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.870258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:59.870271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3013
2025-10-02T09:35:59.870393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:59.870417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:59.870425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:59.870428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:59.870806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3013 sessionId:  describe result for acl check
2025-10-02T09:35:59.870834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:59.870839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:59.870844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:59.870849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:59.871286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:59.873124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:59.876275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:59.876286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:59.876288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555836656489358:7103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:59.876293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:59.876814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:59.878338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:59.878350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:59.878351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:59.878355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:59.878358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3012 [2:7556555836580906663:11312]
2025-10-02T09:35:59.878365Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:59.878374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:59.878379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.878380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.878381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.878390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:59.878393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:59.878397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:59.878427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.878432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.878432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.878434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:59.878436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:59.878472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:59.878477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.878485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:59.878491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:59.878498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:59.878514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489393:7103], now have 1 active actors on pipe
2025-10-02T09:35:59.878519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489290:2446], now have 1 active actors on pipe
2025-10-02T09:35:59.878523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.878524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.878525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.878533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:59.878540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:59.878544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:59.878546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:59.878547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:59.878549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:59.878550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:59.878543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3012
2025-10-02T09:35:59.878565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.878567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:59.878563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3012
2025-10-02T09:35:59.878568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:59.878584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.878586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.878603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:59.878610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:59.878613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:59.878614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:59.878619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:59.878627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:59.878638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.878737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.878742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.878749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:59.878814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3013 partition: 0 MaxSeqNo: 36 sessionId: src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0
2025-10-02T09:35:59.879067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e867f8ac-7ec88bc1-60f03ab6-7ad75b99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:59.881847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Write session: try to update token
2025-10-02T09:35:59.881858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:59.888443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:59.888461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:59.888463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:59.888465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:59.888471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.888478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.888481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555836580906658:11312]
2025-10-02T09:35:59.888508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:59.888518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:59.888518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:59.888520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:59.888524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:59.888526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:59.888767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:59.894271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId: src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:59.896728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:59.962195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555836656489428:6976]
2025-10-02T09:35:59.962396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3012, pipe: [1:7556555836656489428:6976]
2025-10-02T09:35:59.998573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:59.998799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:59.998808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:59.998820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489428:6976], now have 1 active actors on pipe
2025-10-02T09:35:59.999049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:59.999061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:59.999060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:59.999110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3013 reason: error at write: Disconnected sessionId: src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0
2025-10-02T09:35:59.999119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555836656489428:6976]
2025-10-02T09:35:59.999241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3013 sessionId: src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0 is DEAD
2025-10-02T09:35:59.999361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:59.999371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Write session will restart in 0.005000s
2025-10-02T09:35:59.999386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Write session: Do CDS request
2025-10-02T09:35:59.999395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:59.999590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.005084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.005116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.005911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.005926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3014
2025-10-02T09:36:00.006035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.006068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.006094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.006103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.006106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.006161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.006169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.006175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.006205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.006230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874098:11326]
2025-10-02T09:36:00.006487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3014 sessionId:  describe result for acl check
2025-10-02T09:36:00.006517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.006522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.006524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.006528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.006578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.006744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.006767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.006997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.006991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.007031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.007035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.007035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.007036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.007037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.007037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.007038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.007039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.007039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.007040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.007040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.007041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.007044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.007052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.007054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.007057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.007059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.007060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.007062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.007064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.007066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.007068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.007070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.007072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.007076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.007080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.007084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.007087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.007090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.007092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.007095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.007098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.007100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.007103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.007105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.007107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.007110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.007113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.007115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.007117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.007121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.007123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.007125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.007128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.007130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.007133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.007135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.007138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.007154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.008848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.014330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.014341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.014343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951456793:7119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.014350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.014831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.016452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.016465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.016467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.016470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.016474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3013 [2:7556555840875874098:11326]
2025-10-02T09:36:00.016482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.016492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.016498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.016500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.016501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.016510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.016514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.016520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.016552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.016557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.016559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.016561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.016563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.016602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.016607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.016613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.016618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.016626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.016642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456831:7119], now have 1 active actors on pipe
2025-10-02T09:36:00.016648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555836656489432:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.016652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.016653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.016654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.016664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.016672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.016679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.016681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.016682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.016683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.016685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.016680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3013
2025-10-02T09:36:00.016702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.016706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.016708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.016716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.016718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.016713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3013
2025-10-02T09:36:00.016743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|992a647f-b4760107-44ff0a42-2c28cdee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.016751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.016753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.016754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.016759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.016764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.016777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.016904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.016910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.016918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.016995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3014 partition: 0 MaxSeqNo: 36 sessionId: src_id|992a647f-b4760107-44ff0a42-2c28cdee_0
2025-10-02T09:36:00.017373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b274a85a-8191ef89-c18ae34f-dbc5fbe7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|992a647f-b4760107-44ff0a42-2c28cdee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.020204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Write session: try to update token
2025-10-02T09:36:00.020218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.027069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.027092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.027094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.027098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.027106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.027111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.027115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874093:11326]
2025-10-02T09:36:00.027147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.027151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.027151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.027153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.027157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.027160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.027319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.033767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId: src_id|992a647f-b4760107-44ff0a42-2c28cdee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.036345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.099406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951456842:6976]
2025-10-02T09:36:00.099649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3013, pipe: [1:7556555840951456842:6976]
2025-10-02T09:36:00.140246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.140497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.140507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.140519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456842:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.140639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.140705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:00.140717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:00.140729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951456842:6976]
2025-10-02T09:36:00.140754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.140773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3014 reason: error at write: Disconnected sessionId: src_id|992a647f-b4760107-44ff0a42-2c28cdee_0
2025-10-02T09:36:00.140907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3014 sessionId: src_id|992a647f-b4760107-44ff0a42-2c28cdee_0 is DEAD
2025-10-02T09:36:00.141287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:00.141300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Write session will restart in 0.005790s
2025-10-02T09:36:00.141316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Write session: Do CDS request
2025-10-02T09:36:00.141321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.146808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.147785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.147907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.147916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.147926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.147971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.148004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874205:11331]
2025-10-02T09:36:00.148199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.148266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.148278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3015
2025-10-02T09:36:00.148414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.148419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.148440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.148449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.148456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.148621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.148648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.148816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3015 sessionId:  describe result for acl check
2025-10-02T09:36:00.148850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.148856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.148861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.148859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.148866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.148896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.148900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.148900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.148901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.148902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.148902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.148903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.148903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.148904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.148905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.148905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.148906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.148909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.148915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.148918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.148922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.148924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.148926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.148928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.148930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.148932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.148934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.148936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.148938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.148942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.148946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.148952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.148955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.148957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.148960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.148962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.148964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.148966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.148969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.148971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.148974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.148977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.148980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.148986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.148988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.148990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.148993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.148995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.148997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.148999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.149002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.149004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.149007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.149025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.149328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.151187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.155445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.155457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.155459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951456911:7143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.155464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.156610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.158163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.158176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.158177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.158180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.158183Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3014 [2:7556555840875874205:11331]
2025-10-02T09:36:00.158191Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.158201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.158207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.158208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.158209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.158219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.158222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.158227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.158265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.158272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.158274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.158277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.158279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.158323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.158328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.158337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.158342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.158350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.158367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456843:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.158372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456948:7143], now have 1 active actors on pipe
2025-10-02T09:36:00.158376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.158377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.158378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.158386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.158379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3014
2025-10-02T09:36:00.158388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3014
2025-10-02T09:36:00.158394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.158394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.158396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.158397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.158405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.158407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.158431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.158436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.158445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.158453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.158460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.158468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90b22dca-3aad551a-728bae38-6c8e391b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.158472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.158475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.158476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.158481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.158489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.158540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.158633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.158638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.158646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.158727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3015 partition: 0 MaxSeqNo: 36 sessionId: src_id|90b22dca-3aad551a-728bae38-6c8e391b_0
2025-10-02T09:36:00.159037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992a647f-b4760107-44ff0a42-2c28cdee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90b22dca-3aad551a-728bae38-6c8e391b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.161836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Write session: try to update token
2025-10-02T09:36:00.161848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.168038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.168059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.168061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.168063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.168071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.168076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.168080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874200:11331]
2025-10-02T09:36:00.168107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.168115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.168116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.168118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.168120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.168122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.168275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.174806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId: src_id|90b22dca-3aad551a-728bae38-6c8e391b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.177253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.240710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951456956:6976]
2025-10-02T09:36:00.240961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3014, pipe: [1:7556555840951456956:6976]
2025-10-02T09:36:00.281151Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:36:00.283051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.283335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.283344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.283357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456956:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.283493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.283586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.283617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:00.283648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951456956:6976]
2025-10-02T09:36:00.283670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3015 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90b22dca-3aad551a-728bae38-6c8e391b_0
2025-10-02T09:36:00.283768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3015 sessionId: src_id|90b22dca-3aad551a-728bae38-6c8e391b_0 is DEAD
2025-10-02T09:36:00.284073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:00.284104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Write session will restart in 0.007160s
2025-10-02T09:36:00.284121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Write session: Do CDS request
2025-10-02T09:36:00.284125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.289242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.290208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.290303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.290310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.290315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.290339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.290365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874322:11334]
2025-10-02T09:36:00.290723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.290894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.290916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.291134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.291177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.291182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.291183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.291183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.291184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.291185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.291185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.291186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.291186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.291187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.291187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.291188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.291191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.291198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.291200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.291202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.291204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.291206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.291208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.291210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.291212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.291214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.291216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.291218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.291222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.291226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.291229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.291232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.291234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.291237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.291239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.291242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.291244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.291247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.291251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.291255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.291260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.291264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.291267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.291276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.291280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.291288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.291292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.291299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.291303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.291308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.291312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.291318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.291349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.292124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.292189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.292201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3016
2025-10-02T09:36:00.292356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.292383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.292391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.292395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.292766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3016 sessionId:  describe result for acl check
2025-10-02T09:36:00.292795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.292819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.292826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.292830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.293286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.294986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.298240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.298251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.298255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457040:7155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.298259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.298794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.300208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.300220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.300222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.300225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.300228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3015 [2:7556555840875874322:11334]
2025-10-02T09:36:00.300291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.300306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.300312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.300314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.300315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.300324Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.300330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.300335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.300365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.300370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.300371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.300373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.300374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.300413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.300417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.300425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.300430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.300440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.300455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457075:7155], now have 1 active actors on pipe
2025-10-02T09:36:00.300460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951456969:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.300463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.300465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.300466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.300473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.300480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.300486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.300488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.300488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.300489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.300490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.300486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3015
2025-10-02T09:36:00.300505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3015
2025-10-02T09:36:00.300504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.300509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.300510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.300525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.300531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.300549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6ef5619-83b1378f-8921a290-b3aed629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.300556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.300559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.300560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.300565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.300570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.300586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.300706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.300711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.300718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.300788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3016 partition: 0 MaxSeqNo: 36 sessionId: src_id|c6ef5619-83b1378f-8921a290-b3aed629_0
2025-10-02T09:36:00.301115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b22dca-3aad551a-728bae38-6c8e391b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c6ef5619-83b1378f-8921a290-b3aed629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.303860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Write session: try to update token
2025-10-02T09:36:00.303869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.310305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.310327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.310330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.310333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.310340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.310345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.310349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874317:11334]
2025-10-02T09:36:00.310377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.310386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.310388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.310390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.310394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.310397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.310571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.316656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId: src_id|c6ef5619-83b1378f-8921a290-b3aed629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.319157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.384036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951457085:6976]
2025-10-02T09:36:00.384232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3015, pipe: [1:7556555840951457085:6976]
2025-10-02T09:36:00.422565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.422810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.422819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.422832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457085:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.422984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.423033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:00.423079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951457085:6976]
2025-10-02T09:36:00.423103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3016 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6ef5619-83b1378f-8921a290-b3aed629_0
2025-10-02T09:36:00.423103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.423228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3016 sessionId: src_id|c6ef5619-83b1378f-8921a290-b3aed629_0 is DEAD
2025-10-02T09:36:00.423651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:00.423663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Write session will restart in 0.008086s
2025-10-02T09:36:00.423678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Write session: Do CDS request
2025-10-02T09:36:00.423683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.428788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.429692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.429790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.429796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.429802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.429826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.429851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874429:11337]
2025-10-02T09:36:00.430194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.430347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.430371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.430545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.430573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.430577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.430578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.430578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.430579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.430579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.430580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.430580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.430582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.430582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.430585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.430592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.430594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.430596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.430598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.430600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.430602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.430604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.430606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.430608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.430610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.430612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.430616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.430619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.430623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.430626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.430628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.430630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.430632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.430635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.430637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.430640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.430642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.430645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.430647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.430650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.430655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.430658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.430660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.430664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.430666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.430668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.430670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.430673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.430675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.430677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.430695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.433238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.433371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.433387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3017
2025-10-02T09:36:00.433499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.433523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.433531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.433535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.433903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3017 sessionId:  describe result for acl check
2025-10-02T09:36:00.433933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.433938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.433942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.433946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.434387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.435796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.437643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.437654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.437656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457158:7167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.437661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.438098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.439571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.439583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.439584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.439587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.439590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3016 [2:7556555840875874429:11337]
2025-10-02T09:36:00.439596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.439606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.439607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.439609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.439610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.439619Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.439625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.439630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.439660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.439665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.439665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.439667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.439668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.439706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.439711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.439718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.439723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.439731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.439745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457086:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.439750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457193:7167], now have 1 active actors on pipe
2025-10-02T09:36:00.439754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.439755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.439757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.439766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.439774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.439785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.439787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.439768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3016
2025-10-02T09:36:00.439784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.439801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.439802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.439803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.439804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.439808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.439812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.439814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.439843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.439838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3016
2025-10-02T09:36:00.439850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.439852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.439853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.439860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.439866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.439878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.439994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.439999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.440007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.440069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3017 partition: 0 MaxSeqNo: 36 sessionId: src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0
2025-10-02T09:36:00.440306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ef5619-83b1378f-8921a290-b3aed629_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.442939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Write session: try to update token
2025-10-02T09:36:00.442953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.448915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.448925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.448926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.448926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.448930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.448934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.448936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874424:11337]
2025-10-02T09:36:00.448954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.448957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.448960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.448960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.448961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.448963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.449079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.455362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3017 sessionId: src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.457735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.523332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951457200:6976]
2025-10-02T09:36:00.523575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3016, pipe: [1:7556555840951457200:6976]
2025-10-02T09:36:00.560778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.561013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.561023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.561036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457200:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.561319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:00.561330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:00.561350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951457200:6976]
2025-10-02T09:36:00.561379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.561379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3017 reason: error at write: Disconnected sessionId: src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0
2025-10-02T09:36:00.561513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3017 sessionId: src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0 is DEAD
2025-10-02T09:36:00.561601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.561683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:00.561694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Write session will restart in 0.006808s
2025-10-02T09:36:00.561717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Write session: Do CDS request
2025-10-02T09:36:00.561722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.567347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.568247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.568348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.568355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.568361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.568385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.568411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874536:11339]
2025-10-02T09:36:00.568790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.568977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.569002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.569187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.569198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.569230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.569234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.569234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.569235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.569235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.569236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.569236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.569237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.569238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.569238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.569239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.569240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.569243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.569250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.569252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.569254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.569256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.569258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.569260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.569262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.569264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.569267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.569269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.569271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.569275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.569279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.569283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.569287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.569289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.569292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.569294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.569297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.569299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.569302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.569304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.569307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.569309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.569312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.569315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.569317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.569319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.569322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.569324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.569327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.569329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.569332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.569334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.569337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.569307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.569320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3018
2025-10-02T09:36:00.569356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.569427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.569452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.569460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.569464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.569766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3018 sessionId:  describe result for acl check
2025-10-02T09:36:00.569803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.569810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.569812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.569817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.570201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.571957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.575816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.575827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.575828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457275:7190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.575833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.577038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.578633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.578648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.578649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.578653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.578657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3017 [2:7556555840875874536:11339]
2025-10-02T09:36:00.578664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.578674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.578679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.578680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.578681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.578691Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.578695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.578703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.578753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.578758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.578759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.578761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.578762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.578802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.578808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.578815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.578824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.578832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.578848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457310:7190], now have 1 active actors on pipe
2025-10-02T09:36:00.578854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457202:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.578857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.578858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.578860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.578871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.578882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.578884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.578885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.578885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.578882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3017
2025-10-02T09:36:00.578900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3017
2025-10-02T09:36:00.578897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.578904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.578934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.578940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.578947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.578953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.578960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.578971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.578979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.578981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.578982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.578987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.578993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.579007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.579096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.579102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.579109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.579165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3018 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0
2025-10-02T09:36:00.579373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fa17f0-bf803849-ce66ca15-62e922b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.581652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Write session: try to update token
2025-10-02T09:36:00.581665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.588129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.588143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.588144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.588145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.588149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.588153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.588155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874531:11339]
2025-10-02T09:36:00.588174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.588178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.588179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.588181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.588182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.588184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.588291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.593984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId: src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.596212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.661577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951457317:6976]
2025-10-02T09:36:00.661817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3017, pipe: [1:7556555840951457317:6976]
2025-10-02T09:36:00.700704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.700996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.701005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.701018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457317:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.701167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.701242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.701250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951457317:6976]
2025-10-02T09:36:00.701268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:00.701327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3018 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0
2025-10-02T09:36:00.701461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3018 sessionId: src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0 is DEAD
2025-10-02T09:36:00.701636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:00.701649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Write session will restart in 0.009855s
2025-10-02T09:36:00.701674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Write session: Do CDS request
2025-10-02T09:36:00.701680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.706634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.707547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.707646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.707653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.707658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.707681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.707705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874644:11341]
2025-10-02T09:36:00.708052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.708213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.708235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.708437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.708441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.708442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.708442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.708443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.708443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.708444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.708444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.708446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.708446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.708449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.708456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.708458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.708460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.708462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.708464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.708466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.708468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.708469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.708472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.708474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.708475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.708479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.708483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.708485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.708489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.708491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.708494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.708496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.708499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.708501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.708504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.708506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.708509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.708511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.708514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.708516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.708519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.708522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.708525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.708527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.708529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.708531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.708534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.708536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.708538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.708558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.712157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.712268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.712278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3019
2025-10-02T09:36:00.712404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.712429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.712437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.712440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.712752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3019 sessionId:  describe result for acl check
2025-10-02T09:36:00.712781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.712788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.712789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.712792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.713295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.714784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.715980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.716716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.716727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.716729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457393:7204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.716732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.717493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.717506Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.717507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.717510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.717513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3018 [2:7556555840875874644:11341]
2025-10-02T09:36:00.717521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.717531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.717533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.717534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.717535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.717545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.717548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.717552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.717585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.717590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.717591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.717593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.717594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.717629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.717634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.717641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.717646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.717655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.717669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457428:7204], now have 1 active actors on pipe
2025-10-02T09:36:00.717676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457318:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.717679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.717680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.717681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.717689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.717700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.717701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.717703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.717704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.717710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.717711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.717707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3018
2025-10-02T09:36:00.717711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3018
2025-10-02T09:36:00.717727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.717733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.717734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.717749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.717755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.717772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.717779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.717781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.717783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.717788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.717796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.717808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.717913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.717919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.717928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.717994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3019 partition: 0 MaxSeqNo: 36 sessionId: src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0
2025-10-02T09:36:00.718301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4eef66-622aef79-69c4ef03-c89c509c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.720597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Write session: try to update token
2025-10-02T09:36:00.720612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.726835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.726847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.726849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.726850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.726853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.726856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.726858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874639:11341]
2025-10-02T09:36:00.726877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.726879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.726880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.726881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.726882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.726884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.727002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.732426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId: src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.734731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.801345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951457435:6976]
2025-10-02T09:36:00.801629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3018, pipe: [1:7556555840951457435:6976]
2025-10-02T09:36:00.840215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.840519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.840528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.840541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457435:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.840667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.840739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:00.840752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:00.840756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951457435:6976]
2025-10-02T09:36:00.840813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.840854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3019 reason: error at write: Disconnected sessionId: src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0
2025-10-02T09:36:00.841035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3019 sessionId: src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0 is DEAD
2025-10-02T09:36:00.841179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:00.841192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Write session will restart in 0.008286s
2025-10-02T09:36:00.841217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Write session: Do CDS request
2025-10-02T09:36:00.841223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.847382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.848628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.848740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.848748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.848753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.848783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.848817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874753:11343]
2025-10-02T09:36:00.849157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.849360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.849381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.849568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.849599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.849603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.849605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.849605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.849607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.849607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.849608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.849608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.849609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.849612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.849620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.849622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.849624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.849626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.849628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.849630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.849632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.849634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.849636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.849638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.849640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.849646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.849650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.849653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.849656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.849658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.849662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.849664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.849666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.849669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.849671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.849673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.849676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.849678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.849681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.849683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.849686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.849688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.849693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.849698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.849700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.849703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.849705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.849709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.849725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.850196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.850310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.850321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3020
2025-10-02T09:36:00.850434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.850458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.850466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.850469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.850851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3020 sessionId:  describe result for acl check
2025-10-02T09:36:00.850879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.850885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.850886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.850890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.851353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.853083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.856658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.856668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.856670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457511:7205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.856675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.857166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.858619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.858631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.858631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.858634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.858638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3019 [2:7556555840875874753:11343]
2025-10-02T09:36:00.858645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.858654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.858656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.858657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.858658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.858669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.858672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.858676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.858705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.858720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.858722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.858724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.858726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.858760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.858765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.858771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.858776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.858784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.858799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457546:7205], now have 1 active actors on pipe
2025-10-02T09:36:00.858805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457436:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.858808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.858809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.858810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.858818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.858826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.858830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.858832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.858833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.858836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.858837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.858851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.858857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.858858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.858867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3019
2025-10-02T09:36:00.858873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3019
2025-10-02T09:36:00.858921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.858926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.858940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.858947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.858949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.858950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.858955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.858964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.858972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.859098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.859103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.859111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.859183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3020 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0
2025-10-02T09:36:00.859405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6042a174-1e49ea7d-e383f65c-abf3e4ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:00.861665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Write session: try to update token
2025-10-02T09:36:00.861678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:00.867993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:00.868005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:00.868007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:00.868007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:00.868011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.868013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.868015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874748:11343]
2025-10-02T09:36:00.868034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:00.868035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:00.868037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:00.868039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.868039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:00.868040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:00.868157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:00.873483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId: src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:00.875848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:00.941079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555840951457563:6976]
2025-10-02T09:36:00.941282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3019, pipe: [1:7556555840951457563:6976]
2025-10-02T09:36:00.981139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:00.981406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.981416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.981428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457563:6976], now have 1 active actors on pipe
2025-10-02T09:36:00.981548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:00.981613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:00.981612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555840951457563:6976]
2025-10-02T09:36:00.981632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:00.981676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3020 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0
2025-10-02T09:36:00.981810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3020 sessionId: src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0 is DEAD
2025-10-02T09:36:00.981967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:00.981979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Write session will restart in 0.005844s
2025-10-02T09:36:00.981998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Write session: Do CDS request
2025-10-02T09:36:00.982004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:00.988163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:00.989109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.989241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:00.989252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3021
2025-10-02T09:36:00.989354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:00.989377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:00.989384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:00.989387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:00.989413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:00.989523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:00.989530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:00.989536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:00.989563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:00.989585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555840875874898:11357]
2025-10-02T09:36:00.989709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3021 sessionId:  describe result for acl check
2025-10-02T09:36:00.989736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:00.989741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:00.989742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:00.989746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:00.989930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:00.990119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:00.990141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:00.990318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:00.990349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.990353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.990354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.990354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.990355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.990356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.990356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.990357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.990357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.990358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.990359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.990359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.990362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.990369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.990371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.990373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.990376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.990378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.990380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.990382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.990384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.990386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.990388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.990389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.990393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.990397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:00.990400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.990403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:00.990405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.990408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:00.990410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.990413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:00.990416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.990418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:00.990421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.990423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:00.990426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.990429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:00.990431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.990434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:00.990436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.990439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:00.990442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.990444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.990446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.990449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.990451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.990456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.990472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:00.990515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:00.992380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:00.996767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:00.996777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:00.996779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555840951457657:7236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:00.996783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:00.997941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:00.999494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:00.999507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:00.999509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:00.999511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:00.999514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3020 [2:7556555840875874898:11357]
2025-10-02T09:36:00.999522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:00.999533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:00.999534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.999536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.999537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.999546Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:00.999555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:00.999561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:00.999594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.999598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.999599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.999601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:00.999603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:00.999640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:00.999646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:00.999653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:00.999657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:00.999668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:00.999679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457695:7236], now have 1 active actors on pipe
2025-10-02T09:36:00.999681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555840951457582:2446], now have 1 active actors on pipe
2025-10-02T09:36:00.999684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:00.999685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:00.999687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:00.999695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:00.999706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:00.999708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:00.999710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:00.999711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:00.999715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:00.999717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:00.999730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:00.999734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:00.999735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:00.999738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3020
2025-10-02T09:36:00.999751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3020
2025-10-02T09:36:00.999784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.999789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.999802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dece309e-571fc262-ea873e9e-23e4be08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:00.999809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:00.999811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:00.999813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:00.999818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:00.999826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:00.999837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:00.999956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:00.999961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:00.999968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.000055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3021 partition: 0 MaxSeqNo: 36 sessionId: src_id|dece309e-571fc262-ea873e9e-23e4be08_0
2025-10-02T09:36:01.000303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a387f6c-da7d4bd2-956f4356-efe0b8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dece309e-571fc262-ea873e9e-23e4be08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.002572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Write session: try to update token
2025-10-02T09:36:01.002586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.008788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.008813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.008816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.008817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.008821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:01.008825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:01.008826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555840875874893:11357]
2025-10-02T09:36:01.008847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.008848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.008851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.008853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.008853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.008855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.008962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.014358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId: src_id|dece309e-571fc262-ea873e9e-23e4be08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.016727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.081908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425000:6976]
2025-10-02T09:36:01.082149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3020, pipe: [1:7556555845246425000:6976]
2025-10-02T09:36:01.121557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.121843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.121859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.121893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425000:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.122087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:01.122088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425000:6976]
2025-10-02T09:36:01.122100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:01.122104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.122172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3021 reason: error at write: Disconnected sessionId: src_id|dece309e-571fc262-ea873e9e-23e4be08_0
2025-10-02T09:36:01.122336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3021 sessionId: src_id|dece309e-571fc262-ea873e9e-23e4be08_0 is DEAD
2025-10-02T09:36:01.122396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.122480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:01.122491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Write session will restart in 0.005493s
2025-10-02T09:36:01.122515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Write session: Do CDS request
2025-10-02T09:36:01.122521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.128396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.129069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.129217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.129227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3022
2025-10-02T09:36:01.129335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.129358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.129366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.129368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.129678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.129725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3022 sessionId:  describe result for acl check
2025-10-02T09:36:01.129755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.129760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.129762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.129766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.129797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.129804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.129811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.129839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.129862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842308:11360]
2025-10-02T09:36:01.130189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.130204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.130394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.130416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.130591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.130617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.130621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.130622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.130623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.130623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.130624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.130624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.130625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.130625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.130626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.130627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.130627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.130630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.130637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.130639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.130641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.130643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.130645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.130647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.130649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.130653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.130662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.130665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.130670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.130674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.130679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.130681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.130684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.130686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.130689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.130696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.130698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.130700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.130702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.130705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.130707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.130710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.130722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.130725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.130727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.130731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.130733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.130736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.130739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.130742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.130759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.131650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.136480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.136491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.136493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425074:7251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.136498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.138138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.139699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.139710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.139711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.139713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.139719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3021 [2:7556555845170842308:11360]
2025-10-02T09:36:01.139726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.139735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.139739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.139741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.139742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.139751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.139757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.139761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.139795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.139800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.139801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.139803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.139805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.139842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.139847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.139853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.139858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.139867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.139883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425113:7251], now have 1 active actors on pipe
2025-10-02T09:36:01.139888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425001:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.139892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.139893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.139895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.139903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.139914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.139914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.139922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.139922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.139923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.139923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.139936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.139942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.139929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3021
2025-10-02T09:36:01.139938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3021
2025-10-02T09:36:01.139948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.139963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.139968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.139986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.139993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.139995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.139996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.140000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.140007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.140014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.140128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.140133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.140141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.140204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3022 partition: 0 MaxSeqNo: 36 sessionId: src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0
2025-10-02T09:36:01.140446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece309e-571fc262-ea873e9e-23e4be08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.142751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Write session: try to update token
2025-10-02T09:36:01.142765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.148918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:01.148928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.148933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.148953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:01.148954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:01.149085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:01.149195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:01.149302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:01.149412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:01.149580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:01.149602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:01.154608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId: src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.156846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.157479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.157492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.157504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.157505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.157506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.157507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.157510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.157512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.157514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842303:11360]
2025-10-02T09:36:01.157532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.157534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.157535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.157536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.157537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.157538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.157644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.222183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425121:6976]
2025-10-02T09:36:01.222433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3021, pipe: [1:7556555845246425121:6976]
2025-10-02T09:36:01.271486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.271762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:01.271785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425121:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.271894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:01.271913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425121:6976]
2025-10-02T09:36:01.271929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.271995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:01.272001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:01.272075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3022 reason: error at write: Disconnected sessionId: src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0
2025-10-02T09:36:01.272216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3022 sessionId: src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0 is DEAD
2025-10-02T09:36:01.272356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:01.272365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Write session will restart in 0.006192s
2025-10-02T09:36:01.272384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Write session: Do CDS request
2025-10-02T09:36:01.272389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.278039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.279103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.279143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.279200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.279206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.279212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.279236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.279261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842431:11363]
2025-10-02T09:36:01.279244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.279255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3023
2025-10-02T09:36:01.279347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.279368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.279376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.279379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.279601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.279699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3023 sessionId:  describe result for acl check
2025-10-02T09:36:01.279731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.279739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.279740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.279743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.279764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.279786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.279961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.279995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.280000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.280000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.280001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.280001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.280002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.280002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.280003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.280003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.280004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.280004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.280005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.280008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.280014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.280016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.280018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.280020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.280022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.280024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.280026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.280028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.280030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.280032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.280034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.280037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.280041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.280045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.280047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.280050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.280052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.280054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.280058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.280060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.280063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.280065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.280068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.280070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.280073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.280075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.280078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.280076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.280080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.280083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.280085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.280087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.280089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.280092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.280094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.280096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.280113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.281576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.285423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.285433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.285435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425210:7252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.285439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.287504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.289000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.289012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.289013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.289016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.289019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3022 [2:7556555845170842431:11363]
2025-10-02T09:36:01.289026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.289036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.289037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.289038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.289039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.289049Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.289054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.289057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.289090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.289095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.289096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.289098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.289099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.289137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.289141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.289147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.289152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.289160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.289177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425134:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.289185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425247:7252], now have 1 active actors on pipe
2025-10-02T09:36:01.289188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.289189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.289190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.289198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.289205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.289213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3022
2025-10-02T09:36:01.289225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3022
2025-10-02T09:36:01.289209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.289211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.289211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.289212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.289213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.289226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.289228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.289244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.289249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.289251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.289266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.289273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.289276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.289278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.289282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.289288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.289295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.289399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.289404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.289411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.289481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3023 partition: 0 MaxSeqNo: 36 sessionId: src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0
2025-10-02T09:36:01.289676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768a9ae3-fca71f40-b0c387b5-c0454970_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.291923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Write session: try to update token
2025-10-02T09:36:01.291936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.298333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.298345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.298347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.298348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.298352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.298354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.298356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842426:11363]
2025-10-02T09:36:01.298376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.298379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.298381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.298383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.298383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.298384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.298507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.303439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId: src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.305691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.372194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425256:6976]
2025-10-02T09:36:01.372429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3022, pipe: [1:7556555845246425256:6976]
2025-10-02T09:36:01.409961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.410188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.410198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.410223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425256:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.410394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.410422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.410438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425256:6976]
2025-10-02T09:36:01.410458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:01.410518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3023 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0
2025-10-02T09:36:01.410668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3023 sessionId: src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0 is DEAD
2025-10-02T09:36:01.410835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:01.410841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Write session will restart in 0.007082s
2025-10-02T09:36:01.410864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Write session: Do CDS request
2025-10-02T09:36:01.410870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.415996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.416971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.417079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.417087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.417093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.417120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.417151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842546:11366]
2025-10-02T09:36:01.417552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.417745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.417771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.417966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.417999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.418003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.418004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.418005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.418005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.418006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.418007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.418007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.418008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.418008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.418009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.418010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.418013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.418021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.418023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.418026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.418028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.418031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.418033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.418035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.418038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.418040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.418042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.418045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.418049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.418054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.418059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.418063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.418065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.418068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.418071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.418074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.418077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.418080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.418082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.418085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.418089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.418092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.418095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.418098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.418101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.418105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.418107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.418110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.418114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.418117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.418120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.418123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.418143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.419227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.419329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.419344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3024
2025-10-02T09:36:01.419448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.419473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.419481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.419485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.419810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3024 sessionId:  describe result for acl check
2025-10-02T09:36:01.419842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.419849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.419850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.419854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.420244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.421988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.426109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.426122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.426124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425337:7263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.426129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.426650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.428239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.428253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.428255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.428257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.428261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3023 [2:7556555845170842546:11366]
2025-10-02T09:36:01.428270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.428282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.428288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.428290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.428291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.428301Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.428304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.428309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.428343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.428348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.428350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.428352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.428354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.428395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.428401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.428408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.428414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.428424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.428440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425258:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.428446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425372:7263], now have 1 active actors on pipe
2025-10-02T09:36:01.428451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.428453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.428454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.428463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.428473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.428469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3023
2025-10-02T09:36:01.428483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.428488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.428479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3023
2025-10-02T09:36:01.428495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.428504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.428506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.428512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.428515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.428526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.428536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.428553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.428559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.428564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.428566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.428568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.428574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.428579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.428653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.428781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.428787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.428795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.428892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3024 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0
2025-10-02T09:36:01.429155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daafd90-f514db5b-9b2bdbd7-9b26f3d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.431567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Write session: try to update token
2025-10-02T09:36:01.431581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.438688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.438701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.438702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.438703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.438708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.438710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.438720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842541:11366]
2025-10-02T09:36:01.438742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.438743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.438746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.438748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.438749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.438749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.438910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.443572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId: src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.445825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.510458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425379:6976]
2025-10-02T09:36:01.510639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3023, pipe: [1:7556555845246425379:6976]
2025-10-02T09:36:01.550747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.550992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.551001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.551026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425379:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.551172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.551206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:01.551218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:01.551218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425379:6976]
2025-10-02T09:36:01.551242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.551268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3024 reason: error at write: Disconnected sessionId: src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0
2025-10-02T09:36:01.551416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3024 sessionId: src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0 is DEAD
2025-10-02T09:36:01.551565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:01.551578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Write session will restart in 0.007702s
2025-10-02T09:36:01.551598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Write session: Do CDS request
2025-10-02T09:36:01.551603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.556906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.557860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.557956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.557962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.557968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.557993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.558017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842660:11368]
2025-10-02T09:36:01.558359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.558519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.558542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.558735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.558780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.558785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.558785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.558786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.558786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.558787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.558787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.558788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.558788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.558789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.558790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.558790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.558793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.558800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.558802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.558804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.558806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.558808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.558810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.558812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.558814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.558816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.558818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.558820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.558825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.558829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.558832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.558835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.558837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.558840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.558842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.558845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.558847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.558849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.558852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.558854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.558856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.558859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.558861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.558864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.558866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.558869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.558874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.558877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.558879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.558882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.558887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.558890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.558907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.560192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.560284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.560298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3025
2025-10-02T09:36:01.560394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.560417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.560425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.560428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.560753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3025 sessionId:  describe result for acl check
2025-10-02T09:36:01.560780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.560786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.560789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.560792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.561162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.562694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.566006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.566020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.566022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425462:7283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.566027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.566496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.568087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.568099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.568100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.568102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.568105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3024 [2:7556555845170842660:11368]
2025-10-02T09:36:01.568114Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.568124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.568125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.568127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.568128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.568139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.568145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.568150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.568183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.568188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.568189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.568191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.568192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.568229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.568233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.568239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.568244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.568252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.568267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425496:7283], now have 1 active actors on pipe
2025-10-02T09:36:01.568273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425382:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.568276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.568278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.568279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.568287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.568297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.568301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.568303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.568304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.568308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.568309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.568305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3024
2025-10-02T09:36:01.568325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.568318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3024
2025-10-02T09:36:01.568330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.568331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.568342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.568348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.568371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.568378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.568380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.568382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.568387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.568393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.568403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.568534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.568538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.568546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.568611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3025 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0
2025-10-02T09:36:01.568856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8934f5-248f4b2e-19d28123-5bc73654_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.571152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Write session: try to update token
2025-10-02T09:36:01.571164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.577535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.577550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.577551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.577552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.577556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.577560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.577562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842655:11368]
2025-10-02T09:36:01.577581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.577588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.577589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.577591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.577594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.577595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.577701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.583218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId: src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.585569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.651264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425507:6976]
2025-10-02T09:36:01.651505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3024, pipe: [1:7556555845246425507:6976]
2025-10-02T09:36:01.689654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.689897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.689906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.689919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425507:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.690059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.690159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425507:6976]
2025-10-02T09:36:01.690163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:01.690184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.690253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3025 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0
2025-10-02T09:36:01.690400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3025 sessionId: src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0 is DEAD
2025-10-02T09:36:01.690531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:01.690542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Write session will restart in 0.008979s
2025-10-02T09:36:01.690560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Write session: Do CDS request
2025-10-02T09:36:01.690564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.696152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.697148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.697251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.697258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.697263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.697288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.697317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842775:11370]
2025-10-02T09:36:01.697670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.697830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.697853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.698057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.698095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.698100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.698100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.698101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.698101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.698102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.698103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.698103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.698104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.698104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.698105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.698105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.698108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.698115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.698117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.698119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.698121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.698123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.698125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.698127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.698129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.698131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.698133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.698135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.698139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.698143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.698146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.698149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.698152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.698154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.698156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.698159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.698161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.698166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.698168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.698171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.698173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.698178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.698180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.698187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.698190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.698192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.698196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.698199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.698201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.698205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.698207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.698209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.698228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.700146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.700241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.700251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3026
2025-10-02T09:36:01.700340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.700362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.700369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.700372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.700692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3026 sessionId:  describe result for acl check
2025-10-02T09:36:01.700723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.700730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.700731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.700733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.701109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.702965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.705171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.705180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.705182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425589:7293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.705186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.705700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.707283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.707297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.707298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.707300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.707304Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3025 [2:7556555845170842775:11370]
2025-10-02T09:36:01.707310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.707321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.707326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.707327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.707328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.707339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.707343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.707348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.707386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.707392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.707394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.707396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.707398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.707446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.707451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.707458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.707463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.707472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.707486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425624:7293], now have 1 active actors on pipe
2025-10-02T09:36:01.707491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425508:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.707495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.707496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.707497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.707505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.707516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.707506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3025
2025-10-02T09:36:01.707518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.707523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3025
2025-10-02T09:36:01.707520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.707521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.707527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.707529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.707554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.707560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.707569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.707578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.707586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.707597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.707602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.707607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.707608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.707613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.707621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.707635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.707755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.707760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.707767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.707834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3026 partition: 0 MaxSeqNo: 36 sessionId: src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0
2025-10-02T09:36:01.708026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4bf9381-7bfc3207-d42f938d-d288037c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.710476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Write session: try to update token
2025-10-02T09:36:01.710490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.716840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.716851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.716852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.716853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.716857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.716859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.716862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842770:11370]
2025-10-02T09:36:01.716881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.716882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.716885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.716887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.716887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.716889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.717003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.723004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId: src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.725381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.790515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425632:6976]
2025-10-02T09:36:01.790690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3025, pipe: [1:7556555845246425632:6976]
2025-10-02T09:36:01.829444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.829767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.829776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.829790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425632:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.829954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.830028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425632:6976]
2025-10-02T09:36:01.830033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:01.830054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.830128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3026 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0
2025-10-02T09:36:01.830300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3026 sessionId: src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0 is DEAD
2025-10-02T09:36:01.830449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:01.830463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Write session will restart in 0.005115s
2025-10-02T09:36:01.830488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Write session: Do CDS request
2025-10-02T09:36:01.830494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.836134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.836168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.836233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.836243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3027
2025-10-02T09:36:01.836325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.836348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.836355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.836357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.836712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3027 sessionId:  describe result for acl check
2025-10-02T09:36:01.836742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.836747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.836749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.836754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.837200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.837210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.837301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.837307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.837313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.837339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.837361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170842890:11372]
2025-10-02T09:36:01.837702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.837867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.837889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.838065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.838093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.838098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.838098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.838099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.838099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.838100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.838100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.838101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.838102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.838102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.838103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.838103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.838106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.838113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.838115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.838117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.838119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.838121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.838122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.838124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.838126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.838128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.838130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.838132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.838136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.838140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.838143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.838146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.838148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.838150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.838153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.838155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.838158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.838160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.838162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.838165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.838172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.838175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.838178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.838183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.838186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.838188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.838190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.838193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.838198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.838201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.838203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.838206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.838224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.838640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.842991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.843004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.843008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425711:7299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.843014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.845615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.847188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.847201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.847202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.847204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.847208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3026 [2:7556555845170842890:11372]
2025-10-02T09:36:01.847215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.847225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.847230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.847232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.847233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.847241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.847248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.847253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.847285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.847289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.847290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.847292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.847293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.847332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.847336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.847343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.847348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.847359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.847371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425633:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.847376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425750:7299], now have 1 active actors on pipe
2025-10-02T09:36:01.847380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.847381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.847382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.847390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.847399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.847404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.847406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.847407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.847408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.847410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.847425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.847416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3026
2025-10-02T09:36:01.847430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.847420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3026
2025-10-02T09:36:01.847443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.847448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.847450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.847469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.847475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.847477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.847478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.847483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.847490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.847499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.847602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.847607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.847615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.847682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3027 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0
2025-10-02T09:36:01.847900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31cfa46-570b73d1-d227a2e0-dc428f53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.850319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Write session: try to update token
2025-10-02T09:36:01.850332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.856449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.856462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.856463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.856464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.856469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.856471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.856473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170842885:11372]
2025-10-02T09:36:01.856493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.856496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.856499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.856499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.856501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.856501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.856613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:01.862277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId: src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:01.864537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:01.930281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555845246425765:6976]
2025-10-02T09:36:01.930491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3026, pipe: [1:7556555845246425765:6976]
2025-10-02T09:36:01.969972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:01.970328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.970339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.970352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425765:6976], now have 1 active actors on pipe
2025-10-02T09:36:01.970471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:01.970532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:01.970542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:01.970591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555845246425765:6976]
2025-10-02T09:36:01.970625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3027 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0
2025-10-02T09:36:01.970805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3027 sessionId: src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0 is DEAD
2025-10-02T09:36:01.970962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:01.970971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Write session will restart in 0.005668s
2025-10-02T09:36:01.970990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Write session: Do CDS request
2025-10-02T09:36:01.970996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:01.976877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:01.977158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.977254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:01.977265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3028
2025-10-02T09:36:01.977348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:01.977369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:01.977372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:01.977375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:01.977679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3028 sessionId:  describe result for acl check
2025-10-02T09:36:01.977705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:01.977709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:01.977712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:01.977716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:01.977893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:01.978007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:01.978014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:01.978020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:01.978026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:01.978048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:01.978073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555845170843036:11380]
2025-10-02T09:36:01.978420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:01.978579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:01.978602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:01.978784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:01.978815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.978819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.978819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.978820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.978820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.978821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.978821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.978822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.978822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.978823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.978825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.978825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.978828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.978834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.978836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.978838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.978840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.978842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.978844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.978846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.978848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.978850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.978852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.978854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.978858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.978861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:01.978865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.978867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:01.978870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.978872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:01.978874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.978877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:01.978879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.978882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:01.978883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.978886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:01.978888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.978890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:01.978892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.978894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:01.978897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.978899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:01.978902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.978906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.978909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.978911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.978913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.978931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:01.979368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:01.983771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:01.983782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:01.983786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555845246425861:7317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:01.983793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:01.986445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:01.988022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:01.988035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:01.988036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:01.988038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:01.988041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3027 [2:7556555845170843036:11380]
2025-10-02T09:36:01.988049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:01.988059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:01.988064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.988066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.988067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.988076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:01.988078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:01.988083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:01.988112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.988118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.988119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.988120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:01.988122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:01.988161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:01.988166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.988173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:01.988179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:01.988189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:01.988202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425896:7317], now have 1 active actors on pipe
2025-10-02T09:36:01.988208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555845246425766:2446], now have 1 active actors on pipe
2025-10-02T09:36:01.988211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.988213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.988214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.988221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:01.988230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:01.988236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:01.988238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:01.988239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:01.988240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:01.988242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:01.988256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.988262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:01.988263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:01.988266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3027
2025-10-02T09:36:01.988292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3027
2025-10-02T09:36:01.988314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.988319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.988332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:01.988339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:01.988342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:01.988343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:01.988348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:01.988357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:01.988366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.988499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:01.988504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:01.988512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:01.988582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3028 partition: 0 MaxSeqNo: 36 sessionId: src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0
2025-10-02T09:36:01.988840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8694cb-f1e6519-aee345e3-351e65fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:01.991236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Write session: try to update token
2025-10-02T09:36:01.991251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:01.997583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:01.997596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:01.997597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:01.997598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:01.997601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.997604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.997610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555845170843031:11380]
2025-10-02T09:36:01.997629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:01.997635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:01.997637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:01.997639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:01.997644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:01.997649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:01.997750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.003266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId: src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.005479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.070564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393213:6976]
2025-10-02T09:36:02.070810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3027, pipe: [1:7556555849541393213:6976]
2025-10-02T09:36:02.110863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.111156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.111165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.111177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393213:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.111296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.111396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.111396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.111447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393213:6976]
2025-10-02T09:36:02.111491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0
2025-10-02T09:36:02.111665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3028 sessionId: src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0 is DEAD
2025-10-02T09:36:02.111806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.111819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Write session will restart in 0.006163s
2025-10-02T09:36:02.111837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Write session: Do CDS request
2025-10-02T09:36:02.111842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.117316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.118463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.118565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.118572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.118579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.118603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.118630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465810459:11389]
2025-10-02T09:36:02.118993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.119234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.119190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.119213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.119322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.119336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3029
2025-10-02T09:36:02.119388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.119420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.119424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.119424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.119425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.119425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.119426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.119426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.119427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.119427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.119428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.119429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.119429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.119432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.119439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.119441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.119443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.119445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.119452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.119447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.119449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.119450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.119453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.119456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.119458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.119460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.119464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.119468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.119472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.119474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.119476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.119477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.119485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.119479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.119481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.119484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.119486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.119489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.119491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.119494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.119496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.119488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.119499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.119501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.119504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.119506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.119509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.119512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.119515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.119517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.119520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.119522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.119525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.119543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.119839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3029 sessionId:  describe result for acl check
2025-10-02T09:36:02.119872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.119877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.119878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.119883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.120334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.121853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.125847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.125859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.125863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393298:7339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.125871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.127038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.128586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.128600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.128602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.128604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.128609Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3028 [2:7556555849465810459:11389]
2025-10-02T09:36:02.128617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.128628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.128634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.128636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.128637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.128646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.128649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.128654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.128691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.128696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.128697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.128699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.128700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.128741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.128746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.128753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.128758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.128768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.128783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393214:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.128789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393333:7339], now have 1 active actors on pipe
2025-10-02T09:36:02.128793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.128794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.128795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.128817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.128818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.128821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.128822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.128825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.128833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.128835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.128850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.128858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.128846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3028
2025-10-02T09:36:02.128859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3028
2025-10-02T09:36:02.128863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.128899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.128904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.128919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.128928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.128930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.128931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.128938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.128946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.128952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.129074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.129079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.129086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.129156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3029 partition: 0 MaxSeqNo: 36 sessionId: src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0
2025-10-02T09:36:02.129431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9258c5e5-b4393fa9-b3767c04-1b0423d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.131762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Write session: try to update token
2025-10-02T09:36:02.131778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.137812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:02.137826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.137830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.137849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:02.137859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:02.137990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:02.138108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:02.138224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:02.138338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:02.138505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:02.138527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:02.144138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId: src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.146061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.146075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.146076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.146077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.146081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.146084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.146086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465810454:11389]
2025-10-02T09:36:02.146104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.146107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.146109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.146109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.146112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.146115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.146230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.146428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.211393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393340:6976]
2025-10-02T09:36:02.211680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3028, pipe: [1:7556555849541393340:6976]
2025-10-02T09:36:02.258317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.258558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.258567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.258578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393340:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.258716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.258762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.258788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.258812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393340:6976]
2025-10-02T09:36:02.258866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3029 reason: status is not ok: tablet will be restarted right now sessionId: src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0
2025-10-02T09:36:02.259019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3029 sessionId: src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0 is DEAD
2025-10-02T09:36:02.259158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.259170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Write session will restart in 0.005411s
2025-10-02T09:36:02.259192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Write session: Do CDS request
2025-10-02T09:36:02.259197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.265151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.265224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.265235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3030
2025-10-02T09:36:02.265333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.265355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.265363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.265366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.265684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3030 sessionId:  describe result for acl check
2025-10-02T09:36:02.265708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.265712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.265714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.265717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.265724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.265986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.266093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.266100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.266106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.266132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.266143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.266156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465810589:11392]
2025-10-02T09:36:02.266494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.267386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.267410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.267670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.267685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.267714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.267719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.267719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.267720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.267720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.267721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.267721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.267722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.267722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.267723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.267723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.267724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.267727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.267733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.267735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.267737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.267739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.267741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.267743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.267745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.267747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.267750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.267752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.267754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.267759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.267763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.267766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.267769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.267773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.267776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.267778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.267781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.267783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.267785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.267787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.267790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.267795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.267798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.267800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.267802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.267804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.267807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.267809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.267815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.267817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.267820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.267822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.267824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.267840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.272632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.272651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.272653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393434:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.272658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.275238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.276684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.276697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.276698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.276700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.276705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3029 [2:7556555849465810589:11392]
2025-10-02T09:36:02.276711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.276722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.276727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.276729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.276730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.276738Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.276741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.276747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.276781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.276786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.276788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.276790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.276791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.276840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.276845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.276853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.276858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.276870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.276881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393354:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.276887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393473:7348], now have 1 active actors on pipe
2025-10-02T09:36:02.276891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.276892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.276894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.276901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.276910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.276917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.276919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.276920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.276920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.276921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.276935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.276925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3029
2025-10-02T09:36:02.276937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3029
2025-10-02T09:36:02.276943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.276950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.276969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.276974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.276989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.276996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.276998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.276999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.277004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.277012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.277020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.277152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.277156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.277163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.277227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3030 partition: 0 MaxSeqNo: 36 sessionId: src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0
2025-10-02T09:36:02.277662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deecc532-f87e7afb-f1afbada-2a0d1231_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.279955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Write session: try to update token
2025-10-02T09:36:02.279967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.285989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.286002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.286003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.286004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.286007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.286010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.286011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465810584:11392]
2025-10-02T09:36:02.286031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.286037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.286038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.286040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.286045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.286048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.286202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.293071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId: src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.295302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.358851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393483:6976]
2025-10-02T09:36:02.359051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3029, pipe: [1:7556555849541393483:6976]
2025-10-02T09:36:02.395294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.395577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.395587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.395598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393483:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.395724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.395788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.395800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.395847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393483:6976]
2025-10-02T09:36:02.395887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3030 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0
2025-10-02T09:36:02.396076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3030 sessionId: src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0 is DEAD
2025-10-02T09:36:02.396227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.396238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Write session will restart in 0.009125s
2025-10-02T09:36:02.396257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Write session: Do CDS request
2025-10-02T09:36:02.396262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.401802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.402909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.403006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.403013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.403019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.403044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.403067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465810711:11395]
2025-10-02T09:36:02.403412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.403576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.403598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.403774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.403803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.403808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.403808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.403809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.403809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.403810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.403810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.403811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.403811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.403812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.403812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.403813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.403816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.403823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.403825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.403831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.403833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.403835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.403837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.403839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.403841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.403843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.403847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.403852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.403855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.403858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.403860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.403863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.403865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.403868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.403870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.403873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.403875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.403877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.403879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.403882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.403884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.403887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.403889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.403891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.403893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.403896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.403898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.403901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.403903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.403905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.403921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.406159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.406269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.406282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3031
2025-10-02T09:36:02.406380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.406404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.406412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.406416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.406823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3031 sessionId:  describe result for acl check
2025-10-02T09:36:02.406853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.406858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.406859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.406864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.407304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.409059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.410926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.410936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.410939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393571:7349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.410943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.411324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.412851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.412862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.412863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.412865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.412869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3030 [2:7556555849465810711:11395]
2025-10-02T09:36:02.412875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.412885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.412887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.412889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.412890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.412898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.412905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.412909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.412943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.412947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.412948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.412951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.412952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.412988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.412993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.412999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.413004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.413016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.413027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393485:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.413032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393606:7349], now have 1 active actors on pipe
2025-10-02T09:36:02.413036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.413037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.413038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.413046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.413057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.413058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.413060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.413061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.413067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.413069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.413060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3030
2025-10-02T09:36:02.413065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3030
2025-10-02T09:36:02.413083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.413088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.413090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.413102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.413107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.413131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.413138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.413140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.413141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.413146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.413151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.413164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.413268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.413273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.413280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.413332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3031 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0
2025-10-02T09:36:02.413536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bd362d-4a56cbc5-e07ba872-2280079b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.415841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Write session: try to update token
2025-10-02T09:36:02.415854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.422237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.422251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.422252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.422253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.422257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.422259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.422261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465810706:11395]
2025-10-02T09:36:02.422280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.422286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.422287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.422294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.422299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.422311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.422410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.427856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3031 sessionId: src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.430237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.496060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393613:6976]
2025-10-02T09:36:02.496299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3030, pipe: [1:7556555849541393613:6976]
2025-10-02T09:36:02.532793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.533025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.533034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.533047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393613:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.533179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.533252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393613:6976]
2025-10-02T09:36:02.533275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.533290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.533374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3031 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0
2025-10-02T09:36:02.533567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3031 sessionId: src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0 is DEAD
2025-10-02T09:36:02.533689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.533700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Write session will restart in 0.006854s
2025-10-02T09:36:02.533723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Write session: Do CDS request
2025-10-02T09:36:02.533729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.538963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.540023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.540121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.540128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.540134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.540158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.540188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465810832:11397]
2025-10-02T09:36:02.540534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.540706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.540729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.540916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.540948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.540952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.540952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.540953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.540954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.540954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.540955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.540956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.540956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.540956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.540957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.540958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.540960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.540968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.540970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.540972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.540974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.540976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.540978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.540980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.540982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.540984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.540986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.540988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.540992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.540996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.540999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.541003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.541005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.541007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.541009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.541012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.541015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.541017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.541019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.541022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.541024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.541027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.541029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.541032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.541034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.541037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.541040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.541042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.541044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.541047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.541050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.541052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.541069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.541130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.541221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.541234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3032
2025-10-02T09:36:02.541323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.541352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.541359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.541362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.541707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3032 sessionId:  describe result for acl check
2025-10-02T09:36:02.541738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.541743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.541745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.541749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.542201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.543686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.547890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.547900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.547903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393701:7366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.547908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.548396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.549894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.549904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.549905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.549907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.549911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3031 [2:7556555849465810832:11397]
2025-10-02T09:36:02.549918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.549928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.549932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.549934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.549935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.549944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.549951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.549955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.549990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.549994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.549996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.549998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.549999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.550036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.550040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.550046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.550055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.550063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.550078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393736:7366], now have 1 active actors on pipe
2025-10-02T09:36:02.550084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393614:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.550087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.550088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.550090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.550097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.550108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.550112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.550113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.550115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.550118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.550119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.550135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.550143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.550148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.550136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3031
2025-10-02T09:36:02.550167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.550171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.550138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3031
2025-10-02T09:36:02.550185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af0a7c38-20091781-3178c033-8c22c086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.550193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.550195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.550200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.550204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.550209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.550219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.550348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.550353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.550361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.550432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3032 partition: 0 MaxSeqNo: 36 sessionId: src_id|af0a7c38-20091781-3178c033-8c22c086_0
2025-10-02T09:36:02.550641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7f7a4d-81e38d0-ed292fab-f56b47e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af0a7c38-20091781-3178c033-8c22c086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.552948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Write session: try to update token
2025-10-02T09:36:02.552959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.559121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.559131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.559132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.559133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.559137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.559139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.559141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465810827:11397]
2025-10-02T09:36:02.559162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.559168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.559169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.559173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.559184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.559191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.559318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.564684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId: src_id|af0a7c38-20091781-3178c033-8c22c086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.567013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.633283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393744:6976]
2025-10-02T09:36:02.633516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3031, pipe: [1:7556555849541393744:6976]
2025-10-02T09:36:02.669779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.670015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.670024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.670036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393744:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.670171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.670245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393744:6976]
2025-10-02T09:36:02.670246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.670284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.670338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3032 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af0a7c38-20091781-3178c033-8c22c086_0
2025-10-02T09:36:02.670506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3032 sessionId: src_id|af0a7c38-20091781-3178c033-8c22c086_0 is DEAD
2025-10-02T09:36:02.670657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.670663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Write session will restart in 0.009687s
2025-10-02T09:36:02.670683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Write session: Do CDS request
2025-10-02T09:36:02.670688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.676429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.677471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.677576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.677583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.677588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.677613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.677636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465810954:11399]
2025-10-02T09:36:02.677973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.678138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.678160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.678331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.678359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.678363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.678363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.678364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.678364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.678366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.678366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.678367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.678368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.678368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.678371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.678378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.678380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.678382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.678384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.678386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.678388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.678390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.678392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.678399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.678401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.678403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.678411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.678414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.678417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.678419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.678422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.678424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.678427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.678429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.678432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.678434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.678436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.678439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.678441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.678444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.678446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.678448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.678451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.678454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.678460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.678462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.678465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.678467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.678469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.678490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.681087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.681171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.681182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3033
2025-10-02T09:36:02.681274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.681298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.681303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.681310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.681666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3033 sessionId:  describe result for acl check
2025-10-02T09:36:02.681696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.681697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.681698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.681702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.682191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.683916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.685787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.685796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.685798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393833:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.685803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.685857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.687292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.687302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.687303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.687305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.687309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3032 [2:7556555849465810954:11399]
2025-10-02T09:36:02.687315Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.687325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.687330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.687331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.687333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.687341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.687346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.687350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.687385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.687390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.687391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.687393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.687395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.687428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.687434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.687440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.687445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.687457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.687471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393868:7377], now have 1 active actors on pipe
2025-10-02T09:36:02.687476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393745:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.687480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.687482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.687483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.687492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.687502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.687504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.687506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.687507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.687512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.687513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.687511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3032
2025-10-02T09:36:02.687513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3032
2025-10-02T09:36:02.687526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.687531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.687544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.687551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.687553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.687569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.687576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.687578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.687579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.687584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.687589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.687599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.687698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.687703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.687710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.687783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3033 partition: 0 MaxSeqNo: 36 sessionId: src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0
2025-10-02T09:36:02.687959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0a7c38-20091781-3178c033-8c22c086_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.690428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Write session: try to update token
2025-10-02T09:36:02.690442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.696542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.696553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.696554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.696555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.696559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.696561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.696563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465810949:11399]
2025-10-02T09:36:02.696581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.696584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.696587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.696592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.696596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.696599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.696702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.702458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId: src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.704687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.770489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541393876:6976]
2025-10-02T09:36:02.770714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3032, pipe: [1:7556555849541393876:6976]
2025-10-02T09:36:02.805238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.805549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.805558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.805569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393876:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.805692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.805777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.805781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541393876:6976]
2025-10-02T09:36:02.805805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.805879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3033 reason: status is not ok: tablet will be restarted right now sessionId: src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0
2025-10-02T09:36:02.806031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3033 sessionId: src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0 is DEAD
2025-10-02T09:36:02.806168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.806181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Write session will restart in 0.007033s
2025-10-02T09:36:02.806201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Write session: Do CDS request
2025-10-02T09:36:02.806206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.811963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.813019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.813116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.813123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.813129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.813153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.813177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465811076:11401]
2025-10-02T09:36:02.813519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.813690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.813712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.813888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.813918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.813922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.813922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.813923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.813924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.813924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.813925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.813925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.813926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.813926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.813927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.813927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.813930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.813937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.813939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.813941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.813943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.813945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.813947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.813949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.813951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.813953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.813955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.813957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.813961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.813965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.813968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.813971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.813973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.813976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.813977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.813980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.813982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.813985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.813987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.813990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.813993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.813995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.813999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.814003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.814007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.814009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.814011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.814014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.814016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.814018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.814020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.814023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.814039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.814138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.814232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.814244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3034
2025-10-02T09:36:02.814334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.814359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.814366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.814369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.814708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3034 sessionId:  describe result for acl check
2025-10-02T09:36:02.814745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.814751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.814753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.814758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.815201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.817089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.820922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.820938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.820942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541393966:7388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.820951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.821436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.822919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.822929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.822931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.822933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.822937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3033 [2:7556555849465811076:11401]
2025-10-02T09:36:02.822944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.822955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.822961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.822962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.822964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.822972Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.822975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.822980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.823013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.823018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.823019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.823022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.823023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.823061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.823066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.823073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.823078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.823086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.823101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541393877:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.823107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541394000:7388], now have 1 active actors on pipe
2025-10-02T09:36:02.823110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.823112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.823113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.823121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.823131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.823135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.823137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.823139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.823143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.823144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.823159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.823164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.823145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3033
2025-10-02T09:36:02.823169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.823155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3033
2025-10-02T09:36:02.823185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.823190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.823205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.823211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.823214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.823215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.823220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.823225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.823231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.823339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.823344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.823351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.823424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3034 partition: 0 MaxSeqNo: 36 sessionId: src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0
2025-10-02T09:36:02.823663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|705be43d-fd774ce0-b2cca2e3-5e798f6a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.826002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Write session: try to update token
2025-10-02T09:36:02.826017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.832139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.832150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.832151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.832152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.832156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.832160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.832163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465811071:11401]
2025-10-02T09:36:02.832182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.832186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.832190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.832193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.832198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.832201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.832304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.837527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId: src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.839680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:02.906181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555849541394012:6976]
2025-10-02T09:36:02.906366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3033, pipe: [1:7556555849541394012:6976]
2025-10-02T09:36:02.943403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:02.943617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.943626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.943638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541394012:6976], now have 1 active actors on pipe
2025-10-02T09:36:02.943782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:02.943842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:02.943854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555849541394012:6976]
2025-10-02T09:36:02.943884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:02.943973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0
2025-10-02T09:36:02.944146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3034 sessionId: src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0 is DEAD
2025-10-02T09:36:02.944274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:02.944280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Write session will restart in 0.009736s
2025-10-02T09:36:02.944305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Write session: Do CDS request
2025-10-02T09:36:02.944312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:02.949884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:02.950982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:02.951090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:02.951097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:02.951103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:02.951128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:02.951154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555849465811200:11403]
2025-10-02T09:36:02.951520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:02.951696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:02.951719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:02.951899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:02.951928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.951932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.951933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.951933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.951934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.951934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.951935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.951935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.951936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.951936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.951936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.951937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.951940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.951947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.951949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.951951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.951953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.951955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.951957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.951959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.951961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.951963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.951965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.951967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.951971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.951975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:02.951978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.951981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:02.951983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.951986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:02.951988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.951991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:02.951993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.951996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:02.951998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.952001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:02.952003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.952006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:02.952008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.952010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:02.952014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.952016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:02.952018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.952021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.952024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.952026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.952030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.952032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.952049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:02.955235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.955317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:02.955332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3035
2025-10-02T09:36:02.955431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:02.955458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:02.955466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:02.955470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:02.955800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3035 sessionId:  describe result for acl check
2025-10-02T09:36:02.955831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:02.955837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:02.955838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:02.955842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:02.956266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:02.957885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:02.959435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:02.959756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:02.959765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:02.959768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555849541394111:7408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:02.959772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:02.960966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:02.960976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:02.960978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:02.960980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:02.960984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3034 [2:7556555849465811200:11403]
2025-10-02T09:36:02.960993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:02.961004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:02.961009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.961010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.961011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.961019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:02.961023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:02.961027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:02.961112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.961118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.961119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.961121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:02.961122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:02.961158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:02.961162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.961169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:02.961174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:02.961185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:02.961199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541394017:2446], now have 1 active actors on pipe
2025-10-02T09:36:02.961204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555849541394142:7408], now have 1 active actors on pipe
2025-10-02T09:36:02.961208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.961209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.961210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.961218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:02.961230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:02.961230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:02.961232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:02.961226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3034
2025-10-02T09:36:02.961234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:02.961240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:02.961231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3034
2025-10-02T09:36:02.961241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:02.961255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.961260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:02.961262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:02.961273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.961278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.961303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:02.961310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:02.961313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:02.961317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:02.961322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:02.961327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:02.961337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.961449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:02.961453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:02.961461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:02.961519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3035 partition: 0 MaxSeqNo: 36 sessionId: src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0
2025-10-02T09:36:02.961739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502b13e2-d1ad24ef-fd840af9-e42fc795_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:02.964054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Write session: try to update token
2025-10-02T09:36:02.964067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:02.970320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:02.970331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:02.970332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:02.970333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:02.970337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.970339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.970341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555849465811195:11403]
2025-10-02T09:36:02.970359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:02.970361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:02.970362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:02.970364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:02.970364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:02.970366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:02.970469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:02.975781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId: src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:02.978040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.043869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836361470:6976]
2025-10-02T09:36:03.044047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3034, pipe: [1:7556555853836361470:6976]
2025-10-02T09:36:03.080989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.081296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.081304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.081317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361470:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.081450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.081496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.081499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:03.081502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:03.081553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836361470:6976]
2025-10-02T09:36:03.081572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3035 reason: error at write: Disconnected sessionId: src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0
2025-10-02T09:36:03.081734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3035 sessionId: src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0 is DEAD
2025-10-02T09:36:03.081863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:03.081874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Write session will restart in 0.007349s
2025-10-02T09:36:03.081894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Write session: Do CDS request
2025-10-02T09:36:03.081898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.087616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.088618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.088720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.088727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.088732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.088758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.088785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760778656:11417]
2025-10-02T09:36:03.089146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.089348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.089380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.089572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.089604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.089608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.089608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.089609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.089610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.089610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.089611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.089611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.089611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.089612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.089613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.089613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.089617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.089624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.089626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.089628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.089630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.089632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.089634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.089636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.089638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.089641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.089643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.089645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.089648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.089653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.089656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.089659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.089661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.089664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.089666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.089669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.089671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.089674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.089676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.089679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.089681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.089684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.089686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.089688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.089692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.089695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.089697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.089699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.089701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.089704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.089710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.089713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.089729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.090137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.090214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.090225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3036
2025-10-02T09:36:03.090314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.090336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.090344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.090347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.090656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3036 sessionId:  describe result for acl check
2025-10-02T09:36:03.090681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.090686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.090688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.090691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.091090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.092847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.096761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.096770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.096774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836361563:7431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.096778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.097268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.098843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.098854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.098855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.098857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.098861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3035 [2:7556555853760778656:11417]
2025-10-02T09:36:03.098867Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.098877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.098881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.098883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.098884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.098893Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.098896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.098903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.098936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.098940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.098941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.098943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.098945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.098979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.098984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.098990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.098999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.099008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.099021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361472:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.099027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361598:7431], now have 1 active actors on pipe
2025-10-02T09:36:03.099031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.099033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.099034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.099040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.099050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.099054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.099056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.099057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.099060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.099062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.099051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3035
2025-10-02T09:36:03.099077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.099082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.099083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.099092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.099096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.099120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.099126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.099128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.099129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.099115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3035
2025-10-02T09:36:03.099134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.099143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.099157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.099257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.099261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.099268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.099331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3036 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0
2025-10-02T09:36:03.099531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14daf63d-3be505b9-caa98c0c-eea098bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.101896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Write session: try to update token
2025-10-02T09:36:03.101911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.108044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.108054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.108055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.108056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.108059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.108062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.108063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760778651:11417]
2025-10-02T09:36:03.108083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.108088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.108089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.108090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.108095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.108099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.108204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.113706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId: src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.115958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.181637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836361605:6976]
2025-10-02T09:36:03.181815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3035, pipe: [1:7556555853836361605:6976]
2025-10-02T09:36:03.217248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.217510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.217521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.217533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361605:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.217671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.217702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:03.217713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:03.217729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.217774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836361605:6976]
2025-10-02T09:36:03.217787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3036 reason: error at write: Disconnected sessionId: src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0
2025-10-02T09:36:03.217943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3036 sessionId: src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0 is DEAD
2025-10-02T09:36:03.218080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:03.218090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Write session will restart in 0.008177s
2025-10-02T09:36:03.218110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Write session: Do CDS request
2025-10-02T09:36:03.218116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.223980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.225026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.225131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.225137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.225143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.225169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.225194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760778796:11421]
2025-10-02T09:36:03.225541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.225718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.225751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.225932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.225962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.225967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.225967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.225968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.225968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.225969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.225969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.225970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.225970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.225971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.225971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.225972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.225975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.225982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.225984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.225986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.225988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.225990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.225992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.225994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.225996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.225998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.226000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.226002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.226006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.226010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.226013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.226016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.226018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.226021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.226023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.226025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.226028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.226030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.226034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.226036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.226039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.226041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.226043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.226046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.226048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.226051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.226053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.226056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.226058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.226061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.226064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.226066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.226083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.227195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.227407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.227420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3037
2025-10-02T09:36:03.227519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.227542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.227549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.227553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.227908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3037 sessionId:  describe result for acl check
2025-10-02T09:36:03.227939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.227944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.227945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.227949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.228359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.229723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.232948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.232958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.232960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836361699:7454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.232965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.233523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.235133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.235143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.235144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.235146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.235151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3036 [2:7556555853760778796:11421]
2025-10-02T09:36:03.235161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.235175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.235178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.235179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.235181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.235190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.235195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.235199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.235231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.235235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.235236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.235238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.235240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.235277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.235282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.235289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.235294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.235302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.235317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361607:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.235322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361734:7454], now have 1 active actors on pipe
2025-10-02T09:36:03.235326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.235327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.235330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.235337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.235348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.235349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.235351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.235352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.235359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.235360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.235364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3036
2025-10-02T09:36:03.235375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.235367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3036
2025-10-02T09:36:03.235380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.235382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.235400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.235405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.235423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.235430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.235432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.235433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.235439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.235448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.235455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.235564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.235569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.235578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.235652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3037 partition: 0 MaxSeqNo: 36 sessionId: src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0
2025-10-02T09:36:03.235867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b273e7-d6cf63f4-b3ea1099-5ddd4b4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.238307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Write session: try to update token
2025-10-02T09:36:03.238321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.244532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.244543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.244544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.244545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.244548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.244551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.244552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760778791:11421]
2025-10-02T09:36:03.244572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.244574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.244577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.244578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.244579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.244579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.244683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.250774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId: src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.253025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.317791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836361755:6976]
2025-10-02T09:36:03.318005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3036, pipe: [1:7556555853836361755:6976]
2025-10-02T09:36:03.354974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.355185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.355194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.355206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361755:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.355350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.355405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:03.355459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836361755:6976]
2025-10-02T09:36:03.355498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.355507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3037 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0
2025-10-02T09:36:03.355655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3037 sessionId: src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0 is DEAD
2025-10-02T09:36:03.355800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:03.355812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Write session will restart in 0.006416s
2025-10-02T09:36:03.355835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Write session: Do CDS request
2025-10-02T09:36:03.355840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.362109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.363127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.363165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.363222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.363231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3038
2025-10-02T09:36:03.363285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.363291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.363297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.363319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.363327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.363343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.363350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.363353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.363351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760778923:11423]
2025-10-02T09:36:03.363694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3038 sessionId:  describe result for acl check
2025-10-02T09:36:03.363697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.363722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.363726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.363728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.363732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.363864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.363886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.364060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.364090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.364094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.364095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.364095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.364096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.364097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.364097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.364098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.364098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.364099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.364099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.364100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.364103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.364110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.364112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.364114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.364116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.364118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.364120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.364122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.364124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.364126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.364128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.364130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.364135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.364138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.364142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.364145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.364147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.364150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.364142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.364152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.364155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.364157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.364160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.364162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.364164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.364166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.364169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.364171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.364174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.364177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.364179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.364182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.364186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.364189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.364191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.364193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.364211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.365917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.370350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.370359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.370361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836361845:7459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.370366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.371590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.373068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.373078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.373079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.373082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.373085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3037 [2:7556555853760778923:11423]
2025-10-02T09:36:03.373092Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.373103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.373108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.373110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.373111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.373119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.373126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.373131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.373161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.373165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.373166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.373168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.373169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.373202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.373207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.373213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.373218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.373229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.373244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361884:7459], now have 1 active actors on pipe
2025-10-02T09:36:03.373249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361756:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.373252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.373254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.373255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.373262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.373273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.373276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.373278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.373279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.373284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.373286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.373299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.373293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3037
2025-10-02T09:36:03.373307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.373309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.373293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3037
2025-10-02T09:36:03.373333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.373338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.373354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.373360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.373362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.373363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.373368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.373376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.373385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.373488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.373493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.373500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.373566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3038 partition: 0 MaxSeqNo: 36 sessionId: src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0
2025-10-02T09:36:03.373777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c1c97c-27fca8ae-7bf454ad-bc0ce164_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.376129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Write session: try to update token
2025-10-02T09:36:03.376143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.382302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.382312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.382313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.382314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.382317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.382320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.382322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760778918:11423]
2025-10-02T09:36:03.382341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.382346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.382347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.382355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.382365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.382369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.382459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.387917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId: src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.390267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.455546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836361892:6976]
2025-10-02T09:36:03.455709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3037, pipe: [1:7556555853836361892:6976]
2025-10-02T09:36:03.491510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.491771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.491779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.491791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361892:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.491935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.492030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:03.492030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836361892:6976]
2025-10-02T09:36:03.492063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.492129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0
2025-10-02T09:36:03.492284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3038 sessionId: src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0 is DEAD
2025-10-02T09:36:03.492434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:03.492445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Write session will restart in 0.006550s
2025-10-02T09:36:03.492464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Write session: Do CDS request
2025-10-02T09:36:03.492470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.498270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.499284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.499379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.499386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.499392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.499417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.499439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760779052:11426]
2025-10-02T09:36:03.499792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.499955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.499979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.500158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.500154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.500182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.500186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.500187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.500187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.500188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.500189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.500189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.500190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.500190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.500191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.500191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.500192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.500194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.500202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.500204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.500206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.500208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.500210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.500212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.500214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.500216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.500219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.500221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.500223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.500226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.500230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.500234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.500236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.500239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.500241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.500243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.500246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.500248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.500251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.500253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.500256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.500258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.500261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.500264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.500266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.500269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.500272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.500274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.500276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.500257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.500280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.500283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.500285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.500288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.500272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3039
2025-10-02T09:36:03.500304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.500369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.500392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.500401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.500404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.500735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3039 sessionId:  describe result for acl check
2025-10-02T09:36:03.500761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.500767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.500768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.500772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.501202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.502582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.506433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.506442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.506445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836361987:7465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.506451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.507650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.509155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.509165Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.509166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.509168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.509171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3038 [2:7556555853760779052:11426]
2025-10-02T09:36:03.509179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.509188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.509190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.509191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.509193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.509202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.509205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.509209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.509240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.509245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.509246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.509248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.509249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.509286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.509293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.509299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.509304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.509312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.509324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362022:7465], now have 1 active actors on pipe
2025-10-02T09:36:03.509326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836361893:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.509330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.509332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.509333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.509341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.509349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.509353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.509356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.509357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.509357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.509358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.509372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.509381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.509383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.509377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3038
2025-10-02T09:36:03.509383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3038
2025-10-02T09:36:03.509399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.509405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.509422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0ca9870-247e6391-60724226-51e30d79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.509429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.509431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.509432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.509497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.509506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.509514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.509636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.509641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.509648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.509715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3039 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0ca9870-247e6391-60724226-51e30d79_0
2025-10-02T09:36:03.509945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73b32de-ff02ff8c-55c68f53-bb818ae2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0ca9870-247e6391-60724226-51e30d79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.512376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Write session: try to update token
2025-10-02T09:36:03.512390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.518356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.518367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.518368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.518369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.518372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.518374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.518376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760779047:11426]
2025-10-02T09:36:03.518396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.518399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.518401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.518406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.518416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.518419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.518530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.524462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId: src_id|c0ca9870-247e6391-60724226-51e30d79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.526798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.592253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836362030:6976]
2025-10-02T09:36:03.592507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3038, pipe: [1:7556555853836362030:6976]
2025-10-02T09:36:03.628833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.629072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.629081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.629094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362030:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.629528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.629540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836362030:6976]
2025-10-02T09:36:03.629576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:03.629578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:03.629648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3039 reason: error at write: Disconnected sessionId: src_id|c0ca9870-247e6391-60724226-51e30d79_0
2025-10-02T09:36:03.629714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.629803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3039 sessionId: src_id|c0ca9870-247e6391-60724226-51e30d79_0 is DEAD
2025-10-02T09:36:03.629928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:03.629933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Write session will restart in 0.006513s
2025-10-02T09:36:03.629953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Write session: Do CDS request
2025-10-02T09:36:03.629958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.635810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.636847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.636949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.636955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.636960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.636985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.637009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760779181:11428]
2025-10-02T09:36:03.637156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.637263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.637275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3040
2025-10-02T09:36:03.637341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.637363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.637387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.637390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.637394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.637515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.637537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.637711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.637728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3040 sessionId:  describe result for acl check
2025-10-02T09:36:03.637740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.637744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.637745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.637745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.637746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.637746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.637747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.637747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.637748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.637753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.637748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.637759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.637749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.637749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.637752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.637759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.637761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.637761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.637763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.637766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.637765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.637767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.637769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.637771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.637773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.637775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.637777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.637778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.637782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.637786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.637789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.637791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.637794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.637796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.637799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.637802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.637804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.637806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.637808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.637811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.637813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.637816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.637818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.637821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.637823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.637826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.637830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.637832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.637834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.637836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.637838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.637841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.637859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.638238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.639816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.644758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.644769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.644772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836362124:7469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.644776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.645224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.646663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.646673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.646674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.646676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.646680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3039 [2:7556555853760779181:11428]
2025-10-02T09:36:03.646686Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.646696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.646701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.646702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.646703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.646712Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.646715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.646719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.646759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.646764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.646765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.646766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.646768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.646803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.646808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.646814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.646820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.646828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.646842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362161:7469], now have 1 active actors on pipe
2025-10-02T09:36:03.646847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362031:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.646851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.646852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.646854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.646861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.646871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.646875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.646877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.646878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.646879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.646881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.646894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.646899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.646901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.646892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3039
2025-10-02T09:36:03.646896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3039
2025-10-02T09:36:03.646925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.646929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.646945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72505d22-55d7fa48-f8520469-12f275b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.646951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.646953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.646954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.646960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.646967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.646978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.647095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.647100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.647108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.647173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3040 partition: 0 MaxSeqNo: 36 sessionId: src_id|72505d22-55d7fa48-f8520469-12f275b0_0
2025-10-02T09:36:03.647374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0ca9870-247e6391-60724226-51e30d79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72505d22-55d7fa48-f8520469-12f275b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.649775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Write session: try to update token
2025-10-02T09:36:03.649790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.655919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.655929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.655930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.655931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.655934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.655938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.655940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760779176:11428]
2025-10-02T09:36:03.655958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.655964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.655965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.655969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.655973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.655976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.656151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.662017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId: src_id|72505d22-55d7fa48-f8520469-12f275b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.664283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.729451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836362169:6976]
2025-10-02T09:36:03.729679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3039, pipe: [1:7556555853836362169:6976]
2025-10-02T09:36:03.766843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.767119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.767127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.767139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362169:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.767276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.767349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:03.767353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.767401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836362169:6976]
2025-10-02T09:36:03.767445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3040 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72505d22-55d7fa48-f8520469-12f275b0_0
2025-10-02T09:36:03.767613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3040 sessionId: src_id|72505d22-55d7fa48-f8520469-12f275b0_0 is DEAD
2025-10-02T09:36:03.767766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:03.767772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Write session will restart in 0.008422s
2025-10-02T09:36:03.767796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Write session: Do CDS request
2025-10-02T09:36:03.767802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.773854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.774931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.775032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.775039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.775044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.775068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.775099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760779310:11430]
2025-10-02T09:36:03.775443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.775600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.775623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.775796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.775828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.775828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.775829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.775830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.775830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.775831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.775831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.775832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.775832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.775833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.775833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.775834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.775837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.775844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.775846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.775848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.775850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.775852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.775854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.775856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.775858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.775861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.775863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.775865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.775869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.775873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.775876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.775879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.775881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.775884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.775886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.775889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.775891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.775894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.775896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.775899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.775901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.775903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.775906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.775908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.775910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.775914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.775916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.775919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.775921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.775924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.775926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.775928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.775945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.777140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.777211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.777225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3041
2025-10-02T09:36:03.777310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.777331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.777339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.777342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.777693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3041 sessionId:  describe result for acl check
2025-10-02T09:36:03.777721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.777726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.777728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.777732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.778156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.779681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.782777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.782787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.782790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836362266:7485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.782795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.783332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.784815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.784823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.784824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.784826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.784830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3040 [2:7556555853760779310:11430]
2025-10-02T09:36:03.784836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.784845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.784847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.784848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.784849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.784859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.784863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.784867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.784900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.784906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.784907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.784909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.784910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.784945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.784949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.784956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.784961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.784971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.784985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362301:7485], now have 1 active actors on pipe
2025-10-02T09:36:03.784990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362170:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.784994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.784996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.784996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.785003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.785013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.785016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.785018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.785019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.785023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.785025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.785029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3040
2025-10-02T09:36:03.785035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3040
2025-10-02T09:36:03.785038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.785046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.785059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.785075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.785081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.785094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.785100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.785102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.785103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.785109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.785114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.785121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.785250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.785254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.785262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.785327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3041 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0
2025-10-02T09:36:03.785507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72505d22-55d7fa48-f8520469-12f275b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.787780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Write session: try to update token
2025-10-02T09:36:03.787792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.793973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.793983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.793984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.793985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.793988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.793991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.793993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760779305:11430]
2025-10-02T09:36:03.794011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.794014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.794017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.794020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.794031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.794033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.794136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.799213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId: src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.801553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:03.867705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555853836362308:6976]
2025-10-02T09:36:03.867925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3040, pipe: [1:7556555853836362308:6976]
2025-10-02T09:36:03.905102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:03.905371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.905383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.905399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362308:6976], now have 1 active actors on pipe
2025-10-02T09:36:03.905597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:03.905615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:03.905630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:03.905631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555853836362308:6976]
2025-10-02T09:36:03.905654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:03.905760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3041 reason: error at write: Disconnected sessionId: src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0
2025-10-02T09:36:03.905917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3041 sessionId: src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0 is DEAD
2025-10-02T09:36:03.906067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:03.906077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Write session will restart in 0.008772s
2025-10-02T09:36:03.906098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Write session: Do CDS request
2025-10-02T09:36:03.906103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:03.912167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:03.913227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:03.913330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:03.913336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:03.913342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:03.913375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:03.913397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555853760779441:11432]
2025-10-02T09:36:03.913742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:03.913923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:03.913944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:03.914119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:03.914147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.914151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.914152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.914153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.914153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.914154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.914154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.914155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.914155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.914156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.914156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.914157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.914159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.914166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.914168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.914170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.914172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.914174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.914176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.914178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.914180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.914182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.914184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.914186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.914189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.914193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:03.914196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.914199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:03.914201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.914204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:03.914206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.914209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:03.914211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.914213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:03.914215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.914218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:03.914220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.914223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:03.914225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.914227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:03.914230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.914232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:03.914234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.914237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.914239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.914242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.914244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.914246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.914264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:03.916199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.916300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:03.916313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3042
2025-10-02T09:36:03.916419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:03.916445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:03.916453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:03.916456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:03.916841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3042 sessionId:  describe result for acl check
2025-10-02T09:36:03.916876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:03.916881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:03.916882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:03.916887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:03.917316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:03.918968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:03.921101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:03.921110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:03.921113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555853836362410:7500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:03.921118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:03.921667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:03.923292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:03.923305Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:03.923306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:03.923308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:03.923312Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3041 [2:7556555853760779441:11432]
2025-10-02T09:36:03.923322Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:03.923333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:03.923334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.923336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.923338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.923349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:03.923355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:03.923360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:03.923399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.923406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.923407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.923409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:03.923412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:03.923466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:03.923472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.923481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:03.923490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:03.923503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:03.923518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362447:7500], now have 1 active actors on pipe
2025-10-02T09:36:03.923520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555853836362313:2446], now have 1 active actors on pipe
2025-10-02T09:36:03.923524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.923527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.923528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.923535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:03.923545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:03.923544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3041
2025-10-02T09:36:03.923553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:03.923556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:03.923557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:03.923545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3041
2025-10-02T09:36:03.923558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:03.923559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:03.923576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.923578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:03.923580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:03.923590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.923596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.923623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:03.923629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:03.923632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:03.923633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:03.923638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:03.923643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:03.923655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.923776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:03.923782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:03.923790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:03.923855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3042 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0
2025-10-02T09:36:03.924097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a6aac4-5d663807-b1c002fe-3dffa4b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:03.926558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Write session: try to update token
2025-10-02T09:36:03.926572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:03.932692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:03.932702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:03.932703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:03.932705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:03.932708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.932710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.932713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555853760779436:11432]
2025-10-02T09:36:03.932732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:03.932735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:03.932736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:03.932740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:03.932743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:03.932745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:03.932855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:03.938640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId: src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:03.941210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.005935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131329755:6976]
2025-10-02T09:36:04.006139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3041, pipe: [1:7556555858131329755:6976]
2025-10-02T09:36:04.044261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.044513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.044521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.044533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131329755:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.044652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.044686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:04.044699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:04.044768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3042 reason: error at write: Disconnected sessionId: src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0
2025-10-02T09:36:04.044932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3042 sessionId: src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0 is DEAD
2025-10-02T09:36:04.045058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:04.045067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Write session will restart in 0.008965s
2025-10-02T09:36:04.045086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Write session: Do CDS request
2025-10-02T09:36:04.045092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.045159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.045196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131329755:6976]
2025-10-02T09:36:04.051346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.052764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.052875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.052881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.052887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.052913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.052964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055746899:11444]
2025-10-02T09:36:04.053315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.053496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.053526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.053702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.053733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.053737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.053737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.053738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.053738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.053739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.053740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.053740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.053741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.053742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.053742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.053743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.053745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.053752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.053754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.053756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.053758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.053760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.053762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.053764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.053765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.053769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.053771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.053773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.053777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.053781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.053784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.053786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.053789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.053791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.053794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.053796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.053800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.053803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.053806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.053808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.053812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.053817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.053819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.053821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.053824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.053827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.053833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.053835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.053838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.053840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.053842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.053845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.053862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.055167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.055306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.055318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3043
2025-10-02T09:36:04.055398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.055419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.055422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.055428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.055706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3043 sessionId:  describe result for acl check
2025-10-02T09:36:04.055728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.055733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.055734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.055738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.056119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.057623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.060793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.060816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.060818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131329868:7528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.060822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.061246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.062784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.062792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.062793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.062796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.062801Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3042 [2:7556555858055746899:11444]
2025-10-02T09:36:04.062809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.062822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.062830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.062832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.062834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.062845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.062851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.062855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.062884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.062889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.062890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.062892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.062893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.062959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.062964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.062971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.062977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.062986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.063000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131329901:7528], now have 1 active actors on pipe
2025-10-02T09:36:04.063006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131329769:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.063009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.063010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.063012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.063020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.063030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.063037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.063039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.063040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.063041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.063029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3042
2025-10-02T09:36:04.063043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.063052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3042
2025-10-02T09:36:04.063057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.063062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.063063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.063076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.063082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.063102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.063109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.063110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.063111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.063116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.063121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.063135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.063257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.063264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.063273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.063349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3043 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0
2025-10-02T09:36:04.063550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd277d8-3b6a5d25-d30155ca-801e7822_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.065793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Write session: try to update token
2025-10-02T09:36:04.065806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.071997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.072006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.072008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.072009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.072012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.072014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.072016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055746894:11444]
2025-10-02T09:36:04.072036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.072042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.072043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.072044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.072049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.072051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.072152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.077283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId: src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.079645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.145216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131329918:6976]
2025-10-02T09:36:04.145440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3042, pipe: [1:7556555858131329918:6976]
2025-10-02T09:36:04.181883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.182143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.182153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.182165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131329918:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.182284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.182342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:04.182365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131329918:6976]
2025-10-02T09:36:04.182385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.182437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3043 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0
2025-10-02T09:36:04.182590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3043 sessionId: src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0 is DEAD
2025-10-02T09:36:04.182724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:04.182743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Write session will restart in 0.006509s
2025-10-02T09:36:04.182767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Write session: Do CDS request
2025-10-02T09:36:04.182772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.188506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.189707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.189809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.189815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.189820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.189845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.189880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747051:11450]
2025-10-02T09:36:04.190108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.190198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.190208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3044
2025-10-02T09:36:04.190237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.190304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.190325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.190332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.190336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.190418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.190442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.190621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.190650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.190654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.190655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.190655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.190656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.190656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.190657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.190657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.190658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.190658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.190663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3044 sessionId:  describe result for acl check
2025-10-02T09:36:04.190659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.190659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.190662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.190668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.190671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.190673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.190675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.190677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.190679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.190681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.190683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.190692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.190686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.190688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.190698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.190690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.190693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.190697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.190699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.190703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.190701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.190706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.190710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.190715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.190719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.190723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.190727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.190739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.190741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.190744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.190746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.190749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.190751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.190753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.190755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.190758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.190760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.190763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.190765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.190767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.190769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.190772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.190787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.191140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.192835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.197807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.197819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.197823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330016:7537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.197830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.198142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.199670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.199680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.199682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.199683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.199686Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3043 [2:7556555858055747051:11450]
2025-10-02T09:36:04.199693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.199702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.199708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.199709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.199710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.199719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.199722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.199726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.199756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.199761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.199762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.199764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.199766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.199801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.199806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.199812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.199818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.199825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.199839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330053:7537], now have 1 active actors on pipe
2025-10-02T09:36:04.199845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131329919:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.199848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.199850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.199851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.199858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.199865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.199874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.199875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.199875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.199877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.199878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.199889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.199894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.199895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.199895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3043
2025-10-02T09:36:04.199905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3043
2025-10-02T09:36:04.199968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.199974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.199988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e597849-5e6b40c9-374ff18d-41debbe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.199995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.200000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.200001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.200006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.200015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.200022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.200164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.200171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.200180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.200242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3044 partition: 0 MaxSeqNo: 36 sessionId: src_id|e597849-5e6b40c9-374ff18d-41debbe8_0
2025-10-02T09:36:04.200473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad15b1bf-f2998928-7403f4b4-eb9e923_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e597849-5e6b40c9-374ff18d-41debbe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.202870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Write session: try to update token
2025-10-02T09:36:04.202883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.208701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:04.208710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.208714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.208734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:04.208741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:04.208888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:04.209038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:04.209166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:04.209288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:04.209462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:04.209484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:04.215019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId: src_id|e597849-5e6b40c9-374ff18d-41debbe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.217049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.217059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.217060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.217061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.217064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.217066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.217068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747046:11450]
2025-10-02T09:36:04.217086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.217092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.217093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.217098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.217101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.217103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.217202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.217382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.282392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330073:6976]
2025-10-02T09:36:04.282646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3043, pipe: [1:7556555858131330073:6976]
2025-10-02T09:36:04.327638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.327955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.327965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.327978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330073:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.328156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.328230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:04.328233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330073:6976]
2025-10-02T09:36:04.328244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:04.328253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.328297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3044 reason: error at write: Disconnected sessionId: src_id|e597849-5e6b40c9-374ff18d-41debbe8_0
2025-10-02T09:36:04.328450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3044 sessionId: src_id|e597849-5e6b40c9-374ff18d-41debbe8_0 is DEAD
2025-10-02T09:36:04.328623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:04.328635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Write session will restart in 0.007955s
2025-10-02T09:36:04.328657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Write session: Do CDS request
2025-10-02T09:36:04.328661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.335684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.337164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.337166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.337300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.337307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.337313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.337296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.337308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3045
2025-10-02T09:36:04.337342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.337369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747185:11452]
2025-10-02T09:36:04.337404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.337427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.337435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.337438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.337730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.337855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3045 sessionId:  describe result for acl check
2025-10-02T09:36:04.337888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.337894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.337896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.337901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.337989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.338011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.338202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.338234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.338239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.338239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.338240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.338240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.338241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.338242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.338242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.338243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.338243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.338244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.338244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.338247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.338254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.338256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.338258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.338260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.338262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.338264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.338266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.338268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.338271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.338273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.338275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.338279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.338282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.338286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.338289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.338291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.338294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.338296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.338299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.338302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.338305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.338307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.338310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.338312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.338315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.338317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.338320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.338322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.338325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.338327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.338330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.338336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.338339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.338341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.338344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.338362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.338440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.340373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.344030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.344040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.344042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330174:7550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.344046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.345733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.347307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.347318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.347320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.347323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.347326Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3044 [2:7556555858055747185:11452]
2025-10-02T09:36:04.347333Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.347343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.347344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.347346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.347347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.347356Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.347362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.347367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.347411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.347416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.347418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.347420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.347421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.347457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.347465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.347473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.347478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.347489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.347503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330076:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.347508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330211:7550], now have 1 active actors on pipe
2025-10-02T09:36:04.347511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.347512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.347514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.347521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.347531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.347538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.347538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.347540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.347541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.347543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.347548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3044
2025-10-02T09:36:04.347550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3044
2025-10-02T09:36:04.347558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.347563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.347565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.347577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.347579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.347598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.347606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.347611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.347613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.347618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.347624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.347639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.347776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.347783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.347791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.347878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3045 partition: 0 MaxSeqNo: 36 sessionId: src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0
2025-10-02T09:36:04.348090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e597849-5e6b40c9-374ff18d-41debbe8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.350394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Write session: try to update token
2025-10-02T09:36:04.350407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.356521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.356532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.356533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.356533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.356537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.356539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.356541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747180:11452]
2025-10-02T09:36:04.356559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.356564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.356565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.356566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.356569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.356571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.356684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.362954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId: src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.365284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.428352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330219:6976]
2025-10-02T09:36:04.428589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3044, pipe: [1:7556555858131330219:6976]
2025-10-02T09:36:04.467754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.468015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.468024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.468036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330219:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.468159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.468225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.468236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:04.468269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330219:6976]
2025-10-02T09:36:04.468323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0
2025-10-02T09:36:04.468588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3045 sessionId: src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0 is DEAD
2025-10-02T09:36:04.468732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:04.468741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Write session will restart in 0.008545s
2025-10-02T09:36:04.468779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Write session: Do CDS request
2025-10-02T09:36:04.468785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.474861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.476050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.476171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.476177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.476183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.476210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.476232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747322:11455]
2025-10-02T09:36:04.476584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.476779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.476817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.477011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.477044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.477048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.477048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.477049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.477049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.477050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.477050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.477051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.477051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.477052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.477053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.477053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.477056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.477063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.477065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.477067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.477069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.477071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.477073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.477075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.477077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.477079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.477081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.477083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.477087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.477091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.477094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.477097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.477099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.477102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.477104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.477107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.477110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.477113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.477115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.477118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.477120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.477123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.477125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.477128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.477134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.477137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.477139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.477142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.477144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.477147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.477149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.477152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.477169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.478205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.478315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.478328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3046
2025-10-02T09:36:04.478438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.478462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.478469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.478472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.478798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3046 sessionId:  describe result for acl check
2025-10-02T09:36:04.478829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.478834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.478835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.478838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.479191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.481139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.483980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.483990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.483992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330321:7557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.483995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.484531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.486071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.486082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.486083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.486085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.486090Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3045 [2:7556555858055747322:11455]
2025-10-02T09:36:04.486096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.486106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.486109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.486111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.486112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.486120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.486126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.486131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.486168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.486173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.486174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.486176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.486177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.486213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.486218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.486225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.486230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.486240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.486253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330355:7557], now have 1 active actors on pipe
2025-10-02T09:36:04.486258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330220:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.486261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.486262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.486263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.486270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.486280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.486282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.486284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.486285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.486289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.486291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.486304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.486308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.486301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3045
2025-10-02T09:36:04.486316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.486326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3045
2025-10-02T09:36:04.486349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.486355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.486368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de0c3663-322e1244-f8d03400-763bc602_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.486374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.486376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.486377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.486382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.486389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.486399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.486524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.486531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.486539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.486609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3046 partition: 0 MaxSeqNo: 36 sessionId: src_id|de0c3663-322e1244-f8d03400-763bc602_0
2025-10-02T09:36:04.486866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c92245-7a2ac8c8-d985057f-7d0e6772_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de0c3663-322e1244-f8d03400-763bc602_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.489194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Write session: try to update token
2025-10-02T09:36:04.489208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.495281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.495292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.495296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.495297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.495301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.495303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.495305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747317:11455]
2025-10-02T09:36:04.495323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.495330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.495331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.495331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.495335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.495338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.495443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.500987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId: src_id|de0c3663-322e1244-f8d03400-763bc602_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.503195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.568624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330364:6976]
2025-10-02T09:36:04.568873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3045, pipe: [1:7556555858131330364:6976]
2025-10-02T09:36:04.606123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.606385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.606394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.606407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330364:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.606568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.606594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:04.606610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:04.606620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330364:6976]
2025-10-02T09:36:04.606646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.606659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3046 reason: error at write: Disconnected sessionId: src_id|de0c3663-322e1244-f8d03400-763bc602_0
2025-10-02T09:36:04.606796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3046 sessionId: src_id|de0c3663-322e1244-f8d03400-763bc602_0 is DEAD
2025-10-02T09:36:04.606970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:04.606985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Write session will restart in 0.006837s
2025-10-02T09:36:04.607006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Write session: Do CDS request
2025-10-02T09:36:04.607012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.613242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.614377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.614482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.614489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.614494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.614522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.614547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747457:11457]
2025-10-02T09:36:04.614915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.615112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.615139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.615158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.615273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.615288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3047
2025-10-02T09:36:04.615343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.615380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.615385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.615386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.615386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.615388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.615414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.615387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.615387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.615388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.615388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.615389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.615389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.615419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.615427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.615390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.615390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.615393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.615401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.615403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.615405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.615407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.615409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.615411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.615412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.615414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.615416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.615418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.615420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.615425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.615429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.615433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.615435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.615438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.615441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.615442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.615445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.615448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.615450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.615453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.615456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.615458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.615461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.615463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.615466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.615468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.615471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.615473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.615475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.615478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.615480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.615483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.615486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.615505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.615774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3047 sessionId:  describe result for acl check
2025-10-02T09:36:04.615803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.615811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.615812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.615816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.616282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.617831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.621709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.621719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.621721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330467:7566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.621725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.622943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.624608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.624618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.624619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.624622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.624625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3046 [2:7556555858055747457:11457]
2025-10-02T09:36:04.624632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.624642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.624643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.624645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.624646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.624654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.624661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.624667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.624698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.624702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.624703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.624705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.624707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.624747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.624752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.624758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.624764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.624772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.624786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330501:7566], now have 1 active actors on pipe
2025-10-02T09:36:04.624791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330365:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.624795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.624796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.624797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.624818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.624826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.624829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.624831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.624832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.624833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.624834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.624849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.624854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.624855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.624861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3046
2025-10-02T09:36:04.624891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3046
2025-10-02T09:36:04.624945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.624952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.624967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.624974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.624978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.624982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.624987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.624994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.625004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.625149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.625154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.625165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.625236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3047 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0
2025-10-02T09:36:04.625544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0c3663-322e1244-f8d03400-763bc602_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.627972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Write session: try to update token
2025-10-02T09:36:04.627988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.633975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.633986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.633987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.633989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.633992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.633994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.633997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747452:11457]
2025-10-02T09:36:04.634017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.634022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.634023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.634024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.634025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.634027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.634136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.640444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId: src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.642819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.706885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330509:6976]
2025-10-02T09:36:04.707088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3046, pipe: [1:7556555858131330509:6976]
2025-10-02T09:36:04.746087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.746321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.746334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.746348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330509:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.746517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.746551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.746574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:04.746592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330509:6976]
2025-10-02T09:36:04.746668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3047 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0
2025-10-02T09:36:04.746844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3047 sessionId: src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0 is DEAD
2025-10-02T09:36:04.746989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:04.747004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Write session will restart in 0.005164s
2025-10-02T09:36:04.747024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Write session: Do CDS request
2025-10-02T09:36:04.747029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.753088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.753125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.753190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.753201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3048
2025-10-02T09:36:04.753286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.753310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.753319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.753322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.753656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3048 sessionId:  describe result for acl check
2025-10-02T09:36:04.753684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.753688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.753689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.753692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.754038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.754336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.754487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.754495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.754503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.754537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.754559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747594:11459]
2025-10-02T09:36:04.754906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.755108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.755136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.755318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.755350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.755354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.755354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.755355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.755355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.755356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.755356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.755357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.755358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.755358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.755358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.755359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.755362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.755368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.755370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.755372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.755374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.755376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.755378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.755380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.755382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.755384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.755386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.755388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.755392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.755395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.755399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.755402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.755404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.755407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.755409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.755413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.755415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.755418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.755420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.755423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.755427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.755429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.755431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.755435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.755438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.755443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.755447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.755451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.755454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.755458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.755464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.755468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.755490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.755518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.760338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.760349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.760351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330610:7578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.760356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.762957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.764454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.764466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.764467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.764469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.764473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3047 [2:7556555858055747594:11459]
2025-10-02T09:36:04.764480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.764490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.764495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.764497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.764498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.764506Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.764510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.764514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.764545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.764550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.764551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.764553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.764554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.764589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.764593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.764600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.764605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.764613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.764628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330649:7578], now have 1 active actors on pipe
2025-10-02T09:36:04.764633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330511:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.764636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.764638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.764639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.764646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.764658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.764654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3047
2025-10-02T09:36:04.764674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3047
2025-10-02T09:36:04.764673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.764673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.764675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.764676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.764679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.764702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.764707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.764716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.764724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.764740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f5da28-4a741d69-9440db44-e2f05da4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.764740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.764746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.764750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.764751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.764756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.764764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.764815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.764954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.764960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.764969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.765039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3048 partition: 0 MaxSeqNo: 36 sessionId: src_id|97f5da28-4a741d69-9440db44-e2f05da4_0
2025-10-02T09:36:04.765305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4b6655-2ffe1c19-b983b244-8f32e0fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97f5da28-4a741d69-9440db44-e2f05da4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.767600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Write session: try to update token
2025-10-02T09:36:04.767612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.773762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.773769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.773772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.773773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.773777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.773780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.773782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747589:11459]
2025-10-02T09:36:04.773799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.773805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.773806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.773807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.773810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.773812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.773947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.778948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId: src_id|97f5da28-4a741d69-9440db44-e2f05da4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.781178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.846627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330656:6976]
2025-10-02T09:36:04.846872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3047, pipe: [1:7556555858131330656:6976]
2025-10-02T09:36:04.883811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:04.884084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.884092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.884105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330656:6976], now have 1 active actors on pipe
2025-10-02T09:36:04.884232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:04.884250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:04.884288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:04.884289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330656:6976]
2025-10-02T09:36:04.884342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3048 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97f5da28-4a741d69-9440db44-e2f05da4_0
2025-10-02T09:36:04.884468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3048 sessionId: src_id|97f5da28-4a741d69-9440db44-e2f05da4_0 is DEAD
2025-10-02T09:36:04.884620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:04.884636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Write session will restart in 0.005526s
2025-10-02T09:36:04.884662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Write session: Do CDS request
2025-10-02T09:36:04.884668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:04.890760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:04.891183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.891241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:04.891254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3049
2025-10-02T09:36:04.891356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:04.891383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:04.891393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:04.891396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:04.891747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3049 sessionId:  describe result for acl check
2025-10-02T09:36:04.891776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:04.891783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:04.891784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:04.891788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:04.891898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:04.892059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:04.892066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:04.892072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:04.892105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:04.892127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555858055747732:11461]
2025-10-02T09:36:04.892225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:04.892547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:04.892723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:04.892747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:04.892939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:04.892969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.892973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.892973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.892974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.892974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.892975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.892975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.892976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.892976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.892977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.892978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.892978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.892981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.892988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.892990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.892992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.892994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.892996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.892998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.893000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.893002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.893004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.893006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.893008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.893012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.893016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:04.893019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.893021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:04.893024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.893026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:04.893028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.893031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:04.893034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.893040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:04.893043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.893046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:04.893048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.893051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:04.893053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.893056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:04.893059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.893061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:04.893067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.893069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.893071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.893074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.893076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.893078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.893095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:04.893752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:04.898762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:04.898771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:04.898772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555858131330758:7585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:04.898777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:04.900445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:04.902182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:04.902195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:04.902196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:04.902198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:04.902202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3048 [2:7556555858055747732:11461]
2025-10-02T09:36:04.902208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:04.902217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:04.902220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.902222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.902224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.902233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:04.902239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:04.902245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:04.902273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.902277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.902278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.902279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:04.902281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:04.902315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:04.902320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.902326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:04.902331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:04.902339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:04.902352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330657:2446], now have 1 active actors on pipe
2025-10-02T09:36:04.902357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330796:7585], now have 1 active actors on pipe
2025-10-02T09:36:04.902360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.902361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.902362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.902370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:04.902378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:04.902383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:04.902386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:04.902388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:04.902393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:04.902389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3048
2025-10-02T09:36:04.902397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:04.902399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3048
2025-10-02T09:36:04.902416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.902422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:04.902423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:04.902434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.902440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.902464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:04.902471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:04.902473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:04.902474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:04.902479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:04.902484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:04.902494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.902601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:04.902608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:04.902616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:04.902682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3049 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0
2025-10-02T09:36:04.902918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5da28-4a741d69-9440db44-e2f05da4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:04.905260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Write session: try to update token
2025-10-02T09:36:04.905274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:04.911478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:04.911491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:04.911493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:04.911494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:04.911500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.911503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.911506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555858055747727:11461]
2025-10-02T09:36:04.911532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:04.911532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:04.911535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:04.911537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:04.911540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:04.911542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:04.911661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:04.917507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId: src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:04.919802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:04.984353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555858131330809:6976]
2025-10-02T09:36:04.984543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3048, pipe: [1:7556555858131330809:6976]
2025-10-02T09:36:05.021564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.021825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.021834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.021847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555858131330809:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.022004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.022044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555858131330809:6976]
2025-10-02T09:36:05.022074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.022181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.022269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3049 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0
2025-10-02T09:36:05.022449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3049 sessionId: src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0 is DEAD
2025-10-02T09:36:05.022602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.022617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Write session will restart in 0.005561s
2025-10-02T09:36:05.022638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Write session: Do CDS request
2025-10-02T09:36:05.022644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.028602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.029130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.029198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.029211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3050
2025-10-02T09:36:05.029298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.029322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.029332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.029335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.029691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.029683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3050 sessionId:  describe result for acl check
2025-10-02T09:36:05.029710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.029717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.029719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.029723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.029844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.029851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.029858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.029890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.029913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715166:11463]
2025-10-02T09:36:05.030169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.030256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.030427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.030450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.030623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.030651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.030655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.030656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.030656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.030657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.030657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.030658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.030658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.030659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.030659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.030660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.030660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.030663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.030670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.030672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.030674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.030676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.030678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.030680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.030682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.030684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.030686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.030688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.030690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.030694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.030698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.030701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.030704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.030706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.030708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.030710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.030713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.030717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.030720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.030722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.030725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.030727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.030730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.030732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.030734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.030744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.030747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.030750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.030753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.030755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.030757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.030760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.030762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.030782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.031953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.036039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.036048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.036050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426298210:7595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.036054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.038262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.039910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.039922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.039924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.039927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.039930Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3049 [2:7556555862350715166:11463]
2025-10-02T09:36:05.039937Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.039946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.039952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.039953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.039954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.039966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.039970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.039974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.040012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.040017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.040018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.040019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.040021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.040059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.040064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.040071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.040077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.040085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.040100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298248:7595], now have 1 active actors on pipe
2025-10-02T09:36:05.040105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298109:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.040109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.040110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.040112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.040118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.040127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.040136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.040139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.040141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.040142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.040143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.040156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.040161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.040147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3049
2025-10-02T09:36:05.040173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.040180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.040183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.040168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3049
2025-10-02T09:36:05.040203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.040210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.040212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.040213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.040218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.040225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.040234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.040342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.040346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.040354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.040427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3050 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0
2025-10-02T09:36:05.040699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7737a5-f39434fe-7cdec360-5d477ba5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.043032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Write session: try to update token
2025-10-02T09:36:05.043046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.049295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.049308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.049309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.049310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.049314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.049317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.049320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715161:11463]
2025-10-02T09:36:05.049346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.049351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.049354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.049353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.049356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.049358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.049473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.054996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId: src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.057345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.122103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426298279:6976]
2025-10-02T09:36:05.122272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3049, pipe: [1:7556555862426298279:6976]
2025-10-02T09:36:05.159387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.159658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.159667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.159679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298279:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.159822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.159864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426298279:6976]
2025-10-02T09:36:05.159884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.159887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.159976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3050 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0
2025-10-02T09:36:05.160136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3050 sessionId: src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0 is DEAD
2025-10-02T09:36:05.160277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.160290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Write session will restart in 0.006920s
2025-10-02T09:36:05.160312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Write session: Do CDS request
2025-10-02T09:36:05.160317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.166819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.168080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.168143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.168207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.168219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3051
2025-10-02T09:36:05.168304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.168313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.168307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.168321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.168333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.168342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.168346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.168361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.168386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715356:11478]
2025-10-02T09:36:05.168645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3051 sessionId:  describe result for acl check
2025-10-02T09:36:05.168671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.168677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.168678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.168681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.168733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.168935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.168962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.168985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.169167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.169201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.169205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.169206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.169206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.169207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.169211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.169213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.169214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.169215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.169215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.169216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.169217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.169220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.169226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.169228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.169230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.169232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.169234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.169236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.169238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.169240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.169243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.169245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.169247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.169250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.169254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.169257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.169259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.169261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.169264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.169266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.169268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.169270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.169273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.169275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.169278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.169280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.169283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.169288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.169290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.169293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.169296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.169298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.169300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.169302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.169309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.169312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.169315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.169333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.171072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.175530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.175540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.175542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426298382:7614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.175546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.176915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.178416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.178428Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.178429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.178431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.178435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3050 [2:7556555862350715356:11478]
2025-10-02T09:36:05.178442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.178452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.178456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.178458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.178459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.178468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.178471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.178475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.178508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.178513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.178514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.178516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.178517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.178551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.178555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.178562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.178568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.178579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.178592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298280:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.178598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298421:7614], now have 1 active actors on pipe
2025-10-02T09:36:05.178601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.178603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.178604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.178608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.178616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.178617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.178623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.178624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.178624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.178626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.178639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.178644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.178646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.178632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3050
2025-10-02T09:36:05.178644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3050
2025-10-02T09:36:05.178663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.178668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.178686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.178693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.178695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.178696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.178701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.178706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.178767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.178915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.178926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.178941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.179025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3051 partition: 0 MaxSeqNo: 36 sessionId: src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0
2025-10-02T09:36:05.179231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc293b08-44acd51b-ce835d9d-5ed50013_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.181531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Write session: try to update token
2025-10-02T09:36:05.181545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.187562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.187575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.187576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.187578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.187583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.187586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.187588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715350:11478]
2025-10-02T09:36:05.187613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.187613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.187616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.187618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.187620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.187621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.187725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.194598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId: src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.196858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.259800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426298441:6976]
2025-10-02T09:36:05.259970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3050, pipe: [1:7556555862426298441:6976]
2025-10-02T09:36:05.298386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.298575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.298584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.298596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298441:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.298745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.298763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:05.298765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.298775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:05.298807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426298441:6976]
2025-10-02T09:36:05.298835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3051 reason: error at write: Disconnected sessionId: src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0
2025-10-02T09:36:05.298973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3051 sessionId: src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0 is DEAD
2025-10-02T09:36:05.299119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:05.299131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Write session will restart in 0.009968s
2025-10-02T09:36:05.299156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Write session: Do CDS request
2025-10-02T09:36:05.299161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.305681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.306722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.306838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.306844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.306850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.306883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.306907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715497:11481]
2025-10-02T09:36:05.307250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.307435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.307462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.307645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.307675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.307679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.307680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.307680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.307681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.307681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.307682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.307682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.307683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.307684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.307684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.307685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.307687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.307694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.307696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.307698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.307700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.307702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.307704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.307706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.307708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.307710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.307712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.307714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.307718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.307722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.307725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.307728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.307730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.307733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.307735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.307738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.307740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.307743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.307745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.307747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.307750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.307752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.307754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.307756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.307760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.307762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.307764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.307767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.307769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.307771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.307774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.307776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.307792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.310179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.310419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.310433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3052
2025-10-02T09:36:05.310535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.310559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.310572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.310575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.310944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3052 sessionId:  describe result for acl check
2025-10-02T09:36:05.310975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.310983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.310984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.310989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.311408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.313024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.314933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.314944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.314947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426298550:7624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.314952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.315194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.316686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.316699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.316701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.316704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.316709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3051 [2:7556555862350715497:11481]
2025-10-02T09:36:05.316719Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.316735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.316741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.316744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.316745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.316755Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.316761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.316766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.316798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.316814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.316817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.316819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.316821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.316854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.316859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.316866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.316871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.316881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.316895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298586:7624], now have 1 active actors on pipe
2025-10-02T09:36:05.316901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298442:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.316904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.316906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.316907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.316914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.316924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.316927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.316929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.316930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.316935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.316936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.316949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.316941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3051
2025-10-02T09:36:05.316958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.316944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3051
2025-10-02T09:36:05.316972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.316984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.316989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.317004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.317011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.317015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.317016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.317021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.317029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.317038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.317150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.317157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.317166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.317231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3052 partition: 0 MaxSeqNo: 36 sessionId: src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0
2025-10-02T09:36:05.317445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450b5722-cc5f7ce5-3bb155c2-fae689f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.319717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Write session: try to update token
2025-10-02T09:36:05.319729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.326006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.326017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.326018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.326019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.326023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.326025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.326027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715492:11481]
2025-10-02T09:36:05.326045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.326047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.326048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.326056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.326066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.326069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.326150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.331281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId: src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.333530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.354529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:36:05.354553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-02T09:36:05.399110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426298596:6976]
2025-10-02T09:36:05.399306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3051, pipe: [1:7556555862426298596:6976]
2025-10-02T09:36:05.437741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.437979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.437988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.438013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298596:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.438160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.438230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.438244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426298596:6976]
2025-10-02T09:36:05.438269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.438282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-02T09:36:05.438333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3052 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0
2025-10-02T09:36:05.438487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3052 sessionId: src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0 is DEAD
2025-10-02T09:36:05.438626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.438640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Write session will restart in 0.005697s
2025-10-02T09:36:05.438659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Write session: Do CDS request
2025-10-02T09:36:05.438664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.444953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.445168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.445394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.445408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3053
2025-10-02T09:36:05.445508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.445537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.445547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.445550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.445923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3053 sessionId:  describe result for acl check
2025-10-02T09:36:05.445959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.445966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.445971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.445975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.446096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.446203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.446210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.446216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.446245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.446278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715641:11485]
2025-10-02T09:36:05.446397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.446628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.446798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.446821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.447004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.447034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.447038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.447039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.447039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.447040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.447041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.447041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.447042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.447042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.447043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.447044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.447044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.447047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.447054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.447056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.447059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.447061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.447064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.447066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.447068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.447070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.447072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.447074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.447076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.447080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.447084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.447087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.447090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.447092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.447095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.447097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.447100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.447102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.447105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.447107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.447109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.447112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.447114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.447116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.447119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.447121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.447125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.447127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.447130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.447132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.447135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.447137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.447140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.447158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.448256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.452551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.452563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.452565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426298701:7632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.452571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.454756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.456346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.456356Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.456357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.456359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.456363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3052 [2:7556555862350715641:11485]
2025-10-02T09:36:05.456372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.456385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.456391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.456394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.456396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.456405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.456408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.456414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.456446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.456451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.456452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.456455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.456456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.456491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.456496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.456503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.456508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.456517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.456532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298740:7632], now have 1 active actors on pipe
2025-10-02T09:36:05.456537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298597:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.456541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.456543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.456544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.456551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.456560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.456565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.456568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.456569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.456569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.456571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.456583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.456568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3052
2025-10-02T09:36:05.456586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.456572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3052
2025-10-02T09:36:05.456594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.456601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.456603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.456634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.456641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.456645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.456647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.456653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.456658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.456693Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:36:05.456711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.456844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.456849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.456857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.456854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 22 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:36:05.456880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:36:05.456925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3053 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0
2025-10-02T09:36:05.457141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc214b3-a2f1bcd2-1cd7f4c9-1d472e7b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.459424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Write session: try to update token
2025-10-02T09:36:05.459437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.465613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.465624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.465625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.465626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.465631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.465633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.465636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715636:11485]
2025-10-02T09:36:05.465655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.465657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.465658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.465664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.465669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.465672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.465772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.470702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId: src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.472922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.538364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426298751:6976]
2025-10-02T09:36:05.538538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3052, pipe: [1:7556555862426298751:6976]
2025-10-02T09:36:05.579247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.579517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.579526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.579539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298751:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.579671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.579743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.579743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426298751:6976]
2025-10-02T09:36:05.579767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.579841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3053 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0
2025-10-02T09:36:05.579987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3053 sessionId: src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0 is DEAD
2025-10-02T09:36:05.580119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.580132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Write session will restart in 0.007567s
2025-10-02T09:36:05.580152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Write session: Do CDS request
2025-10-02T09:36:05.580157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.586667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.587753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.587865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.587871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.587877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.587904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.587997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715785:11488]
2025-10-02T09:36:05.588342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.588530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.588558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.588745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.588772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.588776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.588776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.588777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.588777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.588778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.588778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.588779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.588779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.588780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.588780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.588781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.588785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.588795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.588798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.588813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.588816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.588820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.588823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.588826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.588830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.588834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.588837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.588839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.588843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.588848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.588853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.588857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.588860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.588862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.588866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.588869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.588875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.588877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.588880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.588886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.588889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.588892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.588897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.588900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.588905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.588908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.588910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.588912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.588915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.588917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.588919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.588922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.588939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.589152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.589254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.589269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3054
2025-10-02T09:36:05.589367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.589393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.589403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.589406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.589751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3054 sessionId:  describe result for acl check
2025-10-02T09:36:05.589778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.589785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.589786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.589791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.590250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.592118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.595855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.595870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.595873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426298864:7645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.595878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.596381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.597880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.597891Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.597892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.597894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.597898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3053 [2:7556555862350715785:11488]
2025-10-02T09:36:05.597905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.597914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.597916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.597917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.597918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.597927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.597934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.597938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.597970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.597974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.597975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.597977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.597979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.598021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.598027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.598037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.598050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.598066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.598083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298899:7645], now have 1 active actors on pipe
2025-10-02T09:36:05.598090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298755:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.598096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.598099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.598101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.598110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.598100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3053
2025-10-02T09:36:05.598106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3053
2025-10-02T09:36:05.598122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.598124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.598128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.598129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.598136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.598138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.598158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.598165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.598166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.598185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.598192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.598217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.598229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.598232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.598234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.598242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.598249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.598264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.598386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.598391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.598398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.598461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3054 partition: 0 MaxSeqNo: 36 sessionId: src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0
2025-10-02T09:36:05.598687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2694cbd-6758a19a-89e099e9-861fa5c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.601022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Write session: try to update token
2025-10-02T09:36:05.601035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.607228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.607239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.607240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.607241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.607244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.607246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.607248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715780:11488]
2025-10-02T09:36:05.607267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.607270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.607271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.607279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.607290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.607294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.607484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.612582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId: src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.614969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.679656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426298907:6976]
2025-10-02T09:36:05.679856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3053, pipe: [1:7556555862426298907:6976]
2025-10-02T09:36:05.719127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.719381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.719389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.719402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298907:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.719527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.719615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.719617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426298907:6976]
2025-10-02T09:36:05.719646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.719718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3054 reason: status is not ok: tablet will be restarted right now sessionId: src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0
2025-10-02T09:36:05.719883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3054 sessionId: src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0 is DEAD
2025-10-02T09:36:05.720021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.720036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Write session will restart in 0.008454s
2025-10-02T09:36:05.720068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Write session: Do CDS request
2025-10-02T09:36:05.720074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.726687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.727789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.727903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.727910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.727916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.727945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.728032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350715929:11490]
2025-10-02T09:36:05.728392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.728577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.728603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.728811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.728845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.728849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.728850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.728850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.728851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.728852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.728853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.728853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.728854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.728854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.728855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.728855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.728858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.728865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.728867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.728869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.728871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.728873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.728875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.728877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.728879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.728883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.728885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.728889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.728893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.728897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.728900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.728902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.728905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.728907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.728910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.728912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.728916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.728918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.728921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.728923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.728926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.728928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.728934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.728937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.728947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.728949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.728952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.728957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.728960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.728979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.729193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.729348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.729364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3055
2025-10-02T09:36:05.729478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.729515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.729527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.729531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.729908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3055 sessionId:  describe result for acl check
2025-10-02T09:36:05.729943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.729950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.729952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.729956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.730397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.731964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.735851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.735864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.735867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426299018:7643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.735873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.736367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.737947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.737959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.737960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.737963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.737969Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3054 [2:7556555862350715929:11490]
2025-10-02T09:36:05.737978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.737995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.738001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.738003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.738004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.738012Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.738018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.738024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.738056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.738061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.738062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.738064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.738065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.738101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.738106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.738112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.738118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.738127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.738141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299053:7643], now have 1 active actors on pipe
2025-10-02T09:36:05.738147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426298908:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.738150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.738151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.738153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.738160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.738168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.738176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.738178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.738179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.738179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.738180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.738179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3054
2025-10-02T09:36:05.738181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3054
2025-10-02T09:36:05.738195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.738200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.738205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.738217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.738223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.738242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.738249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.738252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.738253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.738258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.738266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.738278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.738403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.738410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.738419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.738487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3055 partition: 0 MaxSeqNo: 36 sessionId: src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0
2025-10-02T09:36:05.738718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987ca24-d0e4d12e-9bee3c60-5bd6e0e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.741022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Write session: try to update token
2025-10-02T09:36:05.741036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.747205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.747216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.747217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.747219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.747225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.747228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.747231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350715924:11490]
2025-10-02T09:36:05.747250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.747256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.747256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.747257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.747258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.747260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.747380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.752925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId: src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.755306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.819972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426299060:6976]
2025-10-02T09:36:05.820186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3054, pipe: [1:7556555862426299060:6976]
2025-10-02T09:36:05.858455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.858687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.858696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.858710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299060:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.858889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.858943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:05.858943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426299060:6976]
2025-10-02T09:36:05.858960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:05.858965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.859045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3055 reason: error at write: Disconnected sessionId: src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0
2025-10-02T09:36:05.859208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3055 sessionId: src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0 is DEAD
2025-10-02T09:36:05.859314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:05.859328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Write session will restart in 0.006575s
2025-10-02T09:36:05.859347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Write session: Do CDS request
2025-10-02T09:36:05.859353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:05.865781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:05.866837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:05.866937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:05.866943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:05.866949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:05.866973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:05.866997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555862350716074:11492]
2025-10-02T09:36:05.867074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.867174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:05.867187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3056
2025-10-02T09:36:05.867297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:05.867322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:05.867330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:05.867337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:05.867337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:05.867527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:05.867549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:05.867671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3056 sessionId:  describe result for acl check
2025-10-02T09:36:05.867700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:05.867707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:05.867708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:05.867712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:05.867723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:05.867751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.867755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.867756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.867756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.867757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.867757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.867758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.867758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.867759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.867759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.867760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.867761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.867763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.867771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.867773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.867775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.867777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.867779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.867781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.867783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.867785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.867787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.867789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.867791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.867796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.867800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:05.867803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.867806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:05.867808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.867812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:05.867814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.867817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:05.867819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.867821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:05.867823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.867826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:05.867828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.867831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:05.867833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.867837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:05.867839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.867842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:05.867844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.867846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.867848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.867851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.867855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.867857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.867875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:05.868128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:05.869626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:05.874038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:05.874048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:05.874051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555862426299171:7674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:05.874055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:05.875288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:05.876744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:05.876755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:05.876756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:05.876758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:05.876762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3055 [2:7556555862350716074:11492]
2025-10-02T09:36:05.876770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:05.876780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:05.876786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.876787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.876788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.876812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:05.876815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:05.876824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:05.876853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.876858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.876859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.876861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:05.876862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:05.876898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:05.876903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.876909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:05.876914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:05.876922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:05.876936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299208:7674], now have 1 active actors on pipe
2025-10-02T09:36:05.876941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299062:2446], now have 1 active actors on pipe
2025-10-02T09:36:05.876945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.876946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.876948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.876954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:05.876964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:05.876965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:05.876971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:05.876972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:05.876973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:05.876974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:05.876987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.876992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:05.876993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:05.876990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3055
2025-10-02T09:36:05.876996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3055
2025-10-02T09:36:05.877062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.877068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.877115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:05.877122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:05.877126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:05.877127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:05.877132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:05.877141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:05.877152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.877265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.877269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.877277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:05.877333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3056 partition: 0 MaxSeqNo: 36 sessionId: src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0
2025-10-02T09:36:05.877555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abffbb7a-e1f1acc3-f4ca1eb-41477f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:05.879833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Write session: try to update token
2025-10-02T09:36:05.879844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:05.885993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:05.886004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:05.886006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:05.886006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:05.886009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.886012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.886014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555862350716069:11492]
2025-10-02T09:36:05.886032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:05.886033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:05.886036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:05.886037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:05.886038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:05.886039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:05.886165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:05.891442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId: src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:05.893752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:05.959235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555862426299220:6976]
2025-10-02T09:36:05.959420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3055, pipe: [1:7556555862426299220:6976]
2025-10-02T09:36:05.996757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:05.997042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:05.997053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:05.997069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299220:6976], now have 1 active actors on pipe
2025-10-02T09:36:05.997195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:05.997283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:05.997284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555862426299220:6976]
2025-10-02T09:36:05.997312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:05.997395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3056 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0
2025-10-02T09:36:05.997553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3056 sessionId: src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0 is DEAD
2025-10-02T09:36:05.997667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:05.997678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Write session will restart in 0.008536s
2025-10-02T09:36:05.997701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Write session: Do CDS request
2025-10-02T09:36:05.997706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.004460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.005637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.005798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.005806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.005814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.005847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.005871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645683515:11494]
2025-10-02T09:36:06.006212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.006403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.006430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.006618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.006646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.006650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.006650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.006651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.006651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.006652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.006653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.006653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.006654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.006654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.006655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.006655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.006658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.006665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.006667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.006669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.006671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.006673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.006675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.006677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.006679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.006681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.006683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.006685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.006689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.006693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.006697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.006699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.006702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.006704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.006706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.006710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.006714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.006717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.006718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.006721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.006723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.006726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.006728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.006730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.006732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.006735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.006737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.006739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.006749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.006753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.006755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.006757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.006786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.007141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.007208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.007221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3057
2025-10-02T09:36:06.007330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.007355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.007359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.007362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.007707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3057 sessionId:  describe result for acl check
2025-10-02T09:36:06.007739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.007748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.007750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.007756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.008226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.009872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.013615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.013625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.013631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721266633:7687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.013635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.014193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.015743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.015755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.015758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.015762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3056 [2:7556555866645683515:11494]
2025-10-02T09:36:06.015770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.015780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.015785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.015787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.015788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.015797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.015806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.015810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.015841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.015845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.015846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.015848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.015850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.015885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.015889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.015896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.015901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.015909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.015923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555862426299224:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.015929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266668:7687], now have 1 active actors on pipe
2025-10-02T09:36:06.015932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.015933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.015935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.015943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.015950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.015958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.015960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.015961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.015965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.015966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.015975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.015976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.015959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3056
2025-10-02T09:36:06.015963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3056
2025-10-02T09:36:06.015984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.016010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.016018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.016033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.016041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.016043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.016044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.016049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.016053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.016060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.016191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.016198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.016207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.016272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3057 partition: 0 MaxSeqNo: 36 sessionId: src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0
2025-10-02T09:36:06.016517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f5d3c9-c904494c-9cc0be83-d7a95b18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.018853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Write session: try to update token
2025-10-02T09:36:06.018868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.029013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:06.029024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.029029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.029052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:06.029066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:06.029194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:06.029315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.029447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.029570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.029724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:06.029748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:06.031620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId: src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.033455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.033464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.033466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.033467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.033471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.033473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.033477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645683510:11494]
2025-10-02T09:36:06.033495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.033502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.033505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.033509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.033512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.033515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.033670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.034039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.097466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721266675:6976]
2025-10-02T09:36:06.097672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3056, pipe: [1:7556555866721266675:6976]
2025-10-02T09:36:06.145674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.145895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.145904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.145917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266675:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.146057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.146094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721266675:6976]
2025-10-02T09:36:06.146121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.146133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:06.146221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3057 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0
2025-10-02T09:36:06.146375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3057 sessionId: src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0 is DEAD
2025-10-02T09:36:06.146526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:06.146541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Write session will restart in 0.007836s
2025-10-02T09:36:06.146562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Write session: Do CDS request
2025-10-02T09:36:06.146567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.153122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.154208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.154316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.154323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.154328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.154354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.154381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645683700:11509]
2025-10-02T09:36:06.154721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.154902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.154928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.155110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.155139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.155145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.155143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.155143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.155144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.155144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.155145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.155146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.155146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.155147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.155147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.155147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.155148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.155151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.155158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.155160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.155162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.155164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.155166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.155168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.155170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.155172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.155174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.155176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.155178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.155182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.155185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.155188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.155192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.155195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.155198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.155201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.155204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.155206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.155208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.155210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.155213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.155215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.155217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.155219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.155222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.155224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.155227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.155229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.155231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.155233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.155236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.155238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.155241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.155240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.155250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3058
2025-10-02T09:36:06.155270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.155365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.155388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.155396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.155399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.155801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3058 sessionId:  describe result for acl check
2025-10-02T09:36:06.155821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.155826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.155827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.155829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.156396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.157924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.162240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.162249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.162251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721266811:7718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.162254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.162641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.164239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.164252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.164253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.164255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.164258Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3057 [2:7556555866645683700:11509]
2025-10-02T09:36:06.164265Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.164274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.164275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.164277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.164277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.164286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.164290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.164295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.164324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.164328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.164329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.164331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.164333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.164369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.164373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.164379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.164385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.164392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.164406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266698:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.164411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266846:7718], now have 1 active actors on pipe
2025-10-02T09:36:06.164414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.164415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.164416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.164424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.164431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.164441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.164440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.164443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.164443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.164444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.164436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3057
2025-10-02T09:36:06.164456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.164441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3057
2025-10-02T09:36:06.164463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.164465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.164483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.164490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.164512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d42314f7-7f2d623b-571fade0-99415b89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.164524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.164530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.164531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.164535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.164540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.164554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.164655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.164662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.164671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.164727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3058 partition: 0 MaxSeqNo: 36 sessionId: src_id|d42314f7-7f2d623b-571fade0-99415b89_0
2025-10-02T09:36:06.164994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5270a0c6-ca1cfc6c-cb1fc41f-c73a3b32_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d42314f7-7f2d623b-571fade0-99415b89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.167276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Write session: try to update token
2025-10-02T09:36:06.167291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.173433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.173444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.173445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.173446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.173449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.173452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.173453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645683695:11509]
2025-10-02T09:36:06.173472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.173478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.173478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.173479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.173480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.173482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.173609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.181936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId: src_id|d42314f7-7f2d623b-571fade0-99415b89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.184098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.246452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721266854:6976]
2025-10-02T09:36:06.246642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3057, pipe: [1:7556555866721266854:6976]
2025-10-02T09:36:06.287032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.287232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.287241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.287252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266854:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.287382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.287365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.287373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721266854:6976]
2025-10-02T09:36:06.287392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:06.287394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:06.287443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3058 reason: error at write: Disconnected sessionId: src_id|d42314f7-7f2d623b-571fade0-99415b89_0
2025-10-02T09:36:06.287587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3058 sessionId: src_id|d42314f7-7f2d623b-571fade0-99415b89_0 is DEAD
2025-10-02T09:36:06.287717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:06.287732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Write session will restart in 0.005400s
2025-10-02T09:36:06.287753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Write session: Do CDS request
2025-10-02T09:36:06.287758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.294165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.294311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.294324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3059
2025-10-02T09:36:06.294454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.294482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.294490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.294494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.294599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.294818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3059 sessionId:  describe result for acl check
2025-10-02T09:36:06.294847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.294852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.294854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.294857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.295272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.295826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.295928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.295935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.295941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.295967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.295989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645683860:11512]
2025-10-02T09:36:06.296405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.296497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.296605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.296632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.296829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.296858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.296863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.296863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.296864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.296864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.296865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.296865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.296866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.296866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.296867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.296867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.296868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.296870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.296876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.296878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.296881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.296883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.296885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.296887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.296889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.296891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.296893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.296895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.296900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.296904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.296907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.296910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.296912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.296915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.296918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.296920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.296923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.296925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.296927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.296930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.296933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.296936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.296938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.296941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.296943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.296946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.296948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.296951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.296953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.296956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.296962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.296965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.296981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.301731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.301739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.301742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721266977:7736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.301745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.304389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.305972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.305982Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.305983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.305985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.305988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3058 [2:7556555866645683860:11512]
2025-10-02T09:36:06.305994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.306004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.306005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.306007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.306008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.306016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.306023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.306028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.306056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.306061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.306062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.306064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.306065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.306102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.306105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.306111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.306119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.306130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.306144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267016:7736], now have 1 active actors on pipe
2025-10-02T09:36:06.306151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721266867:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.306156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.306161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.306163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.306172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.306186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.306186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.306188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.306189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.306201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.306191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3058
2025-10-02T09:36:06.306191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3058
2025-10-02T09:36:06.306206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.306232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.306239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.306249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.306257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.306270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.306274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.306277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.306279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.306280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.306285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.306290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.306351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.306477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.306482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.306490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.306547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3059 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0
2025-10-02T09:36:06.306788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42314f7-7f2d623b-571fade0-99415b89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.309122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Write session: try to update token
2025-10-02T09:36:06.309137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.315222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.315234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.315235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.315236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.315240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.315244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.315246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645683855:11512]
2025-10-02T09:36:06.315264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.315267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.315268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.315271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.315274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.315276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.315378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.321184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId: src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.323317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.387738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721267026:6976]
2025-10-02T09:36:06.387892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3058, pipe: [1:7556555866721267026:6976]
2025-10-02T09:36:06.424536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.424789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.424798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.424820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267026:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.425029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:06.425030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721267026:6976]
2025-10-02T09:36:06.425039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:06.425048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.425085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3059 reason: error at write: Disconnected sessionId: src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0
2025-10-02T09:36:06.425228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3059 sessionId: src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0 is DEAD
2025-10-02T09:36:06.425388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:06.425403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Write session will restart in 0.009779s
2025-10-02T09:36:06.425424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Write session: Do CDS request
2025-10-02T09:36:06.425435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.425796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.432173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.433192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.433302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.433309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.433315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.433342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.433365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645684010:11515]
2025-10-02T09:36:06.433705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.433905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.433932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.434122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.434150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.434154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.434154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.434155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.434156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.434156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.434157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.434157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.434158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.434158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.434159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.434159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.434162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.434169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.434171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.434173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.434175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.434177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.434179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.434181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.434183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.434185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.434187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.434189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.434193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.434198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.434201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.434204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.434206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.434209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.434211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.434214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.434220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.434223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.434225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.434227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.434231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.434233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.434235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.434238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.434240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.434243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.434245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.434247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.434249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.434252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.434254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.434260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.434275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.436186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.436320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.436336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3060
2025-10-02T09:36:06.436452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.436478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.436487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.436491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.436881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3060 sessionId:  describe result for acl check
2025-10-02T09:36:06.436908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.436913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.436914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.436917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.437319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.439005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.441116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.441126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.441128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721267143:7742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.441132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.441646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.443235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.443246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.443247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.443249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.443253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3059 [2:7556555866645684010:11515]
2025-10-02T09:36:06.443260Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.443268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.443270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.443271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.443272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.443280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.443283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.443287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.443315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.443320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.443321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.443323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.443325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.443360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.443364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.443371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.443376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.443387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.443402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267178:7742], now have 1 active actors on pipe
2025-10-02T09:36:06.443407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267028:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.443411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.443412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.443413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.443421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.443432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.443437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.443439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.443441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.443435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3059
2025-10-02T09:36:06.443443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.443445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.443458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.443446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3059
2025-10-02T09:36:06.443460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.443462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.443469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.443474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.443502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c0996b9-3e9ca246-9e055c1-de338536_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.443510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.443513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.443518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.443524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.443534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.443549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.443663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.443670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.443679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.443749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3060 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c0996b9-3e9ca246-9e055c1-de338536_0
2025-10-02T09:36:06.443967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb62e5c7-142bc579-fa84f6c0-a26cc76e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c0996b9-3e9ca246-9e055c1-de338536_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.446255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Write session: try to update token
2025-10-02T09:36:06.446268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.452497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.452509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.452510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.452510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.452514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.452516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.452518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645684005:11515]
2025-10-02T09:36:06.452537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.452542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.452543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.452544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.452547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.452548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.452652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.457832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId: src_id|5c0996b9-3e9ca246-9e055c1-de338536_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.459913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.524983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721267186:6976]
2025-10-02T09:36:06.525190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3059, pipe: [1:7556555866721267186:6976]
2025-10-02T09:36:06.561667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.562050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.562064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.562078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267186:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.562284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721267186:6976]
2025-10-02T09:36:06.562292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:06.562296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:06.562316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.562369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3060 reason: error at write: Disconnected sessionId: src_id|5c0996b9-3e9ca246-9e055c1-de338536_0
2025-10-02T09:36:06.562514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3060 sessionId: src_id|5c0996b9-3e9ca246-9e055c1-de338536_0 is DEAD
2025-10-02T09:36:06.562683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:06.562698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Write session will restart in 0.005172s
2025-10-02T09:36:06.562720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Write session: Do CDS request
2025-10-02T09:36:06.562726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.563002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.569163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.569226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.569237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3061
2025-10-02T09:36:06.569334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.569360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.569369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.569372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.569522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.569720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3061 sessionId:  describe result for acl check
2025-10-02T09:36:06.569750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.569758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.569760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.569764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.570195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.570581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.570679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.570685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.570691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.570718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.570742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645684160:11517]
2025-10-02T09:36:06.571106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.571291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.571317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.571500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.571538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.571543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.571543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.571544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.571539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.571545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.571545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.571546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.571546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.571547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.571547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.571548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.571548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.571551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.571557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.571559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.571561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.571563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.571565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.571567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.571569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.571571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.571573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.571575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.571577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.571583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.571587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.571590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.571593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.571596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.571599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.571601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.571604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.571606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.571609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.571611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.571615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.571617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.571619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.571622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.571624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.571626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.571634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.571637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.571639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.571645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.571647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.571649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.571670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.576435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.576445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.576447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721267299:7763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.576452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.579049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.580643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.580655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.580656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.580658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.580661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3060 [2:7556555866645684160:11517]
2025-10-02T09:36:06.580667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.580677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.580678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.580680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.580681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.580690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.580696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.580700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.580736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.580742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.580744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.580746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.580748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.580789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.580794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.580813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.580818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.580827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.580840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267187:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.580845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267338:7763], now have 1 active actors on pipe
2025-10-02T09:36:06.580849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.580850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.580851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.580859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.580867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.580876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.580878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.580878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.580879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.580879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.580894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.580898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.580900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.580895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3060
2025-10-02T09:36:06.580899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3060
2025-10-02T09:36:06.580947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.580952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.580965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83c96217-ee916752-2cfcc179-db484b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.580972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.580974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.580975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.580980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.580986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.580995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.581110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.581117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.581126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.581195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3061 partition: 0 MaxSeqNo: 36 sessionId: src_id|83c96217-ee916752-2cfcc179-db484b1a_0
2025-10-02T09:36:06.581371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c0996b9-3e9ca246-9e055c1-de338536_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83c96217-ee916752-2cfcc179-db484b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.583678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Write session: try to update token
2025-10-02T09:36:06.583690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.589897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.589908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.589909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.589910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.589914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.589916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.589918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645684155:11517]
2025-10-02T09:36:06.589940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.589944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.589944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.589946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.589948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.589950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.590071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.595835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId: src_id|83c96217-ee916752-2cfcc179-db484b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.598053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.662715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721267354:6976]
2025-10-02T09:36:06.662928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3060, pipe: [1:7556555866721267354:6976]
2025-10-02T09:36:06.702204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.702536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.702545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.702558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267354:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.702680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.702720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.702737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721267354:6976]
2025-10-02T09:36:06.702769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:06.702853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3061 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83c96217-ee916752-2cfcc179-db484b1a_0
2025-10-02T09:36:06.702996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3061 sessionId: src_id|83c96217-ee916752-2cfcc179-db484b1a_0 is DEAD
2025-10-02T09:36:06.703132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:06.703146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Write session will restart in 0.009677s
2025-10-02T09:36:06.703166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Write session: Do CDS request
2025-10-02T09:36:06.703172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.709944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.711064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.711158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.711164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.711169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.711193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.711216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645684311:11519]
2025-10-02T09:36:06.711562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.711732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.711753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.711926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.711954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.711958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.711959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.711959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.711960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.711961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.711961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.711962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.711962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.711963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.711963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.711964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.711966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.711973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.711975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.711977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.711979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.711981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.711983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.711985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.711987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.711989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.711991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.711993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.712000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.712004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.712007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.712009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.712011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.712013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.712016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.712018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.712021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.712023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.712025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.712031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.712034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.712036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.712039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.712041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.712045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.712048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.712054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.712056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.712059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.712061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.712078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.714136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.714214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.714226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3062
2025-10-02T09:36:06.714334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.714357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.714367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.714371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.714692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3062 sessionId:  describe result for acl check
2025-10-02T09:36:06.714727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.714734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.714736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.714740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.715161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.716892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.718882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.718892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.718894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721267474:7775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.718899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.719428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.720894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.720903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.720904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.720906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.720909Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3061 [2:7556555866645684311:11519]
2025-10-02T09:36:06.720918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.720927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.720929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.720930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.720931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.720939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.720945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.720949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.721041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.721046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.721047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.721048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.721050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.721085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.721089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.721096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.721103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.721112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.721126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267356:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.721129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267508:7775], now have 1 active actors on pipe
2025-10-02T09:36:06.721133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.721134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.721135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.721143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.721150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.721157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.721158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.721160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.721162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.721162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.721176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.721181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.721184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.721183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3061
2025-10-02T09:36:06.721188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3061
2025-10-02T09:36:06.721204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.721208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.721221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.721228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.721230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.721232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.721237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.721242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.721252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.721371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.721375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.721383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.721444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3062 partition: 0 MaxSeqNo: 36 sessionId: src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0
2025-10-02T09:36:06.721660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83c96217-ee916752-2cfcc179-db484b1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.724035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Write session: try to update token
2025-10-02T09:36:06.724049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.729984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:06.729994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.729997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.730016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:06.730023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:06.730153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:06.730268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.730386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.730504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:06.730660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:06.730680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:06.736247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId: src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.738406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.738418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.738419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.738421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.738427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.738430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.738433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645684306:11519]
2025-10-02T09:36:06.738454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.738457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.738460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.738461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.738462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.738462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.738516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.738576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.803012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721267515:6976]
2025-10-02T09:36:06.803228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3061, pipe: [1:7556555866721267515:6976]
2025-10-02T09:36:06.853542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.853786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.853795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.853807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267515:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.853976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.854007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.854031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721267515:6976]
2025-10-02T09:36:06.854053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:06.854138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3062 reason: status is not ok: tablet will be restarted right now sessionId: src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0
2025-10-02T09:36:06.854291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3062 sessionId: src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0 is DEAD
2025-10-02T09:36:06.854408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:06.854421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Write session will restart in 0.006769s
2025-10-02T09:36:06.854444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Write session: Do CDS request
2025-10-02T09:36:06.854449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.860914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.861997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:06.862126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.862133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:06.862140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:06.862147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:06.862175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:06.862202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645684463:11521]
2025-10-02T09:36:06.862251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:06.862264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3063
2025-10-02T09:36:06.862347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:06.862372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:06.862380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:06.862384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:06.862571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:06.862722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3063 sessionId:  describe result for acl check
2025-10-02T09:36:06.862755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:06.862761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:06.862768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:06.862770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:06.862774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:06.862780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:06.862968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:06.863003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.863007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.863007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.863008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.863009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.863009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.863010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.863010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.863011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.863011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.863012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.863012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.863015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.863022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.863024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.863026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.863028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.863030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.863032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.863034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.863036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.863038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.863040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.863042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.863046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.863050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:06.863053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.863056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:06.863058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.863060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:06.863063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.863065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:06.863068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.863071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:06.863073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.863076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:06.863079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.863082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:06.863084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.863087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:06.863089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.863091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:06.863093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.863096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.863098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.863101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.863103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.863109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.863126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:06.863206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:06.864967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:06.869283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:06.869293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:06.869296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555866721267633:7787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:06.869302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:06.870515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:06.872041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:06.872054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:06.872056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:06.872059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:06.872064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3062 [2:7556555866645684463:11521]
2025-10-02T09:36:06.872073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:06.872089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:06.872093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.872095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.872096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.872104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:06.872110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:06.872115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:06.872146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.872150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.872152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.872154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:06.872155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:06.872189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:06.872193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.872200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:06.872205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:06.872217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:06.872231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267670:7787], now have 1 active actors on pipe
2025-10-02T09:36:06.872236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267517:2446], now have 1 active actors on pipe
2025-10-02T09:36:06.872239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.872240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.872241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.872249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:06.872256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:06.872264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:06.872266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:06.872267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:06.872267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:06.872268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:06.872281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.872286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:06.872288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:06.872291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3062
2025-10-02T09:36:06.872297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3062
2025-10-02T09:36:06.872341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.872346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.872362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:06.872369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:06.872372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:06.872373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:06.872378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:06.872383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:06.872392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.872526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.872535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.872545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:06.872616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3063 partition: 0 MaxSeqNo: 36 sessionId: src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0
2025-10-02T09:36:06.872838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559ab6ef-33a4809e-cf0598b5-f3231e6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:06.875118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Write session: try to update token
2025-10-02T09:36:06.875129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:06.881505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:06.881516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:06.881519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:06.881520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:06.881523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.881525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.881527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645684458:11521]
2025-10-02T09:36:06.881545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:06.881548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:06.881549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:06.881552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:06.881556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:06.881558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:06.881668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:06.886705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId: src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:06.888855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:06.954042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555866721267682:6976]
2025-10-02T09:36:06.954242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3062, pipe: [1:7556555866721267682:6976]
2025-10-02T09:36:06.990692Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:06.990977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:06.990986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:06.990998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267682:6976], now have 1 active actors on pipe
2025-10-02T09:36:06.991172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555866721267682:6976]
2025-10-02T09:36:06.991194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:06.991196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:06.991197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:06.991270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3063 reason: error at write: Disconnected sessionId: src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0
2025-10-02T09:36:06.991437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3063 sessionId: src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0 is DEAD
2025-10-02T09:36:06.991576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:06.991589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Write session will restart in 0.007894s
2025-10-02T09:36:06.991608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Write session: Do CDS request
2025-10-02T09:36:06.991613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:06.991853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:06.998739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:06.999878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.000005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.000012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.000018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.000046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.000070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555866645684616:11523]
2025-10-02T09:36:07.000123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.000200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.000212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3064
2025-10-02T09:36:07.000299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.000322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.000332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.000335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.000415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.000587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.000608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.000674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3064 sessionId:  describe result for acl check
2025-10-02T09:36:07.000704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.000710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.000712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.000716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.000783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.000822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.000826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.000827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.000827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.000828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.000828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.000829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.000830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.000830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.000831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.000831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.000832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.000835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.000842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.000844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.000846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.000848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.000850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.000852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.000854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.000856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.000858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.000860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.000862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.000866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.000870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.000876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.000879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.000882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.000885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.000887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.000889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.000891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.000894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.000899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.000902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.000904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.000907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.000909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.000912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.000914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.000917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.000919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.000922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.000924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.000928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.000932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.000935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.000950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.001138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.002596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.007110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.007121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.007126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235099:7806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.007130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.008292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.009941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.009951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.009952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.009954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.009957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3063 [2:7556555866645684616:11523]
2025-10-02T09:36:07.009965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.009974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.009976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.009977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.009978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.009987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.009990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.009995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.010024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.010029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.010030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.010032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.010033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.010068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.010073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.010080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.010085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.010092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.010103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555866721267686:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.010105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235135:7806], now have 1 active actors on pipe
2025-10-02T09:36:07.010109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.010111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.010112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.010120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.010128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.010131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.010135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.010135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.010137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.010137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.010151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.010156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.010161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.010177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.010183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.010155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3063
2025-10-02T09:36:07.010158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3063
2025-10-02T09:36:07.010201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.010208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.010210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.010211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.010216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.010221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.010228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.010329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.010334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.010343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.010405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3064 partition: 0 MaxSeqNo: 36 sessionId: src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0
2025-10-02T09:36:07.010584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 137 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:36:07.010613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477b5ab3-666ca1a3-5820c278-e6479ac6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.012876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Write session: try to update token
2025-10-02T09:36:07.012887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.019201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.019212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.019213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.019214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.019218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.019221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.019223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555866645684611:11523]
2025-10-02T09:36:07.019241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.019244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.019246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.019249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.019254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.019257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.019462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.024431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId: src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.026531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.091242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016235144:6976]
2025-10-02T09:36:07.091454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3063, pipe: [1:7556555871016235144:6976]
2025-10-02T09:36:07.128348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.128554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.128565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.128594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235144:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.128730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.128763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016235144:6976]
2025-10-02T09:36:07.128776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:07.128780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:07.128791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.128873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3064 reason: error at write: Disconnected sessionId: src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0
2025-10-02T09:36:07.129019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3064 sessionId: src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0 is DEAD
2025-10-02T09:36:07.129164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:07.129175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Write session will restart in 0.006407s
2025-10-02T09:36:07.129198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Write session: Do CDS request
2025-10-02T09:36:07.129203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.136158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.136251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.136263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3065
2025-10-02T09:36:07.136335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.136370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.136393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.136401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.136404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.136688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3065 sessionId:  describe result for acl check
2025-10-02T09:36:07.136709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.136714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.136715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.136719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.137115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.137456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.137572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.137579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.137584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.137614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.137637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652098:11536]
2025-10-02T09:36:07.137995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.138189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.138217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.138411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.138442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.138446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.138447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.138447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.138448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.138450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.138450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.138451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.138451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.138452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.138455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.138461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.138463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.138465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.138467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.138469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.138471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.138473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.138475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.138477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.138479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.138481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.138485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.138489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.138492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.138495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.138497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.138500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.138502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.138505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.138507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.138510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.138512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.138515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.138517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.138520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.138522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.138525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.138527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.138530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.138532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.138536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.138542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.138544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.138546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.138563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.138744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.143288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.143298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.143299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235273:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.143304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.145917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.147499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.147513Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.147514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.147517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.147521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3064 [2:7556555870940652098:11536]
2025-10-02T09:36:07.147530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.147545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.147549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.147551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.147552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.147561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.147567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.147571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.147600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.147605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.147606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.147608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.147610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.147647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.147651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.147658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.147663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.147671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.147685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235145:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.147691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235311:7826], now have 1 active actors on pipe
2025-10-02T09:36:07.147694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.147696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.147697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.147705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.147712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.147720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.147722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.147723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.147723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.147725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.147724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3064
2025-10-02T09:36:07.147737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.147742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.147745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3064
2025-10-02T09:36:07.147749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.147756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.147757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.147780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2af5224-9fc5016c-3036d96-995b59eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.147787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.147790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.147791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.147796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.147801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.147811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.147924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.147931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.147940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.148014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3065 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2af5224-9fc5016c-3036d96-995b59eb_0
2025-10-02T09:36:07.148235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963476c1-f164dc9a-e4ca9c5-deccda04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2af5224-9fc5016c-3036d96-995b59eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.150512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Write session: try to update token
2025-10-02T09:36:07.150525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.156906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.156916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.156917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.156920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.156923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.156925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.156928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652092:11536]
2025-10-02T09:36:07.156947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.156949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.156950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.156955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.156958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.156960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.157067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.162503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId: src_id|a2af5224-9fc5016c-3036d96-995b59eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.164653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.229006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016235329:6976]
2025-10-02T09:36:07.229205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3064, pipe: [1:7556555871016235329:6976]
2025-10-02T09:36:07.267130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.267352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.267361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.267373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235329:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.267496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.267533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:07.267547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:07.267563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016235329:6976]
2025-10-02T09:36:07.267582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.267604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3065 reason: error at write: Disconnected sessionId: src_id|a2af5224-9fc5016c-3036d96-995b59eb_0
2025-10-02T09:36:07.267748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3065 sessionId: src_id|a2af5224-9fc5016c-3036d96-995b59eb_0 is DEAD
2025-10-02T09:36:07.268046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:07.268059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Write session will restart in 0.009356s
2025-10-02T09:36:07.268078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Write session: Do CDS request
2025-10-02T09:36:07.268083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.275078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.276186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.276284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.276291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.276297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.276323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.276346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652271:11541]
2025-10-02T09:36:07.276707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.276894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.276917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.277109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.277140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.277144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.277144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.277145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.277145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.277146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.277147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.277147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.277148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.277148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.277149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.277149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.277152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.277158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.277160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.277162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.277165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.277167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.277169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.277171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.277173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.277175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.277177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.277179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.277182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.277186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.277189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.277192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.277195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.277197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.277199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.277202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.277206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.277208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.277211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.277213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.277219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.277222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.277225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.277228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.277230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.277232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.277235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.277237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.277242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.277245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.277247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.277250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.277269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.278118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.278457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.278468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3066
2025-10-02T09:36:07.278555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.278577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.278588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.278590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.279006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3066 sessionId:  describe result for acl check
2025-10-02T09:36:07.279037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.279041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.279043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.279047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.279444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.281120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.284053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.284062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.284064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235463:7842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.284099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.284635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.286229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.286241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.286243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.286245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.286248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3065 [2:7556555870940652271:11541]
2025-10-02T09:36:07.286258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.286271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.286278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.286280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.286282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.286291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.286298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.286304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.286336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.286343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.286344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.286346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.286347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.286384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.286385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.286392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.286396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.286405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.286420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235342:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.286425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235497:7842], now have 1 active actors on pipe
2025-10-02T09:36:07.286429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.286430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.286431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.286438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.286448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.286453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.286455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.286456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.286459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.286460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.286473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.286463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3065
2025-10-02T09:36:07.286478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.286469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3065
2025-10-02T09:36:07.286492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.286535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.286541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.286562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.286569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.286572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.286576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.286580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.286585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.286595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.286713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.286720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.286729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.286820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3066 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0
2025-10-02T09:36:07.287034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af5224-9fc5016c-3036d96-995b59eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.289343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Write session: try to update token
2025-10-02T09:36:07.289357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.295437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.295449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.295450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.295451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.295454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.295458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.295460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652266:11541]
2025-10-02T09:36:07.295483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.295491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.295492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.295493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.295494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.295495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.295609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.301082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId: src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.303233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.367706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016235508:6976]
2025-10-02T09:36:07.367870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3065, pipe: [1:7556555871016235508:6976]
2025-10-02T09:36:07.405766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.406001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.406010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.406022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235508:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.406151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.406194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016235508:6976]
2025-10-02T09:36:07.406217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.406229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:07.406310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3066 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0
2025-10-02T09:36:07.406473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3066 sessionId: src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0 is DEAD
2025-10-02T09:36:07.406621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:07.406633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Write session will restart in 0.006322s
2025-10-02T09:36:07.406653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Write session: Do CDS request
2025-10-02T09:36:07.406658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.413530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.414175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.414325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.414335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3067
2025-10-02T09:36:07.414417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.414439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.414446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.414450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.414631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.414727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.414733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.414739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.414773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3067 sessionId:  describe result for acl check
2025-10-02T09:36:07.414776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.414794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.414799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.414806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652429:11544]
2025-10-02T09:36:07.414800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.414804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.415152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.415210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.415511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.415541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.415730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.415760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.415764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.415764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.415765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.415765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.415766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.415766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.415767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.415767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.415768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.415769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.415769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.415772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.415778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.415781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.415783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.415785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.415787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.415790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.415793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.415796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.415800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.415803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.415806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.415812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.415818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.415822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.415825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.415827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.415829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.415832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.415834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.415836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.415839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.415841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.415844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.415846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.415849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.415851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.415853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.415860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.415863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.415865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.415868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.415870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.415873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.415875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.415878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.415897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.416850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.421698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.421708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.421710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235627:7851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.421715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.423382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.424984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.424994Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.424996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.424998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.425002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3066 [2:7556555870940652429:11544]
2025-10-02T09:36:07.425012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.425024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.425031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.425034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.425036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.425046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.425052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.425057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.425091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.425096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.425097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.425099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.425100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.425136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.425140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.425146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.425155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.425166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.425181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235666:7851], now have 1 active actors on pipe
2025-10-02T09:36:07.425186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235509:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.425189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.425190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.425191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.425199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.425209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.425210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.425212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.425213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.425218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.425220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.425233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.425238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.425224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3066
2025-10-02T09:36:07.425232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3066
2025-10-02T09:36:07.425244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.425255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.425256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.425278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.425286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.425291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.425293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.425298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.425305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.425320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.425444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.425452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.425464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.425531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3067 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0
2025-10-02T09:36:07.425741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aac196-c5fb20f0-d061f21c-a566646f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.428003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Write session: try to update token
2025-10-02T09:36:07.428017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.434239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.434251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.434253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.434254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.434259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.434262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.434265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652424:11544]
2025-10-02T09:36:07.434285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.434287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.434289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.434292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.434292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.434293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.434460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.440161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId: src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.442340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.506629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016235673:6976]
2025-10-02T09:36:07.506832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3066, pipe: [1:7556555871016235673:6976]
2025-10-02T09:36:07.543104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.543313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.543321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.543334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235673:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.543453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.543528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:07.543534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.543627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0
2025-10-02T09:36:07.543689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016235673:6976]
2025-10-02T09:36:07.543781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3067 sessionId: src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0 is DEAD
2025-10-02T09:36:07.543930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:07.543942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Write session will restart in 0.007730s
2025-10-02T09:36:07.543965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Write session: Do CDS request
2025-10-02T09:36:07.543970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.550830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.552110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.552210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.552216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.552222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.552246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.552269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652586:11546]
2025-10-02T09:36:07.552624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.552794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.552830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.553022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.553058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.553062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.553063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.553063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.553064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.553064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.553065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.553065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.553066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.553066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.553067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.553067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.553070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.553077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.553079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.553081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.553083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.553085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.553087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.553089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.553091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.553093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.553095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.553097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.553100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.553104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.553107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.553110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.553112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.553115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.553117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.553119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.553122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.553124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.553127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.553129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.553131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.553134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.553136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.553138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.553140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.553144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.553147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.553150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.553152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.553155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.553157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.553160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.553180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.553177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.553396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.553408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3068
2025-10-02T09:36:07.553497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.553520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.553527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.553530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.553870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3068 sessionId:  describe result for acl check
2025-10-02T09:36:07.553900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.553904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.553906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.553910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.554325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.556051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.560034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.560044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.560047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235798:7856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.560053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.560527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.562134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.562146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.562148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.562150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.562153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3067 [2:7556555870940652586:11546]
2025-10-02T09:36:07.562161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.562169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.562171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.562172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.562173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.562182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.562187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.562194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.562227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.562234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.562235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.562238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.562240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.562290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.562297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.562307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.562317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.562325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.562338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235833:7856], now have 1 active actors on pipe
2025-10-02T09:36:07.562345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235675:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.562349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.562350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.562351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.562361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.562371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.562374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.562376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.562377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.562382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.562384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.562379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3067
2025-10-02T09:36:07.562380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3067
2025-10-02T09:36:07.562400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.562405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.562407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.562415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.562417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.562440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.562447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.562449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.562450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.562455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.562461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.562470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.562572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.562579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.562589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.562651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3068 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0
2025-10-02T09:36:07.562910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3ef4d3-5a558b8b-3223f4b8-7363545b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.565191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Write session: try to update token
2025-10-02T09:36:07.565204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.571406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.571418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.571419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.571420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.571424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.571427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.571429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652581:11546]
2025-10-02T09:36:07.571452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.571453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.571455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.571457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.571457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.571459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.571568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.576784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId: src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.578901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.643719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016235840:6976]
2025-10-02T09:36:07.643947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3067, pipe: [1:7556555871016235840:6976]
2025-10-02T09:36:07.682455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.682748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.682765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.682778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235840:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.682901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.682934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016235840:6976]
2025-10-02T09:36:07.682942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.682965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:07.683052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3068 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0
2025-10-02T09:36:07.683217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3068 sessionId: src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0 is DEAD
2025-10-02T09:36:07.683344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:07.683355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Write session will restart in 0.006785s
2025-10-02T09:36:07.683383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Write session: Do CDS request
2025-10-02T09:36:07.683389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.689932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.691023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.691138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.691149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.691145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.691150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.691180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.691206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652743:11548]
2025-10-02T09:36:07.691256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.691266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3069
2025-10-02T09:36:07.691345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.691366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.691373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.691376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.691555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.691709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3069 sessionId:  describe result for acl check
2025-10-02T09:36:07.691741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.691746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.691747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.691752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.691756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.691794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.691981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.692040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.692044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.692045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.692045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.692046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.692046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.692047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.692047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.692048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.692048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.692049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.692049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.692052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.692059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.692061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.692063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.692065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.692067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.692069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.692071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.692073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.692075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.692077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.692079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.692084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.692088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.692091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.692094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.692096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.692098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.692101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.692104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.692106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.692108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.692111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.692113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.692115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.692118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.692120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.692123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.692125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.692128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.692130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.692132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.692135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.692137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.692139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.692142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.692158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.692181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.693853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.698364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.698373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.698375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016235964:7879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.698381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.699572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.701109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.701122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.701123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.701126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.701129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3068 [2:7556555870940652743:11548]
2025-10-02T09:36:07.701137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.701148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.701150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.701151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.701153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.701163Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.701166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.701176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.701208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.701213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.701215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.701216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.701218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.701257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.701262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.701269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.701274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.701282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.701295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236001:7879], now have 1 active actors on pipe
2025-10-02T09:36:07.701301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016235842:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.701304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.701306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.701308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.701316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.701323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.701325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.701327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.701329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.701334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.701336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.701354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.701362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.701352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3068
2025-10-02T09:36:07.701355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3068
2025-10-02T09:36:07.701371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.701389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.701394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.701410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.701417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.701419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.701420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.701424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.701429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.701437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.701569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.701574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.701582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.701648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3069 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0
2025-10-02T09:36:07.701864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a49aa84-2d7ea8ac-17eabafb-47893da3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.704152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Write session: try to update token
2025-10-02T09:36:07.704166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.710142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:07.710153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.710157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.710177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:07.710183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:07.710307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:07.710416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.710526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.710635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.710799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:07.710821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:07.715838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId: src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.717993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.718413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.718426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.718434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.718435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.718436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.718437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.718440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.718442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.718444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652738:11548]
2025-10-02T09:36:07.718463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.718468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.718470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.718471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.718472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.718473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.718583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.782972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016236008:6976]
2025-10-02T09:36:07.783176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3068, pipe: [1:7556555871016236008:6976]
2025-10-02T09:36:07.828855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.829181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:07.829204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236008:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.829324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:07.829374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016236008:6976]
2025-10-02T09:36:07.829394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.829432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:07.829439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:07.829510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3069 reason: error at write: Disconnected sessionId: src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0
2025-10-02T09:36:07.829625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3069 sessionId: src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0 is DEAD
2025-10-02T09:36:07.829762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:07.829773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Write session will restart in 0.007608s
2025-10-02T09:36:07.829794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Write session: Do CDS request
2025-10-02T09:36:07.829808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.836537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.837738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.837854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.837860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.837866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.837893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.837918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940652902:11550]
2025-10-02T09:36:07.838133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.838204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.838216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3070
2025-10-02T09:36:07.838279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.838299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.838321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.838325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.838332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.838438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.838461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.838638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.838668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.838662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3070 sessionId:  describe result for acl check
2025-10-02T09:36:07.838672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.838673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.838673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.838674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.838675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.838675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.838676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.838676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.838677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.838677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.838678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.838680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.838687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.838689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.838691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.838693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.838693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.838698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.838695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.838698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.838699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.838701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.838705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.838708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.838711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.838715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.838703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.838720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.838726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.838731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.838734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.838736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.838739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.838741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.838744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.838746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.838749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.838751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.838763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.838766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.838768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.838770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.838773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.838776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.838782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.838784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.838787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.838789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.838791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.838793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.838796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.838816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.839145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.840760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.845611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.845646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.845652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016236132:7883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.845662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.846151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.847713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.847724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.847725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.847727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.847730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3069 [2:7556555870940652902:11550]
2025-10-02T09:36:07.847736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.847745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.847746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.847748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.847749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.847757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.847763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.847768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.847798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.847802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.847804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.847806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.847807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.847842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.847847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.847853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.847859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.847871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.847885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236009:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.847890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236170:7883], now have 1 active actors on pipe
2025-10-02T09:36:07.847893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.847895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.847896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.847903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.847911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.847917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.847920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.847921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.847926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.847929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.847924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3069
2025-10-02T09:36:07.847941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3069
2025-10-02T09:36:07.847947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.847954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.847956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.847973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.847978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.847997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dabec713-d23a35bf-d075f26b-19595bb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.848004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.848006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.848007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.848011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.848017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.848026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.848131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.848137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.848146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.848213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3070 partition: 0 MaxSeqNo: 36 sessionId: src_id|dabec713-d23a35bf-d075f26b-19595bb2_0
2025-10-02T09:36:07.848423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0746-d0ec5dad-962c52c2-d463e98d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dabec713-d23a35bf-d075f26b-19595bb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.850829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Write session: try to update token
2025-10-02T09:36:07.850843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.856914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:07.856924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.856925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:07.856926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:07.856930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.856933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.856935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940652897:11550]
2025-10-02T09:36:07.856953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:07.856956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.856957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:07.856960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:07.856963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:07.856965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:07.857063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:07.862394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId: src_id|dabec713-d23a35bf-d075f26b-19595bb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:07.864456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:07.929367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555871016236184:6976]
2025-10-02T09:36:07.929531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3069, pipe: [1:7556555871016236184:6976]
2025-10-02T09:36:07.965848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:07.966131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.966140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.966152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236184:6976], now have 1 active actors on pipe
2025-10-02T09:36:07.966292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:07.966321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:07.966332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555871016236184:6976]
2025-10-02T09:36:07.966359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:07.966361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:07.966444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3070 reason: error at write: Disconnected sessionId: src_id|dabec713-d23a35bf-d075f26b-19595bb2_0
2025-10-02T09:36:07.966588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3070 sessionId: src_id|dabec713-d23a35bf-d075f26b-19595bb2_0 is DEAD
2025-10-02T09:36:07.966717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:07.966723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Write session will restart in 0.009566s
2025-10-02T09:36:07.966746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Write session: Do CDS request
2025-10-02T09:36:07.966752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:07.973964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:07.975065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:07.975161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:07.975168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:07.975173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:07.975197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:07.975219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555870940653062:11552]
2025-10-02T09:36:07.975575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:07.975760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:07.975787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:07.975984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:07.976014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.976019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.976019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.976020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.976020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.976021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.976021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.976022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.976023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.976023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.976024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.976024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.976027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.976033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.976036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.976038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.976040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.976042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.976043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.976045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.976047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.976050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.976051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.976053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.976057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.976061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:07.976064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.976067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:07.976070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.976073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:07.976075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.976078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:07.976080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.976083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:07.976085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.976088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:07.976090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.976093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:07.976095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.976097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:07.976100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.976102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:07.976104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.976107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.976110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.976113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.976119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.976122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.976140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:07.977119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.977164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:07.977173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3071
2025-10-02T09:36:07.977267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:07.977288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:07.977296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:07.977299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:07.977624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3071 sessionId:  describe result for acl check
2025-10-02T09:36:07.977650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:07.977655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:07.977657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:07.977660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:07.978083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:07.979495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:07.982973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:07.982982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:07.982985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555871016236311:7902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:07.982989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:07.983516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:07.985231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:07.985243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:07.985244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:07.985246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:07.985249Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3070 [2:7556555870940653062:11552]
2025-10-02T09:36:07.985255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:07.985265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:07.985266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.985268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.985269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.985277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:07.985280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:07.985286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:07.985315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.985320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.985322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.985324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:07.985325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:07.985359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:07.985364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:07.985370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:07.985375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:07.985383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:07.985397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236346:7902], now have 1 active actors on pipe
2025-10-02T09:36:07.985401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555871016236185:2446], now have 1 active actors on pipe
2025-10-02T09:36:07.985404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:07.985405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:07.985407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:07.985416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:07.985423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:07.985431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:07.985433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:07.985433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:07.985434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:07.985434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:07.985448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:07.985451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:07.985452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:07.985455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3070
2025-10-02T09:36:07.985463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3070
2025-10-02T09:36:07.985482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.985487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.985501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|857f4037-41fe7260-78b3ac81-f89ab259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:07.985508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:07.985510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:07.985512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:07.985517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:07.985522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:07.985528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.985650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:07.985659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:07.985672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:07.985746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3071 partition: 0 MaxSeqNo: 36 sessionId: src_id|857f4037-41fe7260-78b3ac81-f89ab259_0
2025-10-02T09:36:07.985951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabec713-d23a35bf-d075f26b-19595bb2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|857f4037-41fe7260-78b3ac81-f89ab259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:07.988397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Write session: try to update token
2025-10-02T09:36:07.988410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:07.988946Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 30 CurrentSessionLifetimeMs: 481514 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:36:07.994249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:07.994261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:07.994264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:07.994283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:07.994288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:07.994429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:07.994551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.994669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.994786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:07.994959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:07.994985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:08.000947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId: src_id|857f4037-41fe7260-78b3ac81-f89ab259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.002626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.002637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.002638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.002639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.002643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:08.002645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:08.002647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555870940653057:11552]
2025-10-02T09:36:08.002666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.002670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.002669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.002671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.002672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.002674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.002803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.003079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.066591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311203653:6976]
2025-10-02T09:36:08.066780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3070, pipe: [1:7556555875311203653:6976]
2025-10-02T09:36:08.112401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.112648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.112660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.112674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311203653:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.112842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.112863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311203653:6976]
2025-10-02T09:36:08.112893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.112897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:08.112901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:08.112984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3071 reason: error at write: Disconnected sessionId: src_id|857f4037-41fe7260-78b3ac81-f89ab259_0
2025-10-02T09:36:08.113133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3071 sessionId: src_id|857f4037-41fe7260-78b3ac81-f89ab259_0 is DEAD
2025-10-02T09:36:08.113275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:08.113280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Write session will restart in 0.009458s
2025-10-02T09:36:08.113299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Write session: Do CDS request
2025-10-02T09:36:08.113306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.120258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.121499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.121598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.121605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.121611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.121636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.121659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235620524:11554]
2025-10-02T09:36:08.122028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.122223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.122251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.122442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.122477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.122481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.122481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.122482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.122483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.122483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.122484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.122484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.122485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.122485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.122486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.122486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.122489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.122495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.122497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.122499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.122501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.122503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.122505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.122507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.122509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.122511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.122513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.122515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.122519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.122523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.122526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.122528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.122531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.122533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.122535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.122538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.122540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.122543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.122545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.122548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.122550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.122553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.122555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.122558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.122560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.122565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.122570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.122573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.122575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.122578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.122589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.122594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.122611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.124210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.124234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.124245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3072
2025-10-02T09:36:08.124361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.124383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.124389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.124391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.124692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3072 sessionId:  describe result for acl check
2025-10-02T09:36:08.124717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.124722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.124723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.124727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.125153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.126477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.129488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.129496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.129499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311203782:7906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.129503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.130043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.131705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.131715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.131717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.131719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.131723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3071 [2:7556555875235620524:11554]
2025-10-02T09:36:08.131729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.131738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.131740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.131741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.131742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.131751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.131757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.131761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.131789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.131794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.131795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.131797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.131798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.131835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.131840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.131847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.131853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.131861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.131872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311203816:7906], now have 1 active actors on pipe
2025-10-02T09:36:08.131877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311203654:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.131881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.131882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.131884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.131891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.131898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.131907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.131908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.131910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.131911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.131913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.131926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.131928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.131929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.131940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3071
2025-10-02T09:36:08.131944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3071
2025-10-02T09:36:08.131982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.131988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.132004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.132009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.132012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.132013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.132017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.132022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.132035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.132165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.132172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.132181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.132244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3072 partition: 0 MaxSeqNo: 36 sessionId: src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0
2025-10-02T09:36:08.132453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|857f4037-41fe7260-78b3ac81-f89ab259_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.134856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Write session: try to update token
2025-10-02T09:36:08.134869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.140706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:08.140719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.140722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.140743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:08.140747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:08.140900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:08.141026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.141147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.141273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.141443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:08.141468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:08.147075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId: src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.149050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.149060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.149061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.149062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.149067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.149069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.149071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235620516:11554]
2025-10-02T09:36:08.149094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.149096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.149099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.149101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.149103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.149105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.149181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.149212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.213028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311203846:6976]
2025-10-02T09:36:08.213196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3071, pipe: [1:7556555875311203846:6976]
2025-10-02T09:36:08.260454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.260796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.260815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.260831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311203846:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.260995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.261056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.261056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:08.261061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:08.261127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311203846:6976]
2025-10-02T09:36:08.261135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3072 reason: error at write: Disconnected sessionId: src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0
2025-10-02T09:36:08.261291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3072 sessionId: src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0 is DEAD
2025-10-02T09:36:08.261422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:08.261429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Write session will restart in 0.009474s
2025-10-02T09:36:08.261454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Write session: Do CDS request
2025-10-02T09:36:08.261460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.268146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.269294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.269471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.269480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.269487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.269524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.269548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235620731:11570]
2025-10-02T09:36:08.269939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.270130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.270157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.270350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.270385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.270391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.270391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.270392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.270393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.270394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.270394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.270395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.270396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.270396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.270397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.270398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.270402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.270411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.270414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.270418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.270421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.270425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.270428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.270432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.270435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.270437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.270439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.270441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.270446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.270454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.270458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.270462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.270464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.270467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.270469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.270472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.270474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.270476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.270480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.270484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.270486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.270489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.270491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.270493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.270496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.270498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.270502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.270504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.270507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.270509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.270512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.270516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.270532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.272182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.272321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.272334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3073
2025-10-02T09:36:08.272424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.272447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.272455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.272458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.272784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3073 sessionId:  describe result for acl check
2025-10-02T09:36:08.272830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.272838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.272839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.272844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.273214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.275259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.277365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.277375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.277377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311203987:7928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.277382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.277890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.279470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.279483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.279486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.279488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.279492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3072 [2:7556555875235620731:11570]
2025-10-02T09:36:08.279499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.279509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.279510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.279511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.279512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.279520Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.279523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.279528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.279572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.279578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.279580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.279582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.279584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.279621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.279625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.279632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.279637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.279646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.279659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311203847:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.279663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204021:7928], now have 1 active actors on pipe
2025-10-02T09:36:08.279666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.279667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.279668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.279679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.279686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.279695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.279698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.279698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.279699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.279699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.279712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.279707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3072
2025-10-02T09:36:08.279717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.279720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.279720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3072
2025-10-02T09:36:08.279738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.279743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.279758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.279765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.279767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.279768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.279773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.279778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.279785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.279922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.279929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.279938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.280013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3073 partition: 0 MaxSeqNo: 36 sessionId: src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0
2025-10-02T09:36:08.280236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637c495-b05dfdd-814ec207-c8aa1d9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.282534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Write session: try to update token
2025-10-02T09:36:08.282548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.288494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:08.288507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.288510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.288529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:08.288533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:08.288667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:08.288788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.288940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.289058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:08.289223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:08.289247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:08.294159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId: src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.296215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.296760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.296774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.296782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.296783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.296784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.296785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.296789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.296790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.296792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235620726:11570]
2025-10-02T09:36:08.296814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.296817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.296819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.296826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.296829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.296830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.296947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.361508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311204031:6976]
2025-10-02T09:36:08.361705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3072, pipe: [1:7556555875311204031:6976]
2025-10-02T09:36:08.406191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.406459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:08.406482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204031:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.406588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:08.406610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.406649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311204031:6976]
2025-10-02T09:36:08.406693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:08.406699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:08.406764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3073 reason: error at write: Disconnected sessionId: src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0
2025-10-02T09:36:08.407210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3073 sessionId: src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0 is DEAD
2025-10-02T09:36:08.407341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:08.407347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Write session will restart in 0.007366s
2025-10-02T09:36:08.407365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Write session: Do CDS request
2025-10-02T09:36:08.407371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.414048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.415240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.415348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.415355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.415361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.415387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.415421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235620895:11573]
2025-10-02T09:36:08.415783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.415974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.416002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.416166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.416188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.416245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.416257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3074
2025-10-02T09:36:08.416310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.416319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.416320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.416321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.416322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.416323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.416324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.416324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.416325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.416337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.416326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.416327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.416328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.416334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.416344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.416348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.416351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.416355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.416358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.416361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.416364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.416359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.416366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.416367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.416369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.416372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.416375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.416378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.416393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.416402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.416405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.416410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.416412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.416415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.416417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.416420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.416422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.416425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.416429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.416431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.416433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.416436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.416438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.416440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.416442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.416445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.416447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.416449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.416451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.416454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.416456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.416459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.416476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.416711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3074 sessionId:  describe result for acl check
2025-10-02T09:36:08.416742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.416746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.416750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.416754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.417184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.418749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.422588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.422596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.422598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311204161:7943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.422604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.423845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.425308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.425321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.425323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.425325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.425328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3073 [2:7556555875235620895:11573]
2025-10-02T09:36:08.425335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.425345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.425346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.425347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.425349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.425356Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.425361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.425365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.425396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.425401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.425403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.425404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.425406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.425442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.425447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.425456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.425465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.425483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.425502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204196:7943], now have 1 active actors on pipe
2025-10-02T09:36:08.425508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204032:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.425512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.425513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.425514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.425522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.425529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.425537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.425538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.425539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.425540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.425540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.425540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3073
2025-10-02T09:36:08.425543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3073
2025-10-02T09:36:08.425555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.425560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.425561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.425583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.425590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.425616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f85be99d-cc7ca34d-578b584d-3472639f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.425622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.425624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.425626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.425630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.425636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.425650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.425783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.425790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.425800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.425865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3074 partition: 0 MaxSeqNo: 36 sessionId: src_id|f85be99d-cc7ca34d-578b584d-3472639f_0
2025-10-02T09:36:08.426071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aebb5ad5-f815b6ef-d8f3b729-81257c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f85be99d-cc7ca34d-578b584d-3472639f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.428355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Write session: try to update token
2025-10-02T09:36:08.428372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.434535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.434548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.434549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.434550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.434555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.434558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.434559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235620890:11573]
2025-10-02T09:36:08.434577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.434580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.434581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.434583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.434588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.434590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.434709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.440103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId: src_id|f85be99d-cc7ca34d-578b584d-3472639f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.442264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.506935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311204203:6976]
2025-10-02T09:36:08.507127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3073, pipe: [1:7556555875311204203:6976]
2025-10-02T09:36:08.544755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.545032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.545041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.545055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204203:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.545172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.545284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.545297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311204203:6976]
2025-10-02T09:36:08.545340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:08.545430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3074 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f85be99d-cc7ca34d-578b584d-3472639f_0
2025-10-02T09:36:08.545590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3074 sessionId: src_id|f85be99d-cc7ca34d-578b584d-3472639f_0 is DEAD
2025-10-02T09:36:08.545767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:08.545783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Write session will restart in 0.005675s
2025-10-02T09:36:08.545811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Write session: Do CDS request
2025-10-02T09:36:08.545819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.552178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.552262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.552273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3075
2025-10-02T09:36:08.552366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.552390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.552397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.552400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.552721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3075 sessionId:  describe result for acl check
2025-10-02T09:36:08.552760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.552765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.552766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.552771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.552964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.553251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.554202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.554315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.554322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.554328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.554353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.554376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235621059:11575]
2025-10-02T09:36:08.554821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.554991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.555024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.555062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.555208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.555241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.555245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.555246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.555246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.555247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.555247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.555248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.555249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.555249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.555250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.555250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.555251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.555254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.555260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.555262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.555265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.555267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.555269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.555271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.555273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.555275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.555277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.555279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.555281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.555285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.555289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.555292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.555295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.555297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.555299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.555302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.555304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.555306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.555309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.555311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.555314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.555316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.555319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.555321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.555324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.555326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.555330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.555332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.555335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.555337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.555340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.555342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.555345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.555361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.560208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.560220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.560223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311204330:7955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.560228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.563013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.564757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.564772Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.564774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.564778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.564783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3074 [2:7556555875235621059:11575]
2025-10-02T09:36:08.564792Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.564820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.564827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.564830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.564831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.564843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.564852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.564862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.564902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.564909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.564912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.564914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.564916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.564963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.564970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.564981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.564996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.565016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.565035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204205:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.565044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204369:7955], now have 1 active actors on pipe
2025-10-02T09:36:08.565053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.565055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.565058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.565068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.565082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.565084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.565086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.565062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3074
2025-10-02T09:36:08.565087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.565065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3074
2025-10-02T09:36:08.565100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.565102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.565132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.565139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.565149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.565160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.565175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.565189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f579572-6d35206-a3945e2f-4826d13f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.565198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.565206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.565212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.565220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.565231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.565251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.565397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.565406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.565418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.565490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3075 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f579572-6d35206-a3945e2f-4826d13f_0
2025-10-02T09:36:08.565723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85be99d-cc7ca34d-578b584d-3472639f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f579572-6d35206-a3945e2f-4826d13f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.568003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Write session: try to update token
2025-10-02T09:36:08.568015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.574348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.574365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.574366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.574367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.574371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.574373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.574375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235621054:11575]
2025-10-02T09:36:08.574397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.574400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.574401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.574402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.574405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.574407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.574518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.579970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId: src_id|6f579572-6d35206-a3945e2f-4826d13f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.582028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.645702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311204377:6976]
2025-10-02T09:36:08.645926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3074, pipe: [1:7556555875311204377:6976]
2025-10-02T09:36:08.684607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.684973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.684984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.684996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204377:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.685159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.685182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.685215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311204377:6976]
2025-10-02T09:36:08.685226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:08.685307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3075 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f579572-6d35206-a3945e2f-4826d13f_0
2025-10-02T09:36:08.685460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3075 sessionId: src_id|6f579572-6d35206-a3945e2f-4826d13f_0 is DEAD
2025-10-02T09:36:08.685606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:08.685616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Write session will restart in 0.007727s
2025-10-02T09:36:08.685639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Write session: Do CDS request
2025-10-02T09:36:08.685644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.692884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.694090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.694128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.694193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.694200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.694206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.694230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.694213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.694222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3076
2025-10-02T09:36:08.694270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235621223:11577]
2025-10-02T09:36:08.694298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.694319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.694328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.694331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.694617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.694670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3076 sessionId:  describe result for acl check
2025-10-02T09:36:08.694700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.694705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.694707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.694711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.694797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.694822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.694999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.695028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.695032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.695033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.695034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.695034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.695035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.695035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.695036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.695036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.695037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.695037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.695038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.695041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.695048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.695050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.695052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.695054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.695056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.695058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.695060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.695062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.695065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.695067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.695069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.695073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.695077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.695080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.695083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.695085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.695088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.695090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.695093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.695096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.695099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.695101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.695104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.695106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.695109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.695111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.695114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.695116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.695121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.695124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.695127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.695129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.695135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.695137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.695139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.695134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.695158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.696862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.701339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.701350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.701353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311204506:7957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.701359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.702556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.704132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.704143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.704144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.704147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.704151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3075 [2:7556555875235621223:11577]
2025-10-02T09:36:08.704157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.704167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.704170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.704172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.704173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.704182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.704189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.704193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.704225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.704230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.704232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.704233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.704235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.704269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.704274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.704280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.704285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.704296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.704310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204545:7957], now have 1 active actors on pipe
2025-10-02T09:36:08.704316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204379:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.704320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.704321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.704324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.704334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.704344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.704345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.704347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.704348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.704356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.704357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.704356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3075
2025-10-02T09:36:08.704357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3075
2025-10-02T09:36:08.704371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.704376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.704378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.704390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.704394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.704421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.704429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.704432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.704433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.704438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.704446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.704456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.704554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.704561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.704569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.704628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3076 partition: 0 MaxSeqNo: 36 sessionId: src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0
2025-10-02T09:36:08.704848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f579572-6d35206-a3945e2f-4826d13f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.707248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Write session: try to update token
2025-10-02T09:36:08.707262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.713375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.713387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.713388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.713389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.713393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.713395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.713397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235621218:11577]
2025-10-02T09:36:08.713417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.713420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.713421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.713424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.713426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.713430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.713534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.718852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId: src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.720871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.785460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311204552:6976]
2025-10-02T09:36:08.785680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3075, pipe: [1:7556555875311204552:6976]
2025-10-02T09:36:08.822810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.823116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.823126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.823138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204552:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.823323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.823355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:08.823359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:08.823374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311204552:6976]
2025-10-02T09:36:08.823423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3076 reason: error at write: Disconnected sessionId: src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0
2025-10-02T09:36:08.823517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.823571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3076 sessionId: src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0 is DEAD
2025-10-02T09:36:08.823714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:08.823719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Write session will restart in 0.005276s
2025-10-02T09:36:08.823739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Write session: Do CDS request
2025-10-02T09:36:08.823744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.830125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.830231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.830242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3077
2025-10-02T09:36:08.830330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.830353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.830360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.830363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.830715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3077 sessionId:  describe result for acl check
2025-10-02T09:36:08.830745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.830751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.830752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.830757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.831193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.831260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.832462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.832513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.832562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.832568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.832574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.832599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.832631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235621389:11579]
2025-10-02T09:36:08.832987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.833166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.833189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.833363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.833392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.833397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.833397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.833398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.833398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.833399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.833400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.833400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.833401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.833401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.833402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.833405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.833411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.833413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.833415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.833417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.833419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.833421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.833423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.833425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.833427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.833429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.833431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.833435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.833438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.833442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.833445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.833447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.833450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.833452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.833454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.833457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.833459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.833461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.833464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.833466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.833469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.833471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.833474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.833476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.833479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.833481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.833484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.833486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.833489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.833491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.833493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.833509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.837420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.837430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.837432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311204679:7978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.837436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.840992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.842488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.842499Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.842500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.842502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.842506Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3076 [2:7556555875235621389:11579]
2025-10-02T09:36:08.842512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.842522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.842527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.842528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.842530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.842538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.842543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.842547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.842577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.842581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.842583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.842584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.842586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.842623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.842629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.842635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.842640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.842650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.842664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204720:7978], now have 1 active actors on pipe
2025-10-02T09:36:08.842670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204553:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.842674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.842675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.842677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.842684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.842692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.842696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.842698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.842699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.842700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.842702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.842715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.842720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.842722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.842750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3076
2025-10-02T09:36:08.842768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3076
2025-10-02T09:36:08.842806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.842812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.842830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65ed67a0-e4a1729-74e2f342-9879c841_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.842837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.842839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.842840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.842845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.842854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.842863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.842987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.842992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.842999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.843061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3077 partition: 0 MaxSeqNo: 36 sessionId: src_id|65ed67a0-e4a1729-74e2f342-9879c841_0
2025-10-02T09:36:08.843283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f409bf51-4d1d3c7e-aa692175-a939cfbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65ed67a0-e4a1729-74e2f342-9879c841_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.845627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Write session: try to update token
2025-10-02T09:36:08.845640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.851848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.851861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.851862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.851863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.851867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.851869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.851872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235621384:11579]
2025-10-02T09:36:08.851890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.851893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.851894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.851897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.851901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.851903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.852093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.857662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId: src_id|65ed67a0-e4a1729-74e2f342-9879c841_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.859872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:08.923691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555875311204733:6976]
2025-10-02T09:36:08.923899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3076, pipe: [1:7556555875311204733:6976]
2025-10-02T09:36:08.961766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:08.962027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.962037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.962050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204733:6976], now have 1 active actors on pipe
2025-10-02T09:36:08.962189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:08.962249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:08.962250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555875311204733:6976]
2025-10-02T09:36:08.962277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:08.962359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3077 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65ed67a0-e4a1729-74e2f342-9879c841_0
2025-10-02T09:36:08.962513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3077 sessionId: src_id|65ed67a0-e4a1729-74e2f342-9879c841_0 is DEAD
2025-10-02T09:36:08.962662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:08.962673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Write session will restart in 0.008213s
2025-10-02T09:36:08.962695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Write session: Do CDS request
2025-10-02T09:36:08.962700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:08.969775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:08.970914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:08.971068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:08.971076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:08.971082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:08.971112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:08.971135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555875235621556:11581]
2025-10-02T09:36:08.971469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:08.971645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:08.971668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:08.971843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:08.971870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.971874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.971875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.971876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.971876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.971877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.971877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.971878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.971878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.971879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.971879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.971880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.971883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.971889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.971891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.971893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.971895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.971897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.971899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.971901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.971903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.971905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.971907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.971909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.971912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.971916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:08.971919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.971922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:08.971926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.971929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:08.971931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.971933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:08.971936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.971938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:08.971941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.971944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:08.971946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.971948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:08.971950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.971953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:08.971955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.971957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:08.971959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.971962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.971965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.971971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.971973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.971976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.971992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:08.972160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.972236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:08.972246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3078
2025-10-02T09:36:08.972331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:08.972353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:08.972360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:08.972364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:08.972700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3078 sessionId:  describe result for acl check
2025-10-02T09:36:08.972727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:08.972733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:08.972734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:08.972738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:08.973168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:08.974802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:08.978790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:08.978799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:08.978802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555875311204869:7995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:08.978806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:08.979339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:08.980841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:08.980849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:08.980851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:08.980852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:08.980856Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3077 [2:7556555875235621556:11581]
2025-10-02T09:36:08.980864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:08.980874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:08.980878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.980880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.980881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.980890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:08.980893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:08.980897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:08.980930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.980935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.980936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.980938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:08.980940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:08.980974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:08.980978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.980985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:08.980990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:08.981001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:08.981014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204736:2446], now have 1 active actors on pipe
2025-10-02T09:36:08.981019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555875311204904:7995], now have 1 active actors on pipe
2025-10-02T09:36:08.981023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.981024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.981025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.981033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:08.981044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:08.981049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:08.981051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:08.981052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:08.981054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:08.981056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:08.981070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.981073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3077
2025-10-02T09:36:08.981077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3077
2025-10-02T09:36:08.981075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:08.981076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:08.981108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.981113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.981128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3da62eb-9ee0d410-d70887af-839efed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:08.981134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:08.981136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:08.981137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:08.981142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:08.981151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:08.981162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.981285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:08.981289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:08.981297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:08.981355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3078 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3da62eb-9ee0d410-d70887af-839efed4_0
2025-10-02T09:36:08.981557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65ed67a0-e4a1729-74e2f342-9879c841_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3da62eb-9ee0d410-d70887af-839efed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:08.983927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Write session: try to update token
2025-10-02T09:36:08.983939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:08.990027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:08.990040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:08.990041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:08.990042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:08.990046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.990048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.990050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555875235621551:11581]
2025-10-02T09:36:08.990070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:08.990076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:08.990076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:08.990077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:08.990078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:08.990080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:08.990209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:08.995628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId: src_id|a3da62eb-9ee0d410-d70887af-839efed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:08.997718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.062449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606172211:6976]
2025-10-02T09:36:09.062642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3077, pipe: [1:7556555879606172211:6976]
2025-10-02T09:36:09.099086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.099337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.099347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.099360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172211:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.099495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.099567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.099567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606172211:6976]
2025-10-02T09:36:09.099596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:09.099694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3078 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3da62eb-9ee0d410-d70887af-839efed4_0
2025-10-02T09:36:09.099847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3078 sessionId: src_id|a3da62eb-9ee0d410-d70887af-839efed4_0 is DEAD
2025-10-02T09:36:09.099962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:09.099970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Write session will restart in 0.009662s
2025-10-02T09:36:09.099995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Write session: Do CDS request
2025-10-02T09:36:09.100002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.107476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.108597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.108714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.108721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.108727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.108757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.108779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589019:11583]
2025-10-02T09:36:09.109139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.109320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.109343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.109518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.109544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.109548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.109549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.109549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.109550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.109550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.109551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.109552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.109552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.109553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.109553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.109554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.109557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.109564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.109566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.109568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.109570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.109573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.109575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.109577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.109579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.109581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.109583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.109585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.109590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.109594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.109597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.109600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.109602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.109605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.109607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.109610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.109612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.109615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.109617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.109620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.109622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.109625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.109629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.109633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.109635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.109638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.109640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.109642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.109645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.109647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.109653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.109656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.109682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.110142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.110244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.110253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3079
2025-10-02T09:36:09.110346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.110368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.110372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.110376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.110720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3079 sessionId:  describe result for acl check
2025-10-02T09:36:09.110747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.110748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.110749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.110753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.111166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.112549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.116661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.116670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.116673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606172346:7991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.116678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.117219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.118710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.118722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.118723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.118725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.118729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3078 [2:7556555879530589019:11583]
2025-10-02T09:36:09.118735Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.118746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.118751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.118754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.118755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.118773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.118776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.118780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.118807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.118812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.118813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.118815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.118817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.118852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.118857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.118864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.118869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.118877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.118892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172381:7991], now have 1 active actors on pipe
2025-10-02T09:36:09.118898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172212:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.118901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.118903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.118904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.118911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.118922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.118927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.118929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.118931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.118931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.118932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.118928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3078
2025-10-02T09:36:09.118945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.118931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3078
2025-10-02T09:36:09.118952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.118953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.118968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.118973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.119035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61bf8020-9827b5dd-e69978c5-906296d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.119043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.119045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.119046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.119051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.119057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.119074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.119206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.119211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.119219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.119281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3079 partition: 0 MaxSeqNo: 36 sessionId: src_id|61bf8020-9827b5dd-e69978c5-906296d6_0
2025-10-02T09:36:09.119474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da62eb-9ee0d410-d70887af-839efed4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61bf8020-9827b5dd-e69978c5-906296d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.121850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Write session: try to update token
2025-10-02T09:36:09.121865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.128063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.128078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.128079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.128080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.128083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.128085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.128087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589014:11583]
2025-10-02T09:36:09.128107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.128110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.128111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.128112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.128115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.128117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.128223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.133967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId: src_id|61bf8020-9827b5dd-e69978c5-906296d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.136028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.199639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606172402:6976]
2025-10-02T09:36:09.199836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3078, pipe: [1:7556555879606172402:6976]
2025-10-02T09:36:09.236721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.237023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.237033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.237045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172402:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.237182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.237219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:09.237232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:09.237232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.237271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606172402:6976]
2025-10-02T09:36:09.237288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3079 reason: error at write: Disconnected sessionId: src_id|61bf8020-9827b5dd-e69978c5-906296d6_0
2025-10-02T09:36:09.237425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3079 sessionId: src_id|61bf8020-9827b5dd-e69978c5-906296d6_0 is DEAD
2025-10-02T09:36:09.237543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:09.237561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Write session will restart in 0.009552s
2025-10-02T09:36:09.237580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Write session: Do CDS request
2025-10-02T09:36:09.237585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.244988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.246271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.246368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.246375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.246381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.246405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.246428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589238:11599]
2025-10-02T09:36:09.247044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.247225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.247247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.247446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.247474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.247478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.247478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.247479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.247480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.247480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.247481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.247482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.247482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.247483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.247484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.247484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.247487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.247494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.247496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.247498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.247500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.247502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.247504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.247506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.247508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.247510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.247512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.247514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.247518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.247522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.247525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.247528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.247531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.247534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.247536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.247539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.247541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.247543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.247545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.247548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.247550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.247553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.247556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.247559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.247561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.247563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.247565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.247568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.247570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.247573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.247575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.247577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.247595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.248107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.248209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.248220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3080
2025-10-02T09:36:09.248302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.248325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.248329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.248331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.248658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3080 sessionId:  describe result for acl check
2025-10-02T09:36:09.248679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.248684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.248685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.248689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.249096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.251001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.254444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.254454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.254456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606172547:8019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.254460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.254940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.256475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.256486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.256488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.256490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.256493Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3079 [2:7556555879530589238:11599]
2025-10-02T09:36:09.256500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.256511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.256514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.256515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.256516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.256525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.256527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.256531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.256561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.256566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.256567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.256568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.256570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.256606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.256611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.256618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.256623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.256633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.256646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172581:8019], now have 1 active actors on pipe
2025-10-02T09:36:09.256650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172412:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.256654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.256655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.256657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.256665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.256673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.256682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.256684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.256685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.256686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.256687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.256686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3079
2025-10-02T09:36:09.256687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3079
2025-10-02T09:36:09.256700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.256705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.256711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.256721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.256726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.256820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.256828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.256830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.256831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.256836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.256841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.256854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.256978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.256983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.256990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.257044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3080 partition: 0 MaxSeqNo: 36 sessionId: src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0
2025-10-02T09:36:09.257226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bf8020-9827b5dd-e69978c5-906296d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.259593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Write session: try to update token
2025-10-02T09:36:09.259605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.265649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.265661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.265662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.265663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.265666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.265669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.265671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589233:11599]
2025-10-02T09:36:09.265690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.265693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.265694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.265698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.265701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.265703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.265797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.271547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId: src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.273569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.337362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606172603:6976]
2025-10-02T09:36:09.337617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3079, pipe: [1:7556555879606172603:6976]
2025-10-02T09:36:09.375636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.375927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.375936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.375949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172603:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.376084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.376097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:09.376113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:09.376114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606172603:6976]
2025-10-02T09:36:09.376136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.376182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3080 reason: error at write: Disconnected sessionId: src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0
2025-10-02T09:36:09.376334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3080 sessionId: src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0 is DEAD
2025-10-02T09:36:09.376466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:09.376473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Write session will restart in 0.009389s
2025-10-02T09:36:09.376499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Write session: Do CDS request
2025-10-02T09:36:09.376505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.383914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.385060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.385233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.385242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.385249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.385280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.385304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589408:11601]
2025-10-02T09:36:09.385650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.385813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.385836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.386023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.386051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.386055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.386055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.386056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.386057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.386057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.386058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.386059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.386059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.386060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.386060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.386061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.386063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.386071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.386073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.386075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.386077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.386079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.386080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.386082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.386084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.386086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.386088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.386090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.386094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.386098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.386102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.386105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.386107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.386110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.386112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.386115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.386117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.386119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.386123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.386129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.386131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.386133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.386136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.386138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.386141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.386143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.386145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.386151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.386155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.386160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.386162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.386165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.386182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.387152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.387322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.387337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3081
2025-10-02T09:36:09.387441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.387470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.387481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.387489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.387836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3081 sessionId:  describe result for acl check
2025-10-02T09:36:09.387862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.387868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.387869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.387873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.388278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.390065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.392993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.393004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.393007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606172742:8033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.393012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.393509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.395062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.395073Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.395074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.395076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.395079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3080 [2:7556555879530589408:11601]
2025-10-02T09:36:09.395087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.395097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.395099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.395100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.395101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.395110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.395116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.395121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.395154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.395159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.395160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.395162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.395163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.395198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.395202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.395208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.395214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.395225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.395239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172776:8033], now have 1 active actors on pipe
2025-10-02T09:36:09.395244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172605:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.395247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.395249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.395250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.395258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.395266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.395271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.395274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.395275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.395279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.395280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.395289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.395294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.395295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.395287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3080
2025-10-02T09:36:09.395290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3080
2025-10-02T09:36:09.395346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.395351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.395366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.395373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.395375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.395376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.395380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.395386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.395396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.395508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.395512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.395520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.395581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3081 partition: 0 MaxSeqNo: 36 sessionId: src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0
2025-10-02T09:36:09.395802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbb03b8-89ad582e-4cddcab4-f421307a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.398243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Write session: try to update token
2025-10-02T09:36:09.398257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.404180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.404192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.404193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.404195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.404199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.404201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.404203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589403:11601]
2025-10-02T09:36:09.404223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.404225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.404228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.404229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.404230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.404231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.404344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.410383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId: src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.412471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.476144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606172783:6976]
2025-10-02T09:36:09.476324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3080, pipe: [1:7556555879606172783:6976]
2025-10-02T09:36:09.512609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.512884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.512893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.512905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172783:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.513046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.513056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.513099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:09.513099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606172783:6976]
2025-10-02T09:36:09.513183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3081 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0
2025-10-02T09:36:09.513336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3081 sessionId: src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0 is DEAD
2025-10-02T09:36:09.513445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:09.513451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Write session will restart in 0.007080s
2025-10-02T09:36:09.513471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Write session: Do CDS request
2025-10-02T09:36:09.513476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.520793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.521135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.521220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.521227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3082
2025-10-02T09:36:09.521326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.521347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.521354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.521356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.521676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3082 sessionId:  describe result for acl check
2025-10-02T09:36:09.521705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.521711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.521712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.521716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.521969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.522070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.522077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.522082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.522108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.522130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589580:11604]
2025-10-02T09:36:09.522135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.522471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.522635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.522657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.522844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.522872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.522876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.522877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.522878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.522878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.522879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.522880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.522882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.522883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.522883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.522884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.522884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.522887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.522894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.522896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.522898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.522900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.522902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.522904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.522906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.522908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.522910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.522912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.522914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.522918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.522922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.522925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.522928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.522930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.522933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.522935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.522938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.522940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.522943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.522945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.522948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.522950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.522953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.522956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.522959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.522961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.522964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.522966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.522968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.522971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.522973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.522977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.522979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.522996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.523695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.527713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.527722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.527724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606172918:8040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.527730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.530399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.531850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.531863Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.531864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.531866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.531870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3081 [2:7556555879530589580:11604]
2025-10-02T09:36:09.531876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.531886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.531890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.531892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.531893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.531901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.531905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.531910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.531940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.531945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.531946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.531948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.531949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.531986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.531991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.531997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.532003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.532011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.532023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172785:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.532029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172962:8040], now have 1 active actors on pipe
2025-10-02T09:36:09.532032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.532034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.532035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.532042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.532049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.532056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.532057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.532058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.532052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3081
2025-10-02T09:36:09.532060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.532068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3081
2025-10-02T09:36:09.532061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.532075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.532076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.532077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.532088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.532093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.532121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.532127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.532129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.532130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.532135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.532140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.532151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.532248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.532254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.532262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.532320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3082 partition: 0 MaxSeqNo: 36 sessionId: src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0
2025-10-02T09:36:09.532517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c8fc7f-590df04a-9cb74144-6d4c1a16_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.534786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Write session: try to update token
2025-10-02T09:36:09.534801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.541105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.541117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.541118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.541119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.541122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.541124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.541126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589575:11604]
2025-10-02T09:36:09.541145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.541148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.541149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.541149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.541153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.541155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.541258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.546625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId: src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.548748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.613364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606172973:6976]
2025-10-02T09:36:09.613574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3081, pipe: [1:7556555879606172973:6976]
2025-10-02T09:36:09.652558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.652823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.652834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.652847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172973:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.653010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.653068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.653074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:09.653120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606172973:6976]
2025-10-02T09:36:09.653159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3082 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0
2025-10-02T09:36:09.653304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3082 sessionId: src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0 is DEAD
2025-10-02T09:36:09.653445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:09.653457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Write session will restart in 0.006072s
2025-10-02T09:36:09.653478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Write session: Do CDS request
2025-10-02T09:36:09.653483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.660143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.660240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.660250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3083
2025-10-02T09:36:09.660349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.660370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.660377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.660380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.660623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.660722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3083 sessionId:  describe result for acl check
2025-10-02T09:36:09.660750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.660752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.660753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.660756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.661205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.661812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.661926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.661933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.661939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.661969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.661990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589752:11606]
2025-10-02T09:36:09.662337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.662492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.662514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.662691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.662722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.662727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.662727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.662727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.662728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.662729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.662729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.662730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.662730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.662731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.662731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.662732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.662735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.662741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.662743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.662745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.662747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.662749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.662751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.662753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.662755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.662757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.662759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.662761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.662772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.662775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.662779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.662782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.662786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.662789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.662791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.662794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.662796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.662799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.662801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.662803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.662806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.662808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.662810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.662813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.662815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.662818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.662820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.662823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.662825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.662828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.662830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.662832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.662848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.663030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.667623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.667634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.667636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606173107:8068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.667641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.670194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.671693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.671703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.671704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.671707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.671710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3082 [2:7556555879530589752:11606]
2025-10-02T09:36:09.671716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.671726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.671728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.671729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.671730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.671740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.671747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.671751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.671778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.671782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.671783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.671785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.671786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.671823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.671828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.671834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.671840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.671848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.671861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.671865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.671866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.671871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.671876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.671878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.671878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173147:8068], now have 1 active actors on pipe
2025-10-02T09:36:09.671879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.671881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606172974:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.671886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.671893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.671898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.671912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.671918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.671916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3082
2025-10-02T09:36:09.671932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3082
2025-10-02T09:36:09.671931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.671956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.671961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.671977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.671983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.671985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.671986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.671991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.671996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.672003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.672114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.672118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.672126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.672190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3083 partition: 0 MaxSeqNo: 36 sessionId: src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0
2025-10-02T09:36:09.672438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e1c73-cd7c23e9-b23c9b8-3021442d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.674730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Write session: try to update token
2025-10-02T09:36:09.674745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.680918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.680928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.680929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.680930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.680933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.680935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.680937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589747:11606]
2025-10-02T09:36:09.680954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.680958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.680958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.680959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.680960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.680964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.681066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.686182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId: src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.688202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.753220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606173159:6976]
2025-10-02T09:36:09.753424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3082, pipe: [1:7556555879606173159:6976]
2025-10-02T09:36:09.793099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.793395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.793404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.793417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173159:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.793535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.793560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:09.793575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:09.793577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606173159:6976]
2025-10-02T09:36:09.793599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.793635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3083 reason: error at write: Disconnected sessionId: src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0
2025-10-02T09:36:09.793766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3083 sessionId: src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0 is DEAD
2025-10-02T09:36:09.793935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:09.793946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Write session will restart in 0.008989s
2025-10-02T09:36:09.793970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Write session: Do CDS request
2025-10-02T09:36:09.793976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.801568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.802784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.802885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.802891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.802897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.802922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.802943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530589926:11608]
2025-10-02T09:36:09.803283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.803455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.803478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.803656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.803686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.803689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.803690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.803691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.803691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.803692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.803692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.803693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.803694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.803694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.803695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.803695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.803698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.803705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.803707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.803709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.803711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.803713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.803715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.803717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.803719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.803721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.803723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.803725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.803729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.803733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.803736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.803739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.803741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.803744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.803746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.803749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.803751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.803754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.803756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.803759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.803761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.803764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.803766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.803769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.803772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.803779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.803781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.803783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.803787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.803793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.803795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.803798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.803813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.804140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.804224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.804236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3084
2025-10-02T09:36:09.804332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.804356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.804364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.804367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.804702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3084 sessionId:  describe result for acl check
2025-10-02T09:36:09.804731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.804736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.804738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.804742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.805184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.806888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.810734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.810746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.810748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606173300:8072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.810753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.811234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.812816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.812826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.812827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.812830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.812833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3083 [2:7556555879530589926:11608]
2025-10-02T09:36:09.812839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.812849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.812851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.812853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.812854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.812863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.812866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.812870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.812902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.812907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.812908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.812910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.812911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.812948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.812953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.812959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.812964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.812976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.812989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173335:8072], now have 1 active actors on pipe
2025-10-02T09:36:09.812995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173161:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.812999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.813001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.813002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.813009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.813020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.813023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.813024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.813026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.813020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3083
2025-10-02T09:36:09.813031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.813032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.813047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.813047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3083
2025-10-02T09:36:09.813049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.813050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.813058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.813060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.813086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.813093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.813096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.813097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.813102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.813110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.813123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.813223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.813229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.813237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.813303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3084 partition: 0 MaxSeqNo: 36 sessionId: src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0
2025-10-02T09:36:09.813479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d263b-fe628d19-6c7439c2-8acf42c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.815721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Write session: try to update token
2025-10-02T09:36:09.815732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.822020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.822032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.822033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.822034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.822037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.822040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.822041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530589921:11608]
2025-10-02T09:36:09.822060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.822062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.822063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.822065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.822068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.822072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.822185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.827283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId: src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.829403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:09.893932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555879606173343:6976]
2025-10-02T09:36:09.894120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3083, pipe: [1:7556555879606173343:6976]
2025-10-02T09:36:09.930306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:09.930507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.930516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.930527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173343:6976], now have 1 active actors on pipe
2025-10-02T09:36:09.930642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:09.930681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:09.930691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555879606173343:6976]
2025-10-02T09:36:09.930693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:09.930705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:09.930761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3084 reason: error at write: Disconnected sessionId: src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0
2025-10-02T09:36:09.930913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3084 sessionId: src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0 is DEAD
2025-10-02T09:36:09.931061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:09.931072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Write session will restart in 0.005827s
2025-10-02T09:36:09.931092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Write session: Do CDS request
2025-10-02T09:36:09.931097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:09.938164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.938236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:09.938248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3085
2025-10-02T09:36:09.938354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:09.938378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:09.938385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:09.938389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:09.938454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:09.938785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3085 sessionId:  describe result for acl check
2025-10-02T09:36:09.938818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:09.938824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:09.938826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:09.938835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:09.939322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:09.939715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:09.939815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:09.939824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:09.939832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:09.939866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:09.939890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555879530590100:11610]
2025-10-02T09:36:09.940238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:09.940410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:09.940433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:09.940608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:09.940636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.940640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.940640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.940641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.940641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.940642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.940643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.940643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.940644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.940644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.940645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.940645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.940648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.940654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.940657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.940659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.940661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.940663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.940664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.940666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.940668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.940670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.940672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.940674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.940678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.940683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:09.940686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.940689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:09.940691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.940693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:09.940696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.940698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:09.940700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.940703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:09.940705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.940708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:09.940710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.940712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:09.940714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.940717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:09.940720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.940724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:09.940726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.940728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.940731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.940733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.940735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.940738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.940754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:09.941152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:09.945538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:09.945548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:09.945550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555879606173487:8078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:09.945556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:09.948084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:09.949700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:09.949712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:09.949713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:09.949715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:09.949718Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3084 [2:7556555879530590100:11610]
2025-10-02T09:36:09.949726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:09.949736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:09.949741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.949742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.949743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.949753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:09.949759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:09.949763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:09.949793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.949798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.949799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.949801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:09.949803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:09.949838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:09.949843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.949849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:09.949856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:09.949867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:09.949880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173524:8078], now have 1 active actors on pipe
2025-10-02T09:36:09.949886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555879606173351:2446], now have 1 active actors on pipe
2025-10-02T09:36:09.949889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.949891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.949892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.949899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:09.949906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:09.949911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:09.949913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:09.949914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:09.949916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:09.949917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:09.949918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3084
2025-10-02T09:36:09.949931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.949937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3084
2025-10-02T09:36:09.949936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:09.949937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:09.949952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.949957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.949973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:09.949980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:09.949982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:09.949983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:09.949988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:09.949992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:09.950004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.950112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:09.950117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:09.950124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:09.950185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3085 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0
2025-10-02T09:36:09.950436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a96a32ff-9ef78eb5-f1504dd7-1dc08edb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:09.952772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Write session: try to update token
2025-10-02T09:36:09.952786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:09.958962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:09.958972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:09.958974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:09.958975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:09.958978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.958980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.958984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555879530590095:11610]
2025-10-02T09:36:09.959012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:09.959013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:09.959017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:09.959019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:09.959021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:09.959024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:09.959133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:09.965256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId: src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:09.967391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.030620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901140832:6976]
2025-10-02T09:36:10.030835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3084, pipe: [1:7556555883901140832:6976]
2025-10-02T09:36:10.069214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.069542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.069552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.069564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901140832:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.069712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.069780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:10.069780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901140832:6976]
2025-10-02T09:36:10.069796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:10.069802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.069851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3085 reason: error at write: Disconnected sessionId: src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0
2025-10-02T09:36:10.069984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3085 sessionId: src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0 is DEAD
2025-10-02T09:36:10.070152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:10.070164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Write session will restart in 0.009869s
2025-10-02T09:36:10.070184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Write session: Do CDS request
2025-10-02T09:36:10.070190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.077415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.078604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.078711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.078719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.078725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.078750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.078787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825557570:11612]
2025-10-02T09:36:10.079128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.079296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.079319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.079492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.079521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.079525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.079525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.079526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.079526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.079527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.079527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.079528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.079528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.079529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.079530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.079530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.079533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.079539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.079541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.079543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.079545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.079547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.079549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.079551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.079553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.079555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.079557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.079559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.079562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.079566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.079570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.079572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.079574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.079577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.079579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.079582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.079584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.079586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.079588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.079591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.079593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.079596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.079598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.079601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.079603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.079606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.079607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.079611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.079613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.079615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.079617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.079620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.079637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.081151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.081284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.081301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3086
2025-10-02T09:36:10.081392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.081420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.081425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.081428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.081783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3086 sessionId:  describe result for acl check
2025-10-02T09:36:10.081819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.081827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.081828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.081833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.082343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.083968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.086584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.086594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.086596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901140975:8091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.086600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.087134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.088826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.088837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.088838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.088840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.088843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3085 [2:7556555883825557570:11612]
2025-10-02T09:36:10.088851Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.088861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.088866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.088868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.088869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.088878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.088884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.088888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.088920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.088925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.088926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.088928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.088930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.088963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.088968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.088974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.088982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.088993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.089008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141009:8091], now have 1 active actors on pipe
2025-10-02T09:36:10.089014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901140833:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.089020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.089025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.089027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.089038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.089049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.089050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.089052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.089053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.089059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.089061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.089043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3085
2025-10-02T09:36:10.089057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3085
2025-10-02T09:36:10.089079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.089085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.089090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.089093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.089095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.089115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.089122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.089125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.089126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.089131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.089139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.089156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.089261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.089267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.089277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.089352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3086 partition: 0 MaxSeqNo: 36 sessionId: src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0
2025-10-02T09:36:10.089559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7fe53b-fca4ddcd-e7c771e1-72d930c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.091838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Write session: try to update token
2025-10-02T09:36:10.091852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.098097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.098110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.098112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.098114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.098118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.098121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.098124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825557565:11612]
2025-10-02T09:36:10.098148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.098149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.098153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.098154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.098156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.098158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.098267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.103412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId: src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.105543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.169891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141016:6976]
2025-10-02T09:36:10.170073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3085, pipe: [1:7556555883901141016:6976]
2025-10-02T09:36:10.207667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.207849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.207857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.207869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141016:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.207975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.208021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.208031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:10.208063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141016:6976]
2025-10-02T09:36:10.208116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3086 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0
2025-10-02T09:36:10.208279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3086 sessionId: src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0 is DEAD
2025-10-02T09:36:10.208467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:10.208479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Write session will restart in 0.005241s
2025-10-02T09:36:10.208502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Write session: Do CDS request
2025-10-02T09:36:10.208507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.215123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.215208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.215219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3087
2025-10-02T09:36:10.215299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.215320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.215327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.215330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.215633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3087 sessionId:  describe result for acl check
2025-10-02T09:36:10.215657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.215661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.215663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.215667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.215810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.216084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.217055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.217152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.217159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.217164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.217189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.217212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825557789:11626]
2025-10-02T09:36:10.217444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.217570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.217731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.217754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.217936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.217969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.217973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.217974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.217974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.217975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.217975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.217976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.217976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.217977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.217977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.217978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.217978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.217981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.217987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.217989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.217992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.217994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.217996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.217997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.217999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.218001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.218003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.218005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.218007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.218011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.218014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.218018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.218021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.218024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.218027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.218031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.218035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.218039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.218045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.218053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.218056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.218062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.218064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.218066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.218069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.218071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.218074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.218076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.218079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.218085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.218088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.218090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.218096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.218113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.221929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.221940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.221943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901141155:8106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.221947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.227078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.227090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.227091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.227093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.227097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3086 [2:7556555883825557789:11626]
2025-10-02T09:36:10.227103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.227112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.227114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.227115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.227116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.227125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.227127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.227131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.227164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.227169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.227170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.227171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.227173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.227206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.227211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.227218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.227223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.227235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.227250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141198:8106], now have 1 active actors on pipe
2025-10-02T09:36:10.227257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141018:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.227262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.227268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.227270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.227280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.227290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.227291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.227293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.227294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.227301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.227303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.227294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3086
2025-10-02T09:36:10.227317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.227322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.227323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.227315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3086
2025-10-02T09:36:10.227332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.227337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.227362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|527bf418-1f224cad-e638c5fb-e545b851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.227370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.227374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.227375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.227380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.227389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.227401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.227487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.227493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.227501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.227559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3087 partition: 0 MaxSeqNo: 36 sessionId: src_id|527bf418-1f224cad-e638c5fb-e545b851_0
2025-10-02T09:36:10.227874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c4998a-3c5e6918-6bd2c30d-eae81fd6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|527bf418-1f224cad-e638c5fb-e545b851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.230149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Write session: try to update token
2025-10-02T09:36:10.230162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.236493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.236510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.236512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.236513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.236519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.236522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.236525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825557784:11626]
2025-10-02T09:36:10.236549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.236554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.236556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.236573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.236587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.236590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.236667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.242793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId: src_id|527bf418-1f224cad-e638c5fb-e545b851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.245159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.308129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141236:6976]
2025-10-02T09:36:10.308284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3086, pipe: [1:7556555883901141236:6976]
2025-10-02T09:36:10.346705Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.346942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.346952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.346964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141236:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.347130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141236:6976]
2025-10-02T09:36:10.347155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.347134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:10.347138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:10.347162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.347181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3087 reason: error at write: Disconnected sessionId: src_id|527bf418-1f224cad-e638c5fb-e545b851_0
2025-10-02T09:36:10.347315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3087 sessionId: src_id|527bf418-1f224cad-e638c5fb-e545b851_0 is DEAD
2025-10-02T09:36:10.347480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:10.347492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Write session will restart in 0.009520s
2025-10-02T09:36:10.347511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Write session: Do CDS request
2025-10-02T09:36:10.347516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.355211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.356566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.356672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.356678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.356684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.356711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.356746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825557972:11630]
2025-10-02T09:36:10.357141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.357332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.357361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.357555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.357595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.357599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.357600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.357600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.357601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.357601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.357602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.357603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.357603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.357604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.357604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.357605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.357608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.357614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.357616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.357618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.357621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.357623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.357625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.357627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.357629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.357631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.357633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.357635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.357639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.357642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.357646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.357648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.357651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.357654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.357656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.357659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.357661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.357664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.357669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.357672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.357674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.357677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.357679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.357682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.357684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.357687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.357689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.357694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.357700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.357702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.357706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.357722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.358155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.358507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.358521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3088
2025-10-02T09:36:10.358662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.358685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.358693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.358696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.359004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3088 sessionId:  describe result for acl check
2025-10-02T09:36:10.359034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.359040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.359041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.359044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.359402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.360889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.364797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.364822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.364824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901141384:8142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.364828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.365314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.366948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.366960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.366962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.366968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3087 [2:7556555883825557972:11630]
2025-10-02T09:36:10.366974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.366984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.366985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.366987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.366988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.366996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.367002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.367006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.367036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.367041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.367042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.367044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.367045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.367082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.367088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.367095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.367100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.367110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.367125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141419:8142], now have 1 active actors on pipe
2025-10-02T09:36:10.367129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141239:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.367133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.367134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.367135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.367143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.367151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.367156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.367143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3087
2025-10-02T09:36:10.367160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.367158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3087
2025-10-02T09:36:10.367161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.367169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.367177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.367189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.367194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.367203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.367214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.367226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.367230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.367234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.367237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.367238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.367243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.367249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.367263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.367371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.367376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.367384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.367448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3088 partition: 0 MaxSeqNo: 36 sessionId: src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0
2025-10-02T09:36:10.367701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|527bf418-1f224cad-e638c5fb-e545b851_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.370025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Write session: try to update token
2025-10-02T09:36:10.370039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.376260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.376273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.376274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.376275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.376279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.376281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.376283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825557967:11630]
2025-10-02T09:36:10.376301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.376305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.376306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.376306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.376309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.376311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.376416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.381888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId: src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.383928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.447441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141426:6976]
2025-10-02T09:36:10.447663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3087, pipe: [1:7556555883901141426:6976]
2025-10-02T09:36:10.486187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.486480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.486490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.486501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141426:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.486644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.486673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141426:6976]
2025-10-02T09:36:10.486685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.486699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:10.486755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0
2025-10-02T09:36:10.486881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3088 sessionId: src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0 is DEAD
2025-10-02T09:36:10.487017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:10.487029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Write session will restart in 0.005479s
2025-10-02T09:36:10.487053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Write session: Do CDS request
2025-10-02T09:36:10.487059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.493130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.493259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.493271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3089
2025-10-02T09:36:10.493384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.493408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.493416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.493419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.493716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3089 sessionId:  describe result for acl check
2025-10-02T09:36:10.493742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.493748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.493749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.493751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.494103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.494182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.495368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.495466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.495473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.495479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.495505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.495502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.495526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825558152:11633]
2025-10-02T09:36:10.495862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.496022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.496044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.496219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.496248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.496255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.496255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.496256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.496256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.496257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.496257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.496260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.496266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.496268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.496270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.496272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.496274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.496276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.496278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.496280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.496282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.496284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.496286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.496290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.496294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.496297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.496300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.496302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.496304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.496306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.496309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.496313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.496316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.496318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.496321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.496324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.496328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.496330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.496333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.496335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.496337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.496339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.496342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.496344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.496347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.496350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.496353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.496368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.500150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.500160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.500162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901141564:8145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.500166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.503738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.505323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.505335Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.505336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.505337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.505342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3088 [2:7556555883825558152:11633]
2025-10-02T09:36:10.505349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.505358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.505360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.505361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.505362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.505370Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.505373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.505381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.505411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.505415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.505416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.505418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.505420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.505453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.505458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.505464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.505470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.505479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.505493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141605:8145], now have 1 active actors on pipe
2025-10-02T09:36:10.505498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141427:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.505501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.505503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.505504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.505511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.505521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.505524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.505526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.505528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.505536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.505540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.505524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3088
2025-10-02T09:36:10.505556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.505561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.505562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.505542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3088
2025-10-02T09:36:10.505576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.505583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.505612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba45b89c-503a9b59-fb378677-10881473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.505619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.505621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.505622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.505626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.505631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.505640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.505747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.505752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.505759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.505825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3089 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba45b89c-503a9b59-fb378677-10881473_0
2025-10-02T09:36:10.506070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04a524a-4a3036a5-5a6642c7-9eb3e6a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba45b89c-503a9b59-fb378677-10881473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.508396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Write session: try to update token
2025-10-02T09:36:10.508409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.514592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.514605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.514607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.514608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.514611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.514613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.514615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825558147:11633]
2025-10-02T09:36:10.514635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.514637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.514638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.514639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.514643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.514645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.514757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.520342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId: src_id|ba45b89c-503a9b59-fb378677-10881473_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.522435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.586851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141614:6976]
2025-10-02T09:36:10.587086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3088, pipe: [1:7556555883901141614:6976]
2025-10-02T09:36:10.623525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.623837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.623846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.623859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141614:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.624045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:10.624059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:10.624081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.624106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3089 reason: error at write: Disconnected sessionId: src_id|ba45b89c-503a9b59-fb378677-10881473_0
2025-10-02T09:36:10.624239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141614:6976]
2025-10-02T09:36:10.624248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3089 sessionId: src_id|ba45b89c-503a9b59-fb378677-10881473_0 is DEAD
2025-10-02T09:36:10.624289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.624401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:10.624415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Write session will restart in 0.008267s
2025-10-02T09:36:10.624434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Write session: Do CDS request
2025-10-02T09:36:10.624439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.632129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.633337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.633433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.633440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.633445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.633470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.633494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825558331:11635]
2025-10-02T09:36:10.633843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.634011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.634034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.634196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.634208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.634238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.634243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.634243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.634244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.634245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.634245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.634246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.634246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.634247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.634247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.634250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.634256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.634258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.634260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.634262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.634264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.634266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.634268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.634270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.634272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.634274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.634276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.634280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.634283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.634286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.634289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.634291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.634279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.634294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.634296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.634291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3090
2025-10-02T09:36:10.634299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.634301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.634304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.634306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.634308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.634310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.634313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.634315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.634318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.634320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.634322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.634324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.634327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.634329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.634332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.634334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.634337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.634354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.634389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.634416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.634425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.634429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.634721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3090 sessionId:  describe result for acl check
2025-10-02T09:36:10.634747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.634752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.634753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.634756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.635114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.636796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.641196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.641205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.641207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901141760:8157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.641210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.641698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.643228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.643239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.643240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.643241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.643245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3089 [2:7556555883825558331:11635]
2025-10-02T09:36:10.643252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.643262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.643265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.643266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.643267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.643275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.643279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.643284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.643317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.643323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.643324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.643326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.643327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.643434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.643439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.643445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.643451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.643443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3089
2025-10-02T09:36:10.643459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.643458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3089
2025-10-02T09:36:10.643474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141795:8157], now have 1 active actors on pipe
2025-10-02T09:36:10.643479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141615:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.643484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.643485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.643486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.643491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.643497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.643499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.643500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.643503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.643511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.643515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.643530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.643535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.643554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.643562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.643570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.643570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d49281f6-11086a60-48fe3eff-771df7b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.643574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.643576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.643577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.643581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.643586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.643600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.643706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.643711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.643720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.643797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3090 partition: 0 MaxSeqNo: 36 sessionId: src_id|d49281f6-11086a60-48fe3eff-771df7b8_0
2025-10-02T09:36:10.644071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba45b89c-503a9b59-fb378677-10881473_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d49281f6-11086a60-48fe3eff-771df7b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.646290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Write session: try to update token
2025-10-02T09:36:10.646305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.652471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.652484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.652485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.652486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.652490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.652492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.652494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825558326:11635]
2025-10-02T09:36:10.652513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.652514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.652516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.652516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.652517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.652518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.652634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.657960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId: src_id|d49281f6-11086a60-48fe3eff-771df7b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.660099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.724395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141803:6976]
2025-10-02T09:36:10.724586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3089, pipe: [1:7556555883901141803:6976]
2025-10-02T09:36:10.760619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.760850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.760864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.760878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141803:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.761027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.761048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:10.761058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:10.761072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141803:6976]
2025-10-02T09:36:10.761093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.761107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3090 reason: error at write: Disconnected sessionId: src_id|d49281f6-11086a60-48fe3eff-771df7b8_0
2025-10-02T09:36:10.761250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3090 sessionId: src_id|d49281f6-11086a60-48fe3eff-771df7b8_0 is DEAD
2025-10-02T09:36:10.761568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:10.761580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Write session will restart in 0.008381s
2025-10-02T09:36:10.761600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Write session: Do CDS request
2025-10-02T09:36:10.761605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.768863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.770046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.770142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.770148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.770154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.770178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.770201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825558510:11637]
2025-10-02T09:36:10.770542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.770709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.770732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.770930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.770965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.770969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.770969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.770970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.770971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.770971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.770972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.770972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.770973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.770973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.770974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.770975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.770977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.770984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.770986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.770988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.770990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.770992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.770994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.770996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.770998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.771000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.771002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.771004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.771008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.771012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.771015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.771018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.771020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.771023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.771025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.771028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.771030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.771033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.771035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.771037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.771039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.771042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.771045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.771048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.771050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.771052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.771054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.771057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.771059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.771062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.771064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.771067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.771083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.771190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.771308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.771321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3091
2025-10-02T09:36:10.771417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.771441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.771445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.771450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.771746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3091 sessionId:  describe result for acl check
2025-10-02T09:36:10.771772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.771776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.771777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.771780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.772130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.773514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.777294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.777302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.777304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901141950:8158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.777308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.778477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.780085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.780098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.780099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.780101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.780104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3090 [2:7556555883825558510:11637]
2025-10-02T09:36:10.780110Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.780119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.780124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.780126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.780127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.780136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.780139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.780144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.780173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.780178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.780179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.780180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.780182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.780217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.780222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.780229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.780239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.780247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.780261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141804:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.780266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141985:8158], now have 1 active actors on pipe
2025-10-02T09:36:10.780270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.780271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.780272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.780280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.780288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.780292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.780294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.780289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3090
2025-10-02T09:36:10.780296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.780300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3090
2025-10-02T09:36:10.780300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.780301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.780315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.780320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.780322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.780330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.780332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.780354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d900aee-805d4c92-49af7b05-90aa059a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.780362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.780364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.780366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.780371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.780377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.780389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.780491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.780496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.780504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.780574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3091 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d900aee-805d4c92-49af7b05-90aa059a_0
2025-10-02T09:36:10.780830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49281f6-11086a60-48fe3eff-771df7b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d900aee-805d4c92-49af7b05-90aa059a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.783237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Write session: try to update token
2025-10-02T09:36:10.783250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.789267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.789280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.789281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.789281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.789285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.789287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.789290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825558505:11637]
2025-10-02T09:36:10.789309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.789310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.789312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.789313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.789313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.789315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.789448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.795189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId: src_id|7d900aee-805d4c92-49af7b05-90aa059a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.797265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.861121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901141992:6976]
2025-10-02T09:36:10.861352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3090, pipe: [1:7556555883901141992:6976]
2025-10-02T09:36:10.897551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:10.897774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.897783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.897795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141992:6976], now have 1 active actors on pipe
2025-10-02T09:36:10.897961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:10.897996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:10.898001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901141992:6976]
2025-10-02T09:36:10.897993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:10.898003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:10.898050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3091 reason: error at write: Disconnected sessionId: src_id|7d900aee-805d4c92-49af7b05-90aa059a_0
2025-10-02T09:36:10.898178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3091 sessionId: src_id|7d900aee-805d4c92-49af7b05-90aa059a_0 is DEAD
2025-10-02T09:36:10.898319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:10.898332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Write session will restart in 0.006179s
2025-10-02T09:36:10.898357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Write session: Do CDS request
2025-10-02T09:36:10.898362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:10.905139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.905344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:10.905359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3092
2025-10-02T09:36:10.905480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:10.905506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:10.905516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:10.905519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:10.905872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3092 sessionId:  describe result for acl check
2025-10-02T09:36:10.905901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:10.905908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:10.905909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:10.905913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:10.906180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:10.906342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:10.907456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:10.907559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:10.907565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:10.907571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:10.907596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:10.907617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555883825558691:11639]
2025-10-02T09:36:10.907697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:10.907966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:10.908131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:10.908155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:10.908335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:10.908366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.908371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.908371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.908372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.908373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.908373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.908374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.908374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.908375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.908375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.908376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.908377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.908379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.908386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.908388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.908390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.908392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.908394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.908396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.908398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.908400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.908402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.908404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.908406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.908410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.908413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:10.908417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.908420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:10.908422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.908425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:10.908427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.908434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:10.908436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.908439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:10.908441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.908444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:10.908446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.908449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:10.908451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.908453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:10.908456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.908458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:10.908461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.908464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.908466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.908469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.908472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.908475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.908493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:10.912287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:10.912296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:10.912298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555883901142135:8183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:10.912302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:10.915901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:10.917371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:10.917382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:10.917383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:10.917385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:10.917389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3091 [2:7556555883825558691:11639]
2025-10-02T09:36:10.917395Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:10.917405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:10.917409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.917411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.917412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.917421Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:10.917425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:10.917430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:10.917461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.917465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.917467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.917469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:10.917470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:10.917505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:10.917517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.917523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:10.917528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:10.917539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:10.917553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901142179:8183], now have 1 active actors on pipe
2025-10-02T09:36:10.917559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901141994:2446], now have 1 active actors on pipe
2025-10-02T09:36:10.917562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.917563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.917564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.917572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:10.917579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:10.917585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:10.917587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:10.917588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:10.917589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:10.917591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:10.917589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3091
2025-10-02T09:36:10.917604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.917599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3091
2025-10-02T09:36:10.917608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:10.917610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:10.917625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.917627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.917647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f588ffcc-f59ed170-79790657-57c063a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:10.917654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:10.917655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:10.917657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:10.917661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:10.917666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:10.917677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.917771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:10.917776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:10.917783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:10.917850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3092 partition: 0 MaxSeqNo: 36 sessionId: src_id|f588ffcc-f59ed170-79790657-57c063a5_0
2025-10-02T09:36:10.918121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d900aee-805d4c92-49af7b05-90aa059a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f588ffcc-f59ed170-79790657-57c063a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:10.920549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Write session: try to update token
2025-10-02T09:36:10.920564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:10.926692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:10.926705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:10.926706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:10.926707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:10.926711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.926713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.926719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555883825558686:11639]
2025-10-02T09:36:10.926737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:10.926739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:10.926740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:10.926741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:10.926748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:10.926750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:10.926857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:10.932831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId: src_id|f588ffcc-f59ed170-79790657-57c063a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:10.934943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:10.998307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555883901142191:6976]
2025-10-02T09:36:10.998489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3091, pipe: [1:7556555883901142191:6976]
2025-10-02T09:36:11.036493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.036884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.036895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.036907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555883901142191:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.037056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.037094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.037109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.037112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555883901142191:6976]
2025-10-02T09:36:11.037128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.037266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3092 reason: error at write: Disconnected sessionId: src_id|f588ffcc-f59ed170-79790657-57c063a5_0
2025-10-02T09:36:11.037418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3092 sessionId: src_id|f588ffcc-f59ed170-79790657-57c063a5_0 is DEAD
2025-10-02T09:36:11.037545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.037556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Write session will restart in 0.007315s
2025-10-02T09:36:11.037575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Write session: Do CDS request
2025-10-02T09:36:11.037580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.045508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.046201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.046343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.046360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3093
2025-10-02T09:36:11.046469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.046494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.046504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.046508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.046698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.046803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.046810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.046816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.046840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.046864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120526169:11641]
2025-10-02T09:36:11.046876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3093 sessionId:  describe result for acl check
2025-10-02T09:36:11.046906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.046908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.046910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.046914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.047206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.047348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.047378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.047402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.047577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.047605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.047608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.047609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.047610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.047610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.047611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.047611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.047612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.047612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.047613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.047613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.047614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.047616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.047623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.047625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.047627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.047629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.047631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.047633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.047635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.047637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.047639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.047641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.047642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.047646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.047650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.047653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.047656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.047658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.047661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.047663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.047665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.047667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.047670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.047672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.047675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.047677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.047679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.047681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.047684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.047686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.047689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.047691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.047697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.047699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.047703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.047705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.047711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.047728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.049024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.052968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.052978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.052981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196109633:8189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.052987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.055076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.056581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.056593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.056595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.056597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.056600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3092 [2:7556555888120526169:11641]
2025-10-02T09:36:11.056606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.056616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.056618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.056619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.056620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.056629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.056635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.056640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.056666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.056671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.056672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.056674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.056675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.056710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.056715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.056721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.056728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.056737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.056751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109489:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.056756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109672:8189], now have 1 active actors on pipe
2025-10-02T09:36:11.056760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.056762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.056763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.056770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.056777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.056783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.056785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.056786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.056786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.056793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3092
2025-10-02T09:36:11.056787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.056812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.056817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.056827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.056818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3092
2025-10-02T09:36:11.056839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.056844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.056861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79948eb0-73816eea-831b2e81-acdddff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.056868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.056871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.056872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.056877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.056882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.056889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.057010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.057015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.057022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.057139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3093 partition: 0 MaxSeqNo: 36 sessionId: src_id|79948eb0-73816eea-831b2e81-acdddff9_0
2025-10-02T09:36:11.057410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f588ffcc-f59ed170-79790657-57c063a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|79948eb0-73816eea-831b2e81-acdddff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.059835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Write session: try to update token
2025-10-02T09:36:11.059852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.065780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.065791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.065792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.065793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.065797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.065799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.065803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120526164:11641]
2025-10-02T09:36:11.065822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.065825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.065828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.065828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.065829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.065832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.065936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.072160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId: src_id|79948eb0-73816eea-831b2e81-acdddff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.074249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.137071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196109679:6976]
2025-10-02T09:36:11.137271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3092, pipe: [1:7556555888196109679:6976]
2025-10-02T09:36:11.175177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.175388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.175395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.175408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109679:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.175607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.175597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196109679:6976]
2025-10-02T09:36:11.175606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.175611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.175628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.175659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3093 reason: error at write: Disconnected sessionId: src_id|79948eb0-73816eea-831b2e81-acdddff9_0
2025-10-02T09:36:11.175812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3093 sessionId: src_id|79948eb0-73816eea-831b2e81-acdddff9_0 is DEAD
2025-10-02T09:36:11.175939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.175953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Write session will restart in 0.006020s
2025-10-02T09:36:11.175973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Write session: Do CDS request
2025-10-02T09:36:11.175979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.183158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.183225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.183236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3094
2025-10-02T09:36:11.183360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.183386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.183395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.183399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.183735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3094 sessionId:  describe result for acl check
2025-10-02T09:36:11.183762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.183769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.183770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.183774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.183834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.184182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.184997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.185095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.185102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.185107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.185133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.185155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120526365:11644]
2025-10-02T09:36:11.185492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.185512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.185645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.185667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.185845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.185873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.185877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.185877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.185878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.185878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.185879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.185879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.185880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.185880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.185881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.185882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.185882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.185885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.185891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.185893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.185895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.185897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.185899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.185901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.185903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.185905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.185907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.185909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.185911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.185915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.185918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.185922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.185924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.185927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.185929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.185931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.185934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.185936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.185939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.185941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.185943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.185945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.185948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.185954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.185957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.185959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.185962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.185964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.185966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.185972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.185975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.185977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.185980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.185997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.190682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.190691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.190692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196109825:8203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.190698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.193332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.194879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.194890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.194891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.194893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.194896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3093 [2:7556555888120526365:11644]
2025-10-02T09:36:11.194902Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.194912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.194914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.194915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.194916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.194924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.194931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.194935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.194966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.194971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.194972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.194973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.194975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.195010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.195015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.195021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.195026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.195038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.195051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109681:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.195056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109864:8203], now have 1 active actors on pipe
2025-10-02T09:36:11.195060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.195061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.195063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.195070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.195080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.195083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.195075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3093
2025-10-02T09:36:11.195085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.195086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.195086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3093
2025-10-02T09:36:11.195090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.195091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.195105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.195110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.195112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.195122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.195127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.195151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.195158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.195160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.195162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.195167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.195173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.195182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.195288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.195292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.195300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.195369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3094 partition: 0 MaxSeqNo: 36 sessionId: src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0
2025-10-02T09:36:11.195588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79948eb0-73816eea-831b2e81-acdddff9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.198085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Write session: try to update token
2025-10-02T09:36:11.198103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.204066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.204079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.204080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.204081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.204085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.204087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.204089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120526360:11644]
2025-10-02T09:36:11.204109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.204110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.204112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.204112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.204113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.204114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.204224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.210805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId: src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.212979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.275801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196109898:6976]
2025-10-02T09:36:11.275947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3093, pipe: [1:7556555888196109898:6976]
2025-10-02T09:36:11.314924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.315149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.315158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.315169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109898:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.315313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.315331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.315342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.315362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196109898:6976]
2025-10-02T09:36:11.315385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.315424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3094 reason: error at write: Disconnected sessionId: src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0
2025-10-02T09:36:11.315564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3094 sessionId: src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0 is DEAD
2025-10-02T09:36:11.315729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.315742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Write session will restart in 0.008410s
2025-10-02T09:36:11.315767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Write session: Do CDS request
2025-10-02T09:36:11.315772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.323589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.324760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.324912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.324919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.324926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.324958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.324982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120526586:11659]
2025-10-02T09:36:11.325139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.325209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.325225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3095
2025-10-02T09:36:11.325320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.325332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.325344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.325354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.325358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.325510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.325534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.325668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3095 sessionId:  describe result for acl check
2025-10-02T09:36:11.325694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.325701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.325702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.325706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.325714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.325742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.325746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.325746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.325747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.325747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.325748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.325748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.325749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.325750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.325750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.325751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.325751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.325754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.325761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.325763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.325765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.325767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.325769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.325771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.325773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.325775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.325778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.325780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.325782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.325786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.325789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.325792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.325795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.325797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.325800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.325802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.325805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.325807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.325810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.325812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.325814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.325817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.325819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.325822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.325824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.325827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.325829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.325831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.325834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.325836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.325839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.325841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.325845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.325863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.326116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.327942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.332982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.332994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.332995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196110058:8227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.333000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.333396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.334887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.334897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.334898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.334900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.334903Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3094 [2:7556555888120526586:11659]
2025-10-02T09:36:11.334911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.334922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.334927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.334929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.334930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.334939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.334942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.334946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.334974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.334979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.334980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.334981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.334983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.335016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.335021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.335027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.335032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.335043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.335055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.335059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.335060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.335065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.335073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110095:8227], now have 1 active actors on pipe
2025-10-02T09:36:11.335075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.335078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.335078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.335079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.335085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.335087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.335090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196109908:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.335102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.335110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.335110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3094
2025-10-02T09:36:11.335110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3094
2025-10-02T09:36:11.335118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.335135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.335140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.335156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.335162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.335164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.335165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.335170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.335176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.335186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.335305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.335310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.335318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.335380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3095 partition: 0 MaxSeqNo: 36 sessionId: src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0
2025-10-02T09:36:11.335575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6908f52a-1dfc50bf-f88819a0-5506655b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.337836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Write session: try to update token
2025-10-02T09:36:11.337849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.344013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.344025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.344026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.344029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.344032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.344034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.344036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120526581:11659]
2025-10-02T09:36:11.344054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.344060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.344060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.344061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.344063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.344065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.344170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.349613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId: src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.351627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.415606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196110103:6976]
2025-10-02T09:36:11.415804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3094, pipe: [1:7556555888196110103:6976]
2025-10-02T09:36:11.452583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.452797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.452815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.452831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110103:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.453022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.453018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.453066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:11.453145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196110103:6976]
2025-10-02T09:36:11.453154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3095 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0
2025-10-02T09:36:11.453301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3095 sessionId: src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0 is DEAD
2025-10-02T09:36:11.453460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:11.453474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Write session will restart in 0.009889s
2025-10-02T09:36:11.453504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Write session: Do CDS request
2025-10-02T09:36:11.453509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.461651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.462733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.462885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.462893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.462899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.462929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.462952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120526773:11662]
2025-10-02T09:36:11.463293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.463460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.463483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.463655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.463685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.463689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.463691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.463691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.463692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.463692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.463693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.463693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.463694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.463694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.463697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.463704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.463706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.463708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.463710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.463712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.463716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.463718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.463721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.463723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.463724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.463728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.463732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.463735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.463738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.463740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.463743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.463745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.463748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.463750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.463752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.463757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.463759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.463762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.463768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.463771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.463773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.463776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.463781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.463784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.463787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.463790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.463798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.463813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.464137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.464399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.464414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3096
2025-10-02T09:36:11.464515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.464541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.464544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.464550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.464911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3096 sessionId:  describe result for acl check
2025-10-02T09:36:11.464947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.464953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.464954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.464959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.465443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.466851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.470781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.470790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.470792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196110256:8237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.470796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.471278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.472772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.472783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.472784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.472786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.472790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3095 [2:7556555888120526773:11662]
2025-10-02T09:36:11.472796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.472817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.472819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.472821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.472822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.472830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.472833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.472837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.472864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.472870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.472872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.472874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.472875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.472911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.472916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.472922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.472927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.472938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.472953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110104:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.472958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110290:8237], now have 1 active actors on pipe
2025-10-02T09:36:11.472961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.472963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.472964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.472971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.472979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.472983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.472985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.472987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.472989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.472990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.473004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.473009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.472995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3095
2025-10-02T09:36:11.473000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3095
2025-10-02T09:36:11.473016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.473025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.473028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.473046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cccf9109-d31f4483-103f15a8-dd703e22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.473053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.473055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.473056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.473062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.473067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.473078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.473200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.473205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.473212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.473276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3096 partition: 0 MaxSeqNo: 36 sessionId: src_id|cccf9109-d31f4483-103f15a8-dd703e22_0
2025-10-02T09:36:11.473481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1616fa31-d01cf842-8201df31-ae5d6ddc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cccf9109-d31f4483-103f15a8-dd703e22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.475709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Write session: try to update token
2025-10-02T09:36:11.475721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.481918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.481930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.481931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.481932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.481936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.481939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.481941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120526768:11662]
2025-10-02T09:36:11.481960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.481964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.481966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.481966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.481967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.481969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.482070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.487502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId: src_id|cccf9109-d31f4483-103f15a8-dd703e22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.489633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.553314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196110298:6976]
2025-10-02T09:36:11.553510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3095, pipe: [1:7556555888196110298:6976]
2025-10-02T09:36:11.590543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.590846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.590854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.590866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110298:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.591038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196110298:6976]
2025-10-02T09:36:11.591053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.591057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.591060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.591051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.591124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3096 reason: error at write: Disconnected sessionId: src_id|cccf9109-d31f4483-103f15a8-dd703e22_0
2025-10-02T09:36:11.591241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3096 sessionId: src_id|cccf9109-d31f4483-103f15a8-dd703e22_0 is DEAD
2025-10-02T09:36:11.591344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.591356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Write session will restart in 0.006474s
2025-10-02T09:36:11.591381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Write session: Do CDS request
2025-10-02T09:36:11.591387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.598646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.599174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.599257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.599272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3097
2025-10-02T09:36:11.599370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.599395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.599404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.599407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.599721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3097 sessionId:  describe result for acl check
2025-10-02T09:36:11.599750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.599754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.599755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.599758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.599864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.599963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.599970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.599975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.600001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.600024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120526958:11664]
2025-10-02T09:36:11.600107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.600366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.600537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.600560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.600732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.600762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.600766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.600766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.600767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.600768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.600768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.600769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.600769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.600770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.600770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.600771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.600771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.600774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.600780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.600782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.600784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.600786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.600788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.600790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.600792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.600794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.600797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.600799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.600815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.600819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.600822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.600826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.600829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.600830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.600833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.600837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.600840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.600842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.600846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.600849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.600852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.600858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.600860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.600862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.600865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.600867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.600870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.600872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.600875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.600878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.600881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.600883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.600891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.600909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.602057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.605771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.605781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.605783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196110453:8256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.605788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.608341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.609865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.609877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.609879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.609881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.609884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3096 [2:7556555888120526958:11664]
2025-10-02T09:36:11.609891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.609900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.609902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.609903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.609905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.609913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.609916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.609921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.609952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.609956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.609957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.609959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.609960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.609995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.610000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.610006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.610011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.610019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.610033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110491:8256], now have 1 active actors on pipe
2025-10-02T09:36:11.610039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110305:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.610042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.610043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.610044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.610051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.610059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.610065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.610067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.610068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.610069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.610071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.610072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3096
2025-10-02T09:36:11.610087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3096
2025-10-02T09:36:11.610084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.610089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.610090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.610099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.610101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.610124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c23503ae-33201b8a-6cefd146-10d7c123_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.610131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.610134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.610135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.610140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.610145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.610154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.610267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.610271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.610279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.610350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3097 partition: 0 MaxSeqNo: 36 sessionId: src_id|c23503ae-33201b8a-6cefd146-10d7c123_0
2025-10-02T09:36:11.610581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccf9109-d31f4483-103f15a8-dd703e22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c23503ae-33201b8a-6cefd146-10d7c123_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.613054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Write session: try to update token
2025-10-02T09:36:11.613068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.619038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.619049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.619050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.619051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.619055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.619057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.619059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120526953:11664]
2025-10-02T09:36:11.619077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.619078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.619080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.619081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.619081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.619082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.619191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.625296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId: src_id|c23503ae-33201b8a-6cefd146-10d7c123_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.627384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.691065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196110499:6976]
2025-10-02T09:36:11.691258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3096, pipe: [1:7556555888196110499:6976]
2025-10-02T09:36:11.726939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.727228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.727236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.727249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110499:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.727526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.727531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196110499:6976]
2025-10-02T09:36:11.727539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.727552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.727590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3097 reason: error at write: Disconnected sessionId: src_id|c23503ae-33201b8a-6cefd146-10d7c123_0
2025-10-02T09:36:11.727719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3097 sessionId: src_id|c23503ae-33201b8a-6cefd146-10d7c123_0 is DEAD
2025-10-02T09:36:11.727863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.727875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Write session will restart in 0.008093s
2025-10-02T09:36:11.727904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Write session: Do CDS request
2025-10-02T09:36:11.727914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.728510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.735702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.736918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.737017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.737024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.737030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.737054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.737076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120527145:11666]
2025-10-02T09:36:11.737182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.737226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.737239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3098
2025-10-02T09:36:11.737341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.737366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.737374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.737378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.737419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.737571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.737594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.737705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3098 sessionId:  describe result for acl check
2025-10-02T09:36:11.737732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.737739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.737741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.737745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.737765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.737795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.737799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.737799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.737800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.737800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.737801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.737801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.737802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.737804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.737804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.737807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.737813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.737815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.737818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.737819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.737821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.737823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.737825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.737827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.737829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.737831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.737833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.737837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.737841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.737846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.737848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.737850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.737853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.737856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.737858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.737861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.737863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.737865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.737868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.737870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.737875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.737877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.737880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.737885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.737889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.737894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.737901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.737916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.738162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.739661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.744131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.744141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.744143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196110652:8260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.744148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.745291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.746770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.746790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.746791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.746793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.746797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3097 [2:7556555888120527145:11666]
2025-10-02T09:36:11.746805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.746815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.746816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.746819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.746820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.746828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.746834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.746840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.746966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.746970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.746971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.746973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.746975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.747012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.747016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.747023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.747028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.747038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.747052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110689:8260], now have 1 active actors on pipe
2025-10-02T09:36:11.747057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110501:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.747060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.747062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.747063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.747070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.747078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.747081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.747086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.747087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.747090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.747091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.747085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3097
2025-10-02T09:36:11.747101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.747105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.747100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3097
2025-10-02T09:36:11.747106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.747121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.747126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.747144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.747151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.747154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.747155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.747161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.747169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.747182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.747299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.747304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.747312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.747375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3098 partition: 0 MaxSeqNo: 36 sessionId: src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0
2025-10-02T09:36:11.747569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c23503ae-33201b8a-6cefd146-10d7c123_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.749970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Write session: try to update token
2025-10-02T09:36:11.749985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.756112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.756125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.756126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.756127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.756132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.756135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.756137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120527140:11666]
2025-10-02T09:36:11.756156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.756158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.756161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.756163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.756163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.756164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.756308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.761683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId: src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.763735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.827763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196110696:6976]
2025-10-02T09:36:11.827978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3097, pipe: [1:7556555888196110696:6976]
2025-10-02T09:36:11.864512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:11.864722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.864731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.864743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110696:6976], now have 1 active actors on pipe
2025-10-02T09:36:11.864979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:11.864976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:11.864985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:11.864985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196110696:6976]
2025-10-02T09:36:11.865008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:11.865060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3098 reason: error at write: Disconnected sessionId: src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0
2025-10-02T09:36:11.865198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3098 sessionId: src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0 is DEAD
2025-10-02T09:36:11.865341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:11.865355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Write session will restart in 0.007577s
2025-10-02T09:36:11.865375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Write session: Do CDS request
2025-10-02T09:36:11.865381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:11.873192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:11.874146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.874273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:11.874287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3099
2025-10-02T09:36:11.874406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:11.874433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:11.874442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:11.874445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:11.874446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:11.874544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:11.874551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:11.874556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:11.874580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:11.874602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555888120527333:11668]
2025-10-02T09:36:11.874756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3099 sessionId:  describe result for acl check
2025-10-02T09:36:11.874790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:11.874797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:11.874798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:11.874801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:11.874945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:11.875106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:11.875129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:11.875163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:11.875300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:11.875327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.875331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.875332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.875332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.875333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.875333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.875334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.875334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.875335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.875335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.875336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.875336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.875339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.875345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.875347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.875349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.875351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.875353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.875355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.875357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.875359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.875361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.875363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.875365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.875368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.875372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:11.875376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.875379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:11.875381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.875383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:11.875386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.875388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:11.875391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.875393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:11.875395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.875398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:11.875400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.875403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:11.875406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.875408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:11.875412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.875414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:11.875417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.875419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.875422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.875429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.875447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:11.876927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:11.880701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:11.880709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:11.880714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555888196110848:8280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:11.880717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:11.882831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:11.884344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:11.884356Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:11.884357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:11.884360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:11.884363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3098 [2:7556555888120527333:11668]
2025-10-02T09:36:11.884370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:11.884379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:11.884381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.884383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.884384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.884393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:11.884399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:11.884403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:11.884432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.884439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.884440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.884442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:11.884443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:11.884479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:11.884484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.884490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:11.884495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:11.884505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:11.884520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110697:2446], now have 1 active actors on pipe
2025-10-02T09:36:11.884525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110885:8280], now have 1 active actors on pipe
2025-10-02T09:36:11.884529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.884530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.884531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.884539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:11.884546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:11.884552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:11.884554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:11.884555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:11.884557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:11.884559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:11.884572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.884568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3098
2025-10-02T09:36:11.884577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:11.884581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:11.884572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3098
2025-10-02T09:36:11.884597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.884602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.884618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:11.884625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:11.884628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:11.884629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:11.884634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:11.884639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:11.884647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.884769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:11.884774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:11.884781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:11.884859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3099 partition: 0 MaxSeqNo: 36 sessionId: src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0
2025-10-02T09:36:11.885064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43378d3-4d8d0206-25d5b5fc-8dc991a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:11.887326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Write session: try to update token
2025-10-02T09:36:11.887339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:11.893537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:11.893549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:11.893550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:11.893551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:11.893555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.893557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.893559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555888120527328:11668]
2025-10-02T09:36:11.893578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:11.893585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:11.893586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:11.893585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:11.893589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:11.893590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:11.893697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:11.899766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId: src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:11.901968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:11.964980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555888196110898:6976]
2025-10-02T09:36:11.965140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3098, pipe: [1:7556555888196110898:6976]
2025-10-02T09:36:12.002106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.002312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.002320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.002333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555888196110898:6976], now have 1 active actors on pipe
2025-10-02T09:36:12.002453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.002550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:12.002557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.002562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:12.002589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555888196110898:6976]
2025-10-02T09:36:12.002636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3099 reason: error at write: Disconnected sessionId: src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0
2025-10-02T09:36:12.002830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3099 sessionId: src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0 is DEAD
2025-10-02T09:36:12.002924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:12.002937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Write session will restart in 0.008690s
2025-10-02T09:36:12.002960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Write session: Do CDS request
2025-10-02T09:36:12.002965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.010593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.011778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.011877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.011884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.011890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.011914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.011938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415494817:11670]
2025-10-02T09:36:12.012093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.012182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.012194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3100
2025-10-02T09:36:12.012276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.012273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.012298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.012304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.012308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.012457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.012478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.012607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3100 sessionId:  describe result for acl check
2025-10-02T09:36:12.012635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.012640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.012641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.012643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.012654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.012682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.012685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.012686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.012687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.012687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.012688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.012688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.012689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.012689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.012690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.012690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.012691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.012694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.012701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.012703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.012705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.012707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.012709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.012711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.012713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.012715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.012717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.012719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.012721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.012725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.012729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.012732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.012735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.012738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.012740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.012742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.012745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.012747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.012750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.012753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.012757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.012762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.012764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.012767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.012774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.012777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.012779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.012781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.012783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.012786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.012788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.012791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.012818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.013013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.014716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.019066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.019074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.019076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491078351:2326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.019082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.020251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.021989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.022001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.022002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.022004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.022007Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3099 [2:7556555892415494817:11670]
2025-10-02T09:36:12.022014Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.022023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.022025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.022026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.022027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.022036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.022038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.022042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.022073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.022078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.022079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.022081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.022082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.022120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.022125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.022131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.022140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.022151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.022163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.022168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.022169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.022174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.022182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.022183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.022186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.022187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.022193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.022194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.022200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078198:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.022203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078388:2326], now have 1 active actors on pipe
2025-10-02T09:36:12.022216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.022223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.022233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.022233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3099
2025-10-02T09:36:12.022239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3099
2025-10-02T09:36:12.022262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.022267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.022284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f2c330c-36241303-1aafc935-774104f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.022291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.022293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.022294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.022301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.022306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.022317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.022466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.022471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.022479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.022547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3100 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f2c330c-36241303-1aafc935-774104f9_0
2025-10-02T09:36:12.022742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ab0a12-57e40d15-d90832ee-e84c238f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f2c330c-36241303-1aafc935-774104f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.025157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Write session: try to update token
2025-10-02T09:36:12.025171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.031234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.031246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.031247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.031248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.031252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.031254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.031256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415494812:11670]
2025-10-02T09:36:12.031276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.031280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.031281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.031283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.031283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.031286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.031385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.037194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId: src_id|4f2c330c-36241303-1aafc935-774104f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.039245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.102668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491078396:6976]
2025-10-02T09:36:12.102896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3099, pipe: [1:7556555892491078396:6976]
2025-10-02T09:36:12.139070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.139332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.139341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.139354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078396:6976], now have 1 active actors on pipe
2025-10-02T09:36:12.139467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.139502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.139535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491078396:6976]
2025-10-02T09:36:12.139539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:12.139605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3100 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f2c330c-36241303-1aafc935-774104f9_0
2025-10-02T09:36:12.139746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3100 sessionId: src_id|4f2c330c-36241303-1aafc935-774104f9_0 is DEAD
2025-10-02T09:36:12.139889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:12.139904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Write session will restart in 0.005916s
2025-10-02T09:36:12.139925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Write session: Do CDS request
2025-10-02T09:36:12.139930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.147128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.147266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.147283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3101
2025-10-02T09:36:12.147401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.147429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.147438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.147443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.147742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3101 sessionId:  describe result for acl check
2025-10-02T09:36:12.147769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.147773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.147774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.147776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.147925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.148149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.149231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.149325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.149332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.149338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.149363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.149386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415495009:11673]
2025-10-02T09:36:12.149717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.149845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.149868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.149890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.150061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.150090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.150094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.150095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.150095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.150096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.150097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.150097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.150098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.150098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.150098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.150099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.150100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.150102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.150108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.150110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.150112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.150114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.150116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.150118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.150120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.150122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.150124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.150126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.150128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.150132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.150135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.150139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.150142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.150145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.150148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.150150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.150153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.150155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.150158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.150161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.150163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.150166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.150168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.150170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.150173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.150175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.150178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.150180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.150183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.150185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.150188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.150191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.150193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.150209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.154962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.154972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.154974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491078548:2332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.154978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.157536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.159024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.159035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.159036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.159038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.159040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3100 [2:7556555892415495009:11673]
2025-10-02T09:36:12.159047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.159055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.159057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.159058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.159059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.159068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.159075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.159080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.159115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.159120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.159121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.159123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.159124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.159158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.159163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.159169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.159174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.159185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.159199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078397:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.159205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078587:2332], now have 1 active actors on pipe
2025-10-02T09:36:12.159208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.159210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.159211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.159219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.159229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.159232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.159237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.159230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3100
2025-10-02T09:36:12.159239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.159240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.159249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3100
2025-10-02T09:36:12.159241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.159252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.159253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.159255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.159265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.159270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.159294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.159301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.159303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.159304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.159309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.159317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.159329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.159438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.159443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.159450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.159521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3101 partition: 0 MaxSeqNo: 36 sessionId: src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0
2025-10-02T09:36:12.159740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2c330c-36241303-1aafc935-774104f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.162134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Write session: try to update token
2025-10-02T09:36:12.162147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.168217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.168230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.168231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.168232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.168235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.168238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.168240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415495004:11673]
2025-10-02T09:36:12.168258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.168259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.168260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.168261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.168262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.168263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.168378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.173634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId: src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.175667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.239915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491078596:6976]
2025-10-02T09:36:12.240175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3100, pipe: [1:7556555892491078596:6976]
2025-10-02T09:36:12.277453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.277642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.277650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.277662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078596:6976], now have 1 active actors on pipe
2025-10-02T09:36:12.277776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.277825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:12.277829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491078596:6976]
2025-10-02T09:36:12.277838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:12.277841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.277859Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:36:12.277897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3101 reason: error at write: Disconnected sessionId: src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0
2025-10-02T09:36:12.277968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3101 sessionId: src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0 is DEAD
2025-10-02T09:36:12.278007Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 31 consumer shared/user session shared/user_1_31_12091325694439449584_v1 is DEAD
2025-10-02T09:36:12.278114Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555832361520839:6970] disconnected; active server actors: 1
2025-10-02T09:36:12.278123Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:36:12.278120Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555832361520839:6970] client user disconnected session shared/user_1_31_12091325694439449584_v1
2025-10-02T09:36:12.278240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:12.278251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Write session will restart in 0.007436s
2025-10-02T09:36:12.278270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Write session: Do CDS request
2025-10-02T09:36:12.278275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.278281Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:12.278290Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:12.278296Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.009946s
2025-10-02T09:36:12.286274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.287155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.287222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.287230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3102
2025-10-02T09:36:12.287328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.287348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.287353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.287356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.287517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.287568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3102 sessionId:  describe result for acl check
2025-10-02T09:36:12.287588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.287592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.287593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.287596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.287624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.287631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.287637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.287662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.287685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415495241:11686]
2025-10-02T09:36:12.287927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.288021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.288168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.288191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.288364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.288395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.288399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.288399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.288400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.288400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.288401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.288401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.288402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.288402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.288403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.288404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.288404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.288407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.288412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.288415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.288417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.288419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.288421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.288423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.288425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.288427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.288429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.288431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.288433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.288436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.288440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.288443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.288446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.288449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.288452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.288454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.288457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.288459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.288462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.288464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.288466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.288469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.288471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.288475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.288478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.288480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.288483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.288485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.288490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.288492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.288495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.288497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.288500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.288518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.289081Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:36:12.289350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.289440Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:36:12.289445Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 32
2025-10-02T09:36:12.289646Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 32 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:12.289675Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:12.289722Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 auth for : user
2025-10-02T09:36:12.290213Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 Handle describe topics response
2025-10-02T09:36:12.290232Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 auth is DEAD
2025-10-02T09:36:12.290247Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:36:12.290413Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:36:12.290458Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555892491078811:2374] connected; active server actors: 1
2025-10-02T09:36:12.290465Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555892491078811:2374] session shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:12.290470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:36:12.290476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:36:12.290479Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:12.290480Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_32_1159518760392506779_v1" (Sender=[1:7556555892491078798:2374], Pipe=[1:7556555892491078811:2374], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:12.290484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:36:12.290491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:36:12.290506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_32_1159518760392506779_v1" (Sender=[1:7556555892491078798:2374], Pipe=[1:7556555892491078811:2374], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:12.290515Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_32_1159518760392506779_v1" sender [1:7556555892491078798:2374] lock partition 0 for ReadingSession "shared/user_1_32_1159518760392506779_v1" (Sender=[1:7556555892491078798:2374], Pipe=[1:7556555892491078811:2374], Partitions=[], ActiveFamilyCount=1) generation 1 step 32
2025-10-02T09:36:12.290520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:36:12.290523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-02T09:36:12.290645Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 32 Session: "shared/user_1_32_1159518760392506779_v1" ClientId: "user" PipeClient { RawX1: 7556555892491078811 RawX2: 4503603922340166 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:36:12.290657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:36:12.293809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.293818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.293821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491078774:2361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.293826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.295945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.297390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.297401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.297402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.297404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.297407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3101 [2:7556555892415495241:11686]
2025-10-02T09:36:12.297417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.297426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.297428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.297429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.297430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.297438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.297443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.297448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.297477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.297482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.297483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.297484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.297485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.297519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.297523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.297530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.297535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.297544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.297559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078609:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.297564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078814:2397], now have 1 active actors on pipe
2025-10-02T09:36:12.297565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078819:2361], now have 1 active actors on pipe
2025-10-02T09:36:12.297568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.297569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.297570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.297579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.297586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.297590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.297592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.297593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.297596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.297598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.297595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3101, pipe: [1:7556555892491078814:2397]
2025-10-02T09:36:12.297610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3101
2025-10-02T09:36:12.297612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.297616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.297618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.297623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3101
2025-10-02T09:36:12.297627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.297632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.297640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_32_1159518760392506779_v1 on pipe: [1:7556555892491078814:2397]
2025-10-02T09:36:12.297665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.297666Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_32_1159518760392506779_v1:1 with generation 3101
2025-10-02T09:36:12.297669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.297675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.297678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.297679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.297686Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:12.297690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.297708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77e08eca-b18cbe3-13c93de2-6db977df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.297714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:36:12.297716Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:36:12.301059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:36:12.301072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:36:12.301076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.301079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.301080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.301085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.301090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.301096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:36:12.301101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:36:12.301110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.301170Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397772297 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:36:12.301179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:36:12.301204Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 sending to client partition status
2025-10-02T09:36:12.301238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.301244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.301251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.301292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3102 partition: 0 MaxSeqNo: 36 sessionId: src_id|77e08eca-b18cbe3-13c93de2-6db977df_0
2025-10-02T09:36:12.301441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74a7609-ad5073c1-bdda9641-5aca7f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77e08eca-b18cbe3-13c93de2-6db977df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.303711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Write session: try to update token
2025-10-02T09:36:12.303723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.306640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.306652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.306654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.306655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.306658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.306660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.306662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415495235:11686]
2025-10-02T09:36:12.306682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.306684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.306685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.306687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.306689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.306691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.306797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.315593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId: src_id|77e08eca-b18cbe3-13c93de2-6db977df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.317648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.414825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.415008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.415023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.415209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.415224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491078814:2397]
2025-10-02T09:36:12.415248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:12.415252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:12.415315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3102 reason: error at write: Disconnected sessionId: src_id|77e08eca-b18cbe3-13c93de2-6db977df_0
2025-10-02T09:36:12.415474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3102 sessionId: src_id|77e08eca-b18cbe3-13c93de2-6db977df_0 is DEAD
2025-10-02T09:36:12.415555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:12.415572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.415595Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:12.415615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:12.415629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Write session will restart in 0.005277s
2025-10-02T09:36:12.415649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Write session: Do CDS request
2025-10-02T09:36:12.415656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.422113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.422203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.422215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3103
2025-10-02T09:36:12.422308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.422332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.422341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.422344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.422675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3103 sessionId:  describe result for acl check
2025-10-02T09:36:12.422700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.422707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.422708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.422712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.423130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.423779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.424741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.425103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.425197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.425205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.425210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.425236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.425261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415495446:11691]
2025-10-02T09:36:12.425611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.425778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.425800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.425976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.426005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.426009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.426010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.426010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.426011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.426012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.426012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.426013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.426013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.426014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.426014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.426015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.426018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.426024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.426026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.426028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.426030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.426032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.426034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.426036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.426039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.426041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.426043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.426045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.426049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.426053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.426056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.426059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.426061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.426064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.426066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.426069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.426071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.426074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.426076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.426079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.426082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.426085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.426087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.426089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.426092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.426095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.426097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.426100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.426102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.426105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.426107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.426109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.426128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.430150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.430162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.430166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491078983:2390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.430173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.433692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.435295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.435306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.435307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.435309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.435312Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3102 [2:7556555892415495446:11691]
2025-10-02T09:36:12.435321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.435331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.435337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.435339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.435340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.435348Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.435354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.435358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.435385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.435390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.435391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.435393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.435394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.435427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.435432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.435438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.435446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.435457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.435470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491078840:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.435476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079032:2390], now have 1 active actors on pipe
2025-10-02T09:36:12.435479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.435480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.435481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.435488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.435495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.435499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.435502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.435503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.435505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.435507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.435518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3102
2025-10-02T09:36:12.435522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.435525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3102
2025-10-02T09:36:12.435529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.435533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.435569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.435574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.435588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.435595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.435597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.435601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.435606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.435612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.435619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.435728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.435735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.435741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.435801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3103 partition: 0 MaxSeqNo: 36 sessionId: src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0
2025-10-02T09:36:12.435986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e08eca-b18cbe3-13c93de2-6db977df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.438214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Write session: try to update token
2025-10-02T09:36:12.438227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.444535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.444547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.444548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.444549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.444552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.444555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.444557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415495440:11691]
2025-10-02T09:36:12.444575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.444580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.444581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.444582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.444585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.444587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.444692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.449857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId: src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.451938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.515391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491079039:2397]
2025-10-02T09:36:12.515584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3102, pipe: [1:7556555892491079039:2397]
2025-10-02T09:36:12.551626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.551824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.551832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.551844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079039:2397], now have 1 active actors on pipe
2025-10-02T09:36:12.551978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.551999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491079039:2397]
2025-10-02T09:36:12.552004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:12.552007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:12.552028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.552060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3103 reason: error at write: Disconnected sessionId: src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0
2025-10-02T09:36:12.552200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3103 sessionId: src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0 is DEAD
2025-10-02T09:36:12.552332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:12.552345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Write session will restart in 0.007027s
2025-10-02T09:36:12.552364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Write session: Do CDS request
2025-10-02T09:36:12.552369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.560134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.560158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.560268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.560283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3104
2025-10-02T09:36:12.560375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.560399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.560405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.560409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.560751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3104 sessionId:  describe result for acl check
2025-10-02T09:36:12.560778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.560783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.560784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.560790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.561160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.561444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.561537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.561544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.561549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.561575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.561598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415495638:11693]
2025-10-02T09:36:12.561934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.562075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.562097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.562270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.562299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.562303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.562303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.562304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.562304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.562305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.562305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.562306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.562306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.562307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.562308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.562308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.562311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.562317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.562319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.562321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.562323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.562325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.562327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.562329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.562331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.562333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.562335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.562337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.562342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.562345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.562349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.562352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.562354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.562357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.562359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.562362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.562364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.562367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.562369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.562372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.562374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.562377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.562378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.562381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.562383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.562386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.562388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.562391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.562393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.562396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.562398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.562400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.562418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.563014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.568148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.568159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.568161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491079196:2403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.568167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.569773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.571409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.571421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.571422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.571424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.571427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3103 [2:7556555892415495638:11693]
2025-10-02T09:36:12.571433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.571444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.571445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.571447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.571448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.571457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.571460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.571464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.571497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.571502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.571503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.571505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.571506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.571543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.571548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.571555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.571560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.571568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.571582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079235:2403], now have 1 active actors on pipe
2025-10-02T09:36:12.571587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079041:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.571591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.571593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.571595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.571602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.571613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.571613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.571615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.571616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.571624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.571626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.571624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3103
2025-10-02T09:36:12.571640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.571645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.571627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3103
2025-10-02T09:36:12.571647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.571662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.571667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.571685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.571692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.571694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.571695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.571700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.571705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.571715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.571817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.571822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.571829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.571899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3104 partition: 0 MaxSeqNo: 36 sessionId: src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0
2025-10-02T09:36:12.572108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcbf32-d3803f64-c73ee0bf-d2d8fd34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.574403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Write session: try to update token
2025-10-02T09:36:12.574416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.580782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.580815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.580817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.580818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.580824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.580826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.580829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415495633:11693]
2025-10-02T09:36:12.580853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.580856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.580860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.580862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.580862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.580864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.581006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.585790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId: src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.587811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.652042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491079242:2397]
2025-10-02T09:36:12.652260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3103, pipe: [1:7556555892491079242:2397]
2025-10-02T09:36:12.689994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.690313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.690322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.690346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079242:2397], now have 1 active actors on pipe
2025-10-02T09:36:12.690485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.690612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491079242:2397]
2025-10-02T09:36:12.690638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.690751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:12.690833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0
2025-10-02T09:36:12.690981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3104 sessionId: src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0 is DEAD
2025-10-02T09:36:12.691131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:12.691143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Write session will restart in 0.005112s
2025-10-02T09:36:12.691162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Write session: Do CDS request
2025-10-02T09:36:12.691167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.697093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.697184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.697192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3105
2025-10-02T09:36:12.697264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.697284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.697289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.697292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.697638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3105 sessionId:  describe result for acl check
2025-10-02T09:36:12.697674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.697681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.697682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.697685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.698055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.699281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.699787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.700668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.700765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.700772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.700778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.700818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.700841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415495832:11695]
2025-10-02T09:36:12.701183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.701367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.701396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.701587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.701600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.701611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.701613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491079352:2420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.701618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.701620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.701625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.701625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.701626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.701626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.701627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.701628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.701628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.701628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.701629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.701630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.701630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.701633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.701639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.701641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.701643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.701645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.701647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.701649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.701651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.701653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.701656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.701658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.701660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.701663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.701667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.701670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.701673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.701675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.701678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.701680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.701683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.701685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.701688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.701690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.701693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.701695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.701697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.701700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.701703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.701705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.701708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.701710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.701714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.701716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.701719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.701721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.701724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.701740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.709109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.710723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.710735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.710737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.710739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.710742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3104 [2:7556555892415495832:11695]
2025-10-02T09:36:12.710749Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.710759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.710765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.710767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.710768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.710777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.710780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.710792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.710826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.710831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.710832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.710834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.710835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.710873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.710878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.710885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.710890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.710902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.710916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079243:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.710919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079436:2420], now have 1 active actors on pipe
2025-10-02T09:36:12.710924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.710925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.710926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.710934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.710941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.710948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.710950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.710951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.710951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.710953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.710966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.710948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3104
2025-10-02T09:36:12.710960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3104
2025-10-02T09:36:12.710970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.710971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.710983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.710985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.711005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|830e19a9-b7f14c29-fb698603-45e8137e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.711012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.711014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.711015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.711020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.711025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.711037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.711163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.711170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.711180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.711252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3105 partition: 0 MaxSeqNo: 36 sessionId: src_id|830e19a9-b7f14c29-fb698603-45e8137e_0
2025-10-02T09:36:12.711480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9085dd33-e10cf563-e0b5b54d-c1e3b8d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|830e19a9-b7f14c29-fb698603-45e8137e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.713831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Write session: try to update token
2025-10-02T09:36:12.713846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.720013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.720026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.720028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.720030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.720036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.720039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.720043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415495827:11695]
2025-10-02T09:36:12.720065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.720070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.720074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.720075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.720076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.720077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.720201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.725911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId: src_id|830e19a9-b7f14c29-fb698603-45e8137e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.727907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.790842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491079446:2397]
2025-10-02T09:36:12.791087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3104, pipe: [1:7556555892491079446:2397]
2025-10-02T09:36:12.830259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.830553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.830562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.830585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079446:2397], now have 1 active actors on pipe
2025-10-02T09:36:12.830715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.830756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.830778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:12.830804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491079446:2397]
2025-10-02T09:36:12.830871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3105 reason: status is not ok: tablet will be restarted right now sessionId: src_id|830e19a9-b7f14c29-fb698603-45e8137e_0
2025-10-02T09:36:12.831028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3105 sessionId: src_id|830e19a9-b7f14c29-fb698603-45e8137e_0 is DEAD
2025-10-02T09:36:12.831155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:12.831168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Write session will restart in 0.008300s
2025-10-02T09:36:12.831194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Write session: Do CDS request
2025-10-02T09:36:12.831199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.839565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.840101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.840200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.840211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3106
2025-10-02T09:36:12.840297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.840323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.840331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.840334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.840665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3106 sessionId:  describe result for acl check
2025-10-02T09:36:12.840696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.840703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.840704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.840708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.840956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.841060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.841067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.841072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.841076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.841098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.841120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415496027:11697]
2025-10-02T09:36:12.841463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.841663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.841687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.841878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.841912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.841916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.841917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.841917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.841918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.841918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.841919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.841919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.841920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.841920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.841921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.841921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.841924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.841930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.841932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.841934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.841936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.841938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.841940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.841942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.841944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.841947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.841949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.841951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.841955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.841958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.841961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.841964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.841966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.841969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.841971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.841974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.841979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.841981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.841984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.841986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.841989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.841991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.841995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.841998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.842000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.842002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.842006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.842008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.842010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.842013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.842016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.842034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.842530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.846741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.846753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.846755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491079604:2437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.846759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.849393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.850902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.850913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.850914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.850916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.850919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3105 [2:7556555892415496027:11697]
2025-10-02T09:36:12.850927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.850937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.850938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.850940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.850941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.850950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.850955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.850959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.850991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.850996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.850997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.850999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.851001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.851035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.851040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.851047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.851052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.851060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.851074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079643:2437], now have 1 active actors on pipe
2025-10-02T09:36:12.851079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079447:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.851082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.851084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.851085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.851092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.851101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.851105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.851107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.851108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.851110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.851111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.851102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3105
2025-10-02T09:36:12.851109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3105
2025-10-02T09:36:12.851125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.851130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.851131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.851142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.851148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.851172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.851178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.851181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.851182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.851187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.851192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.851204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.851312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.851317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.851324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.851387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3106 partition: 0 MaxSeqNo: 36 sessionId: src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0
2025-10-02T09:36:12.851579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830e19a9-b7f14c29-fb698603-45e8137e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.853838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Write session: try to update token
2025-10-02T09:36:12.853854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.860250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.860267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.860271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.860272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.860278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.860281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.860284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415496022:11697]
2025-10-02T09:36:12.860306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.860310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.860314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.860315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.860315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.860317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.860433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:12.865389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId: src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:12.867522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:12.931096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555892491079656:2397]
2025-10-02T09:36:12.931268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3105, pipe: [1:7556555892491079656:2397]
2025-10-02T09:36:12.969308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:12.969634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.969644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.969668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079656:2397], now have 1 active actors on pipe
2025-10-02T09:36:12.969787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:12.969876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555892491079656:2397]
2025-10-02T09:36:12.969895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:12.969915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:12.970007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0
2025-10-02T09:36:12.970150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3106 sessionId: src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0 is DEAD
2025-10-02T09:36:12.970284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:12.970294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Write session will restart in 0.009721s
2025-10-02T09:36:12.970314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Write session: Do CDS request
2025-10-02T09:36:12.970319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:12.978645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:12.979919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:12.980022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:12.980029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:12.980035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:12.980060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:12.980083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555892415496223:11699]
2025-10-02T09:36:12.980427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:12.980589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:12.980611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:12.980783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:12.980824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.980831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.980831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.980833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.980833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.980834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.980837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.980844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.980848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.980850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.980852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.980854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.980856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.980858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.980860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.980862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.980864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.980868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.980872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:12.980875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.980878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:12.980880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.980882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:12.980886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.980889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:12.980891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.980894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:12.980896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.980899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:12.980901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.980903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:12.980905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.980908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:12.980910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.980913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:12.980915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.980918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.980920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.980923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.980926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.980928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.980945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:12.981128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.981211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:12.981222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3107
2025-10-02T09:36:12.981303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:12.981324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:12.981332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:12.981335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:12.981641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3107 sessionId:  describe result for acl check
2025-10-02T09:36:12.981665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:12.981670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:12.981671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:12.981676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:12.982106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:12.983818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:12.987781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:12.987791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:12.987793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555892491079820:2443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:12.987798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:12.988332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:12.989906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:12.989918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:12.989919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:12.989921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:12.989924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3106 [2:7556555892415496223:11699]
2025-10-02T09:36:12.989930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:12.989941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:12.989942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.989944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.989945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.989953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:12.989962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:12.989966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:12.990091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.990097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.990098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.990100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:12.990102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:12.990138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:12.990143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.990149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:12.990154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:12.990163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:12.990174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079854:2443], now have 1 active actors on pipe
2025-10-02T09:36:12.990176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555892491079657:2446], now have 1 active actors on pipe
2025-10-02T09:36:12.990179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.990184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.990185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.990192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:12.990200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:12.990203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:12.990205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:12.990206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:12.990210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:12.990212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:12.990210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3106
2025-10-02T09:36:12.990227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.990232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:12.990221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3106
2025-10-02T09:36:12.990233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:12.990244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.990246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.990270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf4609f-2513009d-20b28327-314c28d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:12.990276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:12.990278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:12.990279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:12.990284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:12.990289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:12.990298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.990393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:12.990398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:12.990405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:12.990466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3107 partition: 0 MaxSeqNo: 36 sessionId: src_id|8bf4609f-2513009d-20b28327-314c28d8_0
2025-10-02T09:36:12.990658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c68b5d-4b86a6c-db08d9b0-90a0b43c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8bf4609f-2513009d-20b28327-314c28d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:12.993104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Write session: try to update token
2025-10-02T09:36:12.993117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:12.999344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:12.999357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:12.999359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:12.999361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:12.999365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.999369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.999372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555892415496218:11699]
2025-10-02T09:36:12.999396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:12.999398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:12.999402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:12.999403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:12.999405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:12.999407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:12.999518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.005176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId: src_id|8bf4609f-2513009d-20b28327-314c28d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.007269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.069862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786047161:2397]
2025-10-02T09:36:13.070026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3106, pipe: [1:7556555896786047161:2397]
2025-10-02T09:36:13.109321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.109623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.109632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.109645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047161:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.109767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.109829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:13.109839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.109841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:13.109872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786047161:2397]
2025-10-02T09:36:13.109912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3107 reason: error at write: Disconnected sessionId: src_id|8bf4609f-2513009d-20b28327-314c28d8_0
2025-10-02T09:36:13.110054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3107 sessionId: src_id|8bf4609f-2513009d-20b28327-314c28d8_0 is DEAD
2025-10-02T09:36:13.110181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:13.110188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Write session will restart in 0.007891s
2025-10-02T09:36:13.110207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Write session: Do CDS request
2025-10-02T09:36:13.110212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.118614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.119135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.119240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.119251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3108
2025-10-02T09:36:13.119351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.119374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.119381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.119384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.119735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3108 sessionId:  describe result for acl check
2025-10-02T09:36:13.119759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.119764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.119765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.119769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.119897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.119994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.120001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.120006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.120032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.120056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710463715:11701]
2025-10-02T09:36:13.120202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.120404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.120566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.120589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.120767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.120796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.120812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.120814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.120815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.120815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.120816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.120816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.120817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.120817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.120818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.120818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.120819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.120822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.120828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.120831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.120833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.120834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.120836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.120838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.120840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.120842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.120845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.120847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.120848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.120852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.120857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.120860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.120863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.120865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.120868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.120870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.120873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.120875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.120878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.120880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.120883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.120886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.120889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.120891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.120894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.120896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.120899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.120901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.120904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.120906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.120908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.120912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.120915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.120932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.121537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.126616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.126628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.126630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786047321:2452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.126635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.128305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.129873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.129887Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.129888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.129890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.129894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3107 [2:7556555896710463715:11701]
2025-10-02T09:36:13.129902Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.129912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.129914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.129915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.129916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.129926Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.129928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.129932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.129963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.129964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.129965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.129967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.129968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.130008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.130013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.130020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.130026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.130035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.130049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047359:2452], now have 1 active actors on pipe
2025-10-02T09:36:13.130054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047162:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.130057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.130059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.130060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.130067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.130077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.130080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.130082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.130083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.130088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.130090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.130087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3107
2025-10-02T09:36:13.130099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3107
2025-10-02T09:36:13.130105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.130110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.130112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.130121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.130124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.130152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82f2e184-51841470-d9aedd4e-8829a809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.130159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.130161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.130162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.130168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.130173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.130185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.130272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.130277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.130285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.130338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3108 partition: 0 MaxSeqNo: 36 sessionId: src_id|82f2e184-51841470-d9aedd4e-8829a809_0
2025-10-02T09:36:13.130575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf4609f-2513009d-20b28327-314c28d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82f2e184-51841470-d9aedd4e-8829a809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.132915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Write session: try to update token
2025-10-02T09:36:13.132931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.139300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.139316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.139318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.139319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.139324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.139327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.139330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710463710:11701]
2025-10-02T09:36:13.139355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.139355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.139360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.139361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.139363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.139365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.139477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.144692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId: src_id|82f2e184-51841470-d9aedd4e-8829a809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.146827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.210145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786047368:2397]
2025-10-02T09:36:13.210364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3107, pipe: [1:7556555896786047368:2397]
2025-10-02T09:36:13.248657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.248884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.248893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.248917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047368:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.249081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.249112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:13.249126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:13.249131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.249177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3108 reason: error at write: Disconnected sessionId: src_id|82f2e184-51841470-d9aedd4e-8829a809_0
2025-10-02T09:36:13.249178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786047368:2397]
2025-10-02T09:36:13.249316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3108 sessionId: src_id|82f2e184-51841470-d9aedd4e-8829a809_0 is DEAD
2025-10-02T09:36:13.249472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:13.249480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Write session will restart in 0.006049s
2025-10-02T09:36:13.249503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Write session: Do CDS request
2025-10-02T09:36:13.249509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.256140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.256231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.256243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3109
2025-10-02T09:36:13.256339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.256364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.256371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.256375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.256785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3109 sessionId:  describe result for acl check
2025-10-02T09:36:13.256820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.256825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.256826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.256830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.257262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.259131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.262025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.262963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.262974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.262977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786047458:2473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.262982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.264117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.264264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.264273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.264281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.264323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.264353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710463942:11705]
2025-10-02T09:36:13.264947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.265143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.265179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.265470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.265517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.265523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.265524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.265525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.265526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.265527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.265527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.265528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.265529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.265530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.265531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.265532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.265537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.265546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.265550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.265553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.265557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.265562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.265566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.265569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.265574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.265578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.265584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.265587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.265594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.265600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.265609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.265613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.265619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.265623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.265631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.265636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.265641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.265646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.265654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.265658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.265666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.265670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.265676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.265681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.265690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.265696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.265700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.265709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.265712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.265721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.265725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.265733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.265764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.276127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.277775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.277787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.277788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.277790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.277794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3108 [2:7556555896710463942:11705]
2025-10-02T09:36:13.277800Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.277810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.277811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.277813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.277814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.277822Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.277827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.277831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.277867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.277872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.277873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.277875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.277876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.277911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.277916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.277923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.277928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.277940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.277955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047569:2473], now have 1 active actors on pipe
2025-10-02T09:36:13.277960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047369:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.277964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.277965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.277967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.277974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.277981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.277986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.277989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.277990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.277991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.277993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.278008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.278013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.278000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3108
2025-10-02T09:36:13.278003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3108
2025-10-02T09:36:13.278022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.278027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.278029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.278048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.278056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.278058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.278059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.278064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.278069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.278078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.278179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.278184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.278191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.278258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3109 partition: 0 MaxSeqNo: 36 sessionId: src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0
2025-10-02T09:36:13.278498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f2e184-51841470-d9aedd4e-8829a809_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.280869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Write session: try to update token
2025-10-02T09:36:13.280883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.287266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.287280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.287282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.287283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.287287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.287290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.287293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710463936:11705]
2025-10-02T09:36:13.287316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.287320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.287323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.287325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.287325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.287327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.287450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.293772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId: src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.295823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.349392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786047616:2397]
2025-10-02T09:36:13.349529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3108, pipe: [1:7556555896786047616:2397]
2025-10-02T09:36:13.396880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.397198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.397208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.397220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047616:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.397357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.397374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.397403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:13.397408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:13.397418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786047616:2397]
2025-10-02T09:36:13.397485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3109 reason: error at write: Disconnected sessionId: src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0
2025-10-02T09:36:13.397665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3109 sessionId: src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0 is DEAD
2025-10-02T09:36:13.397838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:13.397851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Write session will restart in 0.007911s
2025-10-02T09:36:13.397872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Write session: Do CDS request
2025-10-02T09:36:13.397878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.406026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.407284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.407382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.407396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3110
2025-10-02T09:36:13.407471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.407501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.407525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.407533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.407537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.407664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.407672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.407679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.407713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.407742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710464164:11720]
2025-10-02T09:36:13.407890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3110 sessionId:  describe result for acl check
2025-10-02T09:36:13.407916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.407921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.407923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.407927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.408090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.408253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.408277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.408419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.408454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.408483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.408487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.408487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.408488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.408489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.408489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.408490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.408490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.408491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.408491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.408492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.408492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.408495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.408501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.408504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.408506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.408508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.408510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.408512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.408514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.408516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.408519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.408521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.408523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.408528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.408532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.408535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.408539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.408541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.408544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.408546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.408549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.408551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.408554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.408556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.408559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.408561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.408564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.408566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.408568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.408571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.408578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.408580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.408583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.408585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.408588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.408590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.408592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.408608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.410251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.415269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.415281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.415283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786047779:2499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.415288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.415995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.417619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.417630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.417632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.417634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.417638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3109 [2:7556555896710464164:11720]
2025-10-02T09:36:13.417645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.417655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.417660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.417662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.417663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.417672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.417675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.417679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.417711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.417716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.417718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.417720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.417721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.417757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.417762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.417770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.417775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.417783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.417798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047817:2499], now have 1 active actors on pipe
2025-10-02T09:36:13.417803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047618:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.417807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.417808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.417809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.417817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.417824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.417830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.417832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.417834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.417835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.417836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.417836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3109
2025-10-02T09:36:13.417853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.417858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.417859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.417849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3109
2025-10-02T09:36:13.417870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.417875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.417902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.417908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.417910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.417912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.417917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.417922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.417932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.418030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.418036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.418043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.418101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3110 partition: 0 MaxSeqNo: 36 sessionId: src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0
2025-10-02T09:36:13.418363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6192c5d-cb6a2eb4-3bb74098-f078eba6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.420704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Write session: try to update token
2025-10-02T09:36:13.420717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.427426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.427443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.427445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.427446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.427452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.427455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.427458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710464159:11720]
2025-10-02T09:36:13.427485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.427485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.427488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.427490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.427493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.427495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.427623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.433291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId: src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.435664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.497398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786047825:2397]
2025-10-02T09:36:13.497576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3109, pipe: [1:7556555896786047825:2397]
2025-10-02T09:36:13.538727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.539037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.539046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.539059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047825:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.539196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.539227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786047825:2397]
2025-10-02T09:36:13.539255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.539298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:13.539363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0
2025-10-02T09:36:13.539512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3110 sessionId: src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0 is DEAD
2025-10-02T09:36:13.539691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:13.539702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Write session will restart in 0.007424s
2025-10-02T09:36:13.539726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Write session: Do CDS request
2025-10-02T09:36:13.539732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.547645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.548153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.548287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.548303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3111
2025-10-02T09:36:13.548417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.548444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.548453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.548456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.548817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3111 sessionId:  describe result for acl check
2025-10-02T09:36:13.548844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.548850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.548851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.548854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.548966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.549061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.549068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.549074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.549099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.549131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710464363:11722]
2025-10-02T09:36:13.549203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.549471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.549643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.549666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.549918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.549960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.549964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.549964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.549965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.549965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.549966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.549966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.549967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.549967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.549968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.549968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.549969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.549972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.549977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.549980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.549982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.549984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.549986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.549988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.549989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.549992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.549995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.549997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.549999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.550003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.550007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.550011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.550014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.550016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.550019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.550021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.550024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.550026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.550029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.550030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.550033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.550035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.550038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.550040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.550043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.550045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.550047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.550049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.550051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.550053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.550056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.550059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.550061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.550077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.550598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.555765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.555776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.555777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786047989:2515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.555782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.557445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.558965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.558976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.558977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.558979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.558982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3110 [2:7556555896710464363:11722]
2025-10-02T09:36:13.558989Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.559000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.559005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.559006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.559008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.559017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.559020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.559023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.559052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.559057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.559058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.559060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.559061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.559098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.559103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.559110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.559115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.559126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.559140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786047827:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.559145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048027:2515], now have 1 active actors on pipe
2025-10-02T09:36:13.559149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.559150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.559151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.559158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.559167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.559170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.559172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.559173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.559177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.559179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.559193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.559200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.559205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.559188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3110
2025-10-02T09:36:13.559199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3110
2025-10-02T09:36:13.559227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.559232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.559249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.559256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.559258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.559259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.559264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.559269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.559276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.559414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.559421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.559431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.559505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3111 partition: 0 MaxSeqNo: 36 sessionId: src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0
2025-10-02T09:36:13.559749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda4c089-4aec2f6e-23a4dd62-fb8f7367_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.562212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Write session: try to update token
2025-10-02T09:36:13.562230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.568288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.568302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.568305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.568306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.568311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.568315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.568318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710464358:11722]
2025-10-02T09:36:13.568342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.568346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.568350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.568351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.568353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.568354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.568475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.574400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId: src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.576673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.639223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786048035:2397]
2025-10-02T09:36:13.639402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3110, pipe: [1:7556555896786048035:2397]
2025-10-02T09:36:13.680025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.680245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.680255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.680268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048035:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.680417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.680465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786048035:2397]
2025-10-02T09:36:13.680486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.680493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:13.680553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0
2025-10-02T09:36:13.680682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3111 sessionId: src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0 is DEAD
2025-10-02T09:36:13.680857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:13.680867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Write session will restart in 0.008081s
2025-10-02T09:36:13.680887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Write session: Do CDS request
2025-10-02T09:36:13.680893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.689612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.690152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.690400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.690413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3112
2025-10-02T09:36:13.690511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.690534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.690541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.690545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.690920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3112 sessionId:  describe result for acl check
2025-10-02T09:36:13.690949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.690954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.690955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.690958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.691003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.691112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.691119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.691125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.691151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.691174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710464564:11724]
2025-10-02T09:36:13.691303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.691511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.691693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.691716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.691890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.691919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.691923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.691923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.691924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.691924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.691925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.691925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.691926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.691926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.691927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.691928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.691928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.691931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.691937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.691939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.691941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.691943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.691945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.691947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.691949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.691951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.691954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.691956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.691958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.691961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.691965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.691968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.691971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.691974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.691976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.691978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.691981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.691984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.691986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.691988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.691991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.691993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.691995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.691998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.692000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.692003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.692006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.692008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.692010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.692013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.692016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.692018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.692021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.692039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.692960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.697779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.697790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.697793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786048199:2524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.697796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.699448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.700870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.700881Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.700883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.700885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.700889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3111 [2:7556555896710464564:11724]
2025-10-02T09:36:13.700896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.700907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.700909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.700910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.700912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.700922Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.700928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.700934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.700968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.700973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.700974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.700976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.700977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.701015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.701020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.701026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.701031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.701043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.701056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.701063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.701064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.701070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.701078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048237:2524], now have 1 active actors on pipe
2025-10-02T09:36:13.701077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.701079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.701080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.701081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048036:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.701085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.701092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.701094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.701108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.701112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.701122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.701113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3111
2025-10-02T09:36:13.701127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3111
2025-10-02T09:36:13.701234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.701241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.701256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.701264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.701266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.701267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.701272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.701279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.701289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.701430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.701437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.701447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.701516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3112 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0
2025-10-02T09:36:13.701719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b96cd-3524df4a-86a8d17e-dda682a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.704041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Write session: try to update token
2025-10-02T09:36:13.704053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.710602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.710619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.710621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.710623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.710629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.710632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.710635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710464559:11724]
2025-10-02T09:36:13.710657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.710662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.710665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.710667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.710667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.710670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.710782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.715814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId: src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.718150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.780543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786048246:2397]
2025-10-02T09:36:13.780769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3111, pipe: [1:7556555896786048246:2397]
2025-10-02T09:36:13.822195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.822501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.822509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.822535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048246:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.822745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:13.822756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786048246:2397]
2025-10-02T09:36:13.822759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:13.822797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.822826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3112 reason: error at write: Disconnected sessionId: src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0
2025-10-02T09:36:13.822960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3112 sessionId: src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0 is DEAD
2025-10-02T09:36:13.823115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:13.823122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Write session will restart in 0.006118s
2025-10-02T09:36:13.823143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Write session: Do CDS request
2025-10-02T09:36:13.823148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.823520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.830181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.830263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.830277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3113
2025-10-02T09:36:13.830378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.830402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.830410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.830414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.830820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3113 sessionId:  describe result for acl check
2025-10-02T09:36:13.830848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.830853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.830855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.830859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.831288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.832311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.832785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.833565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.833709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.833717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.833723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.833755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.833776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710464766:11726]
2025-10-02T09:36:13.834128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.834297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.834320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.834516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.834558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.834563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.834563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.834564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.834565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.834565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.834566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.834566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.834567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.834567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.834568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.834568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.834571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.834578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.834580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.834582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.834584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.834586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.834588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.834590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.834592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.834594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.834596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.834598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.834602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.834606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.834609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.834612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.834614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.834617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.834619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.834622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.834624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.834628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.834630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.834633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.834635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.834638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.834640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.834643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.834645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.834648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.834651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.834653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.834656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.834659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.834662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.834666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.834683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.834694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.834707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.834708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786048381:2534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.834713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.842224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.843785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.843797Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.843798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.843800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.843804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3112 [2:7556555896710464766:11726]
2025-10-02T09:36:13.843811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.843821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.843823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.843825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.843826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.843835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.843838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.843844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.843873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.843878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.843879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.843881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.843882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.843917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.843922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.843928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.843933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.843943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.843957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048247:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.843962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048448:2534], now have 1 active actors on pipe
2025-10-02T09:36:13.843965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.843966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.843967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.843975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.843982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.843991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.843990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.843992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.843993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.843994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.844006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.844011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.844012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.844020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3112
2025-10-02T09:36:13.844035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3112
2025-10-02T09:36:13.844055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.844060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.844077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.844084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.844086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.844087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.844093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.844097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.844107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.844234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.844241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.844251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.844321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3113 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0
2025-10-02T09:36:13.844570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a74fc94-49a7ffc1-d8c8cf7a-3ba612ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.846862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Write session: try to update token
2025-10-02T09:36:13.846878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.853340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.853354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.853356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.853358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.853363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.853368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.853371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710464761:11726]
2025-10-02T09:36:13.853393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.853397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.853401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.853402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.853402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.853406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.854170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:13.860603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId: src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:13.862780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:13.922872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555896786048461:2397]
2025-10-02T09:36:13.923035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3112, pipe: [1:7556555896786048461:2397]
2025-10-02T09:36:13.963900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:13.964126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.964135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.964147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048461:2397], now have 1 active actors on pipe
2025-10-02T09:36:13.964293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:13.964356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:13.964378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555896786048461:2397]
2025-10-02T09:36:13.964394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:13.964455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3113 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0
2025-10-02T09:36:13.964590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3113 sessionId: src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0 is DEAD
2025-10-02T09:36:13.964703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:13.964713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Write session will restart in 0.009421s
2025-10-02T09:36:13.964741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Write session: Do CDS request
2025-10-02T09:36:13.964746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:13.973562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:13.974771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:13.974915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:13.974923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:13.974928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:13.974960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:13.975057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555896710464970:11728]
2025-10-02T09:36:13.975190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.975296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:13.975309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3114
2025-10-02T09:36:13.975403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:13.975434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:13.975459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:13.975467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:13.975470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:13.975587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:13.975611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:13.975788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:13.975815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.975819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.975820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.975820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.975821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.975821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.975822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.975822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.975823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.975823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.975824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.975825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.975828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.975834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.975836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.975838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.975840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.975842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.975844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.975846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.975848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.975850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.975852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.975854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.975859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.975863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:13.975865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3114 sessionId:  describe result for acl check
2025-10-02T09:36:13.975866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.975869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:13.975871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.975874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:13.975876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.975879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:13.975881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.975884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:13.975886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.975889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:13.975892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.975894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:13.975896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.975899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:13.975901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.975894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:13.975903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:13.975905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.975899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:13.975901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:13.975908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.975910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.975913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.975915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.975917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.975933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:13.975907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:13.976344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:13.978133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:13.982566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:13.982577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:13.982579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555896786048636:2545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:13.982583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:13.983300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:13.984945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:13.984956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:13.984957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:13.984959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:13.984962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3113 [2:7556555896710464970:11728]
2025-10-02T09:36:13.984969Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:13.984980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:13.984981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.984983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.984984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.984992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:13.984996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:13.985000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:13.985034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.985039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.985039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.985041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:13.985043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:13.985079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:13.985084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.985091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:13.985096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:13.985104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:13.985119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048469:2446], now have 1 active actors on pipe
2025-10-02T09:36:13.985124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555896786048669:2545], now have 1 active actors on pipe
2025-10-02T09:36:13.985128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.985129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.985130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.985138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:13.985146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:13.985149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:13.985150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:13.985151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:13.985157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:13.985159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:13.985151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3113
2025-10-02T09:36:13.985165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3113
2025-10-02T09:36:13.985172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.985177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:13.985178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:13.985186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.985188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.985217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e43a9466-7a23f6e4-831f4016-1121f317_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:13.985228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:13.985233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:13.985234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:13.985240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:13.985245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:13.985260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.985362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:13.985367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:13.985375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:13.985437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3114 partition: 0 MaxSeqNo: 36 sessionId: src_id|e43a9466-7a23f6e4-831f4016-1121f317_0
2025-10-02T09:36:13.985664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1976dd3-59db9a08-dc9d3cbb-25729793_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e43a9466-7a23f6e4-831f4016-1121f317_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:13.987921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Write session: try to update token
2025-10-02T09:36:13.987932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:13.994197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:13.994211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:13.994213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:13.994214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:13.994219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.994221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.994224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555896710464965:11728]
2025-10-02T09:36:13.994247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:13.994250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:13.994253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:13.994255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:13.994256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:13.994258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:13.994374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.001003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId: src_id|e43a9466-7a23f6e4-831f4016-1121f317_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.003108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.064688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081015976:2397]
2025-10-02T09:36:14.064852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3113, pipe: [1:7556555901081015976:2397]
2025-10-02T09:36:14.104828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.105091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.105100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.105113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081015976:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.105227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.105222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.105242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081015976:2397]
2025-10-02T09:36:14.105262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.105264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.105309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3114 reason: error at write: Disconnected sessionId: src_id|e43a9466-7a23f6e4-831f4016-1121f317_0
2025-10-02T09:36:14.105601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.105610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Write session will restart in 0.007804s
2025-10-02T09:36:14.105634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Write session: Do CDS request
2025-10-02T09:36:14.105639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.105443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3114 sessionId: src_id|e43a9466-7a23f6e4-831f4016-1121f317_0 is DEAD
2025-10-02T09:36:14.114158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.114424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.114315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.114327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3115
2025-10-02T09:36:14.114441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.114458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.114461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.114463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.114718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3115 sessionId:  describe result for acl check
2025-10-02T09:36:14.114744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.114753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.114755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.114760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.115123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.115740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.115883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.115891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.115897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.115927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.115953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005432468:11730]
2025-10-02T09:36:14.116315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.116470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.116496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.116673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.116703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.116707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.116708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.116708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.116709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.116709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.116710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.116711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.116711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.116712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.116712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.116713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.116715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.116722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.116724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.116726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.116728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.116730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.116732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.116734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.116736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.116739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.116741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.116743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.116745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.116747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.116751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.116754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.116757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.116759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.116762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.116765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.116767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.116770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.116772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.116775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.116777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.116780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.116782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.116784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.116787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.116789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.116793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.116795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.116797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.116810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.116813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.116815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.116818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.116835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.120632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.120645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.120647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081016143:2565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.120651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.124239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.125963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.125975Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.125977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.125979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.125983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3114 [2:7556555901005432468:11730]
2025-10-02T09:36:14.125989Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.125999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.126001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.126003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.126004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.126013Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.126020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.126024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.126052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.126057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.126058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.126060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.126061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.126098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.126103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.126110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.126115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.126123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.126137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016182:2565], now have 1 active actors on pipe
2025-10-02T09:36:14.126143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081015977:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.126147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.126148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.126149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.126157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.126165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.126170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.126172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.126174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.126175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.126177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.126165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3114
2025-10-02T09:36:14.126172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3114
2025-10-02T09:36:14.126191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.126197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.126198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.126207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.126209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.126233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.126240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.126242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.126243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.126248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.126253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.126263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.126342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.126348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.126355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.126415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3115 partition: 0 MaxSeqNo: 36 sessionId: src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0
2025-10-02T09:36:14.126657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a9466-7a23f6e4-831f4016-1121f317_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.129055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Write session: try to update token
2025-10-02T09:36:14.129074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.135551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.135567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.135569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.135571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.135577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.135584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.135587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005432463:11730]
2025-10-02T09:36:14.135613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.135614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.135616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.135618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.135620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.135622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.135745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.142288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId: src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.144449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.205462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081016190:2397]
2025-10-02T09:36:14.205603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3114, pipe: [1:7556555901081016190:2397]
2025-10-02T09:36:14.247892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.248234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.248242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.248254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016190:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.248420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.248446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081016190:2397]
2025-10-02T09:36:14.248466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.248472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.248474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.248526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3115 reason: error at write: Disconnected sessionId: src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0
2025-10-02T09:36:14.248681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3115 sessionId: src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0 is DEAD
2025-10-02T09:36:14.248832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.248843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Write session will restart in 0.007600s
2025-10-02T09:36:14.248861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Write session: Do CDS request
2025-10-02T09:36:14.248868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.257167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.257239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.257252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3116
2025-10-02T09:36:14.257319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.257342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.257352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.257355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.257683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3116 sessionId:  describe result for acl check
2025-10-02T09:36:14.257715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.257717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.257718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.257722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.257902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.258152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.259256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.259366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.259373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.259379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.259406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.259430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005432687:11734]
2025-10-02T09:36:14.259754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.260035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.260197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.260219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.260493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.260523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.260528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.260528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.260529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.260529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.260530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.260531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.260531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.260532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.260533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.260533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.260534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.260537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.260543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.260545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.260547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.260549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.260551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.260553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.260555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.260557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.260561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.260563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.260565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.260569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.260573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.260576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.260579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.260581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.260584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.260586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.260589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.260593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.260596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.260598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.260601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.260603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.260606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.260608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.260611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.260614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.260617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.260623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.260626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.260629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.260632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.260635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.260637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.260657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.264674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.264690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.264693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081016357:2571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.264700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.268070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.269686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.269698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.269699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.269701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.269705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3115 [2:7556555901005432687:11734]
2025-10-02T09:36:14.269713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.269723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.269725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.269726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.269727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.269737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.269743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.269747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.269778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.269782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.269783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.269785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.269786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.269822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.269827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.269833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.269839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.269850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.269864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016191:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.269869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016397:2571], now have 1 active actors on pipe
2025-10-02T09:36:14.269873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.269874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.269875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.269884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.269894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.269896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.269900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.269901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.269904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.269886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3115
2025-10-02T09:36:14.269906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.269906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3115
2025-10-02T09:36:14.269926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.269931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.269932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.269939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.269941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.269964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beeceef7-802089ce-f9a48297-2afe7d62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.269973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.269975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.269976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.269982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.269987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.269996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.270080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.270086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.270093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.270137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3116 partition: 0 MaxSeqNo: 36 sessionId: src_id|beeceef7-802089ce-f9a48297-2afe7d62_0
2025-10-02T09:36:14.270361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd0af8a-5b020d07-16c354fc-6f11fd13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|beeceef7-802089ce-f9a48297-2afe7d62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.272655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Write session: try to update token
2025-10-02T09:36:14.272670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.279012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.279024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.279025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.279027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.279031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.279033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.279035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005432682:11734]
2025-10-02T09:36:14.279056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.279056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.279058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.279059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.279060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.279060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.279170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.284476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId: src_id|beeceef7-802089ce-f9a48297-2afe7d62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.286546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.348842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081016431:2397]
2025-10-02T09:36:14.349015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3115, pipe: [1:7556555901081016431:2397]
2025-10-02T09:36:14.390681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.390959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.390968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.390995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016431:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.391144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.391128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.391162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.391163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.391181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081016431:2397]
2025-10-02T09:36:14.391204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3116 reason: error at write: Disconnected sessionId: src_id|beeceef7-802089ce-f9a48297-2afe7d62_0
2025-10-02T09:36:14.391353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3116 sessionId: src_id|beeceef7-802089ce-f9a48297-2afe7d62_0 is DEAD
2025-10-02T09:36:14.391500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.391512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Write session will restart in 0.005291s
2025-10-02T09:36:14.391532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Write session: Do CDS request
2025-10-02T09:36:14.391537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.398134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.398241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.398250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3117
2025-10-02T09:36:14.398357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.398377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.398385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.398388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.398757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3117 sessionId:  describe result for acl check
2025-10-02T09:36:14.398802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.398809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.398811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.398816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.399245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.399992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.401404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.401473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.401501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.401507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.401513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.401540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.401562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005432931:11748]
2025-10-02T09:36:14.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.402063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.402084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.402256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.402286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.402290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.402291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.402292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.402292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.402293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.402293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.402294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.402294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.402295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.402295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.402296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.402299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.402305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.402307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.402309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.402311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.402313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.402315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.402317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.402319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.402321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.402323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.402325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.402329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.402332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.402335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.402339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.402342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.402344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.402346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.402349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.402351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.402353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.402355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.402358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.402360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.402363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.402365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.402367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.402369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.402372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.402375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.402379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.402380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.402383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.402385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.402388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.402403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.406218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.406229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.406232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081016587:2601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.406237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.409790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.411418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.411429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.411430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.411432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.411435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3116 [2:7556555901005432931:11748]
2025-10-02T09:36:14.411442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.411451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.411453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.411454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.411455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.411464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.411468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.411473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.411501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.411506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.411507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.411509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.411511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.411545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.411550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.411558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.411567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.411577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.411591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016442:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.411596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016649:2601], now have 1 active actors on pipe
2025-10-02T09:36:14.411600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.411601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.411602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.411610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.411618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.411622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.411624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.411625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.411616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3116
2025-10-02T09:36:14.411629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.411631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.411631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3116
2025-10-02T09:36:14.411644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.411646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.411648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.411658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.411664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.411689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.411696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.411698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.411699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.411703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.411711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.411723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.411809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.411814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.411821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.411887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3117 partition: 0 MaxSeqNo: 36 sessionId: src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0
2025-10-02T09:36:14.412133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beeceef7-802089ce-f9a48297-2afe7d62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.414997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Write session: try to update token
2025-10-02T09:36:14.415008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.420766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.420782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.420784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.420786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.420792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.420795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.420797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005432926:11748]
2025-10-02T09:36:14.420839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.420839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.420842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.420845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.420846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.420849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.420955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.426927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId: src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.428957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.491156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081016656:2397]
2025-10-02T09:36:14.491280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3116, pipe: [1:7556555901081016656:2397]
2025-10-02T09:36:14.529578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.529854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.529863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.529876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016656:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.529994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.530018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.530044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.530050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.530093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3117 reason: error at write: Disconnected sessionId: src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0
2025-10-02T09:36:14.530240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3117 sessionId: src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0 is DEAD
2025-10-02T09:36:14.530357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.530365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Write session will restart in 0.008600s
2025-10-02T09:36:14.530380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Write session: Do CDS request
2025-10-02T09:36:14.530384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.530599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081016656:2397]
2025-10-02T09:36:14.539236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.540176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.540251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.540261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3118
2025-10-02T09:36:14.540397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.540417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.540423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.540425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.540664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.540761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.540767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.540773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.540797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.540875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005433137:11751]
2025-10-02T09:36:14.540878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3118 sessionId:  describe result for acl check
2025-10-02T09:36:14.540919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.540926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.540928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.540933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.541221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.541364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.541395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.541419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.541595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.541626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.541630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.541631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.541631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.541632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.541633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.541633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.541634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.541634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.541635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.541635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.541636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.541639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.541645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.541647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.541649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.541651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.541653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.541655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.541657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.541659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.541661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.541663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.541665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.541669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.541673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.541676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.541679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.541681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.541683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.541686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.541688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.541691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.541693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.541695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.541698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.541700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.541703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.541706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.541708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.541711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.541713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.541715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.541718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.541721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.541725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.541727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.541729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.541746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.542781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.547128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.547140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.547143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081016827:2621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.547149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.549163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.550685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.550695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.550697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.550699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.550702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3117 [2:7556555901005433137:11751]
2025-10-02T09:36:14.550709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.550720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.550725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.550727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.550729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.550738Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.550742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.550747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.550780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.550784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.550786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.550787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.550789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.550921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3117
2025-10-02T09:36:14.550943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.550934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3117
2025-10-02T09:36:14.550948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.550955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.550960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.550969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.550983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016866:2621], now have 1 active actors on pipe
2025-10-02T09:36:14.550988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016657:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.550997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.551001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.551012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.551017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.551018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.551026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.551036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.551037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.551039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.551041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.551047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.551048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.551057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.551064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.551066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.551067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.551072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.551079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.551098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.551107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.551113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.551116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.551209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.551214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.551221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.551274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3118 partition: 0 MaxSeqNo: 36 sessionId: src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0
2025-10-02T09:36:14.551494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb4d4-2dc40b3d-c835ddf7-1693f5ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.554321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Write session: try to update token
2025-10-02T09:36:14.554331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.560216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:14.560228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.560234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.560257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:14.560263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:14.560427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:14.560565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:14.560704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:14.560857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:14.561026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:14.561055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:14.566806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId: src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.568791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.568813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.568815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.568816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.568822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.568825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.568827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005433132:11751]
2025-10-02T09:36:14.568848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.568852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.568855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.568856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.568859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.568861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.568964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.569057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.630955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081016873:2397]
2025-10-02T09:36:14.631153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3117, pipe: [1:7556555901081016873:2397]
2025-10-02T09:36:14.678715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.679099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.679110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.679124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016873:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.679267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.679268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081016873:2397]
2025-10-02T09:36:14.679289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.679301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.679304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.679351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3118 reason: error at write: Disconnected sessionId: src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0
2025-10-02T09:36:14.679488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3118 sessionId: src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0 is DEAD
2025-10-02T09:36:14.679611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.679619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Write session will restart in 0.008598s
2025-10-02T09:36:14.679638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Write session: Do CDS request
2025-10-02T09:36:14.679643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.688603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.689151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.689212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.689223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3119
2025-10-02T09:36:14.689312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.689336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.689343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.689346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.689625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3119 sessionId:  describe result for acl check
2025-10-02T09:36:14.689649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.689653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.689654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.689658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.689999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.690115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.690211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.690218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.690224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.690249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.690273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005433345:11753]
2025-10-02T09:36:14.690629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.690778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.690809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.690987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.691017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.691021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.691021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.691022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.691023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.691023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.691024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.691024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.691025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.691025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.691026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.691026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.691029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.691035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.691038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.691040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.691042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.691044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.691046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.691047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.691049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.691052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.691054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.691056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.691059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.691063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.691067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.691070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.691073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.691077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.691079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.691082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.691084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.691087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.691089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.691091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.691093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.691096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.691101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.691104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.691106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.691108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.691110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.691113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.691116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.691118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.691121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.691127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.691145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.691278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.695904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.695913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.695914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081017044:2624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.695918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.698563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.700098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.700108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.700109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.700111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.700115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3118 [2:7556555901005433345:11753]
2025-10-02T09:36:14.700122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.700133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.700135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.700137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.700138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.700147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.700153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.700157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.700190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.700195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.700195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.700198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.700199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.700238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.700243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.700249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.700254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.700262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.700276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017082:2624], now have 1 active actors on pipe
2025-10-02T09:36:14.700283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081016874:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.700287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.700288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.700289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.700297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.700305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.700309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.700311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.700312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.700316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.700318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.700334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.700318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3118
2025-10-02T09:36:14.700339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.700318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3118
2025-10-02T09:36:14.700340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.700349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.700352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.700382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.700389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.700391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.700392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.700398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.700406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.700416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.700506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.700511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.700518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.700580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3119 partition: 0 MaxSeqNo: 36 sessionId: src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0
2025-10-02T09:36:14.700778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|172c86d0-b35f2b49-d2a62d26-2882c8bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.703519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Write session: try to update token
2025-10-02T09:36:14.703530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.709689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.709703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.709705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.709707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.709714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.709717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.709722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005433340:11753]
2025-10-02T09:36:14.709743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.709749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.709750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.709751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.709755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.709757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.709872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.715479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId: src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.717515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.779416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081017091:2397]
2025-10-02T09:36:14.779599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3118, pipe: [1:7556555901081017091:2397]
2025-10-02T09:36:14.821281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.821476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.821487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.821637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.821511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017091:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.821648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.821651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.821699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081017091:2397]
2025-10-02T09:36:14.821709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3119 reason: error at write: Disconnected sessionId: src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0
2025-10-02T09:36:14.821837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.821863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3119 sessionId: src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0 is DEAD
2025-10-02T09:36:14.821986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.821994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Write session will restart in 0.006357s
2025-10-02T09:36:14.822010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Write session: Do CDS request
2025-10-02T09:36:14.822015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.829247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.829327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.829339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3120
2025-10-02T09:36:14.829459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.829485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.829492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.829495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.829778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3120 sessionId:  describe result for acl check
2025-10-02T09:36:14.829805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.829809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.829810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.829813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.830148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.831036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.831618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.832397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.832493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.832499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.832505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.832531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.832556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005433554:11755]
2025-10-02T09:36:14.832909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.833070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.833093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.833268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.833386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.833393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.833393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.833394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.833394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.833395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.833397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.833398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.833398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.833402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.833407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.833409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.833411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.833413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.833415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.833417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.833419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.833421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.833424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.833426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.833429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.833433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.833437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.833440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.833443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.833445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.833448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.833450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.833453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.833455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.833458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.833460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.833462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.833465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.833467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.833470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.833472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.833475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.833478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.833480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.833482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.833484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.833487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.833489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.833492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.833508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.833556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.833565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.833567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081017251:2639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.833571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.841054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.842603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.842612Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.842613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.842615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.842618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3119 [2:7556555901005433554:11755]
2025-10-02T09:36:14.842625Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.842635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.842640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.842641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.842643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.842651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.842654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.842661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.842691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.842696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.842697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.842699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.842701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.842735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.842739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.842746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.842751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.842760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.842773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017303:2639], now have 1 active actors on pipe
2025-10-02T09:36:14.842778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017094:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.842782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.842783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.842784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.842792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.842807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.842811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.842813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.842814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.842818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.842820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.842820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3119
2025-10-02T09:36:14.842833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.842823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3119
2025-10-02T09:36:14.842838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.842840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.842857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.842862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.842878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.842885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.842888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.842889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.842894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.842899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.842908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.843035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.843042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.843053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.843110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3120 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0
2025-10-02T09:36:14.843356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5357f32c-662f89e2-b6c33c57-c07aa182_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.845848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Write session: try to update token
2025-10-02T09:36:14.845862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.851995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.852008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.852010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.852011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.852017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.852021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.852024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005433549:11755]
2025-10-02T09:36:14.852049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.852057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.852060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.852063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.852067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.852069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.852201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.858157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId: src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:14.860197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:14.921923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555901081017315:2397]
2025-10-02T09:36:14.922073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3119, pipe: [1:7556555901081017315:2397]
2025-10-02T09:36:14.961958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:14.962159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.962167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.962179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017315:2397], now have 1 active actors on pipe
2025-10-02T09:36:14.962326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:14.962355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:14.962361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:14.962368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:14.962400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555901081017315:2397]
2025-10-02T09:36:14.962420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3120 reason: error at write: Disconnected sessionId: src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0
2025-10-02T09:36:14.962571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3120 sessionId: src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0 is DEAD
2025-10-02T09:36:14.962742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:14.962759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Write session will restart in 0.005333s
2025-10-02T09:36:14.962794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Write session: Do CDS request
2025-10-02T09:36:14.962808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:14.969153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.969272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:14.969283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3121
2025-10-02T09:36:14.969398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:14.969424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:14.969432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:14.969435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:14.969756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3121 sessionId:  describe result for acl check
2025-10-02T09:36:14.969779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:14.969783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:14.969786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:14.969788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:14.970128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:14.972015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:14.972194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:14.973643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:14.973743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:14.973750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:14.973756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:14.973782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:14.973806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555901005433763:11757]
2025-10-02T09:36:14.973841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:14.973849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:14.973851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555901081017418:2659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:14.973854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:14.974140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:14.974296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:14.974317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:14.974503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:14.974535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.974539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.974539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.974540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.974541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.974541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.974542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.974542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.974543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.974543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.974544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.974544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.974547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.974553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.974555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.974557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.974559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.974561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.974563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.974565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.974567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.974569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.974571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.974573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.974576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.974580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:14.974583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.974585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:14.974588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.974590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:14.974592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.974595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:14.974597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.974599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:14.974601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.974604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:14.974606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.974609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:14.974611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.974613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:14.974616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.974618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:14.974622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.974625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.974626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.974630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.974632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.974638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.974655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:14.982006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:14.983500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:14.983510Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:14.983511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:14.983513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:14.983516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3120 [2:7556555901005433763:11757]
2025-10-02T09:36:14.983522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:14.983532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:14.983534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.983535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.983536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.983544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:14.983550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:14.983554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:14.983583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.983587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.983588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.983590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:14.983591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:14.983625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:14.983630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.983636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:14.983643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:14.983652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:14.983665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017526:2659], now have 1 active actors on pipe
2025-10-02T09:36:14.983671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555901081017320:2446], now have 1 active actors on pipe
2025-10-02T09:36:14.983675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.983676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.983677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.983686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:14.983696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:14.983698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:14.983700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:14.983701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:14.983705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:14.983689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3120
2025-10-02T09:36:14.983706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:14.983692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3120
2025-10-02T09:36:14.983721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.983726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:14.983727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:14.983736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.983738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.983765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:14.983773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:14.983775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:14.983776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:14.983781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:14.983787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:14.983799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.983886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:14.983893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:14.983900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:14.983953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3121 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0
2025-10-02T09:36:14.984184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd55da-d85d1d2f-93815a1b-fb8cdd62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:14.986558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Write session: try to update token
2025-10-02T09:36:14.986573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:14.992861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:14.992871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:14.992872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:14.992874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:14.992879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.992882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.992885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555901005433758:11757]
2025-10-02T09:36:14.992913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:14.992921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:14.992923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:14.992929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:14.992933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:14.992935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:14.993048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:14.999397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId: src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.001560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.062563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375984838:2397]
2025-10-02T09:36:15.062760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3120, pipe: [1:7556555905375984838:2397]
2025-10-02T09:36:15.108567Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.108797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.108821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.108836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375984838:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.108967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.108994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.108997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375984838:2397]
2025-10-02T09:36:15.109018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.109020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.109074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3121 reason: error at write: Disconnected sessionId: src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0
2025-10-02T09:36:15.109219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3121 sessionId: src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0 is DEAD
2025-10-02T09:36:15.109378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.109393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Write session will restart in 0.007737s
2025-10-02T09:36:15.109417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Write session: Do CDS request
2025-10-02T09:36:15.109425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.118190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.118272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.118283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3122
2025-10-02T09:36:15.118382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.118401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.118407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.118410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.118465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.118689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3122 sessionId:  describe result for acl check
2025-10-02T09:36:15.118715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.118719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.118720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.118724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.119073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.119844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.119963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.119970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.119976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.120005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.120029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300401270:11759]
2025-10-02T09:36:15.120294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.120515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.120539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.120714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.120744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.120748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.120749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.120749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.120750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.120751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.120751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.120752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.120752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.120753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.120753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.120754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.120757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.120763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.120765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.120767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.120769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.120771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.120773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.120775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.120777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.120779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.120781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.120783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.120787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.120791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.120794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.120797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.120814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.120817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.120819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.120822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.120824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.120827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.120830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.120832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.120834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.120837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.120839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.120842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.120849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.120852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.120854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.120857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.120859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.120861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.120867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.120869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.120885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.124702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.124711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.124713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375985012:2665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.124717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.128311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.130050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.130060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.130061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.130063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.130067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3121 [2:7556555905300401270:11759]
2025-10-02T09:36:15.130074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.130084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.130087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.130089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.130090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.130099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.130103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.130109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.130139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.130144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.130145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.130146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.130147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.130185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.130190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.130196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.130201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.130211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.130224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985051:2665], now have 1 active actors on pipe
2025-10-02T09:36:15.130229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375984839:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.130233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.130234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.130236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.130243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.130253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.130255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.130258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.130259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.130262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.130263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.130265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3121
2025-10-02T09:36:15.130270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3121
2025-10-02T09:36:15.130277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.130282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.130284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.130300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.130305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.130325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.130331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.130334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.130335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.130340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.130349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.130361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.130489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.130495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.130506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.130561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3122 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0
2025-10-02T09:36:15.130848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4e8ccb-fcb24d36-f8fe1cfb-b543ab5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.133215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Write session: try to update token
2025-10-02T09:36:15.133232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.139511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.139524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.139525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.139527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.139532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.139536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.139539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300401265:11759]
2025-10-02T09:36:15.139562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.139567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.139570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.139571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.139572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.139573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.139710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.145579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId: src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.147735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.208999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375985059:2397]
2025-10-02T09:36:15.209167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3121, pipe: [1:7556555905375985059:2397]
2025-10-02T09:36:15.257244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.257542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.257554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.257567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985059:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.257789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375985059:2397]
2025-10-02T09:36:15.257790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.257793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.257817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.257843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3122 reason: error at write: Disconnected sessionId: src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0
2025-10-02T09:36:15.257987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3122 sessionId: src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0 is DEAD
2025-10-02T09:36:15.258044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.258179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.258193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Write session will restart in 0.005707s
2025-10-02T09:36:15.258220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Write session: Do CDS request
2025-10-02T09:36:15.258225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.265148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.265253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.265267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3123
2025-10-02T09:36:15.265380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.265408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.265417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.265421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.265733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3123 sessionId:  describe result for acl check
2025-10-02T09:36:15.265757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.265761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.265762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.265765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.266113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.267387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.267904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.268785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.268892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.268898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.268904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.268930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.268955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300401496:11763]
2025-10-02T09:36:15.269294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.269513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.269539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.269731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.269764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.269768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.269760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.269768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.269768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.269769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.269769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.269770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.269770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.269770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375985191:2672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.269771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.269773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.269771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.269772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.269772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.269773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.269776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.269782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.269784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.269786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.269788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.269790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.269792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.269794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.269796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.269799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.269801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.269803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.269806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.269810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.269813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.269816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.269819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.269821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.269823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.269826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.269828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.269830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.269832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.269835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.269837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.269840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.269842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.269844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.269847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.269849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.269852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.269855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.269857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.269860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.269863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.269865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.269883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.277321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.278916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.278925Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.278926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.278928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.278932Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3122 [2:7556555905300401496:11763]
2025-10-02T09:36:15.278940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.278951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.278956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.278957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.278958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.278967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.278972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.278977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.279008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.279012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.279013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.279015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.279016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.279053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.279058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.279064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.279069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.279080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.279094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985271:2672], now have 1 active actors on pipe
2025-10-02T09:36:15.279099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985060:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.279104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.279106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.279107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.279115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.279127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.279128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.279130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.279131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.279122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3122
2025-10-02T09:36:15.279137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.279125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3122
2025-10-02T09:36:15.279138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.279164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.279169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.279176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.279184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.279192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.279202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.279209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.279211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.279212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.279217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.279225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.279241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.279324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.279329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.279337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.279391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3123 partition: 0 MaxSeqNo: 36 sessionId: src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0
2025-10-02T09:36:15.279646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0d94ca-561edb1e-24b9bcab-908c34f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.282063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Write session: try to update token
2025-10-02T09:36:15.282079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.288333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.288344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.288345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.288347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.288352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.288356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.288360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300401491:11763]
2025-10-02T09:36:15.288383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.288385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.288385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.288387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.288389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.288391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.288519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.294767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId: src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.296950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.357984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375985294:2397]
2025-10-02T09:36:15.358175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3122, pipe: [1:7556555905375985294:2397]
2025-10-02T09:36:15.403385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.403627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.403635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.403645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985294:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.403744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.403887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.403900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.403906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375985294:2397]
2025-10-02T09:36:15.403917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.403945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3123 reason: error at write: Disconnected sessionId: src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0
2025-10-02T09:36:15.404116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3123 sessionId: src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0 is DEAD
2025-10-02T09:36:15.404280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.404294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Write session will restart in 0.008072s
2025-10-02T09:36:15.404314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Write session: Do CDS request
2025-10-02T09:36:15.404319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.413158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.413254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.413265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3124
2025-10-02T09:36:15.413385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.413412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.413419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.413422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.413542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.413708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3124 sessionId:  describe result for acl check
2025-10-02T09:36:15.413732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.413736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.413737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.413740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.414047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.414739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.414904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.414912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.414918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.414951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.414972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300401747:11778]
2025-10-02T09:36:15.415205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.415311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.415473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.415494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.415671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.415700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.415704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.415705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.415705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.415706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.415706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.415707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.415707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.415708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.415708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.415709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.415709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.415712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.415718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.415720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.415722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.415724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.415726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.415728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.415730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.415732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.415734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.415736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.415738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.415741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.415745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.415748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.415751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.415753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.415756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.415758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.415761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.415763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.415766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.415768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.415771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.415773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.415776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.415778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.415781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.415783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.415785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.415787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.415790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.415792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.415795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.415797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.415800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.415816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.419648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.419657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.419659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375985496:2707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.419663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.423227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.424817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.424826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.424827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.424829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.424832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3123 [2:7556555905300401747:11778]
2025-10-02T09:36:15.424839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.424849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.424850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.424851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.424852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.424861Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.424867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.424871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.424902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.424907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.424908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.424910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.424911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.424946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.424951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.424957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.424964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.424972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.424985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.424989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.424990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.424995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.425002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.425012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.425012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.425014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.425015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.425017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.425036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985532:2707], now have 1 active actors on pipe
2025-10-02T09:36:15.425041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985321:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.425043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.425047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.425061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.425070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3123
2025-10-02T09:36:15.425074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3123
2025-10-02T09:36:15.425096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.425101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.425116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.425123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.425125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.425126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.425130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.425139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.425146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.425253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.425260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.425269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.425321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3124 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0
2025-10-02T09:36:15.425602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56e852e-be1d09a3-6aed0677-e01c99de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.427917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Write session: try to update token
2025-10-02T09:36:15.427930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.434293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.434306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.434308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.434309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.434316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.434319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.434322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300401742:11778]
2025-10-02T09:36:15.434349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.434350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.434354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.434355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.434357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.434359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.434489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.439818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId: src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.441973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.503923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375985539:2397]
2025-10-02T09:36:15.504336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3123, pipe: [1:7556555905375985539:2397]
2025-10-02T09:36:15.547867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.548079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.548089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.548114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985539:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.548334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.548337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.548347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.548368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375985539:2397]
2025-10-02T09:36:15.548404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3124 reason: error at write: Disconnected sessionId: src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0
2025-10-02T09:36:15.548408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.548544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3124 sessionId: src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0 is DEAD
2025-10-02T09:36:15.548736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.548751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Write session will restart in 0.009011s
2025-10-02T09:36:15.548771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Write session: Do CDS request
2025-10-02T09:36:15.548776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.558100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.559172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.559266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.559276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3125
2025-10-02T09:36:15.559425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.559450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.559459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.559462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.559484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.559580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.559587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.559592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.559617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.559641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300401960:11780]
2025-10-02T09:36:15.559756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3125 sessionId:  describe result for acl check
2025-10-02T09:36:15.559779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.559782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.559783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.559786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.559990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.560144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.560155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.560166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.560343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.560373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.560377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.560378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.560378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.560379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.560379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.560380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.560380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.560381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.560382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.560382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.560383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.560386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.560392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.560394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.560396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.560398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.560400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.560402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.560404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.560406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.560409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.560411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.560413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.560416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.560420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.560424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.560427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.560429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.560432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.560434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.560437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.560439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.560441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.560444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.560446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.560449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.560452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.560455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.560458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.560460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.560462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.560467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.560469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.560472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.560475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.560478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.560480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.560498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.561642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.565847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.565855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.565857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375985718:2708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.565861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.568027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.569687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.569697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.569698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.569700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.569704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3124 [2:7556555905300401960:11780]
2025-10-02T09:36:15.569713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.569723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.569726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.569728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.569729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.569738Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.569743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.569747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.569780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.569785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.569786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.569788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.569789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.569826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.569831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.569838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.569843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.569851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.569864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.569868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.569870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.569874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.569879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.569883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985756:2708], now have 1 active actors on pipe
2025-10-02T09:36:15.569884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.569886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.569886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985541:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.569891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.569898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.569901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.569917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.569922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.569923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.569908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3124
2025-10-02T09:36:15.569936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.569942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.569959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.569967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.569969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.569970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.569968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3124
2025-10-02T09:36:15.569975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.569983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.569996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.570105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.570110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.570117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.570173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3125 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0
2025-10-02T09:36:15.570424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1a4f96-f1571817-1a1a4960-ccf2d7b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.572771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Write session: try to update token
2025-10-02T09:36:15.572785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.579185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.579198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.579200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.579202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.579207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.579211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.579215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300401955:11780]
2025-10-02T09:36:15.579238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.579243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.579245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.579247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.579248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.579249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.579449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.584315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId: src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.586526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.648292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375985763:2397]
2025-10-02T09:36:15.648452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3124, pipe: [1:7556555905375985763:2397]
2025-10-02T09:36:15.691434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.691753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.691762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.691787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985763:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.691949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.691978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.691982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.691991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.692011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375985763:2397]
2025-10-02T09:36:15.692052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3125 reason: error at write: Disconnected sessionId: src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0
2025-10-02T09:36:15.692200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3125 sessionId: src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0 is DEAD
2025-10-02T09:36:15.692365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.692378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Write session will restart in 0.005369s
2025-10-02T09:36:15.692403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Write session: Do CDS request
2025-10-02T09:36:15.692409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.699159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.699262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.699273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3126
2025-10-02T09:36:15.699410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.699436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.699444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.699448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.699778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3126 sessionId:  describe result for acl check
2025-10-02T09:36:15.699802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.699807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.699808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.699811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.700152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.701435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.701622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.702932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.703035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.703042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.703048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.703075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.703099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300402175:11782]
2025-10-02T09:36:15.703377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.703385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.703387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375985894:2726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.703390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.703458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.703612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.703636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.703813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.703843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.703847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.703847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.703848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.703848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.703850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.703850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.703851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.703851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.703852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.703854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.703860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.703862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.703865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.703867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.703869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.703871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.703872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.703874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.703877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.703878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.703880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.703885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.703889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.703893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.703896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.703898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.703901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.703903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.703906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.703908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.703911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.703913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.703915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.703917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.703920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.703922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.703925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.703927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.703930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.703932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.703935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.703937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.703940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.703942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.703944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.703961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.711368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.713037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.713046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.713048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.713050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.713053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3125 [2:7556555905300402175:11782]
2025-10-02T09:36:15.713061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.713071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.713076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.713077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.713078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.713087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.713089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.713093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.713124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.713129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.713130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.713131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.713133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.713170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.713175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.713181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.713188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.713196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.713210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985764:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.713216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985975:2726], now have 1 active actors on pipe
2025-10-02T09:36:15.713219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.713221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.713222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.713231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.713241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.713242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.713244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.713246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.713250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.713252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.713265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.713270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.713272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.713256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3125
2025-10-02T09:36:15.713270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3125
2025-10-02T09:36:15.713286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.713291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.713309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4198550-d1846150-9be3dc84-997beabe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.713316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.713318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.713319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.713325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.713334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.713347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.713438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.713444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.713453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.713505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3126 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4198550-d1846150-9be3dc84-997beabe_0
2025-10-02T09:36:15.713759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc1337e3-c6acd37f-fd0a93a3-d24812c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4198550-d1846150-9be3dc84-997beabe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.716142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Write session: try to update token
2025-10-02T09:36:15.716161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.722428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.722442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.722444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.722446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.722451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.722454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.722457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300402170:11782]
2025-10-02T09:36:15.722479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.722484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.722486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.722488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.722489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.722489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.722693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.728155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId: src_id|d4198550-d1846150-9be3dc84-997beabe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.730314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.792159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375985988:2397]
2025-10-02T09:36:15.792320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3125, pipe: [1:7556555905375985988:2397]
2025-10-02T09:36:15.836100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.836358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.836366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.836391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985988:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.836537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.836595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:15.836601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.836641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375985988:2397]
2025-10-02T09:36:15.836671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3126 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4198550-d1846150-9be3dc84-997beabe_0
2025-10-02T09:36:15.836822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3126 sessionId: src_id|d4198550-d1846150-9be3dc84-997beabe_0 is DEAD
2025-10-02T09:36:15.836976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:15.836994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Write session will restart in 0.009817s
2025-10-02T09:36:15.837014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Write session: Do CDS request
2025-10-02T09:36:15.837019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.846534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.847815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.847944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.847952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.847958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.847987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.848012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300402391:11784]
2025-10-02T09:36:15.848167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.848257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.848268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3127
2025-10-02T09:36:15.848360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.848394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.848417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.848421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.848427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.848551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.848574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.848686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3127 sessionId:  describe result for acl check
2025-10-02T09:36:15.848712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.848717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.848718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.848721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.848755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.848784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.848788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.848788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.848789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.848790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.848790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.848791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.848791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.848792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.848792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.848793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.848793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.848796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.848819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.848821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.848823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.848825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.848827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.848829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.848831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.848833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.848836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.848838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.848840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.848844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.848848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.848852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.848855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.848857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.848860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.848862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.848865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.848867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.848870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.848872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.848874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.848877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.848879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.848881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.848884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.848886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.848889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.848891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.848894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.848902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.848904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.848906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.848909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.848926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.849078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.850357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.854265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.854273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.854275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375986170:2728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.854279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:15.856493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:15.858012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:15.858023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:15.858024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:15.858026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:15.858030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3126 [2:7556555905300402391:11784]
2025-10-02T09:36:15.858037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:15.858047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:15.858052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.858054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.858055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.858064Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:15.858067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:15.858071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:15.858101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.858105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.858106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.858108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:15.858109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:15.858148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:15.858152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.858159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.858165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.858176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:15.858190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375986206:2728], now have 1 active actors on pipe
2025-10-02T09:36:15.858196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375985989:2446], now have 1 active actors on pipe
2025-10-02T09:36:15.858200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.858204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.858205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.858214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:15.858224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:15.858225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:15.858227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:15.858228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:15.858234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:15.858236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:15.858226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3126
2025-10-02T09:36:15.858229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3126
2025-10-02T09:36:15.858250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.858255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:15.858256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:15.858267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.858272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.858297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3294eda6-e254df8c-9611de67-2e972c42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:15.858305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:15.858307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:15.858311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:15.858316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:15.858324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:15.858335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.858415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.858420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.858427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:15.858476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3127 partition: 0 MaxSeqNo: 36 sessionId: src_id|3294eda6-e254df8c-9611de67-2e972c42_0
2025-10-02T09:36:15.858714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4198550-d1846150-9be3dc84-997beabe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3294eda6-e254df8c-9611de67-2e972c42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:15.861100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Write session: try to update token
2025-10-02T09:36:15.861115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:15.867449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:15.867461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:15.867462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:15.867464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:15.867469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.867472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.867475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300402386:11784]
2025-10-02T09:36:15.867500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:15.867501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:15.867506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.867508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:15.867509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:15.867511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:15.867676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:15.873058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId: src_id|3294eda6-e254df8c-9611de67-2e972c42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:15.875217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:15.936547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555905375986221:2397]
2025-10-02T09:36:15.936697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3126, pipe: [1:7556555905375986221:2397]
2025-10-02T09:36:15.980815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:15.981143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:15.981152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:15.981164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375986221:2397], now have 1 active actors on pipe
2025-10-02T09:36:15.981286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:15.981321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555905375986221:2397]
2025-10-02T09:36:15.981330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:15.981333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:15.981348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:15.981381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3127 reason: error at write: Disconnected sessionId: src_id|3294eda6-e254df8c-9611de67-2e972c42_0
2025-10-02T09:36:15.981527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3127 sessionId: src_id|3294eda6-e254df8c-9611de67-2e972c42_0 is DEAD
2025-10-02T09:36:15.981698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:15.981713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Write session will restart in 0.009190s
2025-10-02T09:36:15.981739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Write session: Do CDS request
2025-10-02T09:36:15.981744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:15.991077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:15.992141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.992230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:15.992241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3128
2025-10-02T09:36:15.992400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:15.992427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:15.992435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:15.992438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:15.992461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:15.992570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:15.992578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:15.992585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:15.992614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:15.992637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555905300402608:11786]
2025-10-02T09:36:15.992700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3128 sessionId:  describe result for acl check
2025-10-02T09:36:15.992725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:15.992730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:15.992731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:15.992733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:15.992994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:15.993162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:15.993164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:15.993184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:15.993360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:15.993390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.993394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.993394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.993395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.993395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.993396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.993396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.993397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.993397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.993398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.993399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.993399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.993402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.993408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.993410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.993412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.993414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.993416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.993418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.993420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.993422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.993424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.993426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.993428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.993432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.993435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:15.993439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.993441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:15.993444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.993446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:15.993448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.993451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:15.993454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.993457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:15.993459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.993461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:15.993464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.993466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:15.993468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.993471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:15.993473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.993476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:15.993478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.993481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:15.993484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.993487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:15.993489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.993491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:15.993511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:15.994758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:15.998709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:15.998719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:15.998721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555905375986404:2734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:15.998726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.000911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.002521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.002532Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.002533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.002535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.002538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3127 [2:7556555905300402608:11786]
2025-10-02T09:36:16.002545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.002555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.002557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.002558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.002560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.002570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.002573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.002578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.002607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.002612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.002613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.002615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.002616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.002655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.002660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.002666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.002671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.002682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.002696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375986443:2734], now have 1 active actors on pipe
2025-10-02T09:36:16.002701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555905375986222:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.002705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.002706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.002707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.002714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.002724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.002726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.002728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.002729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.002734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.002736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.002749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.002754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.002733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3127
2025-10-02T09:36:16.002755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.002766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.002768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.002733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3127
2025-10-02T09:36:16.002791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e3038b3-80169650-e3e91a08-97762aad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.002797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.002799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.002800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.002812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.002818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.002828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.002911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.002916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.002923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.002979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3128 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e3038b3-80169650-e3e91a08-97762aad_0
2025-10-02T09:36:16.003241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3294eda6-e254df8c-9611de67-2e972c42_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e3038b3-80169650-e3e91a08-97762aad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.005558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Write session: try to update token
2025-10-02T09:36:16.005575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.011964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.011977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.011979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.011980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.011986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.011989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.011992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555905300402603:11786]
2025-10-02T09:36:16.012013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.012019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.012020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.012022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.012023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.012025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.012215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.019065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId: src_id|6e3038b3-80169650-e3e91a08-97762aad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.021280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.081441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670953747:2397]
2025-10-02T09:36:16.081606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3127, pipe: [1:7556555909670953747:2397]
2025-10-02T09:36:16.125412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.125637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.125645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.125658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670953747:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.125794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.125810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.125812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:16.125816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:16.125855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670953747:2397]
2025-10-02T09:36:16.125870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3128 reason: error at write: Disconnected sessionId: src_id|6e3038b3-80169650-e3e91a08-97762aad_0
2025-10-02T09:36:16.126041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3128 sessionId: src_id|6e3038b3-80169650-e3e91a08-97762aad_0 is DEAD
2025-10-02T09:36:16.126196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:16.126210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Write session will restart in 0.006521s
2025-10-02T09:36:16.126230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Write session: Do CDS request
2025-10-02T09:36:16.126236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.134198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.134311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.134322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3129
2025-10-02T09:36:16.134467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.134496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.134504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.134508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.134843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3129 sessionId:  describe result for acl check
2025-10-02T09:36:16.134875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.134881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.134882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.134886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.135304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.136161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.136678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.137447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.137546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.137552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.137558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.137582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.137604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595370124:11789]
2025-10-02T09:36:16.138095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.138259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.138280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.138473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.138505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.138509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.138509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.138510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.138510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.138511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.138511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.138512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.138513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.138513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.138514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.138515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.138517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.138523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.138525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.138527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.138529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.138531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.138533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.138535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.138537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.138540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.138542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.138544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.138548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.138551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.138554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.138557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.138559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.138562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.138564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.138566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.138569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.138571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.138573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.138576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.138578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.138584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.138586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.138589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.138592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.138598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.138600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.138604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.138609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.138612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.138613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.138616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.138635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.138617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.138625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.138627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670953910:2747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.138630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.146027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.147615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.147625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.147626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.147628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.147631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3128 [2:7556555909595370124:11789]
2025-10-02T09:36:16.147639Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.147648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.147653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.147655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.147656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.147666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.147668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.147674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.147705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.147710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.147711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.147712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.147714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.147751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.147755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.147761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.147767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.147778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.147791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670953965:2747], now have 1 active actors on pipe
2025-10-02T09:36:16.147796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670953748:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.147800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.147801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.147802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.147809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.147819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.147822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.147825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.147826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.147829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.147831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.147823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3128
2025-10-02T09:36:16.147830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3128
2025-10-02T09:36:16.147847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.147852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.147853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.147863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.147868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.147892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.147900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.147903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.147904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.147909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.147918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.147929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.148010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.148015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.148022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.148074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3129 partition: 0 MaxSeqNo: 36 sessionId: src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0
2025-10-02T09:36:16.148343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3038b3-80169650-e3e91a08-97762aad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.150711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Write session: try to update token
2025-10-02T09:36:16.150727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.157225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.157237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.157238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.157240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.157245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.157248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.157251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595370118:11789]
2025-10-02T09:36:16.157273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.157276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.157280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.157280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.157282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.157283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.157407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.162544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId: src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.164673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.225832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670953975:2397]
2025-10-02T09:36:16.226070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3128, pipe: [1:7556555909670953975:2397]
2025-10-02T09:36:16.270402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.270728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.270736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.270762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670953975:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.270953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.271022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.271029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670953975:2397]
2025-10-02T09:36:16.271087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:16.271158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3129 reason: status is not ok: tablet will be restarted right now sessionId: src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0
2025-10-02T09:36:16.271302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3129 sessionId: src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0 is DEAD
2025-10-02T09:36:16.271460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:16.271475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Write session will restart in 0.008915s
2025-10-02T09:36:16.271501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Write session: Do CDS request
2025-10-02T09:36:16.271506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.280827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.281141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.281231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.281242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3130
2025-10-02T09:36:16.281370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.281395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.281404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.281407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.281663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3130 sessionId:  describe result for acl check
2025-10-02T09:36:16.281688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.281692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.281693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.281696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.281955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.282176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.282270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.282277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.282282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.282307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.282330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595370354:11792]
2025-10-02T09:36:16.282666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.282880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.282902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.283127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.283166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.283170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.283170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.283171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.283172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.283172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.283173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.283173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.283174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.283174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.283175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.283175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.283178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.283183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.283185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.283188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.283190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.283192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.283193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.283195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.283197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.283201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.283203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.283205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.283209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.283213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.283216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.283219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.283221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.283223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.283226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.283228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.283231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.283233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.283238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.283241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.283243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.283246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.283251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.283254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.283256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.283259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.283261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.283267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.283269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.283272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.283277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.283279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.283296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.283345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.288001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.288008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.288010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670954169:2750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.288014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.290685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.292270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.292281Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.292282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.292284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.292288Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3129 [2:7556555909595370354:11792]
2025-10-02T09:36:16.292295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.292308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.292313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.292314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.292315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.292324Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.292327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.292331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.292361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.292366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.292367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.292369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.292370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.292405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.292410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.292416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.292421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.292433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.292447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954208:2750], now have 1 active actors on pipe
2025-10-02T09:36:16.292452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670953976:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.292456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.292457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.292459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.292467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.292478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.292479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.292481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.292482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.292488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.292490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.292475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3129
2025-10-02T09:36:16.292487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3129
2025-10-02T09:36:16.292508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.292513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.292518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.292521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.292523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.292546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.292553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.292555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.292556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.292562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.292570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.292581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.292667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.292672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.292679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.292730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3130 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0
2025-10-02T09:36:16.292991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822b14aa-6c0b78ed-9a63190d-f3fee956_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.295291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Write session: try to update token
2025-10-02T09:36:16.295304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.301672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.301685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.301687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.301688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.301694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.301697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.301702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595370349:11792]
2025-10-02T09:36:16.301724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.301727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.301732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.301732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.301733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.301734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.301852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.307252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId: src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.309386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.371282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670954217:2397]
2025-10-02T09:36:16.371423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3129, pipe: [1:7556555909670954217:2397]
2025-10-02T09:36:16.414598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.414861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.414869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.414895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954217:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.415009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.415045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670954217:2397]
2025-10-02T09:36:16.415068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:16.415117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3130 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0
2025-10-02T09:36:16.415264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3130 sessionId: src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0 is DEAD
2025-10-02T09:36:16.415356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.415430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:16.415446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Write session will restart in 0.008567s
2025-10-02T09:36:16.415468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Write session: Do CDS request
2025-10-02T09:36:16.415474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.424890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.425152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.425248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.425258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3131
2025-10-02T09:36:16.425381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.425405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.425411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.425414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.425666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3131 sessionId:  describe result for acl check
2025-10-02T09:36:16.425688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.425693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.425694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.425696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.425972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.426390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.426566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.426573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.426580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.426611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.426634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595370613:11805]
2025-10-02T09:36:16.426982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.427138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.427161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.427159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.427340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.427370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.427374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.427375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.427376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.427376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.427377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.427377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.427378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.427378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.427379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.427379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.427380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.427383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.427388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.427390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.427392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.427395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.427397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.427398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.427400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.427402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.427405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.427406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.427408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.427413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.427417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.427420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.427423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.427425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.427427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.427429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.427433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.427435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.427437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.427439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.427442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.427444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.427446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.427448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.427451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.427453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.427455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.427457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.427459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.427461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.427464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.427466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.427468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.427486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.431270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.431277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.431279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670954426:2783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.431283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.434929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.436463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.436473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.436474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.436476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.436479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3130 [2:7556555909595370613:11805]
2025-10-02T09:36:16.436486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.436496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.436500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.436502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.436504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.436513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.436515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.436519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.436550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.436554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.436555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.436557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.436559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.436594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.436599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.436606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.436611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.436618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.436633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954232:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.436638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954461:2783], now have 1 active actors on pipe
2025-10-02T09:36:16.436642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.436644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.436646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.436653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.436663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.436667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.436669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.436670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.436672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.436673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.436674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3130
2025-10-02T09:36:16.436689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.436694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.436696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.436679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3130
2025-10-02T09:36:16.436710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.436711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.436731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.436735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.436740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.436742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.436747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.436752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.436763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.436867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.436872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.436879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.436933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3131 partition: 0 MaxSeqNo: 36 sessionId: src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0
2025-10-02T09:36:16.437217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1978722-5fb6e7a5-154909aa-dd15b211_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.439596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Write session: try to update token
2025-10-02T09:36:16.439611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.445872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.445886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.445888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.445889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.445894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.445896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.445899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595370608:11805]
2025-10-02T09:36:16.445922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.445925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.445929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.445930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.445930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.445932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.446058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.451389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId: src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.453554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.515125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670954468:2397]
2025-10-02T09:36:16.515326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3130, pipe: [1:7556555909670954468:2397]
2025-10-02T09:36:16.560592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.560862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.560870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.560896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954468:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.561033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.561086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.561133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:16.561194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0
2025-10-02T09:36:16.561208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670954468:2397]
2025-10-02T09:36:16.561342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3131 sessionId: src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0 is DEAD
2025-10-02T09:36:16.561444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:16.561453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Write session will restart in 0.009322s
2025-10-02T09:36:16.561468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Write session: Do CDS request
2025-10-02T09:36:16.561473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.571736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.572190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.572356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.572367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3132
2025-10-02T09:36:16.572498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.572525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.572533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.572535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.572907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3132 sessionId:  describe result for acl check
2025-10-02T09:36:16.572939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.572945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.572946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.572951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.573301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.573468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.573566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.573573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.573579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.573606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.573628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595370835:11809]
2025-10-02T09:36:16.573974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.574182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.574204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.574400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.574433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.574437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.574437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.574438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.574438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.574439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.574439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.574440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.574441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.574441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.574445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.574451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.574453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.574455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.574457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.574459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.574460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.574462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.574464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.574466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.574468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.574470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.574474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.574478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.574482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.574485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.574489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.574493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.574497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.574502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.574505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.574507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.574509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.574511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.574516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.574518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.574521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.574523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.574526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.574528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.574531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.574533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.574536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.574540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.574542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.574559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.574864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.579352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.579362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.579367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670954653:2793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.579372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.582031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.583721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.583732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.583733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.583735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.583740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3131 [2:7556555909595370835:11809]
2025-10-02T09:36:16.583748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.583758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.583761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.583763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.583764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.583774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.583777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.583781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.583815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.583821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.583822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.583824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.583825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.583865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.583870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.583876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.583882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.583892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.583906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954470:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.583911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954692:2793], now have 1 active actors on pipe
2025-10-02T09:36:16.583916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.583917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.583919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.583928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.583938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.583941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.583944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.583926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3131
2025-10-02T09:36:16.583936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3131
2025-10-02T09:36:16.583945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.583947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.583949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.583975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.583980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.583987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.583994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.584007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.584011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.584015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.584018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.584019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.584026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.584031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.584045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.584141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.584147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.584154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.584196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3132 partition: 0 MaxSeqNo: 36 sessionId: src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0
2025-10-02T09:36:16.584378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cd6a5d-983fc939-4d4ba54c-c87d9458_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.587160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Write session: try to update token
2025-10-02T09:36:16.587171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.593422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.593438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.593440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.593442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.593450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.593453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.593457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595370829:11809]
2025-10-02T09:36:16.593485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.593487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.593491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.593492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.593494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.593495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.593625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.599461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId: src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.601698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.661544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670954702:2397]
2025-10-02T09:36:16.661727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3131, pipe: [1:7556555909670954702:2397]
2025-10-02T09:36:16.705269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.705498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.705507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.705519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954702:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.705690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.705678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.705702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670954702:2397]
2025-10-02T09:36:16.705722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:16.705724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:16.705775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3132 reason: error at write: Disconnected sessionId: src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0
2025-10-02T09:36:16.705927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3132 sessionId: src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0 is DEAD
2025-10-02T09:36:16.706270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:16.706279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Write session will restart in 0.005573s
2025-10-02T09:36:16.706298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Write session: Do CDS request
2025-10-02T09:36:16.706302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.713116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.713253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.713262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3133
2025-10-02T09:36:16.713378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.713403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.713410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.713413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.713799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3133 sessionId:  describe result for acl check
2025-10-02T09:36:16.713829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.713836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.713837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.713841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.714288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.715654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.715728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.717075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.717170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.717176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.717182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.717206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.717227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595371055:11811]
2025-10-02T09:36:16.717578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.717705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.717733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.717715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.717719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670954837:2801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.717723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.717756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.717928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.717958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.717962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.717962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.717963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.717964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.717964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.717965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.717965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.717966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.717966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.717967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.717967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.717970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.717976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.717978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.717980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.717982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.717984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.717986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.717988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.717990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.717992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.717994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.717996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.718000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.718003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.718007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.718009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.718011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.718014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.718016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.718019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.718021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.718024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.718026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.718028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.718030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.718033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.718035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.718038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.718042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.718044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.718047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.718050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.718052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.718055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.718058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.718060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.718077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.725465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.726953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.726964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.726965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.726967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.726970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3132 [2:7556555909595371055:11811]
2025-10-02T09:36:16.726979Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.726988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.726990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.726991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.726992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.727003Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.727009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.727013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.727044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.727049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.727050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.727051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.727053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.727088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.727093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.727100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.727105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.727113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.727128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954704:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.727133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954924:2801], now have 1 active actors on pipe
2025-10-02T09:36:16.727136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.727137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.727139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.727146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.727155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.727157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.727159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.727160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.727163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.727165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.727156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3132
2025-10-02T09:36:16.727159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3132
2025-10-02T09:36:16.727179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.727184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.727185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.727194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.727197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.727224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6639d4a-e1381bf8-f737b569-d189a514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.727231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.727235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.727236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.727240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.727248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.727258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.727339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.727343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.727350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.727400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3133 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6639d4a-e1381bf8-f737b569-d189a514_0
2025-10-02T09:36:16.727613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccac29d-10c87ff4-b815f538-2c7cd4d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6639d4a-e1381bf8-f737b569-d189a514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.730290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Write session: try to update token
2025-10-02T09:36:16.730301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.736433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.736449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.736450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.736453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.736459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.736463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.736467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595371050:11811]
2025-10-02T09:36:16.736490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.736492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.736495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.736495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.736500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.736501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.736676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.742415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId: src_id|d6639d4a-e1381bf8-f737b569-d189a514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.744586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.805941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670954934:2397]
2025-10-02T09:36:16.806144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3132, pipe: [1:7556555909670954934:2397]
2025-10-02T09:36:16.848825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.849049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.849059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.849071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954934:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.849233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.849252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670954934:2397]
2025-10-02T09:36:16.849269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.849280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:16.849340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3133 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6639d4a-e1381bf8-f737b569-d189a514_0
2025-10-02T09:36:16.849498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3133 sessionId: src_id|d6639d4a-e1381bf8-f737b569-d189a514_0 is DEAD
2025-10-02T09:36:16.849632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:16.849642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Write session will restart in 0.006570s
2025-10-02T09:36:16.849658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Write session: Do CDS request
2025-10-02T09:36:16.849662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:16.857120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.857229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:16.857238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3134
2025-10-02T09:36:16.857322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:16.857348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:16.857355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:16.857358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:16.857679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3134 sessionId:  describe result for acl check
2025-10-02T09:36:16.857709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:16.857715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:16.857716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:16.857721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:16.858168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:16.859884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:16.860776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:16.862179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:16.862276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:16.862282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:16.862288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:16.862315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:16.862307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:16.862317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:16.862320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555909670955034:2812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:16.862339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555909595371279:11813]
2025-10-02T09:36:16.862324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:16.862677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:16.862849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:16.862872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:16.863040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:16.863070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.863073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.863074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.863075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.863075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.863076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.863076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.863077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.863077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.863078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.863078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.863079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.863082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.863088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.863090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.863092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.863094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.863096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.863098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.863100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.863102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.863105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.863107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.863109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.863113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.863117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:16.863121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.863124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:16.863126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.863129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:16.863131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.863134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:16.863137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.863140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:16.863142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.863145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:16.863147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.863150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:16.863152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.863155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:16.863158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.863161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:16.863163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.863166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.863168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.863171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.863176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.863179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.863195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:16.870576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:16.872172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:16.872183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:16.872184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:16.872186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:16.872189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3133 [2:7556555909595371279:11813]
2025-10-02T09:36:16.872196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:16.872206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:16.872208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.872210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.872211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.872219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:16.872224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:16.872229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:16.872261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.872266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.872267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.872269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:16.872270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:16.872304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:16.872308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.872314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:16.872319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:16.872327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:16.872340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.872344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.872345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.872350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:16.872357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:16.872357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670954936:2446], now have 1 active actors on pipe
2025-10-02T09:36:16.872360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670955162:2812], now have 1 active actors on pipe
2025-10-02T09:36:16.872364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:16.872364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:16.872365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:16.872371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:16.872372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:16.872386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.872393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:16.872399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:16.872400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3133
2025-10-02T09:36:16.872402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3133
2025-10-02T09:36:16.872453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.872458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.872474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:16.872480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:16.872482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:16.872483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:16.872489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:16.872495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:16.872504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.872620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.872629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.872639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:16.872692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3134 partition: 0 MaxSeqNo: 36 sessionId: src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0
2025-10-02T09:36:16.872920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6639d4a-e1381bf8-f737b569-d189a514_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:16.875586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Write session: try to update token
2025-10-02T09:36:16.875596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:16.881687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:16.881703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:16.881704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:16.881706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:16.881713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.881717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.881720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555909595371273:11813]
2025-10-02T09:36:16.881748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:16.881748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:16.881751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:16.881753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:16.881757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:16.881760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:16.881898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:16.887625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId: src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:16.889692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:16.949462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555909670955179:2397]
2025-10-02T09:36:16.949653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3133, pipe: [1:7556555909670955179:2397]
2025-10-02T09:36:16.992709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:16.992925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:16.992933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:16.992945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670955179:2397], now have 1 active actors on pipe
2025-10-02T09:36:16.993067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:16.993093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:16.993099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555909670955179:2397]
2025-10-02T09:36:16.993104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:16.993112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:16.993154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3134 reason: error at write: Disconnected sessionId: src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0
2025-10-02T09:36:16.993316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3134 sessionId: src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0 is DEAD
2025-10-02T09:36:16.993463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:16.993471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Write session will restart in 0.007139s
2025-10-02T09:36:16.993490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Write session: Do CDS request
2025-10-02T09:36:16.993494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.001093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.001255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.001266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3135
2025-10-02T09:36:17.001395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.001424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.001432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.001436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.001833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3135 sessionId:  describe result for acl check
2025-10-02T09:36:17.001863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.001869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.001871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.001875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.002324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.003490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.004179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.004918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.005016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.005022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.005028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.005055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.005078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890338799:11815]
2025-10-02T09:36:17.005414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.005578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.005600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.005790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.005823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.005827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.005828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.005828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.005829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.005829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.005830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.005831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.005831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.005832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.005832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.005833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.005835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.005841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.005843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.005845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.005847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.005850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.005852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.005854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.005856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.005858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.005860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.005862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.005867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.005871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.005875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.005878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.005880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.005883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.005885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.005888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.005890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.005893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.005895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.005897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.005900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.005902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.005904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.005907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.005909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.005912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.005914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.005917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.005919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.005922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.005924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.005927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.005948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.005980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.005991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.005994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965922635:2823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.005998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.013391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.014960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.014970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.014971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.014976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3134 [2:7556555913890338799:11815]
2025-10-02T09:36:17.014985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.014995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.014996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.014998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.014999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.015009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.015015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.015019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.015050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.015055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.015057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.015059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.015060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.015098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.015103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.015110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.015115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.015126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.015141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922702:2823], now have 1 active actors on pipe
2025-10-02T09:36:17.015148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555909670955183:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.015152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.015153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.015155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.015163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.015171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.015176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.015172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3134
2025-10-02T09:36:17.015178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.015180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3134
2025-10-02T09:36:17.015178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.015179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.015180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.015195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.015196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.015198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.015206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.015208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.015235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.015242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.015246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.015247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.015253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.015259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.015271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.015353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.015358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.015366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.015419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3135 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0
2025-10-02T09:36:17.015641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bc1173-f5264427-c1794e3f-4d4c02b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.018448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Write session: try to update token
2025-10-02T09:36:17.018458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.024558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.024573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.024575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.024577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.024583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.024587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.024590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890338793:11815]
2025-10-02T09:36:17.024623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.024627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.024630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.024631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.024633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.024633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.024754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.030934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId: src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.033088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.093161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965922712:2397]
2025-10-02T09:36:17.093332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3134, pipe: [1:7556555913965922712:2397]
2025-10-02T09:36:17.134367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.134882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.134891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.134904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922712:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.135027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.135029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965922712:2397]
2025-10-02T09:36:17.135049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.135050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.135053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.135103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3135 reason: error at write: Disconnected sessionId: src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0
2025-10-02T09:36:17.135257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3135 sessionId: src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0 is DEAD
2025-10-02T09:36:17.135374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.135383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Write session will restart in 0.007133s
2025-10-02T09:36:17.135398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Write session: Do CDS request
2025-10-02T09:36:17.135403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.143175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.143277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.143286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3136
2025-10-02T09:36:17.143382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.143408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.143415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.143418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.143682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3136 sessionId:  describe result for acl check
2025-10-02T09:36:17.143706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.143711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.143712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.143715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.144080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.145529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.145850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.147053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.147154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.147160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.147165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.147192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.147215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890339026:11818]
2025-10-02T09:36:17.147562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.147716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.147738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.147750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.147759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.147761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965922854:2834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.147764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.147934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.147970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.147974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.147975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.147976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.147976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.147977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.147977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.147978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.147978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.147979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.147980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.147980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.147983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.147989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.147991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.147993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.147995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.147997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.147999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.148001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.148003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.148005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.148007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.148009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.148012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.148016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.148019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.148022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.148024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.148027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.148029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.148032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.148034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.148037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.148039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.148041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.148045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.148048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.148051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.148053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.148056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.148058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.148060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.148063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.148065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.148069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.148071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.148074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.148091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.155422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.157041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.157051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.157052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.157054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.157057Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3135 [2:7556555913890339026:11818]
2025-10-02T09:36:17.157063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.157072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.157074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.157075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.157076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.157084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.157091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.157094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.157126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.157130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.157131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.157133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.157134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.157171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.157176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.157182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.157187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.157199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.157212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922937:2834], now have 1 active actors on pipe
2025-10-02T09:36:17.157218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922713:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.157221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.157225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.157226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.157234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.157245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.157245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.157247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.157248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.157256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.157258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.157273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.157280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.157281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.157249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3135
2025-10-02T09:36:17.157251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3135
2025-10-02T09:36:17.157295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.157302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.157334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.157341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.157343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.157347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.157352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.157356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.157367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.157453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.157458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.157466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.157520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3136 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0
2025-10-02T09:36:17.157712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d4169f-3dc78866-d24f869a-1b943f13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.160376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Write session: try to update token
2025-10-02T09:36:17.160385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.166383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.166396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.166397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.166398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.166403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.166405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.166407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890339019:11818]
2025-10-02T09:36:17.166428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.166430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.166431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.166433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.166433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.166435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.166557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.172213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId: src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.174269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.234977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965922947:2397]
2025-10-02T09:36:17.235178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3135, pipe: [1:7556555913965922947:2397]
2025-10-02T09:36:17.279069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.279469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.279478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.279489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922947:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.279601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.279618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.279624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.279627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.279659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965922947:2397]
2025-10-02T09:36:17.279666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3136 reason: error at write: Disconnected sessionId: src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0
2025-10-02T09:36:17.279804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3136 sessionId: src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0 is DEAD
2025-10-02T09:36:17.279944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.279953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Write session will restart in 0.009455s
2025-10-02T09:36:17.279970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Write session: Do CDS request
2025-10-02T09:36:17.279975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.289889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.290118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.290280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.290291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3137
2025-10-02T09:36:17.290422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.290449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.290456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.290459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.290738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3137 sessionId:  describe result for acl check
2025-10-02T09:36:17.290761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.290766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.290767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.290769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.291087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.291425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.291522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.291528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.291534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.291560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.291586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890339263:11821]
2025-10-02T09:36:17.291925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.292099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.292121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.292292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.292320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.292324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.292324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.292325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.292325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.292326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.292326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.292327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.292327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.292328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.292328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.292329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.292332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.292337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.292339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.292342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.292343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.292346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.292348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.292349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.292351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.292354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.292355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.292357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.292361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.292364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.292368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.292371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.292373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.292375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.292377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.292380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.292382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.292385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.292387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.292390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.292395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.292397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.292400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.292406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.292408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.292410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.292413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.292415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.292418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.292420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.292423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.292440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.292697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.297163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.297174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.297176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965923148:2843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.297180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.299762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.301342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.301352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.301353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.301355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.301358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3136 [2:7556555913890339263:11821]
2025-10-02T09:36:17.301366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.301375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.301380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.301381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.301382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.301391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.301395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.301399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.301428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.301433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.301434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.301436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.301437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.301474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.301478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.301484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.301490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.301498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.301511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965922960:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.301517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923186:2843], now have 1 active actors on pipe
2025-10-02T09:36:17.301520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.301522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.301523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.301530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.301538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.301544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.301546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.301548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.301551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.301552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.301564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.301568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.301569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.301546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3136
2025-10-02T09:36:17.301547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3136
2025-10-02T09:36:17.301589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.301596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.301619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a46296-d4737d86-227e138b-3c7a76fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.301627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.301629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.301630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.301635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.301643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.301657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.301746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.301751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.301758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.301810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3137 partition: 0 MaxSeqNo: 36 sessionId: src_id|60a46296-d4737d86-227e138b-3c7a76fe_0
2025-10-02T09:36:17.301991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d2a02-88d01f8f-36cb5152-8633b5d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60a46296-d4737d86-227e138b-3c7a76fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.304706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Write session: try to update token
2025-10-02T09:36:17.304716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.310644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.310657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.310658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.310659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.310664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.310667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.310669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890339257:11821]
2025-10-02T09:36:17.310690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.310690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.310693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.310694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.310695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.310696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.310798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.316631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId: src_id|60a46296-d4737d86-227e138b-3c7a76fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.318747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.379861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965923197:2397]
2025-10-02T09:36:17.380006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3136, pipe: [1:7556555913965923197:2397]
2025-10-02T09:36:17.421258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.421660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.421670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.421681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923197:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.421827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.421840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.421844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.421848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.421886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965923197:2397]
2025-10-02T09:36:17.421913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3137 reason: error at write: Disconnected sessionId: src_id|60a46296-d4737d86-227e138b-3c7a76fe_0
2025-10-02T09:36:17.422061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3137 sessionId: src_id|60a46296-d4737d86-227e138b-3c7a76fe_0 is DEAD
2025-10-02T09:36:17.422287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.422294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Write session will restart in 0.009201s
2025-10-02T09:36:17.422317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Write session: Do CDS request
2025-10-02T09:36:17.422322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.432237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.432267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.432279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3138
2025-10-02T09:36:17.432440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.432462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.432467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.432469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.432722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3138 sessionId:  describe result for acl check
2025-10-02T09:36:17.432753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.432759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.432761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.432766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.433140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.433215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.434726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.434843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.434850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.434856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.434847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.434885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.434911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890339521:11834]
2025-10-02T09:36:17.435260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.435444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.435467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.435721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.435755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.435759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.435760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.435760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.435761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.435761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.435762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.435762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.435763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.435763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.435764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.435764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.435767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.435772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.435774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.435776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.435778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.435780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.435782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.435784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.435786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.435789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.435791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.435793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.435797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.435801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.435805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.435807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.435809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.435812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.435814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.435816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.435819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.435822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.435823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.435826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.435828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.435831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.435833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.435835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.435837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.435840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.435842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.435844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.435846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.435849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.435852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.435854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.435871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.439748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.439763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.439765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965923398:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.439771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.443345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.445327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.445338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.445340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.445342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.445345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3137 [2:7556555913890339521:11834]
2025-10-02T09:36:17.445352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.445361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.445362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.445364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.445365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.445374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.445381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.445385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.445414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.445418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.445419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.445421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.445422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.445543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.445548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.445555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.445561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.445572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.445584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923438:2869], now have 1 active actors on pipe
2025-10-02T09:36:17.445589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923198:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.445592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.445594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.445595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.445599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.445580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3137
2025-10-02T09:36:17.445607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.445607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.445609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.445610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.445617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.445619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.445604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3137
2025-10-02T09:36:17.445632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.445637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.445658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.445666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.445674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820bd3b9-636fa774-e9782314-234da156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.445675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.445680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.445682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.445683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.445688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.445693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.445715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.445810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.445815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.445822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.445881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3138 partition: 0 MaxSeqNo: 36 sessionId: src_id|820bd3b9-636fa774-e9782314-234da156_0
2025-10-02T09:36:17.446153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a46296-d4737d86-227e138b-3c7a76fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|820bd3b9-636fa774-e9782314-234da156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.452070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Write session: try to update token
2025-10-02T09:36:17.452086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.454853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.454865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.454867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.454868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.454873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.454876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.454879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890339515:11834]
2025-10-02T09:36:17.454901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.454904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.454906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.454906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.454910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.454912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.455034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.467441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId: src_id|820bd3b9-636fa774-e9782314-234da156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.469585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.522219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965923455:2397]
2025-10-02T09:36:17.522410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3137, pipe: [1:7556555913965923455:2397]
2025-10-02T09:36:17.564973Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.565188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.565195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.565209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923455:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.565331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.565406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.565409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:17.565451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965923455:2397]
2025-10-02T09:36:17.565473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|820bd3b9-636fa774-e9782314-234da156_0
2025-10-02T09:36:17.565637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3138 sessionId: src_id|820bd3b9-636fa774-e9782314-234da156_0 is DEAD
2025-10-02T09:36:17.565809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:17.565823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Write session will restart in 0.007747s
2025-10-02T09:36:17.565849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Write session: Do CDS request
2025-10-02T09:36:17.565856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.574298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.574376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.574390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3139
2025-10-02T09:36:17.574541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.574571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.574581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.574584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.574940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3139 sessionId:  describe result for acl check
2025-10-02T09:36:17.574970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.574978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.574979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.574984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.575419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.576391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.577206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.577883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.578015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.578023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.578029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.578058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.578084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890339756:11838]
2025-10-02T09:36:17.578428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.578587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.578609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.578781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.578819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.578824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.578824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.578825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.578826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.578826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.578827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.578827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.578828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.578828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.578829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.578829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.578832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.578839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.578841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.578843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.578845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.578847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.578849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.578851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.578853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.578855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.578857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.578859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.578863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.578867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.578870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.578873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.578875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.578878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.578881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.578883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.578886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.578888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.578891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.578893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.578896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.578899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.578901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.578904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.578907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.578909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.578911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.578914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.578916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.578919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.578921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.578923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.578941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.580811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.580823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.580825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965923627:2878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.580830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.586311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.588011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.588024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.588025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.588028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.588033Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3138 [2:7556555913890339756:11838]
2025-10-02T09:36:17.588041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.588052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.588057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.588058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.588059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.588068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.588072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.588076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.588107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.588111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.588112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.588114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.588116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.588153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.588157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.588163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.588168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.588176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.588191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923686:2878], now have 1 active actors on pipe
2025-10-02T09:36:17.588198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.588200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.588201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.588207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.588213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923457:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.588218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.588220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.588222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.588223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.588228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.588230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.588245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.588249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.588255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.588270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.588275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.588243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3138
2025-10-02T09:36:17.588292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.588299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.588301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.588244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3138
2025-10-02T09:36:17.588302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.588308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.588313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.588324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.588419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.588423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.588431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.588485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3139 partition: 0 MaxSeqNo: 36 sessionId: src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0
2025-10-02T09:36:17.588769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820bd3b9-636fa774-e9782314-234da156_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.591452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Write session: try to update token
2025-10-02T09:36:17.591468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.597431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.597443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.597445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.597447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.597453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.597456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.597459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890339750:11838]
2025-10-02T09:36:17.597487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.597489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.597492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.597494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.597496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.597498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.597623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.605578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId: src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.607795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.665579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965923693:2397]
2025-10-02T09:36:17.665760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3138, pipe: [1:7556555913965923693:2397]
2025-10-02T09:36:17.711131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.711351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.711361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.711373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923693:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.711522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.711506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.711546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.711548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.711553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965923693:2397]
2025-10-02T09:36:17.711612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3139 reason: error at write: Disconnected sessionId: src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0
2025-10-02T09:36:17.711775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3139 sessionId: src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0 is DEAD
2025-10-02T09:36:17.711941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.711953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Write session will restart in 0.008400s
2025-10-02T09:36:17.711984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Write session: Do CDS request
2025-10-02T09:36:17.711991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.721138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.721240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.721253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3140
2025-10-02T09:36:17.721370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.721397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.721402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.721405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.721707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3140 sessionId:  describe result for acl check
2025-10-02T09:36:17.721735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.721741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.721743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.721746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.721983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.722098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.723339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.723417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.723436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.723442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.723448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.723473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.723497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890339983:11840]
2025-10-02T09:36:17.723837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.724004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.724027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.724205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.724234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.724238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.724238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.724239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.724239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.724240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.724240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.724241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.724242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.724242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.724243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.724243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.724246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.724252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.724257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.724259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.724261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.724263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.724265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.724267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.724269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.724271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.724273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.724277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.724282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.724285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.724288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.724290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.724293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.724295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.724298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.724300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.724303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.724306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.724308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.724310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.724313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.724315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.724318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.724324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.724327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.724329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.724332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.724334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.724337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.724339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.724342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.724360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.728205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.728214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.728216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965923885:2890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.728220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.731897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.733640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.733651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.733652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.733654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.733657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3139 [2:7556555913890339983:11840]
2025-10-02T09:36:17.733665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.733675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.733680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.733681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.733683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.733692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.733696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.733700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.733729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.733734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.733735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.733737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.733738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.733775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.733779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.733786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.733791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.733799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.733813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923695:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.733818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923925:2890], now have 1 active actors on pipe
2025-10-02T09:36:17.733822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.733823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.733824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.733831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.733839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.733840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.733842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.733843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.733848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.733849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.733868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.733872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.733843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3139
2025-10-02T09:36:17.733873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.733884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.733886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.733848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3139
2025-10-02T09:36:17.733911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.733918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.733920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.733921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.733926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.733932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.733944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.734033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.734038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.734045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.734092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3140 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0
2025-10-02T09:36:17.734360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fd6120b-85a83b2d-34676e94-fb34330c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.737132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Write session: try to update token
2025-10-02T09:36:17.737152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.743028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.743039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.743041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.743043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.743047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.743051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.743053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890339978:11840]
2025-10-02T09:36:17.743076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.743080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.743080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.743082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.743083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.743085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.743240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.751432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId: src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.753669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.811488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965923932:2397]
2025-10-02T09:36:17.811646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3139, pipe: [1:7556555913965923932:2397]
2025-10-02T09:36:17.853598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.853818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.853827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.853838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923932:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.854016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.854040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.854043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.854053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965923932:2397]
2025-10-02T09:36:17.854059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.854089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3140 reason: error at write: Disconnected sessionId: src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0
2025-10-02T09:36:17.854219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3140 sessionId: src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0 is DEAD
2025-10-02T09:36:17.854380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.854396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Write session will restart in 0.006095s
2025-10-02T09:36:17.854421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Write session: Do CDS request
2025-10-02T09:36:17.854428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:17.861157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.861267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:17.861276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3141
2025-10-02T09:36:17.861395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:17.861416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:17.861422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:17.861425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:17.861689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3141 sessionId:  describe result for acl check
2025-10-02T09:36:17.861712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:17.861716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:17.861717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:17.861720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:17.862058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:17.863836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:17.864553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:17.865898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:17.866023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:17.866030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:17.866036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:17.866038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:17.866045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:17.866047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555913965924032:2892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:17.866050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:17.866064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:17.866087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555913890340214:11842]
2025-10-02T09:36:17.866423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:17.866576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:17.866597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:17.866771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:17.866800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.866804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.866804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.866805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.866805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.866806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.866806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.866807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.866807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.866808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.866808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.866809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.866812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.866824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.866826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.866828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.866830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.866832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.866834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.866836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.866838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.866841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.866843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.866844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.866848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.866852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:17.866855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.866858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:17.866860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.866863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:17.866866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.866868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:17.866872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.866874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:17.866876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.866878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:17.866880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.866883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:17.866885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.866887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:17.866889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.866892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:17.866894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.866896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.866898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.866901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.866903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.866905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.866923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:17.874278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:17.875981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:17.875991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:17.875993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:17.875994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:17.875998Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3140 [2:7556555913890340214:11842]
2025-10-02T09:36:17.876005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:17.876014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:17.876019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.876021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.876022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.876031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:17.876036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:17.876040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:17.876070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.876075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.876076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.876078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:17.876079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:17.876115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:17.876120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.876127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:17.876132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:17.876142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:17.876156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965924160:2892], now have 1 active actors on pipe
2025-10-02T09:36:17.876161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965923933:2446], now have 1 active actors on pipe
2025-10-02T09:36:17.876166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.876167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.876169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.876177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:17.876187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:17.876189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:17.876191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:17.876192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:17.876197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:17.876199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:17.876193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3140
2025-10-02T09:36:17.876195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3140
2025-10-02T09:36:17.876212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.876217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:17.876219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:17.876227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.876232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.876258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:17.876264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:17.876267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:17.876268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:17.876273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:17.876278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:17.876289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.876385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.876390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.876397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:17.876451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3141 partition: 0 MaxSeqNo: 36 sessionId: src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0
2025-10-02T09:36:17.876723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a44b13c-8fb3d6cb-9663a7f5-21016d07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:17.879397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Write session: try to update token
2025-10-02T09:36:17.879415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:17.885359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:17.885372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:17.885373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:17.885375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:17.885380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.885383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.885386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555913890340208:11842]
2025-10-02T09:36:17.885407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:17.885413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:17.885415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:17.885416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:17.885418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:17.885418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:17.885580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:17.892884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId: src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:17.895013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:17.954338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555913965924177:2397]
2025-10-02T09:36:17.954481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3140, pipe: [1:7556555913965924177:2397]
2025-10-02T09:36:17.995523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:17.995725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:17.995734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:17.995746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965924177:2397], now have 1 active actors on pipe
2025-10-02T09:36:17.995865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:17.995882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:17.995892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:17.995893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:17.995923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555913965924177:2397]
2025-10-02T09:36:17.995937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3141 reason: error at write: Disconnected sessionId: src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0
2025-10-02T09:36:17.996073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3141 sessionId: src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0 is DEAD
2025-10-02T09:36:17.996238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:17.996253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Write session will restart in 0.005097s
2025-10-02T09:36:17.996283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Write session: Do CDS request
2025-10-02T09:36:17.996288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.002151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.002238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.002245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3142
2025-10-02T09:36:18.002371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.002391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.002397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.002399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.002758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3142 sessionId:  describe result for acl check
2025-10-02T09:36:18.002787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.002793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.002794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.002800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.003261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.005310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.006562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.008092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.008200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.008207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.008213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.008221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.008232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.008234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260891546:2915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.008239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.008240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.008270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185307741:11844]
2025-10-02T09:36:18.008615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.008773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.008796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.008979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.009007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.009011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.009012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.009012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.009013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.009014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.009014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.009015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.009015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.009016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.009016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.009017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.009019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.009025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.009027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.009029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.009031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.009033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.009035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.009037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.009039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.009041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.009043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.009044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.009049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.009053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.009056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.009059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.009061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.009064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.009066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.009069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.009071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.009074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.009076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.009079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.009083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.009087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.009089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.009092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.009094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.009096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.009102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.009104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.009107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.009110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.009112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.009115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.009132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.016524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.018187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.018198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.018199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.018201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.018205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3141 [2:7556555918185307741:11844]
2025-10-02T09:36:18.018212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.018222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.018223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.018225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.018226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.018235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.018238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.018242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.018275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.018276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.018276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.018278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.018280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.018317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.018319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.018325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.018330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.018338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.018350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555913965924181:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.018353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891705:2915], now have 1 active actors on pipe
2025-10-02T09:36:18.018357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.018358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.018360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.018367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.018375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.018380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.018382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.018382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.018383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.018383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.018398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.018401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.018400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3141
2025-10-02T09:36:18.018402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3141
2025-10-02T09:36:18.018417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.018446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.018452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.018466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.018472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.018475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.018476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.018481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.018486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.018493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.018614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.018619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.018629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.018691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3142 partition: 0 MaxSeqNo: 36 sessionId: src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0
2025-10-02T09:36:18.019027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f83ed-f38ee9a0-44f4d523-852491bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.021699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Write session: try to update token
2025-10-02T09:36:18.021715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.027523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.027537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.027539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.027540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.027546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.027549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.027552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185307735:11844]
2025-10-02T09:36:18.027575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.027578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.027581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.027583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.027583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.027585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.027707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.034527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId: src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.036709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.096161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260891717:2397]
2025-10-02T09:36:18.096329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3141, pipe: [1:7556555918260891717:2397]
2025-10-02T09:36:18.137120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.137468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.137477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.137489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891717:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.137601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.137641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260891717:2397]
2025-10-02T09:36:18.137672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:18.137672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.137726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0
2025-10-02T09:36:18.137850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3142 sessionId: src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0 is DEAD
2025-10-02T09:36:18.137951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:18.137974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Write session will restart in 0.008644s
2025-10-02T09:36:18.137987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Write session: Do CDS request
2025-10-02T09:36:18.137991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.147151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.147292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.147309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3143
2025-10-02T09:36:18.147458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.147488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.147492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.147495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.147839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3143 sessionId:  describe result for acl check
2025-10-02T09:36:18.147877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.147884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.147887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.147890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.148084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.148381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.149576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.149670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.149676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.149681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.149705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.149727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185307975:11847]
2025-10-02T09:36:18.149952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.150065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.150209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.150231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.150407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.150436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.150440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.150440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.150441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.150442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.150442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.150443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.150443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.150444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.150444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.150445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.150445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.150448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.150454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.150456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.150458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.150460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.150462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.150464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.150466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.150468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.150470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.150472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.150474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.150477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.150481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.150484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.150487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.150489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.150492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.150494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.150497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.150501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.150503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.150506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.150508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.150511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.150513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.150516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.150518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.150523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.150527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.150530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.150533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.150535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.150537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.150540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.150558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.154309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.154316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.154318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260891911:2920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.154322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.157908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.159645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.159657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.159658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.159659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.159662Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3142 [2:7556555918185307975:11847]
2025-10-02T09:36:18.159671Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.159680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.159685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.159686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.159688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.159695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.159699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.159704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.159736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.159741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.159742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.159743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.159744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.159783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.159788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.159794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.159799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.159808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.159819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.159823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.159824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.159829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.159835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.159837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891718:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.159838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.159839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.159840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891950:2920], now have 1 active actors on pipe
2025-10-02T09:36:18.159844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.159852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.159853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.159867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.159874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.159876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3142
2025-10-02T09:36:18.159895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3142
2025-10-02T09:36:18.159890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.159911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.159916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.159932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d76e3d9a-595df106-52996abb-11e9d365_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.159938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.159940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.159942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.159948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.159955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.159963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.160083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.160088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.160095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.160160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3143 partition: 0 MaxSeqNo: 36 sessionId: src_id|d76e3d9a-595df106-52996abb-11e9d365_0
2025-10-02T09:36:18.160416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c8d581-6d59ce44-b75c5e37-5d1ed4b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d76e3d9a-595df106-52996abb-11e9d365_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.163413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Write session: try to update token
2025-10-02T09:36:18.163425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.168687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:18.168699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.168704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.168726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:18.168728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:18.168882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:18.169001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:18.169117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:18.169235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:18.169395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:18.169421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:18.175898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId: src_id|d76e3d9a-595df106-52996abb-11e9d365_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.176934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.176945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.176946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.176948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.176952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.176954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.176957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185307968:11847]
2025-10-02T09:36:18.176977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.176977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.176981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.176983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.176985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.176987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.177095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.178087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.237997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260891959:2397]
2025-10-02T09:36:18.238156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3142, pipe: [1:7556555918260891959:2397]
2025-10-02T09:36:18.286718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.287005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.287015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.287028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891959:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.287156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.287195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:18.287205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.287248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260891959:2397]
2025-10-02T09:36:18.287259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d76e3d9a-595df106-52996abb-11e9d365_0
2025-10-02T09:36:18.287389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3143 sessionId: src_id|d76e3d9a-595df106-52996abb-11e9d365_0 is DEAD
2025-10-02T09:36:18.287525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:18.287535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Write session will restart in 0.007774s
2025-10-02T09:36:18.287550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Write session: Do CDS request
2025-10-02T09:36:18.287554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.296231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.296246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3144
2025-10-02T09:36:18.296346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.296586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.296611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.296622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.296625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.297011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3144 sessionId:  describe result for acl check
2025-10-02T09:36:18.297038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.297040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.297041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.297045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.297441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.297880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.298885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.299333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.299434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.299441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.299447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.299473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.299496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185308219:11850]
2025-10-02T09:36:18.299846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.300009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.300032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.300205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.300234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.300238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.300239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.300240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.300240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.300241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.300241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.300242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.300242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.300244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.300247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.300253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.300255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.300257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.300259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.300261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.300263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.300265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.300267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.300269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.300271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.300273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.300276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.300280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.300283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.300286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.300288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.300291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.300293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.300298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.300301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.300303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.300309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.300311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.300315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.300317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.300320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.300322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.300325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.300330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.300333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.300338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.300339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.300342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.300358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.301838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.301846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.301848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260892164:2927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.301852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.307769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.309497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.309507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.309508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.309510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.309514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3143 [2:7556555918185308219:11850]
2025-10-02T09:36:18.309521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.309532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.309537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.309538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.309539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.309549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.309553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.309557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.309589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.309593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.309594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.309596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.309598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.309634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.309638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.309645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.309651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.309660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.309674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892205:2927], now have 1 active actors on pipe
2025-10-02T09:36:18.309679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260891972:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.309682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.309684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.309685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.309692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.309701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.309705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.309707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.309708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.309712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.309713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.309727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.309731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.309742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.309750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.309752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.309729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3143
2025-10-02T09:36:18.309738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3143
2025-10-02T09:36:18.309767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c124de87-7c129d97-88c318c1-db3978f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.309774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.309776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.309777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.309782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.309787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.309794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.309912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.309919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.309930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.310003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3144 partition: 0 MaxSeqNo: 36 sessionId: src_id|c124de87-7c129d97-88c318c1-db3978f6_0
2025-10-02T09:36:18.310285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e3d9a-595df106-52996abb-11e9d365_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c124de87-7c129d97-88c318c1-db3978f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.312968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Write session: try to update token
2025-10-02T09:36:18.312982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.319149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.319164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.319167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.319168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.319173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.319176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.319180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185308213:11850]
2025-10-02T09:36:18.319204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.319205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.319209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.319211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.319212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.319214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.319345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.324513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId: src_id|c124de87-7c129d97-88c318c1-db3978f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.326591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.387494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260892216:2397]
2025-10-02T09:36:18.387722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3143, pipe: [1:7556555918260892216:2397]
2025-10-02T09:36:18.428978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.429243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.429252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.429273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892216:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.429389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.429437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.429467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260892216:2397]
2025-10-02T09:36:18.429476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:18.429535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c124de87-7c129d97-88c318c1-db3978f6_0
2025-10-02T09:36:18.429680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3144 sessionId: src_id|c124de87-7c129d97-88c318c1-db3978f6_0 is DEAD
2025-10-02T09:36:18.429824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:18.429829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Write session will restart in 0.005276s
2025-10-02T09:36:18.429846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Write session: Do CDS request
2025-10-02T09:36:18.429851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.436180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.436289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.436302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3145
2025-10-02T09:36:18.436420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.436447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.436456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.436459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.436844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3145 sessionId:  describe result for acl check
2025-10-02T09:36:18.436873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.436880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.436882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.436886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.437315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.438988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.440232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.441619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.441734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.441743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.441745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260892308:2945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.441749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.441780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.441788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.441795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.441825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.441849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185308485:11863]
2025-10-02T09:36:18.442189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.442383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.442407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.442580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.442610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.442613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.442614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.442616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.442617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.442617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.442618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.442618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.442619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.442621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.442628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.442630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.442632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.442634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.442636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.442638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.442640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.442641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.442643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.442645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.442647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.442651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.442655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.442658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.442661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.442663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.442668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.442671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.442673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.442676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.442677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.442680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.442682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.442684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.442689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.442691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.442695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.442697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.442701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.442703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.442705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.442708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.442710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.442712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.442728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.450209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.451698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.451709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.451710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.451711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.451716Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3144 [2:7556555918185308485:11863]
2025-10-02T09:36:18.451725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.451734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.451736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.451737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.451738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.451748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.451752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.451756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.451785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.451790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.451792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.451793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.451795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.451832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.451837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.451843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.451849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.451859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.451873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892446:2945], now have 1 active actors on pipe
2025-10-02T09:36:18.451878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892220:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.451882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.451883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.451885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.451892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.451902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.451905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.451907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.451908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.451911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.451913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.451902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3144
2025-10-02T09:36:18.451927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.451917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3144
2025-10-02T09:36:18.451932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.451934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.451943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.451945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.451971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.451978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.451980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.451981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.451986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.451994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.452005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.452112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.452116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.452124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.452189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3145 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0
2025-10-02T09:36:18.452452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c124de87-7c129d97-88c318c1-db3978f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.454886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Write session: try to update token
2025-10-02T09:36:18.454903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.461172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.461186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.461188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.461189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.461194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.461199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.461202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185308478:11863]
2025-10-02T09:36:18.461226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.461228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.461231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.461233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.461235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.461237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.461362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.466995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId: src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.469139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.529818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260892480:2397]
2025-10-02T09:36:18.529965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3144, pipe: [1:7556555918260892480:2397]
2025-10-02T09:36:18.571061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.571350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.571360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.571386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892480:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.571515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.571556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.571597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260892480:2397]
2025-10-02T09:36:18.571612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:18.571719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0
2025-10-02T09:36:18.571867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3145 sessionId: src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0 is DEAD
2025-10-02T09:36:18.572025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:18.572040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Write session will restart in 0.007308s
2025-10-02T09:36:18.572067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Write session: Do CDS request
2025-10-02T09:36:18.572072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.580110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.580207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.580218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3146
2025-10-02T09:36:18.580359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.580381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.580387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.580390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.580716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3146 sessionId:  describe result for acl check
2025-10-02T09:36:18.580756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.580763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.580764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.580768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.581222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.581725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.583228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.583326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.583344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.583351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.583357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.583386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.583411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185308726:11867]
2025-10-02T09:36:18.583761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.583919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.583940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.584114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.584144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.584148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.584149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.584149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.584150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.584150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.584151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.584152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.584152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.584152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.584153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.584153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.584156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.584163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.584165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.584167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.584169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.584171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.584173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.584175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.584177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.584179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.584181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.584183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.584186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.584190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.584193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.584196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.584198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.584200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.584202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.584205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.584207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.584210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.584212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.584214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.584217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.584220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.584222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.584225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.584227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.584230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.584232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.584235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.584238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.584241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.584247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.584249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.584265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.588160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.588176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.588178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260892673:2975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.588183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.591627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.593252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.593262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.593263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.593266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.593269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3145 [2:7556555918185308726:11867]
2025-10-02T09:36:18.593277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.593287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.593288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.593290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.593291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.593300Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.593303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.593307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.593337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.593343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.593344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.593346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.593347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.593384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.593389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.593396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.593401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.593410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.593423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892718:2975], now have 1 active actors on pipe
2025-10-02T09:36:18.593429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892482:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.593432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.593433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.593434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.593442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.593451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.593453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.593456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.593457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.593461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.593462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.593476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.593470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3145
2025-10-02T09:36:18.593481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.593475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3145
2025-10-02T09:36:18.593487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.593518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.593523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.593538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6601f137-aefbaf3d-80849317-bee73d01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.593545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.593547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.593548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.593553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.593559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.593566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.593668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.593674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.593683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.593746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3146 partition: 0 MaxSeqNo: 36 sessionId: src_id|6601f137-aefbaf3d-80849317-bee73d01_0
2025-10-02T09:36:18.593981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa946470-aa9cf83b-6f5ac4be-6541229c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6601f137-aefbaf3d-80849317-bee73d01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.596725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Write session: try to update token
2025-10-02T09:36:18.596736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.602765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.602778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.602779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.602781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.602786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.602789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.602791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185308720:11867]
2025-10-02T09:36:18.602812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.602816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.602825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.602826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.602829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.602831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.602936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.609325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId: src_id|6601f137-aefbaf3d-80849317-bee73d01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.611629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.671666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260892725:2397]
2025-10-02T09:36:18.671891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3145, pipe: [1:7556555918260892725:2397]
2025-10-02T09:36:18.712363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.712584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.712592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.712605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892725:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.712762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:18.712773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:18.712841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.712828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260892725:2397]
2025-10-02T09:36:18.712838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3146 reason: error at write: Disconnected sessionId: src_id|6601f137-aefbaf3d-80849317-bee73d01_0
2025-10-02T09:36:18.712861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.712971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3146 sessionId: src_id|6601f137-aefbaf3d-80849317-bee73d01_0 is DEAD
2025-10-02T09:36:18.713365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:18.713374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Write session will restart in 0.007772s
2025-10-02T09:36:18.713393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Write session: Do CDS request
2025-10-02T09:36:18.713397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.722132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.722246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.722260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3147
2025-10-02T09:36:18.722379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.722406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.722410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.722414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.722768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3147 sessionId:  describe result for acl check
2025-10-02T09:36:18.722801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.722808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.722809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.722813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.722960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.723275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.724336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.724445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.724452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.724457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.724484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.724507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185308961:11869]
2025-10-02T09:36:18.724860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.724841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.725036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.725058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.725229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.725262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.725262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.725263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.725265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.725265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.725266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.725266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.725267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.725270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.725276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.725278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.725282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.725284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.725288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.725292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.725296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.725300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.725304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.725308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.725311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.725313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.725315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.725317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.725320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.725322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.725324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.725326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.725329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.725331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.725334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.725336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.725338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.725344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.725347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.725349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.725351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.725354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.725360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.725362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.725364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.725382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.729164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.729176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.729179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260892924:2980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.729184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.732725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.734508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.734518Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.734519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.734521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.734524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3146 [2:7556555918185308961:11869]
2025-10-02T09:36:18.734534Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.734544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.734545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.734547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.734548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.734556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.734559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.734563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.734593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.734598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.734599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.734601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.734602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.734633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.734637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.734643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.734649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.734657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.734670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892964:2980], now have 1 active actors on pipe
2025-10-02T09:36:18.734676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892727:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.734679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.734680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.734681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.734689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.734698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.734704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.734706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.734707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.734712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.734701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3146
2025-10-02T09:36:18.734713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.734721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.734723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.734702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3146
2025-10-02T09:36:18.734731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.734738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.734740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.734759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cca22172-9193e86c-29e31d2b-74da42c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.734766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.734769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.734770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.734775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.734782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.734795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.734908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.734913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.734920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.734982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3147 partition: 0 MaxSeqNo: 36 sessionId: src_id|cca22172-9193e86c-29e31d2b-74da42c9_0
2025-10-02T09:36:18.735251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6601f137-aefbaf3d-80849317-bee73d01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cca22172-9193e86c-29e31d2b-74da42c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.738044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Write session: try to update token
2025-10-02T09:36:18.738056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.743736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.743749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.743750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.743751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.743755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.743758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.743760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185308956:11869]
2025-10-02T09:36:18.743779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.743782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.743784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.743795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.743798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.743801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.743917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.750905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId: src_id|cca22172-9193e86c-29e31d2b-74da42c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.753188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.812985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260892971:2397]
2025-10-02T09:36:18.813204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3146, pipe: [1:7556555918260892971:2397]
2025-10-02T09:36:18.854242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.854465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.854474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.854486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892971:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.854629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.854755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260892971:2397]
2025-10-02T09:36:18.854758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.854790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:18.855014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3147 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cca22172-9193e86c-29e31d2b-74da42c9_0
2025-10-02T09:36:18.855171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3147 sessionId: src_id|cca22172-9193e86c-29e31d2b-74da42c9_0 is DEAD
2025-10-02T09:36:18.855340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:18.855350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Write session will restart in 0.009410s
2025-10-02T09:36:18.855366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Write session: Do CDS request
2025-10-02T09:36:18.855369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:18.864904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:18.866130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.866224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:18.866236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3148
2025-10-02T09:36:18.866330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:18.866386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:18.866411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:18.866420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:18.866423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:18.866432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:18.866439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:18.866444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:18.866469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:18.866494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555918185309199:11871]
2025-10-02T09:36:18.866782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3148 sessionId:  describe result for acl check
2025-10-02T09:36:18.866814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:18.866829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:18.866831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:18.866836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:18.866845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:18.867009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:18.867031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:18.867206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:18.867235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.867239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.867239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.867240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.867240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.867241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.867241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.867242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.867243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.867243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.867244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.867244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.867247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.867253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.867256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.867258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.867260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.867262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.867264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.867265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.867267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.867270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.867272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.867274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.867277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.867281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:18.867284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.867287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:18.867289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.867291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:18.867293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.867297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:18.867300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.867302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:18.867304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.867307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:18.867313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.867315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:18.867317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.867320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:18.867314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:18.867322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.867325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:18.867327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.867329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.867332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.867334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.867336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.867338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.867356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:18.868759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:18.872541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:18.872552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:18.872554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555918260893172:3009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:18.872561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:18.874672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:18.876386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:18.876400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:18.876402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:18.876404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:18.876409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3147 [2:7556555918185309199:11871]
2025-10-02T09:36:18.876418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:18.876431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:18.876439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.876441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.876442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.876454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:18.876461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:18.876467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:18.876506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.876512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.876514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.876516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:18.876519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:18.876566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:18.876572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.876582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:18.876593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:18.876609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:18.876628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260893210:3009], now have 1 active actors on pipe
2025-10-02T09:36:18.876635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260892972:2446], now have 1 active actors on pipe
2025-10-02T09:36:18.876640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.876648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.876650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.876636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3147
2025-10-02T09:36:18.876640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3147
2025-10-02T09:36:18.876661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:18.876669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:18.876671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:18.876672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:18.876677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:18.876690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:18.876696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:18.876724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.876731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.876745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.876756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:18.876762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:18.876776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:18.876785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:18.876790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:18.876791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:18.876798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:18.876821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:18.876847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.876963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.876970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.876982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:18.877053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3148 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0
2025-10-02T09:36:18.877327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca22172-9193e86c-29e31d2b-74da42c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:18.880086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Write session: try to update token
2025-10-02T09:36:18.880097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:18.885895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:18.885911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:18.885913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:18.885914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:18.885918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.885921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.885923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555918185309193:11871]
2025-10-02T09:36:18.885945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:18.885948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:18.885950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:18.885950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:18.885953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:18.885956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:18.886105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:18.892207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId: src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:18.894470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:18.954808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555918260893223:2397]
2025-10-02T09:36:18.955005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3147, pipe: [1:7556555918260893223:2397]
2025-10-02T09:36:18.996604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:18.996887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:18.996896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:18.996909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260893223:2397], now have 1 active actors on pipe
2025-10-02T09:36:18.997079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:18.997094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:18.997095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555918260893223:2397]
2025-10-02T09:36:18.997118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:18.997167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3148 reason: error at write: Disconnected sessionId: src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0
2025-10-02T09:36:18.997178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:18.997333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3148 sessionId: src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0 is DEAD
2025-10-02T09:36:18.997463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:18.997473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Write session will restart in 0.007611s
2025-10-02T09:36:18.997489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Write session: Do CDS request
2025-10-02T09:36:18.997493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.006133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.006243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.006253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3149
2025-10-02T09:36:19.006383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.006407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.006415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.006418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.006763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3149 sessionId:  describe result for acl check
2025-10-02T09:36:19.006793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.006800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.006802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.006805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.007235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.007359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.008816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.008935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.008942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.008947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.008977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.009010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480276733:11873]
2025-10-02T09:36:19.009141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.009357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.009519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.009551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.009749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.009782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.009786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.009786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.009787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.009787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.009788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.009788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.009789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.009789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.009790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.009790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.009791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.009794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.009800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.009802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.009804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.009806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.009808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.009810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.009812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.009814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.009816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.009818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.009820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.009824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.009828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.009831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.009834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.009836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.009839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.009845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.009848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.009850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.009852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.009854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.009857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.009859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.009862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.009865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.009868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.009870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.009873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.009876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.009879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.009881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.009885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.009887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.009889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.009909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.013736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.013747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.013750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555860720:3006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.013755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.017324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.019003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.019012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.019013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.019016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.019020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3148 [2:7556555922480276733:11873]
2025-10-02T09:36:19.019027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.019037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.019043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.019044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.019045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.019054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.019060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.019065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.019096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.019101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.019103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.019105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.019106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.019144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.019149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.019155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.019160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.019170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.019184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555860762:3006], now have 1 active actors on pipe
2025-10-02T09:36:19.019189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555918260893227:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.019193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.019194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.019195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.019203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.019212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.019217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.019219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.019220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.019222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.019224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.019237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.019242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.019232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3148
2025-10-02T09:36:19.019236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3148
2025-10-02T09:36:19.019253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.019262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.019264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.019282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.019289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.019292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.019293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.019298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.019305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.019312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.019423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.019427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.019435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.019499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3149 partition: 0 MaxSeqNo: 36 sessionId: src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0
2025-10-02T09:36:19.019744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e15b3ab-4bfa7e04-cb737d59-c4a583db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.022490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Write session: try to update token
2025-10-02T09:36:19.022502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.028443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.028458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.028459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.028460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.028464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.028467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.028469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480276727:11873]
2025-10-02T09:36:19.028490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.028496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.028497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.028498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.028503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.028506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.028620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.034683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId: src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.037033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.097161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555860770:2397]
2025-10-02T09:36:19.097337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3148, pipe: [1:7556555922555860770:2397]
2025-10-02T09:36:19.138164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.138533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.138543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.138556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555860770:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.138703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.138791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.138793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:19.138862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555860770:2397]
2025-10-02T09:36:19.138885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0
2025-10-02T09:36:19.139037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3149 sessionId: src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0 is DEAD
2025-10-02T09:36:19.139159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:19.139167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Write session will restart in 0.008695s
2025-10-02T09:36:19.139186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Write session: Do CDS request
2025-10-02T09:36:19.139190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.149113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.149106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.149201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.149215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3150
2025-10-02T09:36:19.149343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.149369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.149377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.149380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.149733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3150 sessionId:  describe result for acl check
2025-10-02T09:36:19.149766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.149775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.149776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.149785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.150229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.150406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.150506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.150512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.150518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.150543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.150568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480276974:11876]
2025-10-02T09:36:19.150941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.151115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.151145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.151342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.151373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.151377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.151378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.151378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.151379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.151380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.151380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.151380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.151381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.151381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.151382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.151382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.151392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.151394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.151396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.151398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.151399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.151401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.151403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.151405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.151407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.151409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.151411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.151415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.151419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.151423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.151426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.151428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.151430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.151432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.151435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.151437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.151440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.151442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.151444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.151447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.151451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.151453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.151456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.151458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.151461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.151464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.151468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.151470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.151473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.151476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.151478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.151496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.151900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.156244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.156255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.156258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555860972:3010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.156264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.158844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.160514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.160526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.160527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.160530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.160534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3149 [2:7556555922480276974:11876]
2025-10-02T09:36:19.160540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.160549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.160552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.160553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.160554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.160563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.160566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.160570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.160600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.160605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.160606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.160608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.160609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.160644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.160648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.160655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.160660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.160670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.160684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861011:3010], now have 1 active actors on pipe
2025-10-02T09:36:19.160689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555860771:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.160693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.160694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.160696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.160704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.160713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.160716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.160718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.160719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.160722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.160723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.160736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.160741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.160724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3149
2025-10-02T09:36:19.160737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3149
2025-10-02T09:36:19.160742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.160752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.160753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.160777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.160786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.160789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.160790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.160797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.160814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.160831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.160929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.160934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.160942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.161002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3150 partition: 0 MaxSeqNo: 36 sessionId: src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0
2025-10-02T09:36:19.161223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c15ee7-5c7f4811-57ff6b87-de639795_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.163944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Write session: try to update token
2025-10-02T09:36:19.163953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.169902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.169918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.169919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.169920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.169924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.169927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.169929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480276967:11876]
2025-10-02T09:36:19.169950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.169953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.169954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.169954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.169957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.169960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.170076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.176092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId: src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.178386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.238955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555861019:2397]
2025-10-02T09:36:19.239178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3149, pipe: [1:7556555922555861019:2397]
2025-10-02T09:36:19.280634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.280873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.280882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.280895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861019:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.281033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.281135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555861019:2397]
2025-10-02T09:36:19.281171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:19.281252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0
2025-10-02T09:36:19.281438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3150 sessionId: src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0 is DEAD
2025-10-02T09:36:19.281462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.281598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:19.281608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Write session will restart in 0.005867s
2025-10-02T09:36:19.281623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Write session: Do CDS request
2025-10-02T09:36:19.281627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.288137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.288237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.288248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3151
2025-10-02T09:36:19.288360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.288385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.288394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.288396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.288825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3151 sessionId:  describe result for acl check
2025-10-02T09:36:19.288855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.288863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.288864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.288869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.289202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.290937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.291895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.293293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.293400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.293407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.293412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.293438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.293461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480277225:11879]
2025-10-02T09:36:19.293520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.293531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.293533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555861133:3025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.293539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.293809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.293965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.293988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.294162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.294192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.294195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.294196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.294197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.294198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.294198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.294199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.294199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.294200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.294200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.294201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.294201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.294204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.294211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.294213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.294215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.294217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.294219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.294221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.294223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.294225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.294227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.294229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.294231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.294234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.294238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.294242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.294245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.294247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.294250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.294252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.294255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.294258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.294261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.294263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.294265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.294267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.294270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.294272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.294275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.294277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.294280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.294282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.294285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.294288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.294292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.294294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.294297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.294312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.301662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.303362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.303371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.303373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.303375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.303379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3150 [2:7556555922480277225:11879]
2025-10-02T09:36:19.303384Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.303394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.303399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.303400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.303401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.303409Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.303412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.303416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.303446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.303451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.303452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.303454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.303455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.303491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.303496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.303502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.303507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.303515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.303526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861022:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.303531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861268:3025], now have 1 active actors on pipe
2025-10-02T09:36:19.303534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.303536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.303537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.303544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.303553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.303558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.303560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.303561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.303562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.303563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.303577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.303581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.303582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.303582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3150
2025-10-02T09:36:19.303594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3150
2025-10-02T09:36:19.303651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.303657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.303672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.303678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.303680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.303681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.303686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.303693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.303700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.303821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.303826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.303833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.303893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3151 partition: 0 MaxSeqNo: 36 sessionId: src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0
2025-10-02T09:36:19.304141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866f3aae-d5374e8f-ee5d5cd6-9a4db122_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.306847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Write session: try to update token
2025-10-02T09:36:19.306857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.312678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.312691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.312692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.312693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.312697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.312700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.312702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480277220:11879]
2025-10-02T09:36:19.312721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.312724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.312726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.312730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.312733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.312735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.312848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.318391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId: src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.320635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.381278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555861282:2397]
2025-10-02T09:36:19.381461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3150, pipe: [1:7556555922555861282:2397]
2025-10-02T09:36:19.421526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.421742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.421751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.421764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861282:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.421917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.421972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:19.421976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.421986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:19.422019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555861282:2397]
2025-10-02T09:36:19.422056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3151 reason: error at write: Disconnected sessionId: src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0
2025-10-02T09:36:19.422231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3151 sessionId: src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0 is DEAD
2025-10-02T09:36:19.422372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:19.422382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Write session will restart in 0.006641s
2025-10-02T09:36:19.422401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Write session: Do CDS request
2025-10-02T09:36:19.422406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.430133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.430235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.430248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3152
2025-10-02T09:36:19.430364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.430390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.430399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.430402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.430744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3152 sessionId:  describe result for acl check
2025-10-02T09:36:19.430775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.430783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.430784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.430788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.431217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.432762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.432945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.434248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.434457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.434465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.434472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.434508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.434532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480277481:11882]
2025-10-02T09:36:19.434900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.434911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.434913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555861438:3032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.434917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.434931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.435152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.435180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.435369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.435407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.435411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.435412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.435412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.435413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.435413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.435414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.435415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.435415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.435415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.435416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.435416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.435419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.435425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.435428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.435430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.435431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.435434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.435436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.435437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.435439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.435442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.435443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.435445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.435449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.435453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.435457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.435460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.435462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.435466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.435468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.435471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.435473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.435476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.435478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.435480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.435482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.435485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.435487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.435490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.435493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.435497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.435506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.435509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.435513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.435518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.435522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.435527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.435554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.442987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.444606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.444616Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.444618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.444619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.444622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3151 [2:7556555922480277481:11882]
2025-10-02T09:36:19.444629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.444638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.444639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.444640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.444642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.444651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.444657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.444661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.444691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.444696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.444697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.444699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.444700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.444735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.444740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.444746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.444751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.444759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.444771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.444776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.444777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.444781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.444789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.444796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.444811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.444812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.444815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.444816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.444829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861283:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.444831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861532:3032], now have 1 active actors on pipe
2025-10-02T09:36:19.444832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.444837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.444861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.444860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3151
2025-10-02T09:36:19.444868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3151
2025-10-02T09:36:19.444910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.444916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.444932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.444939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.444941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.444942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.444947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.444953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.444960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.445107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.445113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.445120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.445183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3152 partition: 0 MaxSeqNo: 36 sessionId: src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0
2025-10-02T09:36:19.445460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1c0aa-4dbea692-69058144-a3ead2e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.448143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Write session: try to update token
2025-10-02T09:36:19.448151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.453967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.453982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.453984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.453985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.453990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.453993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.453995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480277475:11882]
2025-10-02T09:36:19.454021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.454026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.454027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.454030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.454034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.454036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.454142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.459919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId: src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.462170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.522067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555861565:2397]
2025-10-02T09:36:19.522522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3151, pipe: [1:7556555922555861565:2397]
2025-10-02T09:36:19.563370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.563708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.563718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.563730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861565:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.563859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.563902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555861565:2397]
2025-10-02T09:36:19.563924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.563948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:19.564004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0
2025-10-02T09:36:19.564121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3152 sessionId: src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0 is DEAD
2025-10-02T09:36:19.564248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:19.564256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Write session will restart in 0.006490s
2025-10-02T09:36:19.564270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Write session: Do CDS request
2025-10-02T09:36:19.564274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.572184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.572848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.572865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3153
2025-10-02T09:36:19.573015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.573043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.573053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.573056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.573409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3153 sessionId:  describe result for acl check
2025-10-02T09:36:19.573436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.573440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.573441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.573444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.573817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.574803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.575340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.576421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.576637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.576647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.576653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.576687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.576713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480277745:11896]
2025-10-02T09:36:19.577061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.577224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.577227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.577233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.577235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555861739:3057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.577239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.577250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.577427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.577458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.577462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.577463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.577463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.577464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.577464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.577465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.577465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.577466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.577466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.577467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.577467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.577471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.577477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.577479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.577481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.577483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.577485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.577487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.577489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.577491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.577493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.577495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.577497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.577501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.577505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.577508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.577512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.577514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.577517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.577519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.577521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.577523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.577526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.577528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.577530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.577532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.577535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.577537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.577539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.577541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.577544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.577546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.577548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.577550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.577553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.577555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.577558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.577575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.584949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.586418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.586428Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.586429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.586432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.586435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3152 [2:7556555922480277745:11896]
2025-10-02T09:36:19.586442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.586452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.586453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.586455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.586456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.586465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.586468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.586472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.586501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.586507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.586508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.586510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.586511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.586546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.586550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.586558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.586566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.586577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.586592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861567:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.586597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861807:3057], now have 1 active actors on pipe
2025-10-02T09:36:19.586601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.586602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.586604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.586611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.586618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.586622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.586624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.586626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.586630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.586631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.586644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.586649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.586651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.586663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.586632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3152
2025-10-02T09:36:19.586666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.586640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3152
2025-10-02T09:36:19.586687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.586694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.586696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.586697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.586703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.586708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.586722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.586853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.586858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.586866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.586932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3153 partition: 0 MaxSeqNo: 36 sessionId: src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0
2025-10-02T09:36:19.587221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5351f-8ef4da1-f59ae30f-606d47cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.589978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Write session: try to update token
2025-10-02T09:36:19.589989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.595815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.595830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.595831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.595833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.595837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.595840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.595842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480277739:11896]
2025-10-02T09:36:19.595863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.595866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.595868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.595870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.595871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.595873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.595985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.601933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId: src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.604121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.663920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555861817:2397]
2025-10-02T09:36:19.664113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3152, pipe: [1:7556555922555861817:2397]
2025-10-02T09:36:19.706121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.706473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.706483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.706496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861817:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.706617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.706664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555861817:2397]
2025-10-02T09:36:19.706688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.706711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:19.706771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0
2025-10-02T09:36:19.706901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3153 sessionId: src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0 is DEAD
2025-10-02T09:36:19.707041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:19.707050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Write session will restart in 0.008744s
2025-10-02T09:36:19.707064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Write session: Do CDS request
2025-10-02T09:36:19.707070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.717114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.717266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.717444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.717460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3154
2025-10-02T09:36:19.717591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.717618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.717627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.717631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.717946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3154 sessionId:  describe result for acl check
2025-10-02T09:36:19.717973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.717977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.717978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.717981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.718341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.718635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.718746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.718752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.718758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.718786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.718808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480277989:11898]
2025-10-02T09:36:19.719154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.719303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.719325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.719500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.719531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.719537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.719537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.719538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.719538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.719539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.719539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.719540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.719540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.719543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.719548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.719550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.719553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.719554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.719556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.719558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.719560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.719562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.719565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.719566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.719568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.719572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.719576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.719579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.719581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.719584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.719586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.719588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.719591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.719593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.719596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.719598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.719601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.719603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.719605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.719607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.719609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.719611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.719613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.719615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.719618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.719620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.719623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.719625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.719627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.719643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.719698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.724397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.724406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.724408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555862025:3069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.724412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.727030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.728665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.728677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.728678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.728680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.728683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3153 [2:7556555922480277989:11898]
2025-10-02T09:36:19.728689Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.728699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.728700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.728702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.728703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.728712Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.728717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.728721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.728750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.728755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.728756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.728758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.728760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.728795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.728811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.728821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.728829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.728841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.728855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555861819:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.728860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862064:3069], now have 1 active actors on pipe
2025-10-02T09:36:19.728864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.728865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.728866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.728874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.728882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3153
2025-10-02T09:36:19.728882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.728887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.728896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3153
2025-10-02T09:36:19.728889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.728890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.728890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.728891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.728905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.728906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.728908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.728916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.728918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.728941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b183ea2a-8d536f28-9302719f-16c18263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.728948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.728950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.728951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.728956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.728961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.728971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.729070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.729075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.729082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.729149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3154 partition: 0 MaxSeqNo: 36 sessionId: src_id|b183ea2a-8d536f28-9302719f-16c18263_0
2025-10-02T09:36:19.729413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be02bd6-b27e9d74-8229fae8-14c9791e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b183ea2a-8d536f28-9302719f-16c18263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.732111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Write session: try to update token
2025-10-02T09:36:19.732121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.738525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.738539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.738540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.738541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.738545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.738548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.738550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480277983:11898]
2025-10-02T09:36:19.738570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.738572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.738574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.738575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.738576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.738576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.738692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.744827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId: src_id|b183ea2a-8d536f28-9302719f-16c18263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.747071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.806915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555862075:2397]
2025-10-02T09:36:19.807115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3153, pipe: [1:7556555922555862075:2397]
2025-10-02T09:36:19.850066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.850489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.850499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.850510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862075:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.850659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.850691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.850698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:19.850701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:19.850746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555862075:2397]
2025-10-02T09:36:19.850748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3154 reason: error at write: Disconnected sessionId: src_id|b183ea2a-8d536f28-9302719f-16c18263_0
2025-10-02T09:36:19.850870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3154 sessionId: src_id|b183ea2a-8d536f28-9302719f-16c18263_0 is DEAD
2025-10-02T09:36:19.851002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:19.851011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Write session will restart in 0.008149s
2025-10-02T09:36:19.851031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Write session: Do CDS request
2025-10-02T09:36:19.851036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:19.860126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.860357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:19.860367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3155
2025-10-02T09:36:19.860486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:19.860511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:19.860521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:19.860524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:19.860838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3155 sessionId:  describe result for acl check
2025-10-02T09:36:19.860866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:19.860871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:19.860872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:19.860875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:19.861216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:19.861517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:19.862534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:19.862956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:19.863051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:19.863058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:19.863063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:19.863163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:19.863188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555922480278234:11900]
2025-10-02T09:36:19.863524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:19.863689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:19.863712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:19.863886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:19.863913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.863917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.863917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.863918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.863918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.863919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.863919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.863920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.863920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.863921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.863921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.863922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.863925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.863930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.863932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.863934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.863936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.863938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.863940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.863942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.863944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.863946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.863948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.863950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.863953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.863957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:19.863960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.863963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:19.863965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.863968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:19.863970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.863973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:19.863975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.863979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:19.863981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.863984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:19.863987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.863990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:19.863992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.863995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:19.863997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.864000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:19.864004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.864010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.864015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.864023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.864026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.864031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.864059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:19.864458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:19.864466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:19.864468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555922555862279:3072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:19.864472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:19.871406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:19.873034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:19.873044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:19.873045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:19.873047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:19.873050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3154 [2:7556555922480278234:11900]
2025-10-02T09:36:19.873057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:19.873067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:19.873068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.873070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.873071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.873080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:19.873085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:19.873089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:19.873119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.873124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.873125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.873127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:19.873128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:19.873163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:19.873169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.873175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:19.873180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:19.873190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:19.873204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862076:2446], now have 1 active actors on pipe
2025-10-02T09:36:19.873209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862320:3072], now have 1 active actors on pipe
2025-10-02T09:36:19.873212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.873214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.873215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.873223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:19.873231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:19.873236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:19.873238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:19.873239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:19.873242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:19.873244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:19.873235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3154
2025-10-02T09:36:19.873257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3154
2025-10-02T09:36:19.873257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.873262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:19.873264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:19.873274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.873279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.873302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:19.873310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:19.873312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:19.873313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:19.873318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:19.873326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:19.873334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.873440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.873445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.873452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:19.873519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3155 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0
2025-10-02T09:36:19.873780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b183ea2a-8d536f28-9302719f-16c18263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:19.876464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Write session: try to update token
2025-10-02T09:36:19.876473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:19.882496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:19.882516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:19.882517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:19.882519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:19.882526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.882529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.882532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555922480278227:11900]
2025-10-02T09:36:19.882553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:19.882556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:19.882558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:19.882558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:19.882563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:19.882564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:19.882696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:19.888437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId: src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:19.890578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:19.951155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555922555862335:2397]
2025-10-02T09:36:19.951336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3154, pipe: [1:7556555922555862335:2397]
2025-10-02T09:36:19.992431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:19.992678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:19.992688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:19.992700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862335:2397], now have 1 active actors on pipe
2025-10-02T09:36:19.992833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:19.992862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:19.992873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555922555862335:2397]
2025-10-02T09:36:19.992890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:19.992944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0
2025-10-02T09:36:19.993073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3155 sessionId: src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0 is DEAD
2025-10-02T09:36:19.993295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:19.993304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Write session will restart in 0.008718s
2025-10-02T09:36:19.993320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Write session: Do CDS request
2025-10-02T09:36:19.993325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.003107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.003270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.003281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3156
2025-10-02T09:36:20.003407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.003433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.003442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.003445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.003617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.003741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3156 sessionId:  describe result for acl check
2025-10-02T09:36:20.003769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.003773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.003774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.003777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.004115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.005104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.005235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.005242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.005248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.005277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.005392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775245775:11902]
2025-10-02T09:36:20.005735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.005879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.005896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.005920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.006096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.006124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.006128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.006129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.006130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.006130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.006131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.006131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.006132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.006133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.006133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.006134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.006134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.006137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.006143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.006145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.006147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.006149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.006151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.006153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.006155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.006157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.006160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.006162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.006164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.006168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.006172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.006175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.006178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.006180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.006183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.006185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.006188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.006190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.006194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.006196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.006198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.006200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.006204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.006207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.006209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.006211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.006214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.006216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.006219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.006221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.006224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.006226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.006228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.006249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.010963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.010973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.010977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850829842:3085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.010981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.013591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.015024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.015035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.015036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.015038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.015042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3155 [2:7556555926775245775:11902]
2025-10-02T09:36:20.015053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.015062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.015067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.015069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.015070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.015079Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.015082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.015086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.015116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.015121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.015123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.015125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.015126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.015162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.015167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.015173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.015179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.015189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.015202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850829881:3085], now have 1 active actors on pipe
2025-10-02T09:36:20.015207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555922555862336:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.015211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.015212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.015214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.015221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.015232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.015232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.015234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.015235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.015243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.015244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.015238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3155
2025-10-02T09:36:20.015258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.015263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.015264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.015258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3155
2025-10-02T09:36:20.015275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.015279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.015377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.015385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.015387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.015388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.015394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.015399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.015411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.015526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.015531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.015539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.015600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3156 partition: 0 MaxSeqNo: 36 sessionId: src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0
2025-10-02T09:36:20.015845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0360fe8-d8165234-d2d2f8fd-9882b380_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.018616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Write session: try to update token
2025-10-02T09:36:20.018628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.024822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.024838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.024840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.024841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.024847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.024850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.024853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775245769:11902]
2025-10-02T09:36:20.024882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.024883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.024886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.024888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.024888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.024891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.025029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.031199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId: src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.033556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.092980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850829889:2397]
2025-10-02T09:36:20.093150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3155, pipe: [1:7556555926850829889:2397]
2025-10-02T09:36:20.138644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.138980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.138991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.139004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850829889:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.139212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:20.139222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:20.139244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850829889:2397]
2025-10-02T09:36:20.139278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.139279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3156 reason: error at write: Disconnected sessionId: src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0
2025-10-02T09:36:20.139409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3156 sessionId: src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0 is DEAD
2025-10-02T09:36:20.139533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:20.139543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Write session will restart in 0.006431s
2025-10-02T09:36:20.139560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Write session: Do CDS request
2025-10-02T09:36:20.139568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.139708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.147113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.147232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.147243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3157
2025-10-02T09:36:20.147374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.147403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.147413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.147420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.147775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3157 sessionId:  describe result for acl check
2025-10-02T09:36:20.147804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.147811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.147813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.147816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.148250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.150089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.150962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.152343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.152435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.152445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.152446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850830004:3087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.152451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.152461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.152468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.152474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.152503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.152667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775246023:11905]
2025-10-02T09:36:20.153044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.153243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.153274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.153471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.153505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.153509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.153509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.153510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.153511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.153511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.153512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.153512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.153513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.153513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.153514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.153515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.153518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.153524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.153526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.153528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.153530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.153533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.153535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.153537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.153538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.153540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.153542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.153544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.153548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.153552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.153556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.153559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.153561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.153563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.153566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.153570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.153577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.153579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.153581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.153584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.153586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.153589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.153592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.153595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.153599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.153601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.153604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.153606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.153609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.153611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.153613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.153616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.153633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.161086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.162676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.162689Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.162690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.162692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.162696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3156 [2:7556555926775246023:11905]
2025-10-02T09:36:20.162704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.162713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.162715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.162716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.162717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.162726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.162729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.162733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.162765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.162770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.162772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.162774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.162775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.162813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.162818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.162824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.162841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.162853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.162871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830132:3087], now have 1 active actors on pipe
2025-10-02T09:36:20.162879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850829890:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.162885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.162888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.162891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.162899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.162909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.162913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.162915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.162916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.162917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.162919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.162933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.162941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.162925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3156
2025-10-02T09:36:20.162935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3156
2025-10-02T09:36:20.162945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.162966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.162972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.162985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.162993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.162995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.162996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.163001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.163007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.163019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.163150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.163157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.163168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.163238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3157 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0
2025-10-02T09:36:20.163553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d11bb7-92ecd1ff-7fc6887-cddb550_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.166245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Write session: try to update token
2025-10-02T09:36:20.166262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.171950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.171962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.171964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.171965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.171968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.171970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.171972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775246017:11905]
2025-10-02T09:36:20.171992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.171993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.171995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.171996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.171996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.171998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.172115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.178205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId: src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.180336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.239396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850830145:2397]
2025-10-02T09:36:20.239626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3156, pipe: [1:7556555926850830145:2397]
2025-10-02T09:36:20.286147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.286582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.286592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.286604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830145:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.286716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.286741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.286751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850830145:2397]
2025-10-02T09:36:20.286772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:20.286848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0
2025-10-02T09:36:20.287023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3157 sessionId: src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0 is DEAD
2025-10-02T09:36:20.287172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:20.287186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Write session will restart in 0.009689s
2025-10-02T09:36:20.287206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Write session: Do CDS request
2025-10-02T09:36:20.287211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.297698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.298174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.298276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.298290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3158
2025-10-02T09:36:20.298413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.298441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.298450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.298453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.298747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3158 sessionId:  describe result for acl check
2025-10-02T09:36:20.298777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.298781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.298783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.298786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.299131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.299139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.299232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.299238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.299243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.299268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.299289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775246281:11908]
2025-10-02T09:36:20.299644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.299820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.299852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.300037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.300064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.300068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.300069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.300070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.300071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.300072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.300073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.300074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.300075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.300076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.300077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.300078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.300082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.300091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.300095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.300099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.300101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.300103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.300105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.300107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.300109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.300111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.300113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.300115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.300118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.300122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.300125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.300128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.300132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.300135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.300137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.300139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.300142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.300144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.300147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.300151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.300153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.300155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.300157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.300160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.300162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.300165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.300168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.300172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.300174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.300177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.300179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.300182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.300198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.300828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.305993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.306008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.306046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850830368:3100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.306057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.307718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.309324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.309336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.309337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.309339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.309344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3157 [2:7556555926775246281:11908]
2025-10-02T09:36:20.309352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.309362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.309363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.309364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.309365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.309374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.309381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.309386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.309578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.309586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.309587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.309589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.309591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.309631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.309637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.309644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.309649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.309661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.309675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830406:3100], now have 1 active actors on pipe
2025-10-02T09:36:20.309681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830158:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.309685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.309686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.309688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.309695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.309707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.309707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.309709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.309710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.309717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.309719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.309714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3157
2025-10-02T09:36:20.309722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3157
2025-10-02T09:36:20.309733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.309738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.309739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.309748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.309752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.309778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.309785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.309788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.309789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.309795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.309806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.309823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.309925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.309932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.309941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.310012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3158 partition: 0 MaxSeqNo: 36 sessionId: src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0
2025-10-02T09:36:20.310278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eb2753-41d3c3cc-5fcfb428-af06deb3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.312620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Write session: try to update token
2025-10-02T09:36:20.312633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.319096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.319107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.319108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.319109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.319113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.319115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.319117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775246275:11908]
2025-10-02T09:36:20.319137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.319140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.319141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.319142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.319144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.319146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.319251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.324311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId: src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.326402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.386853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850830418:2397]
2025-10-02T09:36:20.387077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3157, pipe: [1:7556555926850830418:2397]
2025-10-02T09:36:20.431640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.431870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.431886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.431913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830418:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.432081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.432083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:20.432087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:20.432130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850830418:2397]
2025-10-02T09:36:20.432158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3158 reason: error at write: Disconnected sessionId: src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0
2025-10-02T09:36:20.432218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.432350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3158 sessionId: src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0 is DEAD
2025-10-02T09:36:20.432511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:20.432523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Write session will restart in 0.008624s
2025-10-02T09:36:20.432547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Write session: Do CDS request
2025-10-02T09:36:20.432552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.442160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.442260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.442270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3159
2025-10-02T09:36:20.442392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.442415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.442424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.442427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.442756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3159 sessionId:  describe result for acl check
2025-10-02T09:36:20.442781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.442788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.442789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.442793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.443052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.443255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.444414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.444525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.444532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.444537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.444564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.444591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775246531:11911]
2025-10-02T09:36:20.444870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.445250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.445425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.445454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.445652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.445683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.445687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.445687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.445688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.445688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.445689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.445689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.445690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.445690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.445691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.445692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.445692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.445695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.445702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.445704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.445706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.445708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.445710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.445712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.445714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.445716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.445718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.445720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.445722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.445726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.445729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.445733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.445738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.445743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.445748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.445754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.445759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.445761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.445764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.445766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.445769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.445771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.445775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.445778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.445780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.445783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.445785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.445787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.445790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.445793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.445796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.445798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.445801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.445819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.449654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.449663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.449666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850830628:3108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.449671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.453266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.454970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.454984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.454986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.454988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.454992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3158 [2:7556555926775246531:11911]
2025-10-02T09:36:20.455000Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.455010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.455011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.455013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.455014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.455021Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.455028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.455033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.455069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.455074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.455075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.455077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.455078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.455115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.455120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.455127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.455132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.455142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.455156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830668:3108], now have 1 active actors on pipe
2025-10-02T09:36:20.455162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830419:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.455165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.455166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.455167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.455175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.455183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.455188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.455190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.455191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.455193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.455194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.455211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.455218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.455206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3158
2025-10-02T09:36:20.455217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3158
2025-10-02T09:36:20.455233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.455244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.455245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.455261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.455268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.455270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.455271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.455276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.455283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.455290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.455422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.455429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.455438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.455506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3159 partition: 0 MaxSeqNo: 36 sessionId: src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0
2025-10-02T09:36:20.455781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863c8a0b-b0375fdd-16b685e6-3e2ed43c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.458529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Write session: try to update token
2025-10-02T09:36:20.458539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.464393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.464408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.464409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.464411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.464415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.464417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.464420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775246525:11911]
2025-10-02T09:36:20.464445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.464447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.464452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.464453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.464453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.464455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.464567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.471109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId: src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.473415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.532255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850830689:2397]
2025-10-02T09:36:20.532410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3158, pipe: [1:7556555926850830689:2397]
2025-10-02T09:36:20.576290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.576654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.576663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.576676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830689:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.576822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.576972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850830689:2397]
2025-10-02T09:36:20.576997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.577003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:20.577092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3159 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0
2025-10-02T09:36:20.577289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3159 sessionId: src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0 is DEAD
2025-10-02T09:36:20.577587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:20.577593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Write session will restart in 0.007937s
2025-10-02T09:36:20.577609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Write session: Do CDS request
2025-10-02T09:36:20.577612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.586181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.586297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.586308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3160
2025-10-02T09:36:20.586457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.586483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.586491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.586495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.586851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3160 sessionId:  describe result for acl check
2025-10-02T09:36:20.586881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.586886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.586887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.586890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.587242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.588606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.589460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.589958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.590099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.590106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.590111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.590152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.590177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775246815:11925]
2025-10-02T09:36:20.590540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.590709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.590734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.590945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.590981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.590985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.590986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.590987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.590987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.590988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.590988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.590989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.590989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.590990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.590990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.590991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.590994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.591000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.591002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.591005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.591007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.591009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.591011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.591013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.591015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.591017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.591019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.591021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.591025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.591029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.591033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.591036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.591038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.591041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.591043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.591046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.591048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.591051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.591053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.591056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.591059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.591066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.591068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.591071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.591074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.591077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.591079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.591081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.591083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.591086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.591088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.591091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.591107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.591528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.591538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.591541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850830871:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.591545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.598681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.600396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.600408Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.600409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.600411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.600414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3159 [2:7556555926775246815:11925]
2025-10-02T09:36:20.600421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.600430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.600432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.600433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.600434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.600443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.600449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.600454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.600484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.600489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.600490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.600492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.600493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.600529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.600534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.600540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.600546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.600557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.600571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830949:3149], now have 1 active actors on pipe
2025-10-02T09:36:20.600576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830699:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.600580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.600581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.600582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.600589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.600600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.600603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.600605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.600606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.600611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.600612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.600628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.600639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.600630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3159
2025-10-02T09:36:20.600632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3159
2025-10-02T09:36:20.600653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.600668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.600670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.600686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.600694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.600696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.600697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.600702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.600711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.600718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.600849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.600854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.600862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.600931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3160 partition: 0 MaxSeqNo: 36 sessionId: src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0
2025-10-02T09:36:20.601169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bacce2eb-ee91b738-c38874f0-fe3be509_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.603631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Write session: try to update token
2025-10-02T09:36:20.603644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.609729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.609741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.609742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.609743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.609746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.609751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.609752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775246809:11925]
2025-10-02T09:36:20.609772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.609774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.609774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.609775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.609776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.609779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.609901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.616428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId: src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.618576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.677150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850830957:2397]
2025-10-02T09:36:20.677370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3159, pipe: [1:7556555926850830957:2397]
2025-10-02T09:36:20.722191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.722424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.722434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.722446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830957:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.722592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.722625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.722645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850830957:2397]
2025-10-02T09:36:20.722665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:20.722720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0
2025-10-02T09:36:20.722879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3160 sessionId: src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0 is DEAD
2025-10-02T09:36:20.723027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:20.723041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Write session will restart in 0.009194s
2025-10-02T09:36:20.723061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Write session: Do CDS request
2025-10-02T09:36:20.723068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.733169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.733266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.733276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3161
2025-10-02T09:36:20.733383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.733408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.733425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.733433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.733728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3161 sessionId:  describe result for acl check
2025-10-02T09:36:20.733756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.733761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.733762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.733765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.733996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.734121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.735439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.735548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.735557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.735564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.735592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.735618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775247065:11927]
2025-10-02T09:36:20.735675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.735964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.736142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.736171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.736364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.736397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.736401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.736401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.736402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.736402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.736403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.736403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.736404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.736404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.736405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.736406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.736406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.736409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.736415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.736417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.736419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.736421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.736423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.736425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.736427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.736428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.736431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.736432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.736434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.736438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.736442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.736445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.736448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.736450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.736453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.736456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.736459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.736461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.736463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.736465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.736468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.736470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.736473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.736475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.736477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.736479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.736482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.736484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.736486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.736489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.736492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.736494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.736497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.736512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.740383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.740393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.740395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850831168:3159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.740399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.743936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.745584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.745596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.745597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.745599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.745603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3160 [2:7556555926775247065:11927]
2025-10-02T09:36:20.745610Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.745620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.745621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.745622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.745623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.745632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.745634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.745638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.745670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.745671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.745672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.745674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.745676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.745712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.745718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.745724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.745730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.745740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.745752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.745756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.745757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.745762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.745769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.745772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850830958:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.745775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850831209:3159], now have 1 active actors on pipe
2025-10-02T09:36:20.745776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.745777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.745781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.745793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.745795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.745810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.745819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.745830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.745830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3160
2025-10-02T09:36:20.745831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3160
2025-10-02T09:36:20.745860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.745865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.745878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.745884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.745886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.745887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.745893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.745898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.745907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.746037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.746046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.746055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.746120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3161 partition: 0 MaxSeqNo: 36 sessionId: src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0
2025-10-02T09:36:20.746426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164e2ef4-e18bfe5d-7595a37f-5b35caa3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.749309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Write session: try to update token
2025-10-02T09:36:20.749322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.755012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.755029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.755030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.755031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.755036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.755039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.755042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775247059:11927]
2025-10-02T09:36:20.755066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.755070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.755071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.755072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.755076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.755078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.755184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.762121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId: src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.764355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.822583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850831216:2397]
2025-10-02T09:36:20.822745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3160, pipe: [1:7556555926850831216:2397]
2025-10-02T09:36:20.863588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:20.864047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.864062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.864077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850831216:2397], now have 1 active actors on pipe
2025-10-02T09:36:20.864285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850831216:2397]
2025-10-02T09:36:20.864295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:20.864298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:20.864313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:20.864354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3161 reason: error at write: Disconnected sessionId: src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0
2025-10-02T09:36:20.864480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3161 sessionId: src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0 is DEAD
2025-10-02T09:36:20.864551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:20.864616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:20.864627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Write session will restart in 0.008321s
2025-10-02T09:36:20.864651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Write session: Do CDS request
2025-10-02T09:36:20.864656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:20.874175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.874225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:20.874235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3162
2025-10-02T09:36:20.874414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:20.874440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:20.874448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:20.874451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:20.874717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3162 sessionId:  describe result for acl check
2025-10-02T09:36:20.874742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:20.874748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:20.874749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:20.874752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:20.875131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:20.875402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:20.876728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:20.876849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:20.876943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:20.876949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:20.876955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:20.876980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:20.877004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555926775247316:11929]
2025-10-02T09:36:20.877333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:20.877494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:20.877517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:20.877688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:20.877718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.877722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.877723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.877723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.877724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.877724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.877725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.877725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.877727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.877727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.877730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.877736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.877738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.877740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.877742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.877744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.877746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.877747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.877749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.877752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.877753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.877755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.877759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.877763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:20.877767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.877770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:20.877772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.877775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:20.877777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.877780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:20.877782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.877784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:20.877788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.877790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:20.877794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.877796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:20.877798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.877801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:20.877803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.877805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:20.877807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.877811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.877813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.877815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.877817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.877820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.877835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:20.881678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:20.881691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:20.881693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555926850831428:3169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:20.881696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:20.885231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:20.886841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:20.886851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:20.886852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:20.886854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:20.886857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3161 [2:7556555926775247316:11929]
2025-10-02T09:36:20.886865Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:20.886874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:20.886875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.886877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.886878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.886887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:20.886893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:20.886897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:20.886926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.886930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.886931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.886933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:20.886935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:20.886970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:20.886975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.886981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:20.886986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:20.886996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:20.887009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850831470:3169], now have 1 active actors on pipe
2025-10-02T09:36:20.887014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850831218:2446], now have 1 active actors on pipe
2025-10-02T09:36:20.887018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.887020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.887021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.887027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:20.887034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:20.887042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:20.887042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:20.887044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:20.887045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:20.887046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:20.887058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.887059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:20.887065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:20.887052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3161
2025-10-02T09:36:20.887053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3161
2025-10-02T09:36:20.887078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.887079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.887095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:20.887100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:20.887102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:20.887103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:20.887108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:20.887117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:20.887123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.887215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:20.887220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:20.887227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:20.887287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3162 partition: 0 MaxSeqNo: 36 sessionId: src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0
2025-10-02T09:36:20.887487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b720c7-4aa946ec-b52738ef-ccabe458_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:20.890318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Write session: try to update token
2025-10-02T09:36:20.890330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:20.896351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:20.896364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:20.896366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:20.896367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:20.896372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.896375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.896377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555926775247310:11929]
2025-10-02T09:36:20.896399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:20.896403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:20.896402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:20.896404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:20.896405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:20.896407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:20.896521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:20.902485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId: src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:20.904717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:20.964394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555926850831484:2397]
2025-10-02T09:36:20.964583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3161, pipe: [1:7556555926850831484:2397]
2025-10-02T09:36:21.006268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.006485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.006494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.006507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555926850831484:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.006626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:21.006635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555926850831484:2397]
2025-10-02T09:36:21.006636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:21.006654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.006687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3162 reason: error at write: Disconnected sessionId: src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0
2025-10-02T09:36:21.006817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3162 sessionId: src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0 is DEAD
2025-10-02T09:36:21.006962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:21.006972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Write session will restart in 0.008903s
2025-10-02T09:36:21.006987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Write session: Do CDS request
2025-10-02T09:36:21.006991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.007395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.017201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.017284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.017295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3163
2025-10-02T09:36:21.017403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.017427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.017434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.017437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.017721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.017725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3163 sessionId:  describe result for acl check
2025-10-02T09:36:21.017757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.017760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.017761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.017765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.018146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.019186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.019294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.019301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.019307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.019333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.019359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070214864:11931]
2025-10-02T09:36:21.019575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.019703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.019877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.019899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.020076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.020105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.020109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.020110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.020110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.020111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.020111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.020112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.020113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.020113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.020114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.020114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.020115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.020117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.020123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.020125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.020127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.020129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.020131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.020133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.020134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.020137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.020139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.020141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.020142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.020146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.020150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.020153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.020156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.020158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.020161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.020163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.020166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.020168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.020171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.020173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.020175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.020177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.020180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.020182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.020185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.020188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.020190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.020192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.020195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.020197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.020200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.020202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.020204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.020220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.024026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.024039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.024060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145798998:3175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.024069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.027644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.029327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.029340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.029341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.029343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.029348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3162 [2:7556555931070214864:11931]
2025-10-02T09:36:21.029355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.029365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.029380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.029382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.029383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.029393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.029396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.029403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.029436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.029441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.029442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.029443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.029445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.029481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.029486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.029493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.029498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.029506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.029520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799038:3175], now have 1 active actors on pipe
2025-10-02T09:36:21.029526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145798784:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.029529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.029530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.029531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.029538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.029545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.029551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.029552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.029554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.029559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.029560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.029568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.029573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.029570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3162
2025-10-02T09:36:21.029589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.029598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.029600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.029576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3162
2025-10-02T09:36:21.029616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|377bef1-ea8d051d-d73bebad-653e61c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.029624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.029626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.029627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.029632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.029637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.029647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.029729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.029734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.029741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.029811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3163 partition: 0 MaxSeqNo: 36 sessionId: src_id|377bef1-ea8d051d-d73bebad-653e61c2_0
2025-10-02T09:36:21.030050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961973b9-c7759f98-1fc31d19-76cb4d97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|377bef1-ea8d051d-d73bebad-653e61c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.032939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Write session: try to update token
2025-10-02T09:36:21.032951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.038701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.038714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.038716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.038717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.038722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.038725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.038727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070214858:11931]
2025-10-02T09:36:21.038748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.038752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.038753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.038754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.038757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.038760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.038884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.045412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId: src_id|377bef1-ea8d051d-d73bebad-653e61c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.047642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.106722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145799046:2397]
2025-10-02T09:36:21.106906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3162, pipe: [1:7556555931145799046:2397]
2025-10-02T09:36:21.148165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.148534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.148543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.148554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799046:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.148674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.148716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:21.148725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:21.148748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145799046:2397]
2025-10-02T09:36:21.148763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.148765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3163 reason: error at write: Disconnected sessionId: src_id|377bef1-ea8d051d-d73bebad-653e61c2_0
2025-10-02T09:36:21.148897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3163 sessionId: src_id|377bef1-ea8d051d-d73bebad-653e61c2_0 is DEAD
2025-10-02T09:36:21.149039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:21.149049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Write session will restart in 0.008176s
2025-10-02T09:36:21.149067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Write session: Do CDS request
2025-10-02T09:36:21.149071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.158200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.158255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.158265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3164
2025-10-02T09:36:21.158371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.158395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.158398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.158400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.158671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3164 sessionId:  describe result for acl check
2025-10-02T09:36:21.158697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.158703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.158704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.158707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.159076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.160167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.160351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.161665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.161758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.161764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.161770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.161795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.161820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070215119:11934]
2025-10-02T09:36:21.162150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.162299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.162321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.162373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.162383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.162387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145799225:3179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.162390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.162497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.162526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.162530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.162531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.162531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.162532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.162532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.162533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.162534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.162534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.162535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.162535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.162536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.162538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.162544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.162546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.162548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.162550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.162552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.162554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.162556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.162559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.162561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.162563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.162564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.162568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.162571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.162575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.162578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.162580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.162582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.162584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.162587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.162589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.162591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.162593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.162596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.162598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.162600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.162602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.162605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.162607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.162610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.162612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.162615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.162617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.162620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.162623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.162626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.162641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.169943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.171446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.171457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.171458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.171460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.171464Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3163 [2:7556555931070215119:11934]
2025-10-02T09:36:21.171471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.171481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.171484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.171485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.171486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.171495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.171499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.171503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.171531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.171536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.171537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.171539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.171540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.171577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.171581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.171587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.171592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.171600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.171614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799047:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.171619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799298:3179], now have 1 active actors on pipe
2025-10-02T09:36:21.171623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.171624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.171626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.171632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.171640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.171644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.171646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.171647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.171650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.171652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.171665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.171669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.171671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.171682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3163
2025-10-02T09:36:21.171700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3163
2025-10-02T09:36:21.171711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.171717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.171732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.171738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.171740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.171741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.171746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.171753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.171760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.171886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.171890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.171898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.171965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3164 partition: 0 MaxSeqNo: 36 sessionId: src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0
2025-10-02T09:36:21.172218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377bef1-ea8d051d-d73bebad-653e61c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.175071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Write session: try to update token
2025-10-02T09:36:21.175083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.180673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.180687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.180689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.180690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.180696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.180699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.180702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070215113:11934]
2025-10-02T09:36:21.180724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.180726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.180727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.180728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.180731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.180733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.180895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.187222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId: src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.189709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.249092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145799309:2397]
2025-10-02T09:36:21.249313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3163, pipe: [1:7556555931145799309:2397]
2025-10-02T09:36:21.290388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.290783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.290791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.290803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799309:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.290984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.291003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145799309:2397]
2025-10-02T09:36:21.291022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:21.291024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:21.291067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3164 reason: error at write: Disconnected sessionId: src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0
2025-10-02T09:36:21.291117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.291205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3164 sessionId: src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0 is DEAD
2025-10-02T09:36:21.291315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:21.291323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Write session will restart in 0.009520s
2025-10-02T09:36:21.291338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Write session: Do CDS request
2025-10-02T09:36:21.291342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.302168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.302242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.302258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3165
2025-10-02T09:36:21.302307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.302392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.302420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.302430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.302434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.302863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3165 sessionId:  describe result for acl check
2025-10-02T09:36:21.302893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.302899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.302904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.302907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.303363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.303771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.303864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.303870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.303875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.303898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.303920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070215384:11937]
2025-10-02T09:36:21.304258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.304413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.304434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.304612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.304641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.304644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.304645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.304645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.304646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.304646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.304647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.304647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.304648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.304648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.304649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.304649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.304652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.304658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.304660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.304662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.304664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.304666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.304668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.304670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.304672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.304674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.304676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.304678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.304682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.304685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.304688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.304691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.304693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.304696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.304698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.304701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.304703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.304706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.304708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.304710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.304713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.304715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.304718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.304720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.304722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.304725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.304727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.304729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.304735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.304738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.304740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.304743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.304759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.304857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.309571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.309581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.309584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145799539:3197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.309588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.312071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.313717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.313729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.313730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.313733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.313736Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3164 [2:7556555931070215384:11937]
2025-10-02T09:36:21.313742Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.313751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.313752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.313754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.313755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.313764Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.313767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.313772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.313808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.313814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.313815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.313817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.313818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.313852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.313857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.313863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.313868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.313876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.313890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799322:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.313895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799577:3197], now have 1 active actors on pipe
2025-10-02T09:36:21.313898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.313899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.313900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.313907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.313914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.313920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.313922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.313923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.313924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.313924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.313937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.313942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.313944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.313945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3164
2025-10-02T09:36:21.313949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3164
2025-10-02T09:36:21.313979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.313985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.314000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.314004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.314006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.314007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.314011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.314016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.314027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.314150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.314155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.314163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.314224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3165 partition: 0 MaxSeqNo: 36 sessionId: src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0
2025-10-02T09:36:21.314498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e8ff9f-d48985cb-24b0d006-9c248332_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.317420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Write session: try to update token
2025-10-02T09:36:21.317432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.322802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:21.322815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.322819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.322845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:21.322850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:21.322971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:21.323081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.323189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.323311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.323478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:21.323503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:21.329904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId: src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.331335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.331347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.331348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.331349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.331353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.331355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.331358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070215378:11937]
2025-10-02T09:36:21.331375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.331376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.331378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.331379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.331380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.331380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.331494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.332355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.391411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145799587:2397]
2025-10-02T09:36:21.391618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3164, pipe: [1:7556555931145799587:2397]
2025-10-02T09:36:21.439223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.439510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.439523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.439537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799587:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.439708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145799587:2397]
2025-10-02T09:36:21.439712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.439738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:21.439740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:21.439780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3165 reason: error at write: Disconnected sessionId: src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0
2025-10-02T09:36:21.439909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3165 sessionId: src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0 is DEAD
2025-10-02T09:36:21.440030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:21.440039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Write session will restart in 0.007453s
2025-10-02T09:36:21.440037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.440060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Write session: Do CDS request
2025-10-02T09:36:21.440064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.448125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.448239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.448254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3166
2025-10-02T09:36:21.448393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.448419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.448430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.448434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.448811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3166 sessionId:  describe result for acl check
2025-10-02T09:36:21.448847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.448856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.448858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.448864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.449314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.450932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.451048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.452439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.452574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.452581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.452587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.452615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.452639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070215641:11940]
2025-10-02T09:36:21.452667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.452676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.452678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145799738:3207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.452682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.452992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.453152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.453175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.453350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.453379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.453382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.453383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.453383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.453384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.453384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.453385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.453385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.453386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.453386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.453387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.453387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.453390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.453396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.453399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.453401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.453402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.453404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.453406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.453408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.453410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.453413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.453415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.453417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.453420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.453424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.453427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.453431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.453433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.453435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.453437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.453440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.453443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.453445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.453449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.453451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.453453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.453456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.453458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.453461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.453463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.453465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.453471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.453474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.453476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.453480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.453482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.453485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.453503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.460935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.462394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.462405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.462406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.462408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.462411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3165 [2:7556555931070215641:11940]
2025-10-02T09:36:21.462418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.462431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.462436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.462438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.462439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.462448Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.462450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.462455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.462482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.462487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.462488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.462491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.462492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.462528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.462533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.462540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.462545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.462555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.462568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799839:3207], now have 1 active actors on pipe
2025-10-02T09:36:21.462574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799588:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.462578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.462579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.462580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.462587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.462594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.462600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.462602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.462603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.462603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.462605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.462617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.462620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.462622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.462611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3165
2025-10-02T09:36:21.462634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3165
2025-10-02T09:36:21.462640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.462645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.462661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9401d508-d312cad3-b66c4a93-702499e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.462667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.462670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.462671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.462675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.462679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.462686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.462809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.462814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.462821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.462896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3166 partition: 0 MaxSeqNo: 36 sessionId: src_id|9401d508-d312cad3-b66c4a93-702499e2_0
2025-10-02T09:36:21.463156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf531dd-1d20660-db135ef0-b3fe7fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9401d508-d312cad3-b66c4a93-702499e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.465993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Write session: try to update token
2025-10-02T09:36:21.466003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.471647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.471660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.471661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.471662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.471666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.471668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.471671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070215635:11940]
2025-10-02T09:36:21.471692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.471694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.471696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.471698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.471699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.471700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.471806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.477549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId: src_id|9401d508-d312cad3-b66c4a93-702499e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.479926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.539894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145799852:2397]
2025-10-02T09:36:21.540088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3165, pipe: [1:7556555931145799852:2397]
2025-10-02T09:36:21.581159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.581466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.581475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.581486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799852:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.581594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.581639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145799852:2397]
2025-10-02T09:36:21.581655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.581664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:21.581714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3166 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9401d508-d312cad3-b66c4a93-702499e2_0
2025-10-02T09:36:21.581833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3166 sessionId: src_id|9401d508-d312cad3-b66c4a93-702499e2_0 is DEAD
2025-10-02T09:36:21.581943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:21.581951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Write session will restart in 0.006947s
2025-10-02T09:36:21.581966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Write session: Do CDS request
2025-10-02T09:36:21.581971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.590106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.590696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.590712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3167
2025-10-02T09:36:21.590850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.590888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.590902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.590905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.591243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3167 sessionId:  describe result for acl check
2025-10-02T09:36:21.591270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.591275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.591276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.591279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.591623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.592835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.593493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.594288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.594383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.594389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.594395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.594419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.594441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070215934:11954]
2025-10-02T09:36:21.594773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.594939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.594961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.595136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.595176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.595182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.595182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.595183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.595184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.595184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.595185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.595185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.595186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.595186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.595187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.595187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.595190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.595195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.595197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.595199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.595201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.595203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.595205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.595207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.595209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.595211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.595213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.595215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.595218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.595222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.595225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.595228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.595230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.595233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.595235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.595238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.595240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.595242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.595244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.595246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.595248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.595251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.595253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.595256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.595258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.595261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.595263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.595265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.595267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.595270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.595272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.595274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.595292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.595623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.595633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.595635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145800058:3230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.595641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.602655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.604215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.604226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.604228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.604230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.604234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3166 [2:7556555931070215934:11954]
2025-10-02T09:36:21.604241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.604250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.604254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.604256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.604257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.604268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.604271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.604277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.604306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.604311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.604312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.604314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.604315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.604350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.604355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.604361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.604366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.604377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.604388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800134:3230], now have 1 active actors on pipe
2025-10-02T09:36:21.604393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145799875:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.604396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.604397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.604399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.604407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.604416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.604422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.604424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.604426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.604427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.604428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.604441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.604445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.604447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.604443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3166
2025-10-02T09:36:21.604457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3166
2025-10-02T09:36:21.604470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.604476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.604490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e85385d-bdb228b0-e333e0df-ba328692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.604496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.604500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.604501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.604506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.604511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.604518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.604648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.604652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.604660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.604729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3167 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e85385d-bdb228b0-e333e0df-ba328692_0
2025-10-02T09:36:21.605027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9401d508-d312cad3-b66c4a93-702499e2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e85385d-bdb228b0-e333e0df-ba328692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.607757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Write session: try to update token
2025-10-02T09:36:21.607766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.613531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.613545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.613546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.613547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.613552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.613554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.613556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070215928:11954]
2025-10-02T09:36:21.613582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.613584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.613586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.613587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.613587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.613590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.613747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.619741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId: src_id|6e85385d-bdb228b0-e333e0df-ba328692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.622234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.681697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145800143:2397]
2025-10-02T09:36:21.681878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3166, pipe: [1:7556555931145800143:2397]
2025-10-02T09:36:21.724000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.724416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.724425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.724438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800143:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.724564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.724642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:21.724656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145800143:2397]
2025-10-02T09:36:21.724679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.724733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3167 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e85385d-bdb228b0-e333e0df-ba328692_0
2025-10-02T09:36:21.724937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3167 sessionId: src_id|6e85385d-bdb228b0-e333e0df-ba328692_0 is DEAD
2025-10-02T09:36:21.725071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:21.725078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Write session will restart in 0.009745s
2025-10-02T09:36:21.725093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Write session: Do CDS request
2025-10-02T09:36:21.725096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.736156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.736255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.736266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3168
2025-10-02T09:36:21.736376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.736398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.736406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.736409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.736386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.736727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3168 sessionId:  describe result for acl check
2025-10-02T09:36:21.736752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.736757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.736762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.736766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.737247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.737769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.737866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.737872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.737901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.737925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070216190:11956]
2025-10-02T09:36:21.738267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.738452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.738625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.738653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.738657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.738657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.738658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.738658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.738659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.738659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.738660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.738660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.738661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.738661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.738662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.738664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.738671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.738673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.738675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.738677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.738678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.738680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.738682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.738684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.738686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.738688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.738690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.738694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.738697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.738701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.738704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.738707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.738710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.738713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.738715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.738717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.738720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.738722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.738724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.738726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.738730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.738732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.738734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.738737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.738739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.738743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.738746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.738748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.738750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.738752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.738755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.738771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.739043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.743545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.743555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.743557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145800364:3243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.743562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.746164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.747628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.747640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.747641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.747643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.747647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3167 [2:7556555931070216190:11956]
2025-10-02T09:36:21.747654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.747664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.747667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.747668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.747669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.747679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.747682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.747688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.747718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.747723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.747724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.747726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.747727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.747760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.747765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.747771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.747776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.747785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.747800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800401:3243], now have 1 active actors on pipe
2025-10-02T09:36:21.747805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800144:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.747808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.747809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.747810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.747817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.747825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.747829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.747830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.747831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.747834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.747835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.747848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.747853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.747862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.747845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3167
2025-10-02T09:36:21.747865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3167
2025-10-02T09:36:21.747882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.747887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.747899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.747907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.747909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.747910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.747915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.747922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.747928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.748060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.748065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.748073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.748135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3168 partition: 0 MaxSeqNo: 36 sessionId: src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0
2025-10-02T09:36:21.748415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e85385d-bdb228b0-e333e0df-ba328692_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.751321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Write session: try to update token
2025-10-02T09:36:21.751332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.756858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:21.756870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.756874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.756895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:21.756900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:21.757030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:21.757146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.757272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.757416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.757593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:21.757619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:21.763480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId: src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.765529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.765541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.765542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.765543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.765548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.765550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.765554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070216184:11956]
2025-10-02T09:36:21.765572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.765575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.765577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.765577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.765579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.765581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.765708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.765979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.824572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145800409:2397]
2025-10-02T09:36:21.824783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3167, pipe: [1:7556555931145800409:2397]
2025-10-02T09:36:21.873515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:21.873916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.873925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.873939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800409:2397], now have 1 active actors on pipe
2025-10-02T09:36:21.874075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:21.874135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:21.874137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145800409:2397]
2025-10-02T09:36:21.874151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:21.874244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0
2025-10-02T09:36:21.874384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3168 sessionId: src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0 is DEAD
2025-10-02T09:36:21.874515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:21.874525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Write session will restart in 0.007380s
2025-10-02T09:36:21.874545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Write session: Do CDS request
2025-10-02T09:36:21.874549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:21.883086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.883230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:21.883244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3169
2025-10-02T09:36:21.883374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:21.883399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:21.883406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:21.883409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:21.883764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3169 sessionId:  describe result for acl check
2025-10-02T09:36:21.883798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:21.883805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:21.883806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:21.883809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:21.884187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:21.885937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:21.885981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:21.887532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:21.887626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:21.887632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:21.887637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:21.887661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:21.887693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555931070216448:11958]
2025-10-02T09:36:21.887867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:21.887878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:21.887880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555931145800560:3249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:21.887883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:21.888031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:21.888185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:21.888207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:21.888378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:21.888405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.888409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.888410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.888410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.888411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.888411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.888412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.888412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.888413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.888413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.888414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.888414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.888417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.888423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.888425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.888427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.888429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.888431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.888433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.888435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.888436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.888438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.888440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.888442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.888445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.888449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:21.888452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.888455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:21.888457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.888460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:21.888462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.888465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:21.888467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.888470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:21.888472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.888474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:21.888476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.888480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:21.888482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.888484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:21.888487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.888489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:21.888491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.888493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.888496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.888498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.888502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.888504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.888522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:21.896168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:21.897809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:21.897821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:21.897822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:21.897824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:21.897828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3168 [2:7556555931070216448:11958]
2025-10-02T09:36:21.897835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:21.897844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:21.897846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.897847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.897849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.897858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:21.897860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:21.897864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:21.897905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.897910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.897911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.897913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:21.897914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:21.897948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:21.897953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.897960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:21.897965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:21.897974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:21.897988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800666:3249], now have 1 active actors on pipe
2025-10-02T09:36:21.897994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800411:2446], now have 1 active actors on pipe
2025-10-02T09:36:21.897997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.897999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.898000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.898007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:21.898017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:21.898019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:21.898021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:21.898022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:21.898027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:21.898029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:21.898041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.898046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:21.898047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:21.898029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3168
2025-10-02T09:36:21.898068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.898073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.898063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3168
2025-10-02T09:36:21.898087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9338df1-bfaed02e-3016760c-a1435aba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:21.898094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:21.898096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:21.898097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:21.898101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:21.898108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:21.898116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.898225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.898230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.898237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:21.898307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3169 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9338df1-bfaed02e-3016760c-a1435aba_0
2025-10-02T09:36:21.898558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc538fb-81f14792-9f15987c-e74f95f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9338df1-bfaed02e-3016760c-a1435aba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:21.901412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Write session: try to update token
2025-10-02T09:36:21.901422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:21.911307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:21.911322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.911327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.911350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:21.911353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:21.911490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:21.911610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.911729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.911849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:21.912016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:21.912039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:21.913129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId: src_id|c9338df1-bfaed02e-3016760c-a1435aba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:21.915555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:21.915966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:21.915980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:21.915990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:21.915991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:21.915992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:21.915993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:21.915997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.915999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.916001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555931070216442:11958]
2025-10-02T09:36:21.916018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:21.916024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:21.916026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:21.916027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:21.916028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:21.916028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:21.916128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:21.974075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555931145800684:2397]
2025-10-02T09:36:21.974287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3168, pipe: [1:7556555931145800684:2397]
2025-10-02T09:36:22.024102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.024315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:22.024338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555931145800684:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.024428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:22.024519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555931145800684:2397]
2025-10-02T09:36:22.024552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.035064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:22.035076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:22.035098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3169 reason: error at write: Disconnected sessionId: src_id|c9338df1-bfaed02e-3016760c-a1435aba_0
2025-10-02T09:36:22.035212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3169 sessionId: src_id|c9338df1-bfaed02e-3016760c-a1435aba_0 is DEAD
2025-10-02T09:36:22.035351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:22.035363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Write session will restart in 0.006357s
2025-10-02T09:36:22.035381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Write session: Do CDS request
2025-10-02T09:36:22.035387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.039890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.041300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.041399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.041406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.041411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.041436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.041460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365184003:11960]
2025-10-02T09:36:22.041798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.041955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.041977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.042150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.042175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.042179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.042179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.042180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.042180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.042182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.042183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.042183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.042184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.042184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.042187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.042193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.042195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.042197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.042199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.042201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.042203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.042205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.042207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.042209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.042211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.042212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.042216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.042220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.042223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.042226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.042228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.042230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.042232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.042235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.042238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.042242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.042245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.042247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.042249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.042252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.042254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.042256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.042259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.042262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.042265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.042267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.042274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.042275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.042278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.042294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.043132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.043272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.043286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3170
2025-10-02T09:36:22.043422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.043446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.043454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.043460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.043793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3170 sessionId:  describe result for acl check
2025-10-02T09:36:22.043820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.043825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.043826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.043831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.044469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.046574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.049147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.049158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.049160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440768211:3268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.049164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.049652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.051243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.051256Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.051257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.051259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.051262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3169 [2:7556555935365184003:11960]
2025-10-02T09:36:22.051269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.051278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.051281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.051283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.051284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.051293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.051298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.051302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.051331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.051335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.051336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.051338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.051340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.051374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.051378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.051384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.051390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.051401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.051413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768245:3268], now have 1 active actors on pipe
2025-10-02T09:36:22.051418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440767985:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.051421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.051422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.051423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.051431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.051440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.051446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.051448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.051449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.051449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.051450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.051444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3169
2025-10-02T09:36:22.051463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.051468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.051470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.051481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.051471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3169
2025-10-02T09:36:22.051486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.051506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.051513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.051514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.051515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.051521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.051527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.051541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.051678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.051682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.051690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.051759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3170 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0
2025-10-02T09:36:22.052016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9338df1-bfaed02e-3016760c-a1435aba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.054875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Write session: try to update token
2025-10-02T09:36:22.054885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.060545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.060559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.060560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.060561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.060565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.060568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.060570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365183998:11960]
2025-10-02T09:36:22.060589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.060595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.060597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.060596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.060599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.060601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.060706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.067241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId: src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.069750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.124597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440768252:2397]
2025-10-02T09:36:22.124779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3169, pipe: [1:7556555935440768252:2397]
2025-10-02T09:36:22.168853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.169115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.169124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.169136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768252:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.169280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:22.169310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.169361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:22.169403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440768252:2397]
2025-10-02T09:36:22.169442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0
2025-10-02T09:36:22.169617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3170 sessionId: src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0 is DEAD
2025-10-02T09:36:22.169730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:22.169741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Write session will restart in 0.005226s
2025-10-02T09:36:22.169765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Write session: Do CDS request
2025-10-02T09:36:22.169770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.176167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.176274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.176285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3171
2025-10-02T09:36:22.176391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.176415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.176423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.176425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.176815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3171 sessionId:  describe result for acl check
2025-10-02T09:36:22.176844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.176852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.176854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.176858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.177219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.179231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.181275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.181286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.181287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440768332:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.181291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.181390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.182743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.182869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.182876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.182882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.182909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.182933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365184266:11963]
2025-10-02T09:36:22.183264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.183420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.183443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.183611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.183641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.183645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.183645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.183646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.183646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.183647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.183647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.183648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.183648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.183649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.183649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.183650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.183653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.183659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.183661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.183663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.183665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.183667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.183669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.183671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.183673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.183675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.183677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.183679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.183683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.183688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.183690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.183693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.183697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.183699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.183702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.183705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.183707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.183710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.183712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.183714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.183717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.183719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.183722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.183724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.183726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.183729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.183731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.183734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.183736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.183738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.183741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.183744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.183759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.191090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.192525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.192536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.192537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.192539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.192543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3170 [2:7556555935365184266:11963]
2025-10-02T09:36:22.192549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.192558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.192563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.192565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.192566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.192576Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.192580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.192584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.192612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.192616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.192617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.192620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.192622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.192657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.192661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.192667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.192672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.192680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.192694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768510:3264], now have 1 active actors on pipe
2025-10-02T09:36:22.192699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768253:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.192703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.192704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.192706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.192712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.192721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.192726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.192728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.192729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.192730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.192731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.192744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.192749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.192750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.192775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.192749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3170
2025-10-02T09:36:22.192775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3170
2025-10-02T09:36:22.192780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.192796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84c2e069-e26773dd-70752ade-7c938617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.192813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.192815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.192816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.192821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.192828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.192835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.192977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.192982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.192990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.193060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3171 partition: 0 MaxSeqNo: 36 sessionId: src_id|84c2e069-e26773dd-70752ade-7c938617_0
2025-10-02T09:36:22.193301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec5f132-369730c3-ef0c5088-2e5fbcb4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84c2e069-e26773dd-70752ade-7c938617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.196132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Write session: try to update token
2025-10-02T09:36:22.196142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.201830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.201843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.201845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.201846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.201850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.201852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.201854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365184260:11963]
2025-10-02T09:36:22.201876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.201879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.201880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.201880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.201883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.201885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.201983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.208379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId: src_id|84c2e069-e26773dd-70752ade-7c938617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.210797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.269498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440768522:2397]
2025-10-02T09:36:22.269683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3170, pipe: [1:7556555935440768522:2397]
2025-10-02T09:36:22.310498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.310762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.310771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.310783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768522:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.310933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:22.310951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:22.310954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440768522:2397]
2025-10-02T09:36:22.310967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:22.311019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.311036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3171 reason: error at write: Disconnected sessionId: src_id|84c2e069-e26773dd-70752ade-7c938617_0
2025-10-02T09:36:22.311189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3171 sessionId: src_id|84c2e069-e26773dd-70752ade-7c938617_0 is DEAD
2025-10-02T09:36:22.311316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:22.311326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Write session will restart in 0.009198s
2025-10-02T09:36:22.311340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Write session: Do CDS request
2025-10-02T09:36:22.311344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.321182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.321264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.321274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3172
2025-10-02T09:36:22.321397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.321430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.321437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.321441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.321780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3172 sessionId:  describe result for acl check
2025-10-02T09:36:22.321805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.321810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.321812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.321816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.322226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.322934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.323785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.324391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.324488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.324495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.324500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.324525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.324550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365184537:11966]
2025-10-02T09:36:22.324905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.325071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.325092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.325266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.325295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.325299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.325299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.325300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.325300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.325301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.325302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.325302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.325303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.325303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.325304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.325304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.325307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.325314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.325316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.325318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.325320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.325322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.325324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.325326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.325328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.325330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.325332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.325334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.325338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.325342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.325345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.325348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.325350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.325353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.325355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.325357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.325360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.325362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.325364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.325367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.325369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.325371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.325374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.325376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.325378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.325381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.325383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.325386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.325388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.325391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.325393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.325395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.325413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.325627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.325637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.325639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440768752:3280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.325644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.332762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.334309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.334321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.334323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.334325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.334328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3171 [2:7556555935365184537:11966]
2025-10-02T09:36:22.334335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.334344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.334349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.334351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.334351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.334360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.334363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.334367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.334397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.334401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.334402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.334404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.334406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.334438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.334442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.334449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.334454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.334462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.334473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768799:3280], now have 1 active actors on pipe
2025-10-02T09:36:22.334478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768535:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.334481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.334482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.334483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.334490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.334500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.334502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.334505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.334506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.334510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.334511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.334525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.334532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.334537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.334561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3171
2025-10-02T09:36:22.334564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3171
2025-10-02T09:36:22.334606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.334612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.334627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.334634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.334636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.334637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.334641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.334649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.334659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.334772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.334777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.334784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.334869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3172 partition: 0 MaxSeqNo: 36 sessionId: src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0
2025-10-02T09:36:22.335125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c2e069-e26773dd-70752ade-7c938617_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.337634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Write session: try to update token
2025-10-02T09:36:22.337648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.347159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:22.347170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.347174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.347193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:22.347194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:22.347323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:22.347440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:22.347557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:22.347672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:22.347834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:22.347856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:22.349281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId: src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.351532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.351734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.351748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.351756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.351757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.351758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.351762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.351765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.351767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.351768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365184532:11966]
2025-10-02T09:36:22.351787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.351790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.351793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.351794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.351796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.351798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.351907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.411332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440768807:2397]
2025-10-02T09:36:22.411529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3171, pipe: [1:7556555935440768807:2397]
2025-10-02T09:36:22.459395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.459668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:22.459688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768807:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.459788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:22.459816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440768807:2397]
2025-10-02T09:36:22.459831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.459912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:22.459919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:22.459984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3172 reason: error at write: Disconnected sessionId: src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0
2025-10-02T09:36:22.460133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3172 sessionId: src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0 is DEAD
2025-10-02T09:36:22.460261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:22.460272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Write session will restart in 0.009663s
2025-10-02T09:36:22.460292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Write session: Do CDS request
2025-10-02T09:36:22.460300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.471188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.471210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.471223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3173
2025-10-02T09:36:22.471430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.471465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.471475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.471480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.471659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.471810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3173 sessionId:  describe result for acl check
2025-10-02T09:36:22.471837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.471842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.471844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.471848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.472276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.473125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.473290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.473298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.473304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.473333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.473356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365184801:11969]
2025-10-02T09:36:22.473698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.473848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.473869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.473904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.474045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.474071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.474075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.474075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.474076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.474076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.474077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.474077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.474078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.474078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.474079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.474079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.474080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.474083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.474089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.474091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.474093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.474095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.474097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.474099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.474101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.474103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.474105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.474107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.474109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.474112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.474116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.474120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.474123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.474125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.474127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.474129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.474132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.474136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.474138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.474141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.474144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.474146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.474148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.474150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.474153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.474157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.474159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.474161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.474163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.474169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.474172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.474174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.474177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.474192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.478439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.478451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.478452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440769033:3288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.478457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.481510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.483030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.483040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.483041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.483043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.483046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3172 [2:7556555935365184801:11969]
2025-10-02T09:36:22.483053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.483062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.483067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.483068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.483069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.483078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.483081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.483085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.483115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.483120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.483121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.483123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.483124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.483157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.483162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.483168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.483173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.483184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.483197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769071:3288], now have 1 active actors on pipe
2025-10-02T09:36:22.483202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440768808:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.483206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.483207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.483209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.483216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.483226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.483229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.483231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.483232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.483237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.483238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.483250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.483255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.483256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.483236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3172
2025-10-02T09:36:22.483255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3172
2025-10-02T09:36:22.483271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.483275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.483294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.483301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.483304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.483308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.483312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.483317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.483331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.483436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.483440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.483448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.483513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3173 partition: 0 MaxSeqNo: 36 sessionId: src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0
2025-10-02T09:36:22.483766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d56dc0-db7bebe3-49ad51d0-cfca8557_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.486086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Write session: try to update token
2025-10-02T09:36:22.486101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.492150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.492162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.492163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.492164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.492167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.492169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.492171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365184796:11969]
2025-10-02T09:36:22.492188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.492191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.492192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.492201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.492210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.492212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.492301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.497585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId: src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.499847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.559800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440769079:2397]
2025-10-02T09:36:22.559975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3172, pipe: [1:7556555935440769079:2397]
2025-10-02T09:36:22.600622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.600935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.600945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.600957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769079:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.601074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:22.601096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:22.601110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:22.601154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3173 reason: error at write: Disconnected sessionId: src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0
2025-10-02T09:36:22.601300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3173 sessionId: src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0 is DEAD
2025-10-02T09:36:22.601418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:22.601431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Write session will restart in 0.007325s
2025-10-02T09:36:22.601446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Write session: Do CDS request
2025-10-02T09:36:22.601431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440769079:2397]
2025-10-02T09:36:22.601450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.601446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.610117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.610470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.610484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3174
2025-10-02T09:36:22.610602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.610625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.610632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.610635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.610967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3174 sessionId:  describe result for acl check
2025-10-02T09:36:22.610996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.611003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.611004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.611007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.611328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.612751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.612962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.614240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.614356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.614362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.614368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.614395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.614424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365185100:11983]
2025-10-02T09:36:22.614763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.614927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.614940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.614942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.614967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.614941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440769297:3321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.614945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.615144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.615173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.615177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.615177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.615178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.615178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.615179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.615179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.615180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.615180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.615181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.615181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.615182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.615185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.615191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.615193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.615195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.615197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.615199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.615201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.615203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.615205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.615207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.615209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.615211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.615215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.615219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.615222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.615225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.615227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.615229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.615231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.615234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.615236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.615239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.615241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.615244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.615246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.615248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.615250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.615253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.615255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.615258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.615259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.615266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.615268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.615271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.615274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.615276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.615294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.622624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.624193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.624206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.624208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.624210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.624212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3173 [2:7556555935365185100:11983]
2025-10-02T09:36:22.624220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.624229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.624231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.624232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.624233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.624241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.624245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.624250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.624279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.624284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.624285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.624287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.624288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.624323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.624327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.624333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.624338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.624345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.624358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769097:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.624363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769363:3321], now have 1 active actors on pipe
2025-10-02T09:36:22.624367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.624368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.624369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.624376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.624383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.624388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.624390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.624391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.624393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.624395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.624407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.624411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.624413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.624419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3173
2025-10-02T09:36:22.624428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3173
2025-10-02T09:36:22.624449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.624454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.624469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.624476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.624478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.624479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.624483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.624492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.624499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.624666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.624670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.624678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.624747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3174 partition: 0 MaxSeqNo: 36 sessionId: src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0
2025-10-02T09:36:22.625036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45df392-ac6e7e3a-fe653ff4-f332617e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.627733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Write session: try to update token
2025-10-02T09:36:22.627742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.633516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.633530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.633531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.633533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.633538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.633540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.633542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365185095:11983]
2025-10-02T09:36:22.633562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.633565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.633566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.633567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.633573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.633575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.633685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.639610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId: src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.642050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.701613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440769373:2397]
2025-10-02T09:36:22.701840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3173, pipe: [1:7556555935440769373:2397]
2025-10-02T09:36:22.743143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.743452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.743461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.743474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769373:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.743594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:22.743646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440769373:2397]
2025-10-02T09:36:22.743682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.743723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:22.743951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3174 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0
2025-10-02T09:36:22.744110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3174 sessionId: src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0 is DEAD
2025-10-02T09:36:22.744240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:22.744247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Write session will restart in 0.008699s
2025-10-02T09:36:22.744261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Write session: Do CDS request
2025-10-02T09:36:22.744266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.754146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.754257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.754274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3175
2025-10-02T09:36:22.754429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.754456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.754465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.754468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.754790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3175 sessionId:  describe result for acl check
2025-10-02T09:36:22.754829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.754836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.754837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.754840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.755250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.755521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.756952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.756999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.757160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.757167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.757173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.757203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.757226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365185363:11985]
2025-10-02T09:36:22.757597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.757762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.757787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.758014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.758050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.758054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.758055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.758055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.758056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.758056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.758057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.758057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.758058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.758058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.758059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.758059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.758062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.758068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.758070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.758072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.758074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.758076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.758078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.758080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.758082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.758084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.758086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.758087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.758091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.758095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.758099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.758102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.758105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.758108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.758110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.758113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.758115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.758118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.758120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.758122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.758125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.758127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.758132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.758136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.758144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.758152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.758159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.758168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.758172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.758180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.758187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.758195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.758221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.762073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.762087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.762090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440769597:3315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.762095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.765616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.767093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.767109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.767113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.767115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.767119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3174 [2:7556555935365185363:11985]
2025-10-02T09:36:22.767129Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.767141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.767142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.767144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.767145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.767153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.767158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.767162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.767194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.767199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.767200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.767202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.767203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.767237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.767241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.767248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.767256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.767267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.767279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769374:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.767285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769639:3315], now have 1 active actors on pipe
2025-10-02T09:36:22.767288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.767289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.767290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.767299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.767306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.767310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.767312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.767314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.767316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.767318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.767331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.767335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.767317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3174
2025-10-02T09:36:22.767331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3174
2025-10-02T09:36:22.767349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.767358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.767361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.767381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.767390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.767391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.767392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.767398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.767403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.767412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.767519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.767524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.767531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.767593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3175 partition: 0 MaxSeqNo: 36 sessionId: src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0
2025-10-02T09:36:22.767845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b321e724-2b26db54-9333ea62-62d9ea5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.770895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Write session: try to update token
2025-10-02T09:36:22.770906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.776465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.776478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.776479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.776480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.776484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.776486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.776488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365185358:11985]
2025-10-02T09:36:22.776508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.776511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.776512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.776512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.776515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.776517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.776630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.783809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId: src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.786224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.843930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440769647:2397]
2025-10-02T09:36:22.844096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3174, pipe: [1:7556555935440769647:2397]
2025-10-02T09:36:22.884005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:22.884262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.884271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.884283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769647:2397], now have 1 active actors on pipe
2025-10-02T09:36:22.884464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:22.884451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440769647:2397]
2025-10-02T09:36:22.884456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:22.884462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:22.884484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:22.884538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3175 reason: error at write: Disconnected sessionId: src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0
2025-10-02T09:36:22.884710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3175 sessionId: src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0 is DEAD
2025-10-02T09:36:22.884849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:22.884861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Write session will restart in 0.008158s
2025-10-02T09:36:22.884880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Write session: Do CDS request
2025-10-02T09:36:22.884885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:22.894139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.894251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:22.894265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3176
2025-10-02T09:36:22.894384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:22.894409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:22.894417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:22.894421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:22.894765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3176 sessionId:  describe result for acl check
2025-10-02T09:36:22.894797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:22.894799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:22.894800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:22.894803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:22.895164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:22.896421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:22.896756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:22.898017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:22.898120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:22.898127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:22.898132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:22.898159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:22.898190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555935365185628:11987]
2025-10-02T09:36:22.898570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:22.898577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:22.898580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:22.898581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555935440769833:3331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:22.898586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:22.898714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:22.898738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:22.898925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:22.898955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.898959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.898960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.898960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.898960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.898961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.898962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.898962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.898963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.898963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.898964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.898965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.898967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.898973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.898975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.898978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.898979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.898981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.898984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.898985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.898987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.898990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.898992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.898994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.898999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.899003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:22.899006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.899009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:22.899011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.899013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:22.899015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.899018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:22.899020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.899022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:22.899024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.899027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:22.899030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.899032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:22.899034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.899037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:22.899040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.899043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:22.899045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.899048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.899050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.899052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.899054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.899056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.899072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:22.906423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:22.907924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:22.907935Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:22.907936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:22.907938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:22.907942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3175 [2:7556555935365185628:11987]
2025-10-02T09:36:22.907949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:22.907958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:22.907960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.907961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.907962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.907971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:22.907974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:22.907978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:22.908007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.908012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.908013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.908015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:22.908016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:22.908052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:22.908056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.908062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:22.908068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:22.908078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:22.908091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769648:2446], now have 1 active actors on pipe
2025-10-02T09:36:22.908097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769910:3331], now have 1 active actors on pipe
2025-10-02T09:36:22.908101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.908102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.908103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.908109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:22.908118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:22.908121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:22.908123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:22.908124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:22.908127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:22.908128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:22.908141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.908146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:22.908152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:22.908140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3175
2025-10-02T09:36:22.908193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3175
2025-10-02T09:36:22.908268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.908273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.908287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:22.908294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:22.908296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:22.908297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:22.908302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:22.908309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:22.908317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.908444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:22.908449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:22.908457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:22.908526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3176 partition: 0 MaxSeqNo: 36 sessionId: src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0
2025-10-02T09:36:22.908772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e9f11b-7f94c1d1-e0dfe84f-1d45a3e2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:22.911533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Write session: try to update token
2025-10-02T09:36:22.911542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:22.917203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:22.917219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:22.917221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:22.917222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:22.917229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.917231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.917233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555935365185623:11987]
2025-10-02T09:36:22.917256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:22.917257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:22.917259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:22.917261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:22.917261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:22.917263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:22.917365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:22.923292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId: src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:22.925760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:22.984769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555935440769926:2397]
2025-10-02T09:36:22.984973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3175, pipe: [1:7556555935440769926:2397]
2025-10-02T09:36:23.025389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.025615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.025624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.025637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555935440769926:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.025811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.025822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555935440769926:2397]
2025-10-02T09:36:23.025846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:23.025848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:23.025894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.025894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3176 reason: error at write: Disconnected sessionId: src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0
2025-10-02T09:36:23.026034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3176 sessionId: src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0 is DEAD
2025-10-02T09:36:23.026156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:23.026163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Write session will restart in 0.008176s
2025-10-02T09:36:23.026179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Write session: Do CDS request
2025-10-02T09:36:23.026183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.035168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.035258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.035270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3177
2025-10-02T09:36:23.035420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.035446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.035454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.035458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.035831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3177 sessionId:  describe result for acl check
2025-10-02T09:36:23.035861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.035866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.035867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.035870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.036213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.037450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.037996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.038888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.039007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.039017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.039024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.039055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.039084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660153190:11989]
2025-10-02T09:36:23.039420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.039596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.039618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.039793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.039823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.039827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.039828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.039828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.039829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.039830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.039830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.039831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.039831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.039832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.039833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.039833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.039836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.039843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.039845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.039847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.039849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.039851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.039853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.039855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.039857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.039859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.039861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.039863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.039862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.039871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.039866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.039870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.039873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735737410:3348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.039877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.039873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.039876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.039880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.039883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.039885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.039887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.039889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.039892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.039894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.039897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.039899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.039902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.039904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.039907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.039909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.039912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.039914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.039917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.039919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.039922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.039924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.039926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.039943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.047239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.048760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.048771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.048773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.048774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.048778Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3176 [2:7556555939660153190:11989]
2025-10-02T09:36:23.048787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.048796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.048798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.048812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.048814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.048824Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.048827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.048830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.048860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.048865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.048866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.048868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.048870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.048904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.048909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.048915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.048920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.048928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.048942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737492:3348], now have 1 active actors on pipe
2025-10-02T09:36:23.048947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737227:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.048951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.048952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.048953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.048960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.048971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.048973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.048975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.048976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.048982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.048983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.048997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.049005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.049012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.048999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3176
2025-10-02T09:36:23.049008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3176
2025-10-02T09:36:23.049028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.049034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.049049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfb30391-993df121-6d8bf694-1f77a579_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.049056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.049058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.049059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.049063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.049069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.049079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.049202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.049209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.049218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.049279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3177 partition: 0 MaxSeqNo: 36 sessionId: src_id|cfb30391-993df121-6d8bf694-1f77a579_0
2025-10-02T09:36:23.049528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc0deb-93a6158c-8ca969e8-963f52bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cfb30391-993df121-6d8bf694-1f77a579_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.052754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Write session: try to update token
2025-10-02T09:36:23.052768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.061952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:23.061974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.061981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.062073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:23.062077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:23.062219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:23.062372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.062517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.062693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.062884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:23.062973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:23.067056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId: src_id|cfb30391-993df121-6d8bf694-1f77a579_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.067124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.067137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.067142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.067144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.067152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.067156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.067160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660153184:11989]
2025-10-02T09:36:23.067185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.067190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.067193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.067195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.067195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.067200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.067320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.069540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.126073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735737501:2397]
2025-10-02T09:36:23.126296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3176, pipe: [1:7556555939735737501:2397]
2025-10-02T09:36:23.174991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.175831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.175843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.175857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737501:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.176109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:23.176125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:23.176175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.176225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735737501:2397]
2025-10-02T09:36:23.176239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3177 reason: error at write: Disconnected sessionId: src_id|cfb30391-993df121-6d8bf694-1f77a579_0
2025-10-02T09:36:23.176256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.176410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3177 sessionId: src_id|cfb30391-993df121-6d8bf694-1f77a579_0 is DEAD
2025-10-02T09:36:23.176664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:23.176677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Write session will restart in 0.008006s
2025-10-02T09:36:23.176728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Write session: Do CDS request
2025-10-02T09:36:23.176733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.186211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.186334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.186350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3178
2025-10-02T09:36:23.186483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.186507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.186515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.186518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.187154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3178 sessionId:  describe result for acl check
2025-10-02T09:36:23.187182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.187187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.187189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.187193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.187663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.189444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.189969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.190866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.190980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.190986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.190992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.191019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.191043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660153459:11992]
2025-10-02T09:36:23.191450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.191620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.191642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.191862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.191895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.191899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.191899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.191900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.191901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.191901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.191902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.191902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.191903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.191903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.191904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.191904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.191907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.191913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.191915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.191918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.191920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.191922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.191924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.191926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.191928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.191930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.191932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.191934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.191937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.191942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.191945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.191948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.191950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.191952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.191954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.191957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.191960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.191962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.191964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.191967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.191954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.191965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.191969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.191972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.191974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.191976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.191978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.191967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735737666:3350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.191981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.191972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.191983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.191986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.191988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.191992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.191994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.191996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.192012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.199432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.201699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.201711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.201713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.201714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.201717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3177 [2:7556555939660153459:11992]
2025-10-02T09:36:23.201724Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.201733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.201735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.201736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.201737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.201746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.201749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.201757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.201784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.201789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.201790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.201792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.201793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.201825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.201830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.201836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.201842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.201851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.201865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737769:3350], now have 1 active actors on pipe
2025-10-02T09:36:23.201870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737502:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.201873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.201875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.201876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.201883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.201891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.201894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.201896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.201897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.201900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.201901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.201915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.201923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.201926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.201917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3177
2025-10-02T09:36:23.201922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3177
2025-10-02T09:36:23.201949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.201954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.201968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e24aae2-68833e11-d732ee19-176943ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.201974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.201977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.201977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.201982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.201987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.201996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.202095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.202100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.202107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.202170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3178 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e24aae2-68833e11-d732ee19-176943ab_0
2025-10-02T09:36:23.202429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb30391-993df121-6d8bf694-1f77a579_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e24aae2-68833e11-d732ee19-176943ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.209665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Write session: try to update token
2025-10-02T09:36:23.209676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.210893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:23.210905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.210909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.210928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:23.210931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:23.211061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:23.211175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.211286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.211396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.211536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:23.211559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:23.219414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.219427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.219428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.219429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.219434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.219436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.219440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660153454:11992]
2025-10-02T09:36:23.219458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.219461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.219463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.219463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.219464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.219466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.219606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.225078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId: src_id|3e24aae2-68833e11-d732ee19-176943ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.227514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.276596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735737778:2397]
2025-10-02T09:36:23.276830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3177, pipe: [1:7556555939735737778:2397]
2025-10-02T09:36:23.328700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.329062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.329071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.329085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737778:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.329227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.329231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:23.329234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.329245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:23.329283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735737778:2397]
2025-10-02T09:36:23.329297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3178 reason: error at write: Disconnected sessionId: src_id|3e24aae2-68833e11-d732ee19-176943ab_0
2025-10-02T09:36:23.329425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3178 sessionId: src_id|3e24aae2-68833e11-d732ee19-176943ab_0 is DEAD
2025-10-02T09:36:23.329634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:23.329644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Write session will restart in 0.005246s
2025-10-02T09:36:23.329659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Write session: Do CDS request
2025-10-02T09:36:23.329663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.336189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.336315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.336329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3179
2025-10-02T09:36:23.336453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.336479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.336487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.336490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.336874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3179 sessionId:  describe result for acl check
2025-10-02T09:36:23.336907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.336913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.336915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.336921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.337365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.339449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.341470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.341483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.341484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735737870:3361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.341489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.341816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.343202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.343317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.343323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.343329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.343356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.343378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660153740:11995]
2025-10-02T09:36:23.343714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.343870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.343893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.344066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.344098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.344102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.344103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.344103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.344105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.344105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.344106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.344106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.344107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.344107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.344110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.344116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.344118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.344120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.344122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.344124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.344126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.344128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.344130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.344132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.344134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.344136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.344139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.344143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.344146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.344149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.344151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.344154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.344156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.344159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.344161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.344163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.344165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.344168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.344172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.344175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.344177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.344185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.344188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.344191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.344193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.344198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.344200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.344203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.344205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.344207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.344224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.351540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.353099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.353108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.353109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.353111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.353115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3178 [2:7556555939660153740:11995]
2025-10-02T09:36:23.353121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.353130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.353136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.353138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.353139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.353147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.353150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.353154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.353181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.353186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.353187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.353189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.353190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.353228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.353232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.353239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.353244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.353253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.353266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735737793:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.353273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.353274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.353275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.353282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.353287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738057:3361], now have 1 active actors on pipe
2025-10-02T09:36:23.353295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.353295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.353297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.353298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.353302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.353303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.353316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.353321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.353331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.353324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3178
2025-10-02T09:36:23.353329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3178
2025-10-02T09:36:23.353363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.353368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.353382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.353389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.353391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.353392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.353397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.353405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.353412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.353533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.353538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.353546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.353620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3179 partition: 0 MaxSeqNo: 36 sessionId: src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0
2025-10-02T09:36:23.353867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e24aae2-68833e11-d732ee19-176943ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.356699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Write session: try to update token
2025-10-02T09:36:23.356710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.362271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:23.362281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.362289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.362311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:23.362311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:23.362446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:23.362559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.362697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.362807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.362974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:23.362995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:23.368596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId: src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.370685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.370696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.370698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.370699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.370705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.370707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.370709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660153734:11995]
2025-10-02T09:36:23.370729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.370729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.370732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.370733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.370734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.370734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.370845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.371028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.429679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735738070:2397]
2025-10-02T09:36:23.429839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3178, pipe: [1:7556555939735738070:2397]
2025-10-02T09:36:23.478837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.479245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.479253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.479266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738070:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.479413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.479450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:23.479455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.479461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:23.479504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735738070:2397]
2025-10-02T09:36:23.479512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3179 reason: error at write: Disconnected sessionId: src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0
2025-10-02T09:36:23.479642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3179 sessionId: src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0 is DEAD
2025-10-02T09:36:23.479848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:23.479863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Write session will restart in 0.008754s
2025-10-02T09:36:23.479892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Write session: Do CDS request
2025-10-02T09:36:23.479897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.490222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.490389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.490401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3180
2025-10-02T09:36:23.490513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.490540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.490549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.490557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.490896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3180 sessionId:  describe result for acl check
2025-10-02T09:36:23.490923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.490929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.490931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.490933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.491293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.491358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.492705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.492879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.492971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.492978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.492983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.493008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.493031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660154009:11998]
2025-10-02T09:36:23.493365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.493529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.493550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.493776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.493807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.493811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.493812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.493812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.493813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.493813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.493814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.493815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.493815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.493815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.493816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.493816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.493820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.493826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.493828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.493830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.493832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.493834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.493835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.493837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.493839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.493841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.493844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.493845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.493849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.493853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.493857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.493860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.493862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.493865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.493867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.493870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.493872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.493874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.493876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.493879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.493881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.493884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.493886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.493889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.493892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.493894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.493896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.493899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.493901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.493903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.493905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.493908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.493926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.497880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.497889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.497891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735738300:3372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.497895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.501671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.503307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.503318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.503320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.503321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.503325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3179 [2:7556555939660154009:11998]
2025-10-02T09:36:23.503331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.503342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.503343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.503345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.503345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.503354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.503357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.503361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.503389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.503394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.503395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.503397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.503398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.503431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.503436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.503443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.503448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.503456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.503471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738071:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.503476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738341:3372], now have 1 active actors on pipe
2025-10-02T09:36:23.503479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.503480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.503482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.503489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.503496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.503503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.503505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.503506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.503507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.503508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.503520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.503522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.503523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.503533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3179
2025-10-02T09:36:23.503554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3179
2025-10-02T09:36:23.503569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.503574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.503589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.503595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.503597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.503598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.503603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.503608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.503618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.503741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.503745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.503753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.503818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3180 partition: 0 MaxSeqNo: 36 sessionId: src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0
2025-10-02T09:36:23.504069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165a71d4-7e7b3c65-2f6f4fc1-fef6c7c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.506761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Write session: try to update token
2025-10-02T09:36:23.506771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.513012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.513022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.513023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.513024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.513028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.513032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.513034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660154004:11998]
2025-10-02T09:36:23.513053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.513056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.513057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.513058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.513061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.513063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.513161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.520590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId: src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.522922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.579685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735738349:2397]
2025-10-02T09:36:23.579874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3179, pipe: [1:7556555939735738349:2397]
2025-10-02T09:36:23.622066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.622382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.622390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.622402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738349:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.622531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.622580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.622617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735738349:2397]
2025-10-02T09:36:23.622629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:23.622685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0
2025-10-02T09:36:23.622815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3180 sessionId: src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0 is DEAD
2025-10-02T09:36:23.622932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:23.622941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Write session will restart in 0.007746s
2025-10-02T09:36:23.622956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Write session: Do CDS request
2025-10-02T09:36:23.622960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.632216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.632317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.632327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3181
2025-10-02T09:36:23.632401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.632421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.632426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.632429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.632718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3181 sessionId:  describe result for acl check
2025-10-02T09:36:23.632737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.632740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.632741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.632744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.633181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.635249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.635570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.637105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.637198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.637204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.637210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.637237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.637259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660154315:12010]
2025-10-02T09:36:23.637346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.637357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.637359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735738519:3396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.637362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.637598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.637751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.637774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.637957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.637988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.637992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.637992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.637993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.637993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.637994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.637994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.637995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.637996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.637996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.637997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.637997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.638000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.638006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.638008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.638010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.638012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.638014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.638016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.638018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.638020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.638022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.638024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.638026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.638029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.638033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.638036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.638039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.638041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.638044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.638046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.638048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.638051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.638053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.638055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.638058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.638060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.638063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.638065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.638068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.638072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.638075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.638077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.638081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.638083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.638085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.638087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.638090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.638106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.645449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.647053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.647062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.647063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.647065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.647068Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3180 [2:7556555939660154315:12010]
2025-10-02T09:36:23.647074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.647083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.647086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.647088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.647088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.647097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.647103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.647108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.647136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.647141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.647142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.647145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.647147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.647181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.647186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.647192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.647197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.647205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.647219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738363:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.647224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738637:3396], now have 1 active actors on pipe
2025-10-02T09:36:23.647228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.647230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.647230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.647238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.647245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.647252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.647254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.647254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.647256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.647256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.647270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.647274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.647277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.647265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3180
2025-10-02T09:36:23.647305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3180
2025-10-02T09:36:23.647326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.647331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.647345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.647351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.647355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.647356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.647361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.647366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.647372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.647489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.647491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.647498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.647564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3181 partition: 0 MaxSeqNo: 36 sessionId: src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0
2025-10-02T09:36:23.647816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988da0b8-6dbdb5c0-1b8e74b3-ad2bc7e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.650488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Write session: try to update token
2025-10-02T09:36:23.650503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.656027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:23.656040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.656045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.656065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:23.656065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:23.656196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:23.656312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.656450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.656565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.656742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:23.656764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:23.663060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId: src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.664562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.664572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.664573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.664574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.664579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.664581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.664583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660154310:12010]
2025-10-02T09:36:23.664601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.664604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.664604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.664606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.664606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.664609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.664710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.665528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.722535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735738649:2397]
2025-10-02T09:36:23.722723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3180, pipe: [1:7556555939735738649:2397]
2025-10-02T09:36:23.773114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.773349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.773357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.773370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738649:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.773488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.773563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:23.773588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735738649:2397]
2025-10-02T09:36:23.773619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.773632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0
2025-10-02T09:36:23.773765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3181 sessionId: src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0 is DEAD
2025-10-02T09:36:23.773929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:23.773942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Write session will restart in 0.005720s
2025-10-02T09:36:23.773967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Write session: Do CDS request
2025-10-02T09:36:23.773972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.781145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.781268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.781283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3182
2025-10-02T09:36:23.781404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.781431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.781441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.781444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.781805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3182 sessionId:  describe result for acl check
2025-10-02T09:36:23.781835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.781841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.781843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.781847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.782285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.784336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.785922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.787376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.787491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.787497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.787503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.787530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.787552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660154586:12014]
2025-10-02T09:36:23.787568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.787578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.787582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735738752:3399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.787586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.787930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.788095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.788119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.788293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.788320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.788324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.788324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.788325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.788325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.788326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.788326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.788327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.788327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.788328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.788328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.788329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.788332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.788338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.788340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.788342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.788344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.788346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.788348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.788350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.788352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.788354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.788356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.788358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.788362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.788365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.788369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.788372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.788374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.788376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.788378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.788381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.788383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.788386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.788388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.788391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.788393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.788395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.788398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.788405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.788407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.788409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.788412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.788414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.788417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.788420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.788422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.788424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.788440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.795758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.797384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.797394Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.797395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.797397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.797400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3181 [2:7556555939660154586:12014]
2025-10-02T09:36:23.797406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.797415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.797416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.797418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.797418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.797428Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.797434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.797438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.797465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.797470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.797471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.797474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.797475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.797509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.797514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.797521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.797526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.797537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.797550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738918:3399], now have 1 active actors on pipe
2025-10-02T09:36:23.797556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738650:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.797559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.797560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.797561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.797568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.797576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.797581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.797583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.797584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.797585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.797586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.797598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.797606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.797600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3181
2025-10-02T09:36:23.797621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3181
2025-10-02T09:36:23.797621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.797640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.797646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.797659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c1721b2-5298b8e-f3baf362-531f7736_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.797666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.797668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.797669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.797674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.797681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.797688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.797815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.797819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.797826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.797912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3182 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c1721b2-5298b8e-f3baf362-531f7736_0
2025-10-02T09:36:23.798175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d738e2-5f7b6a5a-953806b7-25689f92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c1721b2-5298b8e-f3baf362-531f7736_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.800633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Write session: try to update token
2025-10-02T09:36:23.800650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.806368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:23.806378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.806381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.806401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:23.806402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:23.806542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:23.806671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.806788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.806913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:23.807143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:23.807165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:23.813731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId: src_id|2c1721b2-5298b8e-f3baf362-531f7736_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.814747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.814757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.814758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.814759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.814763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.814765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.814767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660154581:12014]
2025-10-02T09:36:23.814785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.814788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.814789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.814789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.814793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.814795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.814902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.816170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:23.873576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555939735738930:2397]
2025-10-02T09:36:23.873774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3181, pipe: [1:7556555939735738930:2397]
2025-10-02T09:36:23.922468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:23.922860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.922868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.922881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738930:2397], now have 1 active actors on pipe
2025-10-02T09:36:23.923003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:23.923059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555939735738930:2397]
2025-10-02T09:36:23.923075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:23.923093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:23.923140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3182 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c1721b2-5298b8e-f3baf362-531f7736_0
2025-10-02T09:36:23.923283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3182 sessionId: src_id|2c1721b2-5298b8e-f3baf362-531f7736_0 is DEAD
2025-10-02T09:36:23.923427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:23.923441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Write session will restart in 0.009087s
2025-10-02T09:36:23.923462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Write session: Do CDS request
2025-10-02T09:36:23.923468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:23.933198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.933295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:23.933310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3183
2025-10-02T09:36:23.933434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:23.933462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:23.933470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:23.933474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:23.933814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3183 sessionId:  describe result for acl check
2025-10-02T09:36:23.933843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:23.933850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:23.933852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:23.933857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:23.934301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:23.935103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:23.936177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:23.936513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:23.936608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:23.936615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:23.936620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:23.936646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:23.936666Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555939660154858:12016]
2025-10-02T09:36:23.937019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:23.937184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:23.937206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:23.937379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:23.937410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.937414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.937414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.937415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.937415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.937416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.937416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.937417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.937417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.937418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.937418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.937419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.937422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.937428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.937430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.937432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.937434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.937436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.937438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.937440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.937442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.937445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.937447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.937449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.937453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.937457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:23.937460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.937463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:23.937465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.937467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:23.937470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.937472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:23.937474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.937477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:23.937479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.937482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:23.937484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.937487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:23.937490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.937496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:23.937498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.937501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:23.937503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.937505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.937507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.937510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.937513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.937515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.937533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:23.941409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:23.941420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:23.941424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555939735739151:3421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:23.941428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:23.944940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:23.946662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:23.946671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:23.946672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:23.946674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:23.946678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3182 [2:7556555939660154858:12016]
2025-10-02T09:36:23.946685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:23.946695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:23.946697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.946699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.946700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.946709Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:23.946715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:23.946719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:23.946746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.946752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.946753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.946756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:23.946757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:23.946793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:23.946797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.946804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:23.946809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:23.946817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:23.946829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735739209:3421], now have 1 active actors on pipe
2025-10-02T09:36:23.946835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555939735738934:2446], now have 1 active actors on pipe
2025-10-02T09:36:23.946838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.946839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.946840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.946847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:23.946865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:23.946866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:23.946869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:23.946870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:23.946876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:23.946877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:23.946891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.946898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:23.946901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:23.946907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3182
2025-10-02T09:36:23.946908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3182
2025-10-02T09:36:23.946941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.946946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.946959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:23.946966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:23.946968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:23.946969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:23.946974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:23.946979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:23.946989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.947097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:23.947102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:23.947109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:23.947169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3183 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0
2025-10-02T09:36:23.947415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1721b2-5298b8e-f3baf362-531f7736_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:23.949751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Write session: try to update token
2025-10-02T09:36:23.949767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:23.955910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:23.955920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:23.955921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:23.955922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:23.955926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.955929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.955931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555939660154853:12016]
2025-10-02T09:36:23.955949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:23.955952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:23.955953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:23.955954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:23.955957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:23.955960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:23.956112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:23.962068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId: src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:23.964196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.023067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030706516:2397]
2025-10-02T09:36:24.023210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3182, pipe: [1:7556555944030706516:2397]
2025-10-02T09:36:24.064843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.065294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.065301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.065313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030706516:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.065431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.065453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:24.065464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:24.065469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030706516:2397]
2025-10-02T09:36:24.065506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3183 reason: error at write: Disconnected sessionId: src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0
2025-10-02T09:36:24.065538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.065646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3183 sessionId: src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0 is DEAD
2025-10-02T09:36:24.065817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:24.065832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Write session will restart in 0.007155s
2025-10-02T09:36:24.065859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Write session: Do CDS request
2025-10-02T09:36:24.065864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.074182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.074282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.074292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3184
2025-10-02T09:36:24.074390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.074410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.074416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.074419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.074704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3184 sessionId:  describe result for acl check
2025-10-02T09:36:24.074734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.074738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.074739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.074742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.075099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.077020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.080072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.080118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.080126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.080128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030706630:5426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.080131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.080300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.080393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.080398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.080404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.080430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.080452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955122427:12018]
2025-10-02T09:36:24.080785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.080949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.080971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.081144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.081172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.081176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.081176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.081177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.081177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.081178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.081178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.081179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.081179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.081180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.081180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.081181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.081183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.081189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.081191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.081193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.081195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.081197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.081199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.081201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.081203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.081205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.081207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.081209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.081212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.081216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.081219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.081222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.081225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.081228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.081230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.081232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.081235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.081237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.081239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.081241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.081243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.081246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.081249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.081251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.081253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.081256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.081258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.081260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.081262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.081265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.081267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.081271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.081289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.088603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.090033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.090043Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.090044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.090046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.090050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3183 [2:7556555943955122427:12018]
2025-10-02T09:36:24.090056Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.090065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.090067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.090068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.090069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.090077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.090084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.090088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.090116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.090121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.090122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.090124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.090125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.090157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.090161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.090168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.090174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.090182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.090196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030706517:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.090201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030706786:5426], now have 1 active actors on pipe
2025-10-02T09:36:24.090205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.090206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.090208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.090215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.090225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.090230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.090232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.090233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.090234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.090216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3183
2025-10-02T09:36:24.090235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.090229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3183
2025-10-02T09:36:24.090257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.090262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.090269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.090275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.090286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.090291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.090295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.090297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.090298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.090303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.090308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.090320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.090395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.090400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.090407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.090456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3184 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0
2025-10-02T09:36:24.090721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae38f4d3-6ae2c953-641f50f6-9d4c210a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.093201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Write session: try to update token
2025-10-02T09:36:24.093218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.099182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.099192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.099193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.099194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.099197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.099199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.099201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955122421:12018]
2025-10-02T09:36:24.099220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.099222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.099225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.099226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.099227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.099227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.099341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.105524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId: src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.107641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.165406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030706798:2397]
2025-10-02T09:36:24.165552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3183, pipe: [1:7556555944030706798:2397]
2025-10-02T09:36:24.206611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.206787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.206795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.206807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030706798:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.206928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.206990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030706798:2397]
2025-10-02T09:36:24.207010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.207009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:24.207056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0
2025-10-02T09:36:24.207185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3184 sessionId: src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0 is DEAD
2025-10-02T09:36:24.207366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:24.207385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Write session will restart in 0.006783s
2025-10-02T09:36:24.207411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Write session: Do CDS request
2025-10-02T09:36:24.207417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.215164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.215243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.215251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3185
2025-10-02T09:36:24.215376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.215396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.215402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.215404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.215739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3185 sessionId:  describe result for acl check
2025-10-02T09:36:24.215761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.215765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.215767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.215769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.216110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.217814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.219454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.220976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.221066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.221072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.221078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.221102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.221123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955122714:12022]
2025-10-02T09:36:24.221215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.221224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.221226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030706911:5439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.221230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.221459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.221610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.221632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.221809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.221840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.221843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.221844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.221844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.221845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.221845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.221846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.221846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.221847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.221848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.221848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.221849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.221852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.221857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.221860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.221862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.221863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.221866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.221867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.221869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.221871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.221874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.221876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.221878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.221885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.221888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.221891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.221897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.221900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.221902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.221905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.221907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.221910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.221912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.221915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.221917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.221919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.221921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.221924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.221926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.221932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.221934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.221937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.221939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.221942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.221944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.221947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.221965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.229335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.230922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.230931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.230932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.230934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.230937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3184 [2:7556555943955122714:12022]
2025-10-02T09:36:24.230943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.230952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.230954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.230955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.230956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.230965Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.230968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.230972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.231001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.231006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.231007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.231009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.231011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.231043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.231048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.231054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.231060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.231071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.231084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030706800:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.231089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707070:5439], now have 1 active actors on pipe
2025-10-02T09:36:24.231092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.231093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.231095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.231102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.231110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.231114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.231116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.231118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.231118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.231120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.231133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.231137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.231138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.231144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3184
2025-10-02T09:36:24.231158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3184
2025-10-02T09:36:24.231177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.231182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.231197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.231203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.231205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.231206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.231212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.231220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.231228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.231357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.231361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.231368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.231438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3185 partition: 0 MaxSeqNo: 36 sessionId: src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0
2025-10-02T09:36:24.231657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3b20e3-7b78349a-c8cccb0d-76a7f1e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.233972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Write session: try to update token
2025-10-02T09:36:24.233986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.240072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.240084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.240085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.240086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.240089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.240092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.240094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955122709:12022]
2025-10-02T09:36:24.240112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.240113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.240115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.240116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.240117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.240117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.240264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.246407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId: src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.248649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.307229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030707094:2397]
2025-10-02T09:36:24.307398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3184, pipe: [1:7556555944030707094:2397]
2025-10-02T09:36:24.349918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.350292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.350301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.350313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707094:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.350429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.350458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:24.350470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:24.350507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.350547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3185 reason: error at write: Disconnected sessionId: src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0
2025-10-02T09:36:24.350569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030707094:2397]
2025-10-02T09:36:24.350693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3185 sessionId: src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0 is DEAD
2025-10-02T09:36:24.350843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:24.350863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Write session will restart in 0.006237s
2025-10-02T09:36:24.350883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Write session: Do CDS request
2025-10-02T09:36:24.350888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.358140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.358495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.358507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3186
2025-10-02T09:36:24.358597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.358620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.358629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.358632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.358966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3186 sessionId:  describe result for acl check
2025-10-02T09:36:24.358998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.359003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.359004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.359007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.359356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.361486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.363142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.363456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.363465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.363466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030707197:5468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.363471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.364785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.364893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.364900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.364906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.364931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.364954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955122990:12024]
2025-10-02T09:36:24.365299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.365468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.365491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.365664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.365691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.365695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.365696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.365697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.365697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.365698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.365698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.365699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.365699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.365700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.365700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.365701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.365704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.365710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.365712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.365715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.365716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.365719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.365721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.365723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.365725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.365727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.365729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.365731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.365734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.365738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.365742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.365744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.365746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.365749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.365751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.365754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.365756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.365759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.365761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.365763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.365766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.365768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.365771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.365774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.365776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.365779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.365781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.365787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.365790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.365792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.365794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.365797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.365814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.373186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.374780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.374791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.374793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.374794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.374798Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3185 [2:7556555943955122990:12024]
2025-10-02T09:36:24.374804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.374814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.374816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.374817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.374818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.374827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.374830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.374834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.374871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.374876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.374877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.374879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.374880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.375012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3185
2025-10-02T09:36:24.375019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3185
2025-10-02T09:36:24.375022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.375028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.375034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.375040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.375049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.375061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707369:5468], now have 1 active actors on pipe
2025-10-02T09:36:24.375066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707098:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.375077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.375080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.375090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.375093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.375094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.375102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.375109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.375117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.375119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.375119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.375120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.375122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.375132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|100562f3-f9f600a8-7fd5940b-821161b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.375137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.375139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.375140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.375145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.375151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.375167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.375174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.375180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.375182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.375293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.375298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.375306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.375378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3186 partition: 0 MaxSeqNo: 36 sessionId: src_id|100562f3-f9f600a8-7fd5940b-821161b4_0
2025-10-02T09:36:24.375663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1783254a-df48af0a-218f5e54-8d9f09aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|100562f3-f9f600a8-7fd5940b-821161b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.377979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Write session: try to update token
2025-10-02T09:36:24.377993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.387805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:24.387815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.387820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.387841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:24.387854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:24.387974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:24.388091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:24.388203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:24.388313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:24.388480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:24.388502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:24.390364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId: src_id|100562f3-f9f600a8-7fd5940b-821161b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.392389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.392400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.392401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.392402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.392407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.392409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.392411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955122984:12024]
2025-10-02T09:36:24.392429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.392429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.392432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.392434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.392434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.392436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.392543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.392601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.450612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030707381:2397]
2025-10-02T09:36:24.450821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3185, pipe: [1:7556555944030707381:2397]
2025-10-02T09:36:24.499878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.500097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.500107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.500120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707381:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.500270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.500335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.500348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030707381:2397]
2025-10-02T09:36:24.500367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:24.500429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3186 reason: status is not ok: tablet will be restarted right now sessionId: src_id|100562f3-f9f600a8-7fd5940b-821161b4_0
2025-10-02T09:36:24.500576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3186 sessionId: src_id|100562f3-f9f600a8-7fd5940b-821161b4_0 is DEAD
2025-10-02T09:36:24.500743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:24.500767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Write session will restart in 0.006227s
2025-10-02T09:36:24.500791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Write session: Do CDS request
2025-10-02T09:36:24.500797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.508192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.508276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.508288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3187
2025-10-02T09:36:24.508423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.508451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.508463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.508467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.508823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3187 sessionId:  describe result for acl check
2025-10-02T09:36:24.508851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.508855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.508857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.508860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.509215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.511275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.513038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.514523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.514626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.514633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.514639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.514656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.514663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.514665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.514665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030707486:5500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.514669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.514696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955123267:12027]
2025-10-02T09:36:24.515086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.515249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.515271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.515449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.515477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.515481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.515482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.515482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.515483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.515484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.515484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.515485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.515485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.515486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.515486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.515487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.515490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.515496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.515498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.515500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.515502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.515504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.515506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.515507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.515509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.515511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.515513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.515515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.515519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.515523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.515526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.515529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.515531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.515533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.515536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.515538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.515540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.515543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.515545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.515548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.515550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.515553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.515555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.515557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.515561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.515565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.515567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.515570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.515572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.515574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.515576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.515579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.515597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.522959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.524536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.524547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.524548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.524550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.524554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3186 [2:7556555943955123267:12027]
2025-10-02T09:36:24.524561Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.524570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.524575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.524577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.524578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.524586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.524590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.524594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.524622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.524627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.524628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.524630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.524631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.524665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.524670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.524677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.524682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.524690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.524704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707655:5500], now have 1 active actors on pipe
2025-10-02T09:36:24.524709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707382:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.524713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.524714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.524715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.524722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.524730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.524737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.524738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.524739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.524740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3186
2025-10-02T09:36:24.524762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3186
2025-10-02T09:36:24.524742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.524744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.524756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.524758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.524768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.524771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.524773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.524792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8750b49e-15328840-fe14ab8f-54a851b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.524815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.524820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.524821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.524826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.524831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.524845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.524950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.524955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.524963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.525032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3187 partition: 0 MaxSeqNo: 36 sessionId: src_id|8750b49e-15328840-fe14ab8f-54a851b2_0
2025-10-02T09:36:24.525288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100562f3-f9f600a8-7fd5940b-821161b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8750b49e-15328840-fe14ab8f-54a851b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.527736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Write session: try to update token
2025-10-02T09:36:24.527751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.533992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.534002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.534003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.534004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.534008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.534010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.534013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955123262:12027]
2025-10-02T09:36:24.534031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.534033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.534033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.534034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.534036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.534038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.534139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.541101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId: src_id|8750b49e-15328840-fe14ab8f-54a851b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.543413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.600610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030707667:2397]
2025-10-02T09:36:24.600760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3186, pipe: [1:7556555944030707667:2397]
2025-10-02T09:36:24.643957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.644165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.644175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.644189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707667:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.644296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.644330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:24.644342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:24.644387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3187 reason: error at write: Disconnected sessionId: src_id|8750b49e-15328840-fe14ab8f-54a851b2_0
2025-10-02T09:36:24.644518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3187 sessionId: src_id|8750b49e-15328840-fe14ab8f-54a851b2_0 is DEAD
2025-10-02T09:36:24.644652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:24.644665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Write session will restart in 0.007194s
2025-10-02T09:36:24.644683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Write session: Do CDS request
2025-10-02T09:36:24.644688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.644679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030707667:2397]
2025-10-02T09:36:24.644693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.653169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.653284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.653294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3188
2025-10-02T09:36:24.653397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.653414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.653421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.653426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.653709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3188 sessionId:  describe result for acl check
2025-10-02T09:36:24.653730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.653735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.653736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.653739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.654112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.655653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.657041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.658605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.658701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.658708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.658714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.658740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.658762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955123572:12039]
2025-10-02T09:36:24.658829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.658840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.658841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030707814:5533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.658845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.659101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.659253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.659274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.659448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.659476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.659480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.659481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.659481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.659482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.659482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.659483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.659483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.659484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.659484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.659485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.659485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.659488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.659494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.659496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.659498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.659500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.659503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.659505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.659507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.659509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.659511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.659513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.659515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.659518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.659521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.659525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.659528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.659530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.659532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.659534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.659537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.659539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.659542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.659544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.659546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.659548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.659551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.659553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.659556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.659559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.659561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.659563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.659566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.659568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.659570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.659572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.659575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.659591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.667195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.668708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.668721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.668722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.668725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.668729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3187 [2:7556555943955123572:12039]
2025-10-02T09:36:24.668738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.668750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.668754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.668756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.668757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.668767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.668771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.668775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.668826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.668830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.668833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.668834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.668836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.668885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.668892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.668902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.668916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.668933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.668951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707681:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.668956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707953:5533], now have 1 active actors on pipe
2025-10-02T09:36:24.668961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.668964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.668966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.668976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.668962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3187
2025-10-02T09:36:24.668989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.668992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.668993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.668994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.668980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3187
2025-10-02T09:36:24.669004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.669006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.669036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.669041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.669049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.669057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.669072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.669079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1588bac2-672a8efa-8d35297-664e4a89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.669085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.669089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.669094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.669103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.669115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.669135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.669247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.669255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.669268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.669341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3188 partition: 0 MaxSeqNo: 36 sessionId: src_id|1588bac2-672a8efa-8d35297-664e4a89_0
2025-10-02T09:36:24.669587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8750b49e-15328840-fe14ab8f-54a851b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1588bac2-672a8efa-8d35297-664e4a89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.671828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Write session: try to update token
2025-10-02T09:36:24.671841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.678064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.678075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.678076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.678077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.678080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.678082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.678084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955123567:12039]
2025-10-02T09:36:24.678103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.678105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.678106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.678107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.678109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.678111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.678216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.683791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId: src_id|1588bac2-672a8efa-8d35297-664e4a89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.685924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.744998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030707975:2397]
2025-10-02T09:36:24.745207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3187, pipe: [1:7556555944030707975:2397]
2025-10-02T09:36:24.788993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.789534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.789544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.789557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707975:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.789894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030707975:2397]
2025-10-02T09:36:24.789897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.789930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:24.789932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:24.790001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3188 reason: error at write: Disconnected sessionId: src_id|1588bac2-672a8efa-8d35297-664e4a89_0
2025-10-02T09:36:24.790099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.790156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3188 sessionId: src_id|1588bac2-672a8efa-8d35297-664e4a89_0 is DEAD
2025-10-02T09:36:24.790347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:24.790358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Write session will restart in 0.009316s
2025-10-02T09:36:24.790382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Write session: Do CDS request
2025-10-02T09:36:24.790387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.801148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.801260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.801272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3189
2025-10-02T09:36:24.801394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.801418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.801425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.801429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.801754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3189 sessionId:  describe result for acl check
2025-10-02T09:36:24.801779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.801784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.801785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.801789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.802167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.802542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.803765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.803861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.803868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.803874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.803899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.803924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955123857:12043]
2025-10-02T09:36:24.804291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.804442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.804466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.804647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.804676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.804680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.804681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.804681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.804682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.804682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.804683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.804683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.804684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.804684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.804685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.804685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.804688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.804695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.804697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.804699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.804701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.804703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.804705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.804706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.804708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.804711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.804713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.804715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.804718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.804711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.804722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.804726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.804729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.804731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.804734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.804736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.804739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.804741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.804744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.804746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.804748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.804750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.804753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.804755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.804758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.804760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.804762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.804764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.804767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.804769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.804771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.804773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.804776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.804792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.813255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.813270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.813272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030708215:5556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.813285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.813646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.815358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.815367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.815368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.815370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.815374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3188 [2:7556555943955123857:12043]
2025-10-02T09:36:24.815383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.815393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.815398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.815399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.815401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.815410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.815413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.815417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.815450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.815454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.815457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.815459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.815461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.815521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.815525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.815532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.815537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.815545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.815557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030707976:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.815562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030708254:5556], now have 1 active actors on pipe
2025-10-02T09:36:24.815565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.815566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.815568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.815575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.815584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.815587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.815589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.815590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.815595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.815596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.815582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3188
2025-10-02T09:36:24.815588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3188
2025-10-02T09:36:24.815611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.815617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.815618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.815634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.815641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.815672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.815679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.815681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.815683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.815688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.815696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.815706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.815815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.815820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.815828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.815890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3189 partition: 0 MaxSeqNo: 36 sessionId: src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0
2025-10-02T09:36:24.816185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588bac2-672a8efa-8d35297-664e4a89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.818420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Write session: try to update token
2025-10-02T09:36:24.818433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.826940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.826950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.826951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.826952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.826956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.826958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.826960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955123852:12043]
2025-10-02T09:36:24.826978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.826978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.826980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.826980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.826981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.826982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.827098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.832564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId: src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.834811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:24.889939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555944030708263:2397]
2025-10-02T09:36:24.890166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3188, pipe: [1:7556555944030708263:2397]
2025-10-02T09:36:24.937426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:24.937602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.937610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.937635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030708263:2397], now have 1 active actors on pipe
2025-10-02T09:36:24.937761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:24.937851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:24.937857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555944030708263:2397]
2025-10-02T09:36:24.937870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:24.937953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3189 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0
2025-10-02T09:36:24.938120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3189 sessionId: src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0 is DEAD
2025-10-02T09:36:24.938416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:24.938428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Write session will restart in 0.009773s
2025-10-02T09:36:24.938449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Write session: Do CDS request
2025-10-02T09:36:24.938455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:24.949126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.949320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:24.949334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3190
2025-10-02T09:36:24.949490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:24.949516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:24.949524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:24.949527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:24.949857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3190 sessionId:  describe result for acl check
2025-10-02T09:36:24.949883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:24.949889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:24.949890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:24.949894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:24.950336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:24.950762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:24.951910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:24.952318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:24.952487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:24.952494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:24.952501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:24.952531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:24.952552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555943955124136:12045]
2025-10-02T09:36:24.953178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:24.953350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:24.953375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:24.953654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:24.953687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.953692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.953692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.953693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.953693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.953694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.953695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.953695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.953696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.953697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.953697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.953698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.953701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.953708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.953710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.953712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.953714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.953716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.953718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.953720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.953722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.953724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.953726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.953729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.953733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.953737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:24.953740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.953743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:24.953746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.953749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:24.953751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.953754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:24.953756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.953759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:24.953762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.953765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:24.953768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.953771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:24.953773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.953776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:24.953779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.953782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:24.953786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.953789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.953791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.953793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.953795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.953798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.953814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:24.953847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:24.953859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:24.953861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555944030708508:5571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:24.953867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:24.962804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:24.964433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:24.964443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:24.964444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:24.964446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:24.964450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3189 [2:7556555943955124136:12045]
2025-10-02T09:36:24.964457Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:24.964467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:24.964470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.964472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.964473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.964482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:24.964488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:24.964492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:24.964524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.964529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.964530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.964532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:24.964533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:24.964571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:24.964576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.964582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:24.964587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:24.964595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:24.964610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030708548:5571], now have 1 active actors on pipe
2025-10-02T09:36:24.964615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555944030708269:2446], now have 1 active actors on pipe
2025-10-02T09:36:24.964619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.964620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.964621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.964628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:24.964636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:24.964641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:24.964643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:24.964644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:24.964647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:24.964648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:24.964662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.964667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:24.964669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:24.964646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3189
2025-10-02T09:36:24.964679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.964650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3189
2025-10-02T09:36:24.964684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.964710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2467e90b-a4ac7e1-55938690-4abe985d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:24.964717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:24.964719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:24.964720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:24.964725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:24.964731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:24.964742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.964839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:24.964843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:24.964850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:24.964893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3190 partition: 0 MaxSeqNo: 36 sessionId: src_id|2467e90b-a4ac7e1-55938690-4abe985d_0
2025-10-02T09:36:24.965186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3149c18-e9820787-7d1d06e9-a0bc8b2d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2467e90b-a4ac7e1-55938690-4abe985d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:24.967481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Write session: try to update token
2025-10-02T09:36:24.967498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:24.975905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:24.975916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:24.975917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:24.975918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:24.975922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.975926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.975928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555943955124131:12045]
2025-10-02T09:36:24.975950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:24.975952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:24.975953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:24.975954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:24.975955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:24.975957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:24.976055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:24.980780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId: src_id|2467e90b-a4ac7e1-55938690-4abe985d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:24.982960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.037872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325675856:2397]
2025-10-02T09:36:25.038089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3189, pipe: [1:7556555948325675856:2397]
2025-10-02T09:36:25.087067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.087437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.087447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.087473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325675856:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.087645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.087687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.087710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:25.087742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325675856:2397]
2025-10-02T09:36:25.087804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2467e90b-a4ac7e1-55938690-4abe985d_0
2025-10-02T09:36:25.087963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3190 sessionId: src_id|2467e90b-a4ac7e1-55938690-4abe985d_0 is DEAD
2025-10-02T09:36:25.088097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:25.088110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Write session will restart in 0.006284s
2025-10-02T09:36:25.088131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Write session: Do CDS request
2025-10-02T09:36:25.088136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.095213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.095266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.095280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3191
2025-10-02T09:36:25.095382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.095409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.095419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.095422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.095736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3191 sessionId:  describe result for acl check
2025-10-02T09:36:25.095764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.095768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.095770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.095772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.096124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.098287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.100205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.100213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.100215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325675950:5593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.100219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.102141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.102390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.102490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.102496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.102502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.102526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.102549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250091713:12047]
2025-10-02T09:36:25.102899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.103057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.103079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.103260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.103288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.103292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.103293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.103293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.103294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.103294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.103295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.103295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.103296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.103296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.103297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.103297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.103300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.103306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.103308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.103311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.103313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.103314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.103317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.103318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.103320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.103323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.103325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.103327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.103330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.103334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.103337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.103340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.103342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.103345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.103347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.103350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.103352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.103355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.103357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.103360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.103363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.103365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.103368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.103370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.103372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.103375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.103378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.103380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.103385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.103388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.103389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.103392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.103407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.112496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.113950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.113962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.113963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.113966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.113970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3190 [2:7556555948250091713:12047]
2025-10-02T09:36:25.114143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.114156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.114159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.114161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.114162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.114171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.114177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.114181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.114211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.114216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.114217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.114219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.114220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.114255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.114260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.114266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.114271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.114280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.114295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325675857:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.114300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676132:5593], now have 1 active actors on pipe
2025-10-02T09:36:25.114303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.114304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.114306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.114314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.114324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.114326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.114328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.114329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.114333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.114335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.114352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.114359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.114350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3190
2025-10-02T09:36:25.114376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.114356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3190
2025-10-02T09:36:25.114381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.114381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.114399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.114407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.114409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.114410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.114415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.114423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.114434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.114546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.114550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.114558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.114627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3191 partition: 0 MaxSeqNo: 36 sessionId: src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0
2025-10-02T09:36:25.114924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2467e90b-a4ac7e1-55938690-4abe985d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.117228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Write session: try to update token
2025-10-02T09:36:25.117247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.125842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.125851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.125852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.125853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.125857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.125859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.125861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250091708:12047]
2025-10-02T09:36:25.125880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.125883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.125884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.125884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.125886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.125888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.125991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.130823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId: src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.133101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.187875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325676146:2397]
2025-10-02T09:36:25.188069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3190, pipe: [1:7556555948325676146:2397]
2025-10-02T09:36:25.236272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.236494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.236502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.236529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676146:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.236664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.236736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:25.236742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.236783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325676146:2397]
2025-10-02T09:36:25.236853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3191 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0
2025-10-02T09:36:25.237011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3191 sessionId: src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0 is DEAD
2025-10-02T09:36:25.237174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:25.237189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Write session will restart in 0.009832s
2025-10-02T09:36:25.237222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Write session: Do CDS request
2025-10-02T09:36:25.237227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.248173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.248279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.248292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3192
2025-10-02T09:36:25.248456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.248494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.248504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.248508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.248843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3192 sessionId:  describe result for acl check
2025-10-02T09:36:25.248873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.248878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.248879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.248882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.249245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.250077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.250925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.251775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.251883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.251890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.251896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.251922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.251945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250092006:12051]
2025-10-02T09:36:25.252290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.252484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.252505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.252682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.252711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.252714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.252715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.252716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.252716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.252717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.252717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.252718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.252718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.252719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.252719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.252720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.252723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.252729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.252731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.252733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.252734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.252736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.252738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.252740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.252742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.252745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.252747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.252748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.252752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.252756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.252759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.252762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.252764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.252767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.252769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.252772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.252774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.252777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.252779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.252781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.252784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.252787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.252781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.252791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.252789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.252791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.252793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325676379:5627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.252794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.252797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.252797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.252799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.252812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.252814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.252817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.252820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.252823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.252840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.262628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.264208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.264220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.264221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.264223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.264228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3191 [2:7556555948250092006:12051]
2025-10-02T09:36:25.264235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.264244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.264246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.264247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.264248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.264258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.264263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.264268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.264299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.264304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.264305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.264307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.264309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.264350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.264354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.264361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.264366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.264374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.264386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676427:5627], now have 1 active actors on pipe
2025-10-02T09:36:25.264392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676147:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.264396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.264397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.264398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.264406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.264416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.264424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.264426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.264427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.264429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.264432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.264442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.264447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.264448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.264465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3191
2025-10-02T09:36:25.264495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.264500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.264493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3191
2025-10-02T09:36:25.264515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.264520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.264522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.264523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.264529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.264534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.264541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.264643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.264647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.264655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.264762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3192 partition: 0 MaxSeqNo: 36 sessionId: src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0
2025-10-02T09:36:25.265061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8012-b176d5f8-f68cc774-feed0c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.267418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Write session: try to update token
2025-10-02T09:36:25.267434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.276524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.276535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.276536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.276537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.276542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.276545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.276548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250092001:12051]
2025-10-02T09:36:25.276570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.276573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.276574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.276576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.276579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.276581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.276709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.279780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId: src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.282059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.336877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325676450:2397]
2025-10-02T09:36:25.337088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3191, pipe: [1:7556555948325676450:2397]
2025-10-02T09:36:25.386810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.387015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.387023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.387048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676450:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.387177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.387247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:25.387262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:25.387263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325676450:2397]
2025-10-02T09:36:25.387292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.387312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3192 reason: error at write: Disconnected sessionId: src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0
2025-10-02T09:36:25.387452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3192 sessionId: src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0 is DEAD
2025-10-02T09:36:25.387605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:25.387620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Write session will restart in 0.008544s
2025-10-02T09:36:25.387639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Write session: Do CDS request
2025-10-02T09:36:25.387645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.397204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.397322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.397342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3193
2025-10-02T09:36:25.397489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.397516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.397525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.397528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.397960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3193 sessionId:  describe result for acl check
2025-10-02T09:36:25.397989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.397997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.397998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.398003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.398472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.400588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.400763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.402286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.402380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.402386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.402392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.402416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.402437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250092290:12053]
2025-10-02T09:36:25.402760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.402770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.402772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325676613:5653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.402776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.402784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.402918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.402940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.403115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.403144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.403148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.403148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.403149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.403149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.403150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.403150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.403151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.403151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.403152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.403152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.403153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.403156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.403162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.403164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.403166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.403168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.403170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.403172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.403174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.403176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.403179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.403181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.403183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.403186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.403191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.403194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.403196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.403199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.403201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.403203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.403206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.403209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.403211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.403213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.403216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.403218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.403221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.403223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.403226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.403229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.403232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.403234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.403237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.403239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.403241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.403243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.403246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.403263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.412410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.413924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.413934Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.413935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.413937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.413942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3192 [2:7556555948250092290:12053]
2025-10-02T09:36:25.413951Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.413961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.413966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.413968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.413968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.413977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.413980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.413985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.414015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.414019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.414020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.414023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.414024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.414082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.414086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.414092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.414097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.414105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.414120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676731:5653], now have 1 active actors on pipe
2025-10-02T09:36:25.414126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676452:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.414130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.414131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.414132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.414140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.414150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.414153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.414155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.414156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.414160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.414162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.414175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.414180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.414182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.414168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3192
2025-10-02T09:36:25.414202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3192
2025-10-02T09:36:25.414206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.414211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.414225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.414232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.414235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.414236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.414240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.414248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.414256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.414353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.414357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.414365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.414431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3193 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0
2025-10-02T09:36:25.414708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819dcd2f-8e39b56f-e02130a9-5cb1b016_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.417002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Write session: try to update token
2025-10-02T09:36:25.417017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.423839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.423850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.423851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.423852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.423855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.423857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.423860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250092285:12053]
2025-10-02T09:36:25.423878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.423879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.423880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.423881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.423881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.423883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.423982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.428684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId: src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.430935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.487412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325676742:2397]
2025-10-02T09:36:25.487631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3192, pipe: [1:7556555948325676742:2397]
2025-10-02T09:36:25.531915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.532110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.532118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.532142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676742:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.532260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.532296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.532300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:25.532304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:25.532350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3193 reason: error at write: Disconnected sessionId: src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0
2025-10-02T09:36:25.532352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325676742:2397]
2025-10-02T09:36:25.532484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3193 sessionId: src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0 is DEAD
2025-10-02T09:36:25.532644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:25.532654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Write session will restart in 0.006768s
2025-10-02T09:36:25.532679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Write session: Do CDS request
2025-10-02T09:36:25.532685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.540132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.540236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.540250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3194
2025-10-02T09:36:25.540353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.540377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.540386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.540389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.540734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3194 sessionId:  describe result for acl check
2025-10-02T09:36:25.540762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.540769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.540771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.540775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.541282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.543781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.545344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.546932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.547034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.547045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.547047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325676844:5661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.547051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.547058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.547064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.547071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.547099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.547123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250092573:12056]
2025-10-02T09:36:25.547462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.547623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.547646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.547817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.547846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.547850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.547851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.547851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.547852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.547853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.547853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.547854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.547854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.547855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.547855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.547856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.547859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.547866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.547868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.547870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.547871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.547874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.547875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.547877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.547879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.547881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.547883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.547885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.547889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.547893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.547896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.547899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.547902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.547905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.547907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.547910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.547912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.547915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.547917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.547919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.547921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.547924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.547926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.547929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.547931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.547933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.547936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.547938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.547944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.547947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.547949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.547952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.547968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.556311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.557787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.557797Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.557799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.557801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.557805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3193 [2:7556555948250092573:12056]
2025-10-02T09:36:25.557812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.557821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.557826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.557828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.557829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.557838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.557841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.557846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.557873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.557877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.557880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.557882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.557884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.558021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3193
2025-10-02T09:36:25.558046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3193
2025-10-02T09:36:25.558052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.558057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.558063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.558069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.558081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.558094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325676744:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.558099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677024:5661], now have 1 active actors on pipe
2025-10-02T09:36:25.558108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.558113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.558125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.558129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.558130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.558138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.558146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.558156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.558161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.558169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20bb3a56-8d9814-e00e4b86-57840e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.558175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.558177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.558179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.558184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.558190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.558200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.558204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.558206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.558207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.558208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.558211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.558212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.558317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.558322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.558330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.558398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3194 partition: 0 MaxSeqNo: 36 sessionId: src_id|20bb3a56-8d9814-e00e4b86-57840e96_0
2025-10-02T09:36:25.558666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc852bd-da9e2444-b0e2478-82cc5b1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20bb3a56-8d9814-e00e4b86-57840e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.560962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Write session: try to update token
2025-10-02T09:36:25.560978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.567673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.567683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.567684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.567685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.567689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.567691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.567693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250092568:12056]
2025-10-02T09:36:25.567711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.567714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.567715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.567717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.567723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.567725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.567818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.572667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId: src_id|20bb3a56-8d9814-e00e4b86-57840e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.574983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.632308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325677035:2397]
2025-10-02T09:36:25.632485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3193, pipe: [1:7556555948325677035:2397]
2025-10-02T09:36:25.678653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.678970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.678978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.679003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677035:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.679131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.679175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325677035:2397]
2025-10-02T09:36:25.679199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.679220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:25.679321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3194 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20bb3a56-8d9814-e00e4b86-57840e96_0
2025-10-02T09:36:25.679459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3194 sessionId: src_id|20bb3a56-8d9814-e00e4b86-57840e96_0 is DEAD
2025-10-02T09:36:25.679607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:25.679617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Write session will restart in 0.009041s
2025-10-02T09:36:25.679636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Write session: Do CDS request
2025-10-02T09:36:25.679642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.690182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.690262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.690272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3195
2025-10-02T09:36:25.690370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.690391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.690398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.690400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.690634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3195 sessionId:  describe result for acl check
2025-10-02T09:36:25.690654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.690659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.690660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.690664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.691015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.692051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.692557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.693642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.693733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.693740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.693745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.693768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.693799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250092886:12068]
2025-10-02T09:36:25.694134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.694310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.694332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.694508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.694537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.694541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.694542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.694542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.694543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.694543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.694544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.694544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.694544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.694545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.694545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.694546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.694549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.694554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.694556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.694558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.694560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.694562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.694564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.694566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.694568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.694570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.694571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.694573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.694571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.694577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.694583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.694580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.694584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325677270:5700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.694584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.694587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.694587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.694589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.694591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.694593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.694596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.694598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.694601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.694603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.694605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.694607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.694610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.694612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.694614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.694616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.694619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.694621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.694623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.694625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.694627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.694629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.694632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.694647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.703442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.704949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.704958Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.704959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.704961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.704964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3194 [2:7556555948250092886:12068]
2025-10-02T09:36:25.704970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.704980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.704983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.704985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.704986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.704995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.705002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.705006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.705036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.705040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.705041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.705042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.705044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.705081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.705085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.705091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.705096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.705105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.705121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677332:5700], now have 1 active actors on pipe
2025-10-02T09:36:25.705127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677049:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.705130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.705132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.705132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.705139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.705149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.705154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.705157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.705158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.705158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.705160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.705175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.705180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.705181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.705163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3194
2025-10-02T09:36:25.705166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3194
2025-10-02T09:36:25.705189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.705194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.705224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.705235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.705242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.705243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.705250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.705261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.705273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.705351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.705355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.705363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.705414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3195 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0
2025-10-02T09:36:25.705687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bb3a56-8d9814-e00e4b86-57840e96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.708029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Write session: try to update token
2025-10-02T09:36:25.708043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.714294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.714305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.714306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.714307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.714310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.714312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.714315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250092881:12068]
2025-10-02T09:36:25.714333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.714339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.714340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.714341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.714346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.714349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.714441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.720593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId: src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.722618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.779233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325677351:2397]
2025-10-02T09:36:25.779371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3194, pipe: [1:7556555948325677351:2397]
2025-10-02T09:36:25.823550Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.823785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.823799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.823815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677351:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.823952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.823986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:25.823988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:25.824033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3195 reason: error at write: Disconnected sessionId: src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0
2025-10-02T09:36:25.824049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325677351:2397]
2025-10-02T09:36:25.824171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3195 sessionId: src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0 is DEAD
2025-10-02T09:36:25.824245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.824319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:25.824326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Write session will restart in 0.007235s
2025-10-02T09:36:25.824362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Write session: Do CDS request
2025-10-02T09:36:25.824367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.832207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.832278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.832288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3196
2025-10-02T09:36:25.832379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.832401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.832404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.832406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.832742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3196 sessionId:  describe result for acl check
2025-10-02T09:36:25.832773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.832777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.832779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.832782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.833143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.834771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.836897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.836980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.836991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.836993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325677468:5728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.836997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.838477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.838627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.838634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.838640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.838668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.838698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250093178:12072]
2025-10-02T09:36:25.839041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.839208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.839231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.839432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.839435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.839437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.839437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.839438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.839439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.839439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.839439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.839440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.839440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.839443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.839449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.839451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.839453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.839455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.839457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.839459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.839461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.839462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.839465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.839467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.839469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.839473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.839476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.839480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.839483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.839486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.839489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.839491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.839494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.839496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.839499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.839501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.839508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.839510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.839513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.839515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.839517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.839520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.839523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.839528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.839532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.839534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.839537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.839539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.839541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.839559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.848257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.849916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.849925Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.849926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.849927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.849931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3195 [2:7556555948250093178:12072]
2025-10-02T09:36:25.849937Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.849946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.849950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.849952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.849953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.849962Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.849967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.849971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.849997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.850001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.850002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.850004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.850005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.850054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.850060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.850066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.850071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.850080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.850093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677633:5728], now have 1 active actors on pipe
2025-10-02T09:36:25.850098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677352:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.850102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.850104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.850105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.850113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.850122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.850126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.850128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.850129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.850132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.850134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.850147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.850128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3195
2025-10-02T09:36:25.850151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.850153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.850168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.850170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.850154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3195
2025-10-02T09:36:25.850186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.850192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.850194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.850196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.850201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.850207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.850218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.850348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.850353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.850360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.850436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3196 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0
2025-10-02T09:36:25.850773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d49dc6-b6d0fdb7-e2e4a64c-aee013b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.853266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Write session: try to update token
2025-10-02T09:36:25.853286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:25.859304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:25.859315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:25.859316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:25.859317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:25.859321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.859323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.859325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250093172:12072]
2025-10-02T09:36:25.859344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:25.859350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.859351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:25.859358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:25.859370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:25.859372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:25.859458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:25.866415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId: src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:25.868864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:25.924146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555948325677649:2397]
2025-10-02T09:36:25.924313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3195, pipe: [1:7556555948325677649:2397]
2025-10-02T09:36:25.969890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:25.970099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.970107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.970119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677649:2397], now have 1 active actors on pipe
2025-10-02T09:36:25.970245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:25.970325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:25.970344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555948325677649:2397]
2025-10-02T09:36:25.970377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:25.970399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0
2025-10-02T09:36:25.970540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3196 sessionId: src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0 is DEAD
2025-10-02T09:36:25.970683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:25.970694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Write session will restart in 0.008307s
2025-10-02T09:36:25.970715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Write session: Do CDS request
2025-10-02T09:36:25.970720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:25.980173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.980303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:25.980317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3197
2025-10-02T09:36:25.980446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:25.980474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:25.980478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:25.980481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:25.980842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3197 sessionId:  describe result for acl check
2025-10-02T09:36:25.980872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:25.980873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:25.980874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:25.980880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:25.981246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:25.983141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:25.983238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:25.984869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:25.984968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:25.984975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:25.984981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:25.985007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:25.985029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555948250093463:12074]
2025-10-02T09:36:25.985090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:25.985100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:25.985102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555948325677830:5741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:25.985106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:25.985363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:25.985519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:25.985542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:25.985715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:25.985743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.985747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.985747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.985748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.985748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.985749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.985749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.985750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.985750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.985751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.985752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.985752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.985755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.985761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.985763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.985765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.985767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.985769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.985770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.985772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.985774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.985777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.985778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.985780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.985784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.985788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:25.985792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.985795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:25.985797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.985799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:25.985802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.985805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:25.985807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.985809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:25.985811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.985814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:25.985816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.985819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:25.985821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.985823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:25.985826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.985828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:25.985830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.985833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.985835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.985840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.985842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.985844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.985861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:25.994678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:25.996070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:25.996080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:25.996081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:25.996083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:25.996086Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3196 [2:7556555948250093463:12074]
2025-10-02T09:36:25.996094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:25.996103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:25.996108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.996109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.996110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.996119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:25.996122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:25.996126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:25.996153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.996157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.996158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.996161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:25.996162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:25.996196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:25.996201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:25.996207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:25.996212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:25.996221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:25.996236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677936:5741], now have 1 active actors on pipe
2025-10-02T09:36:25.996241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555948325677654:2446], now have 1 active actors on pipe
2025-10-02T09:36:25.996245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:25.996246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:25.996248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:25.996255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:25.996265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:25.996268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:25.996271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:25.996272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:25.996275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:25.996277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:25.996290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:25.996265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3196
2025-10-02T09:36:25.996296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3196
2025-10-02T09:36:25.996295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:25.996296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:25.996304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.996306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.996439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:25.996447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:25.996449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:25.996450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:25.996455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:25.996460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:25.996475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.996601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:25.996605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:25.996613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:25.996673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3197 partition: 0 MaxSeqNo: 36 sessionId: src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0
2025-10-02T09:36:25.996937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2985ef-d8ad7d15-aba13616-57f0b614_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:25.999242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Write session: try to update token
2025-10-02T09:36:25.999257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.005450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.005461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.005462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.005463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.005467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:26.005469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:26.005472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555948250093458:12074]
2025-10-02T09:36:26.005491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.005493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.005494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.005495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.005495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.005498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.005596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.011204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId: src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.013502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.070579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620645248:2397]
2025-10-02T09:36:26.070777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3196, pipe: [1:7556555952620645248:2397]
2025-10-02T09:36:26.114638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.114860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.114877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.114889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645248:2397], now have 1 active actors on pipe
2025-10-02T09:36:26.115008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.115066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:26.115094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620645248:2397]
2025-10-02T09:36:26.115122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.115142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0
2025-10-02T09:36:26.115273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3197 sessionId: src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0 is DEAD
2025-10-02T09:36:26.115436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:26.115448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Write session will restart in 0.008009s
2025-10-02T09:36:26.115473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Write session: Do CDS request
2025-10-02T09:36:26.115478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.124152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.124271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.124285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3198
2025-10-02T09:36:26.124385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.124409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.124417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.124420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.124790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3198 sessionId:  describe result for acl check
2025-10-02T09:36:26.124839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.124846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.124847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.124852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.125292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.127217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.128573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.130160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.130279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.130285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.130291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.130321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.130313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.130324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.130345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545061048:12076]
2025-10-02T09:36:26.130326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620645385:5759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.130331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.130700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.130873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.130897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.131079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.131112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.131116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.131117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.131117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.131118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.131118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.131119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.131120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.131120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.131121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.131121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.131122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.131125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.131132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.131134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.131136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.131138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.131140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.131142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.131144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.131146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.131148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.131150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.131152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.131156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.131160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.131163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.131166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.131170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.131174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.131176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.131179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.131182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.131184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.131188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.131191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.131193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.131196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.131197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.131200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.131202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.131205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.131207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.131210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.131213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.131216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.131220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.131223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.131239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.138711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.140410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.140420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.140421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.140423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.140427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3197 [2:7556555952545061048:12076]
2025-10-02T09:36:26.140435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.140446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.140451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.140452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.140453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.140461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.140465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.140470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.140501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.140505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.140506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.140508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.140509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.140543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.140547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.140553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.140558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.140568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.140582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645533:5759], now have 1 active actors on pipe
2025-10-02T09:36:26.140586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645249:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.140590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.140591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.140592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.140599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.140607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.140610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.140613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.140614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.140616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.140617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.140630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.140638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.140641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.140632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3197
2025-10-02T09:36:26.140666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3197
2025-10-02T09:36:26.140680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.140687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.140704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.140712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.140714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.140715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.140720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.140728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.140736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.140866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.140870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.140878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.140957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3198 partition: 0 MaxSeqNo: 36 sessionId: src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0
2025-10-02T09:36:26.141276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d5c35a-fcb35424-9beb6db0-104fca0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.143591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Write session: try to update token
2025-10-02T09:36:26.143605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.149606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.149617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.149618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.149619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.149622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.149624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.149626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545061043:12076]
2025-10-02T09:36:26.149644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.149644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.149647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.149649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.149651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.149652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.149761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.155415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId: src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.157744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.215476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620645545:2397]
2025-10-02T09:36:26.215649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3197, pipe: [1:7556555952620645545:2397]
2025-10-02T09:36:26.258993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.259401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.259413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.259426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645545:2397], now have 1 active actors on pipe
2025-10-02T09:36:26.259545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.259627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620645545:2397]
2025-10-02T09:36:26.259637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:26.259652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.259734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0
2025-10-02T09:36:26.259887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3198 sessionId: src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0 is DEAD
2025-10-02T09:36:26.260015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:26.260025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Write session will restart in 0.008384s
2025-10-02T09:36:26.260045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Write session: Do CDS request
2025-10-02T09:36:26.260049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.269131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.269266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.269279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3199
2025-10-02T09:36:26.269394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.269417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.269425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.269428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.269745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3199 sessionId:  describe result for acl check
2025-10-02T09:36:26.269777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.269784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.269785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.269788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.270170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.272175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.272909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.274567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.274664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.274670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.274676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.274701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.274722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545061348:12080]
2025-10-02T09:36:26.274796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.274811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.274814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620645700:5776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.274820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.275074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.275230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.275252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.275477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.275514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.275519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.275519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.275520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.275520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.275521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.275521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.275522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.275522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.275523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.275524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.275524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.275527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.275532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.275534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.275536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.275538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.275540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.275542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.275544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.275546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.275548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.275550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.275552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.275556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.275560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.275563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.275566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.275568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.275571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.275574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.275576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.275579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.275581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.275584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.275586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.275589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.275591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.275593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.275597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.275599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.275602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.275604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.275606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.275608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.275611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.275613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.275616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.275632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.283012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.284714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.284726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.284727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.284729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.284733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3198 [2:7556555952545061348:12080]
2025-10-02T09:36:26.284740Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.284750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.284754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.284756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.284756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.284766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.284769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.284773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.284818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.284823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.284824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.284826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.284827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.284864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.284869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.284877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.284882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.284894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.284905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645546:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.284911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645831:5776], now have 1 active actors on pipe
2025-10-02T09:36:26.284914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.284916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.284917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.284925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.284936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.284937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.284939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.284941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.284947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.284948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.284963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.284972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.284974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.284961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3198
2025-10-02T09:36:26.284975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3198
2025-10-02T09:36:26.284993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.284998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.285016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.285023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.285025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.285026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.285032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.285037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.285046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.285174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.285179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.285187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.285253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3199 partition: 0 MaxSeqNo: 36 sessionId: src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0
2025-10-02T09:36:26.285508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468d3e9e-11f0bb13-5eae5e52-f29fae99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.287792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Write session: try to update token
2025-10-02T09:36:26.287806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.294068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.294082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.294083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.294084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.294088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.294090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.294092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545061343:12080]
2025-10-02T09:36:26.294111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.294114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.294115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.294121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.294125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.294128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.294223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.300039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId: src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.302212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.359847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620645857:2397]
2025-10-02T09:36:26.360041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3198, pipe: [1:7556555952620645857:2397]
2025-10-02T09:36:26.404164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.404562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.404574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.404590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645857:2397], now have 1 active actors on pipe
2025-10-02T09:36:26.404704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.404781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.404795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620645857:2397]
2025-10-02T09:36:26.404842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:26.404928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0
2025-10-02T09:36:26.405086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3199 sessionId: src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0 is DEAD
2025-10-02T09:36:26.405237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:26.405247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Write session will restart in 0.009285s
2025-10-02T09:36:26.405271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Write session: Do CDS request
2025-10-02T09:36:26.405278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.415223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.415328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.415343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3200
2025-10-02T09:36:26.415468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.415493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.415502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.415505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.415843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3200 sessionId:  describe result for acl check
2025-10-02T09:36:26.415876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.415884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.415886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.415889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.416256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.418058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.418696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.420445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.420551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.420559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.420565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.420592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.420614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545061638:12083]
2025-10-02T09:36:26.420631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.420640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.420642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620646030:5785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.420647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.421000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.421184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.421218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.421410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.421440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.421443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.421444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.421444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.421445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.421446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.421446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.421447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.421447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.421448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.421448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.421449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.421452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.421459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.421463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.421466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.421470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.421473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.421477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.421479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.421485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.421488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.421496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.421499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.421503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.421507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.421510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.421513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.421516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.421518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.421521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.421523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.421527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.421530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.421532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.421536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.421539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.421542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.421547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.421550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.421552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.421555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.421558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.421563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.421566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.421568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.421570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.421574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.421591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.429097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.430705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.430718Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.430720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.430722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.430725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3199 [2:7556555952545061638:12083]
2025-10-02T09:36:26.430731Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.430741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.430745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.430747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.430748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.430757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.430760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.430765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.430794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.430799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.430800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.430802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.430803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.430837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.430842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.430849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.430854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.430874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.430887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646144:5785], now have 1 active actors on pipe
2025-10-02T09:36:26.430893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620645858:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.430896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.430897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.430898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.430905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.430913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.430917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.430919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.430920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.430922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.430923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.430937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.430943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.430948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.430933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3199
2025-10-02T09:36:26.430935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3199
2025-10-02T09:36:26.430968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.430973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.430990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1473635a-152b99a7-f83f1d29-16693d24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.430996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.430998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.430999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.431004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.431010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.431017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.431106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.431111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.431118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.431179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3200 partition: 0 MaxSeqNo: 36 sessionId: src_id|1473635a-152b99a7-f83f1d29-16693d24_0
2025-10-02T09:36:26.431568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb4dfab-25cbf8e0-5008ea86-ad61c04b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1473635a-152b99a7-f83f1d29-16693d24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.433850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Write session: try to update token
2025-10-02T09:36:26.433863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.439947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.439958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.439960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.439961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.439965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.439967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.439969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545061633:12083]
2025-10-02T09:36:26.439987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.439993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.439994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.439995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.439997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.439999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.440101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.446395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId: src_id|1473635a-152b99a7-f83f1d29-16693d24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.448766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.504755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620646155:2397]
2025-10-02T09:36:26.504971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3199, pipe: [1:7556555952620646155:2397]
2025-10-02T09:36:26.557115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.557636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.557647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.557661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646155:2397], now have 1 active actors on pipe
2025-10-02T09:36:26.557785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.557869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.557889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:26.557908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620646155:2397]
2025-10-02T09:36:26.557952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3200 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1473635a-152b99a7-f83f1d29-16693d24_0
2025-10-02T09:36:26.558111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3200 sessionId: src_id|1473635a-152b99a7-f83f1d29-16693d24_0 is DEAD
2025-10-02T09:36:26.558243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:26.558257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Write session will restart in 0.009951s
2025-10-02T09:36:26.558283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Write session: Do CDS request
2025-10-02T09:36:26.558288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.569111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.569235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.569246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3201
2025-10-02T09:36:26.569342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.569364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.569371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.569374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.569654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3201 sessionId:  describe result for acl check
2025-10-02T09:36:26.569680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.569681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.569682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.569685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.570050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.571425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.572013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.573364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.573474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.573480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.573486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.573511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.573536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545061929:12085]
2025-10-02T09:36:26.573760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.573770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.573774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620646367:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.573779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.573903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.574085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.574113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.574307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.574343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.574347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.574347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.574348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.574348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.574349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.574349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.574350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.574350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.574351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.574352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.574352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.574355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.574362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.574364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.574366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.574368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.574370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.574372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.574374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.574376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.574378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.574380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.574382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.574386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.574396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.574398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.574400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.574402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.574405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.574407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.574410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.574412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.574415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.574417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.574420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.574422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.574424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.574427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.574431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.574433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.574436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.574441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.574443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.574446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.574452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.574470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.581968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.583825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.583836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.583837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.583839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.583843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3200 [2:7556555952545061929:12085]
2025-10-02T09:36:26.583850Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.583860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.583861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.583863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.583864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.583873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.583876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.583880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.583915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.583920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.583921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.583924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.583925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.583964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.583969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.583976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.583981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.583993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.584007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646445:5816], now have 1 active actors on pipe
2025-10-02T09:36:26.584012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646157:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.584016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.584017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.584019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.584030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.584055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3200
2025-10-02T09:36:26.584081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3200
2025-10-02T09:36:26.584041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.584044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.584048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.584049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.584056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.584058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.584076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.584078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.584080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.584090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.584092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.584119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.584124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.584126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.584127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.584132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.584137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.584147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.584260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.584275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.584286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.584362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3201 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0
2025-10-02T09:36:26.584557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1473635a-152b99a7-f83f1d29-16693d24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.586852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Write session: try to update token
2025-10-02T09:36:26.586876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.593298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.593310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.593312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.593313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.593317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.593319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.593321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545061924:12085]
2025-10-02T09:36:26.593340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.593343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.593344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.593346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.593349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.593352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.593467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.599712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId: src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.602095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.657848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620646459:2397]
2025-10-02T09:36:26.658033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3200, pipe: [1:7556555952620646459:2397]
2025-10-02T09:36:26.709189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.709646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.709655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.709667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646459:2397], now have 1 active actors on pipe
2025-10-02T09:36:26.709802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.709842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620646459:2397]
2025-10-02T09:36:26.709868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:26.709930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3201 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0
2025-10-02T09:36:26.710080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3201 sessionId: src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0 is DEAD
2025-10-02T09:36:26.710184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:26.710194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Write session will restart in 0.005430s
2025-10-02T09:36:26.710208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Write session: Do CDS request
2025-10-02T09:36:26.710212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.710223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.710251Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:36:26.710327Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 32 consumer shared/user session shared/user_1_32_1159518760392506779_v1 is DEAD
2025-10-02T09:36:26.710468Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555892491078811:2374] disconnected; active server actors: 1
2025-10-02T09:36:26.710476Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555892491078811:2374] client user disconnected session shared/user_1_32_1159518760392506779_v1
2025-10-02T09:36:26.710555Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:36:26.710651Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:26.710656Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:26.710668Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005085s
2025-10-02T09:36:26.716092Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:36:26.716244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.716279Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:36:26.716290Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 33
2025-10-02T09:36:26.716364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.716370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3202
2025-10-02T09:36:26.716427Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 33 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:26.716458Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:26.716533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.716549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.716556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.716558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.716587Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 auth for : user
2025-10-02T09:36:26.716781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3202 sessionId:  describe result for acl check
2025-10-02T09:36:26.716812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.716817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.716818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.716821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.717169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.717232Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 Handle describe topics response
2025-10-02T09:36:26.717247Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 auth is DEAD
2025-10-02T09:36:26.717257Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:36:26.717437Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:36:26.717533Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:26.717725Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555952620646553:5839] connected; active server actors: 1
2025-10-02T09:36:26.717734Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555952620646553:5839] session shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:26.717739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:36:26.717745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:36:26.717748Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_33_14522621208006915550_v1" (Sender=[1:7556555952620646519:5839], Pipe=[1:7556555952620646553:5839], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:26.717754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:36:26.717761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:36:26.717765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_33_14522621208006915550_v1" (Sender=[1:7556555952620646519:5839], Pipe=[1:7556555952620646553:5839], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:26.717772Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_33_14522621208006915550_v1" sender [1:7556555952620646519:5839] lock partition 0 for ReadingSession "shared/user_1_33_14522621208006915550_v1" (Sender=[1:7556555952620646519:5839], Pipe=[1:7556555952620646553:5839], Partitions=[], ActiveFamilyCount=1) generation 1 step 33
2025-10-02T09:36:26.717777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:36:26.717779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000016s
2025-10-02T09:36:26.717906Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 33 Session: "shared/user_1_33_14522621208006915550_v1" ClientId: "user" PipeClient { RawX1: 7556555952620646553 RawX2: 4503603922343631 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:36:26.717925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:36:26.719298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.721479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.721491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.721493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620646534:5854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.721497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.723368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.724783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.724895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.724902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.724908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.724935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.724958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545062251:12097]
2025-10-02T09:36:26.725309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.725488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.725516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.725709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.725740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.725744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.725744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.725745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.725745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.725746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.725746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.725747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.725747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.725748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.725748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.725749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.725752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.725758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.725760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.725762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.725764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.725766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.725768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.725770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.725772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.725774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.725776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.725778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.725781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.725785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.725788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.725791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.725793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.725796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.725798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.725801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.725804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.725806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.725808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.725811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.725814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.725817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.725819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.725822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.725824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.725827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.725829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.725831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.725833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.725839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.725841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.725846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.725874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.733322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.734835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.734847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.734848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.734850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.734853Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3201 [2:7556555952545062251:12097]
2025-10-02T09:36:26.734860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.734877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.734883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.734884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.734885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.734894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.734897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.734901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.734930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.734934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.734935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.734937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.734939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.734973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.734979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.734985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.734991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.735000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.735013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646573:5886], now have 1 active actors on pipe
2025-10-02T09:36:26.735019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646719:5854], now have 1 active actors on pipe
2025-10-02T09:36:26.735020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646474:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.735024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.735025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.735027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.735034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.735044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.735047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.735049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.735050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.735052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.735054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.735071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.735081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.735090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.735073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3201
2025-10-02T09:36:26.735108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.735094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3201
2025-10-02T09:36:26.735113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.735100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3201, pipe: [1:7556555952620646573:5886]
2025-10-02T09:36:26.735123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.735124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.735127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_33_14522621208006915550_v1 on pipe: [1:7556555952620646573:5886]
2025-10-02T09:36:26.735138Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_33_14522621208006915550_v1:1 with generation 3201
2025-10-02T09:36:26.735140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.735145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.735147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.735149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.735154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.735159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.735165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.735173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.735173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.735181Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:26.735185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.735198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.735210Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:36:26.735337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.735346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.735355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.735417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3202 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0
2025-10-02T09:36:26.735673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce01622-6b278ae6-e1f39a21-dfa03f08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.738466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Write session: try to update token
2025-10-02T09:36:26.738479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.738580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:36:26.738595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:36:26.738599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.738604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.738604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.738607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:36:26.738611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:36:26.738754Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397786735 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:36:26.738766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:36:26.738791Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 sending to client partition status
2025-10-02T09:36:26.744233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.744246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.744247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.744248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.744252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.744254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.744259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545062246:12097]
2025-10-02T09:36:26.744280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.744284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.744286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.744299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.744308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.744312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.744404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.751197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId: src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.753460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.853442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:26.853714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.853722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.853842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:26.853858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:26.853873Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:26.853860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620646573:5886]
2025-10-02T09:36:26.853873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:26.853875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:26.853887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:26.853919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3202 reason: error at write: Disconnected sessionId: src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0
2025-10-02T09:36:26.854050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3202 sessionId: src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0 is DEAD
2025-10-02T09:36:26.854175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:26.854188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Write session will restart in 0.007723s
2025-10-02T09:36:26.854203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Write session: Do CDS request
2025-10-02T09:36:26.854207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:26.863201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.863313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:26.863324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3203
2025-10-02T09:36:26.863446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:26.863470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:26.863477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:26.863480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:26.863775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3203 sessionId:  describe result for acl check
2025-10-02T09:36:26.863797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:26.863798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:26.863799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:26.863802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:26.864137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:26.866080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:26.867534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:26.869019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:26.869206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:26.869214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:26.869223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:26.869262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:26.869255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:26.869265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:26.869267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555952620646925:5898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:26.869287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555952545062551:12101]
2025-10-02T09:36:26.869270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:26.869634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:26.869812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:26.869840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:26.870033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:26.870064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.870068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.870068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.870069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.870069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.870070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.870070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.870071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.870071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.870072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.870072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.870073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.870076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.870081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.870083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.870086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.870088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.870090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.870092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.870094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.870095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.870098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.870099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.870101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.870106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.870110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:26.870113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.870116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:26.870118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.870121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:26.870123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.870126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:26.870128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.870131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:26.870132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.870135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:26.870137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.870139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:26.870142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.870145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:26.870147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.870149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:26.870151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.870154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.870155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.870158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.870160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.870162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.870181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:26.877532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:26.879065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:26.879076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:26.879077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:26.879079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:26.879082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3202 [2:7556555952545062551:12101]
2025-10-02T09:36:26.879089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:26.879098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:26.879103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.879105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.879106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.879114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:26.879120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:26.879124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:26.879151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.879155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.879156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.879158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:26.879159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:26.879196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:26.879203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.879211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:26.879220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:26.879236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:26.879251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620646790:2446], now have 1 active actors on pipe
2025-10-02T09:36:26.879256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620647079:5898], now have 1 active actors on pipe
2025-10-02T09:36:26.879259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.879260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.879261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.879268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:26.879276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:26.879283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:26.879285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:26.879285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:26.879286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:26.879287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:26.879299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.879307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:26.879310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:26.879292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3202
2025-10-02T09:36:26.879300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3202
2025-10-02T09:36:26.879328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.879333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.879346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24051c7a-87d42c61-84e18492-b53833bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:26.879353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:26.879355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:26.879356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:26.879360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:26.879365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:26.879374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.879611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:26.879618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:26.879627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:26.879686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3203 partition: 0 MaxSeqNo: 36 sessionId: src_id|24051c7a-87d42c61-84e18492-b53833bd_0
2025-10-02T09:36:26.879939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56d243-dca60e90-a6af9996-3a06ca4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24051c7a-87d42c61-84e18492-b53833bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:26.882784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Write session: try to update token
2025-10-02T09:36:26.882796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:26.892146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:26.892158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.892163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.892187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:26.892203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:26.892324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:26.892442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:26.892558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:26.892677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:26.892849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:26.892874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:26.895587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId: src_id|24051c7a-87d42c61-84e18492-b53833bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:26.896774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:26.896786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:26.896787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:26.896788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:26.896791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.896794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.896796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555952545062546:12101]
2025-10-02T09:36:26.896819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:26.896822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:26.896823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:26.896824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:26.896826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:26.896828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:26.896944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:26.897987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:26.953757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555952620647097:5886]
2025-10-02T09:36:26.953905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3202, pipe: [1:7556555952620647097:5886]
2025-10-02T09:36:27.007008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.007431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.007440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.007455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555952620647097:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.007576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.007643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.007653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:27.007674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555952620647097:5886]
2025-10-02T09:36:27.007710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24051c7a-87d42c61-84e18492-b53833bd_0
2025-10-02T09:36:27.007999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:27.008011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Write session will restart in 0.005789s
2025-10-02T09:36:27.008032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Write session: Do CDS request
2025-10-02T09:36:27.007837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3203 sessionId: src_id|24051c7a-87d42c61-84e18492-b53833bd_0 is DEAD
2025-10-02T09:36:27.008037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.015203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.015304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.015316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3204
2025-10-02T09:36:27.015441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.015471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.015480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.015484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.015852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3204 sessionId:  describe result for acl check
2025-10-02T09:36:27.015877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.015883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.015884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.015887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.016227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.018277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.020409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.020419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.020421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915614485:5910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.020425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.023245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.023497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.023603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.023609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.023615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.023643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.023668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840030141:12103]
2025-10-02T09:36:27.024015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.024184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.024211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.024408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.024440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.024444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.024445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.024445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.024446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.024446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.024447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.024448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.024448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.024449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.024449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.024450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.024452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.024458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.024460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.024462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.024464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.024466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.024467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.024469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.024471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.024473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.024475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.024477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.024482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.024485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.024489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.024491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.024494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.024497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.024499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.024501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.024504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.024506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.024510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.024513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.024515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.024518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.024520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.024523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.024527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.024530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.024532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.024534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.024537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.024543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.024546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.024549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.024566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.031926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.033409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.033420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.033421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.033423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.033427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3203 [2:7556555956840030141:12103]
2025-10-02T09:36:27.033434Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.033443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.033448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.033449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.033450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.033459Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.033463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.033467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.033497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.033502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.033502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.033504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.033506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.033539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.033544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.033550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.033555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.033568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.033585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915614685:5910], now have 1 active actors on pipe
2025-10-02T09:36:27.033592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915614397:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.033597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.033602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.033603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.033612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.033622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.033609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3203
2025-10-02T09:36:27.033612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3203
2025-10-02T09:36:27.033631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.033630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.033633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.033634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.033635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.033658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.033660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.033667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.033674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.033687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.033690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|817380d5-33d7e70a-708aec24-41592ef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.033694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.033696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.033697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.033702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.033707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.033788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.033948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.033955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.033964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.034025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3204 partition: 0 MaxSeqNo: 36 sessionId: src_id|817380d5-33d7e70a-708aec24-41592ef7_0
2025-10-02T09:36:27.034285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24051c7a-87d42c61-84e18492-b53833bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|817380d5-33d7e70a-708aec24-41592ef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.036848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Write session: try to update token
2025-10-02T09:36:27.036862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.042651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.042662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.042663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.042664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.042667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.042669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.042671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840030136:12103]
2025-10-02T09:36:27.042689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.042692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.042693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.042701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.042712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.042715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.042813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.049996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId: src_id|817380d5-33d7e70a-708aec24-41592ef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.052123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.107872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915614699:5886]
2025-10-02T09:36:27.108017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3203, pipe: [1:7556555956915614699:5886]
2025-10-02T09:36:27.152248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.152663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.152673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.152685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915614699:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.152815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.152834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915614699:5886]
2025-10-02T09:36:27.152835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.152862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:27.152912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|817380d5-33d7e70a-708aec24-41592ef7_0
2025-10-02T09:36:27.153038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3204 sessionId: src_id|817380d5-33d7e70a-708aec24-41592ef7_0 is DEAD
2025-10-02T09:36:27.153196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:27.153206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Write session will restart in 0.008373s
2025-10-02T09:36:27.153233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Write session: Do CDS request
2025-10-02T09:36:27.153238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.162218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.162267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.162277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3205
2025-10-02T09:36:27.162389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.162410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.162415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.162418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.162676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3205 sessionId:  describe result for acl check
2025-10-02T09:36:27.162702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.162710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.162711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.162714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.163064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.164613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.166556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.166611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.166622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.166624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915614832:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.166628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.168204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.168303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.168310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.168316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.168343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.168364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840030436:12106]
2025-10-02T09:36:27.168704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.168882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.168906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.169090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.169122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.169126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.169127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.169127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.169128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.169129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.169129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.169130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.169130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.169131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.169131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.169132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.169134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.169139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.169141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.169143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.169145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.169147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.169149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.169151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.169153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.169155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.169157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.169159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.169163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.169167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.169170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.169173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.169175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.169177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.169180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.169182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.169185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.169188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.169191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.169193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.169195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.169198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.169200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.169202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.169204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.169207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.169209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.169211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.169213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.169218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.169219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.169222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.169242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.176582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.178197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.178210Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.178211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.178214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.178218Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3204 [2:7556555956840030436:12106]
2025-10-02T09:36:27.178228Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.178242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.178244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.178245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.178246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.178254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.178256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.178262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.178290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.178294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.178295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.178297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.178298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.178332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.178336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.178343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.178348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.178357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.178371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915614700:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.178376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915614991:5924], now have 1 active actors on pipe
2025-10-02T09:36:27.178380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.178381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.178382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.178390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.178400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.178407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.178409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.178410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.178391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3204
2025-10-02T09:36:27.178414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.178415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.178432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.178433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.178440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.178445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.178398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3204
2025-10-02T09:36:27.178457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.178462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.178467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.178470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.178472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.178478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.178488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.178501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.178605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.178610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.178618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.178676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3205 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0
2025-10-02T09:36:27.178925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|817380d5-33d7e70a-708aec24-41592ef7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.181247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Write session: try to update token
2025-10-02T09:36:27.181260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.193972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.193990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.193991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.193992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.193995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.193997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.193999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840030430:12106]
2025-10-02T09:36:27.194023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.194025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.194027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.194049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.194061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.194065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.194160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.202056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId: src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.221628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.252797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915615003:5886]
2025-10-02T09:36:27.253074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3204, pipe: [1:7556555956915615003:5886]
2025-10-02T09:36:27.305271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.305465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.305473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.305486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615003:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.305605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.305630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915615003:5886]
2025-10-02T09:36:27.305638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:27.305643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:27.305652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.305711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3205 reason: error at write: Disconnected sessionId: src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0
2025-10-02T09:36:27.305899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3205 sessionId: src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0 is DEAD
2025-10-02T09:36:27.306033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:27.306044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Write session will restart in 0.006870s
2025-10-02T09:36:27.306077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Write session: Do CDS request
2025-10-02T09:36:27.306082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.314230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.314387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.314399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3206
2025-10-02T09:36:27.314512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.314536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.314547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.314550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.314929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3206 sessionId:  describe result for acl check
2025-10-02T09:36:27.314960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.314966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.314967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.314970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.315265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.317232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.319207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.319217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.319219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915615134:5956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.319222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.319311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.320969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.321107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.321114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.321121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.321153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.321177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840030743:12109]
2025-10-02T09:36:27.321523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.321682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.321706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.321902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.321938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.321939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.321939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.321940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.321940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.321941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.321941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.321942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.321942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.321943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.321943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.321946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.321954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.321956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.321958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.321961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.321963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.321965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.321967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.321969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.321970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.321972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.321976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.321979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.321983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.321986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.321989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.321991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.321993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.321996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.321998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.322001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.322003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.322006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.322008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.322011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.322013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.322015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.322018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.322025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.322028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.322030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.322032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.322035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.322052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.329665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.331245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.331257Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.331258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.331260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.331263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3205 [2:7556555956840030743:12109]
2025-10-02T09:36:27.331270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.331279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.331280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.331282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.331283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.331293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.331297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.331303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.331340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.331344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.331345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.331347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.331348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.331386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.331390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.331397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.331402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.331409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.331423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615016:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.331428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615306:5956], now have 1 active actors on pipe
2025-10-02T09:36:27.331432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.331433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.331434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.331442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.331449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.331456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.331458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.331459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.331460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.331461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.331474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.331479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.331480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.331463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3205
2025-10-02T09:36:27.331491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3205
2025-10-02T09:36:27.331501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.331506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.331522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.331528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.331530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.331531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.331536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.331542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.331553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.331662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.331669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.331678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.331748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3206 partition: 0 MaxSeqNo: 36 sessionId: src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0
2025-10-02T09:36:27.332004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b570dbe-ec3ec8f-2bd4ab18-7056f3d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.334622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Write session: try to update token
2025-10-02T09:36:27.334637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.340574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.340585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.340586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.340587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.340590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.340593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.340595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840030737:12109]
2025-10-02T09:36:27.340616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.340620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.340621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.340625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.340630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.340633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.340734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.347966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId: src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.351101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.405881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915615322:5886]
2025-10-02T09:36:27.406079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3205, pipe: [1:7556555956915615322:5886]
2025-10-02T09:36:27.448995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.449395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.449406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.449421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615322:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.449556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.449572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.449607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915615322:5886]
2025-10-02T09:36:27.449609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:27.449666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0
2025-10-02T09:36:27.449800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3206 sessionId: src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0 is DEAD
2025-10-02T09:36:27.449938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:27.449950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Write session will restart in 0.008025s
2025-10-02T09:36:27.449973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Write session: Do CDS request
2025-10-02T09:36:27.449979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.459198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.459328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.459341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3207
2025-10-02T09:36:27.459454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.459480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.459489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.459492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.459834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3207 sessionId:  describe result for acl check
2025-10-02T09:36:27.459862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.459866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.459868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.459872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.460312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.461976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.463513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.465126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.465230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.465236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.465242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.465268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.465288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840031040:12112]
2025-10-02T09:36:27.465358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.465368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.465370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915615467:5971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.465374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.465632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.465802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.465826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.466006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.466033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.466037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.466038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.466038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.466039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.466039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.466040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.466040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.466041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.466041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.466042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.466042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.466045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.466052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.466054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.466056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.466058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.466060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.466062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.466064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.466066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.466068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.466070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.466072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.466075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.466079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.466082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.466085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.466087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.466090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.466092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.466095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.466097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.466099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.466101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.466104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.466108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.466111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.466113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.466116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.466118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.466121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.466123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.466126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.466128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.466132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.466134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.466137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.466154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.473471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.474863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.474881Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.474882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.474884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.474887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3206 [2:7556555956840031040:12112]
2025-10-02T09:36:27.474894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.474904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.474907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.474908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.474909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.474918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.474925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.474929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.474958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.474962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.474963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.474965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.474966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.475090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3206
2025-10-02T09:36:27.475112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3206
2025-10-02T09:36:27.475146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.475151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.475158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.475163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.475174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.475188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615616:5971], now have 1 active actors on pipe
2025-10-02T09:36:27.475193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615323:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.475203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.475208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.475219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.475223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.475224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.475232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.475241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.475246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.475248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.475249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.475252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.475253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.475262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96d86e0e-3e486c-84989385-bd2c5581_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.475268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.475271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.475272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.475277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.475283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.475300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.475307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.475312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.475314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.475410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.475415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.475423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.475484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3207 partition: 0 MaxSeqNo: 36 sessionId: src_id|96d86e0e-3e486c-84989385-bd2c5581_0
2025-10-02T09:36:27.475703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3668145f-bf743cba-9e9a3a04-2270cb7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96d86e0e-3e486c-84989385-bd2c5581_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.478108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Write session: try to update token
2025-10-02T09:36:27.478123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.484274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.484285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.484286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.484287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.484291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.484293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.484295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840031035:12112]
2025-10-02T09:36:27.484314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.484317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.484318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.484325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.484330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.484333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.484446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.491608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId: src_id|96d86e0e-3e486c-84989385-bd2c5581_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.493957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.549734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915615628:5886]
2025-10-02T09:36:27.549926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3206, pipe: [1:7556555956915615628:5886]
2025-10-02T09:36:27.594839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.595080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.595091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.595104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615628:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.595285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:27.595300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:27.595303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915615628:5886]
2025-10-02T09:36:27.595340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.595355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3207 reason: error at write: Disconnected sessionId: src_id|96d86e0e-3e486c-84989385-bd2c5581_0
2025-10-02T09:36:27.595480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3207 sessionId: src_id|96d86e0e-3e486c-84989385-bd2c5581_0 is DEAD
2025-10-02T09:36:27.595490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.595649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:27.595661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Write session will restart in 0.009981s
2025-10-02T09:36:27.595681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Write session: Do CDS request
2025-10-02T09:36:27.595688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.607242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.607357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.607371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3208
2025-10-02T09:36:27.607495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.607521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.607529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.607532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.607842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3208 sessionId:  describe result for acl check
2025-10-02T09:36:27.607873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.607880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.607881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.607884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.608227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.608777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.609611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.610374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.610477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.610484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.610490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.610515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.610541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840031337:12114]
2025-10-02T09:36:27.610889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.611057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.611079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.611253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.611280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.611284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.611285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.611285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.611286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.611286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.611287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.611287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.611288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.611289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.611289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.611290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.611292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.611299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.611301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.611303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.611305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.611307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.611308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.611310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.611312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.611314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.611316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.611318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.611322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.611326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.611329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.611332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.611334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.611337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.611339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.611341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.611344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.611347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.611349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.611351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.611354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.611356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.611359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.611361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.611364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.611368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.611370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.611373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.611375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.611378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.611380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.611382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.611399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.611520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.611530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.611532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915615886:5975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.611536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.618720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.620278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.620288Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.620289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.620291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.620294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3207 [2:7556555956840031337:12114]
2025-10-02T09:36:27.620300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.620310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.620311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.620313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.620314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.620322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.620324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.620331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.620361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.620366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.620366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.620368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.620369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.620404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.620409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.620415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.620420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.620428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.620442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615629:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.620447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615927:5975], now have 1 active actors on pipe
2025-10-02T09:36:27.620451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.620452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.620453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.620460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.620471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.620473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.620475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.620476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.620481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.620483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.620473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3207
2025-10-02T09:36:27.620496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.620501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.620502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.620505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3207
2025-10-02T09:36:27.620521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.620526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.620541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.620548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.620550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.620552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.620556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.620564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.620571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.620680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.620684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.620691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.620761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3208 partition: 0 MaxSeqNo: 36 sessionId: src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0
2025-10-02T09:36:27.621026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d86e0e-3e486c-84989385-bd2c5581_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.623280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Write session: try to update token
2025-10-02T09:36:27.623293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.629458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.629469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.629470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.629471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.629475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.629478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.629479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840031332:12114]
2025-10-02T09:36:27.629499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.629503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.629504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.629511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.629522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.629525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.629610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.635295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId: src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.637435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.695661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915615935:5886]
2025-10-02T09:36:27.695791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3207, pipe: [1:7556555956915615935:5886]
2025-10-02T09:36:27.747853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.748203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.748214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.748227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615935:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.748401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:27.748415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:27.748526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3208 reason: error at write: Disconnected sessionId: src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0
2025-10-02T09:36:27.748681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3208 sessionId: src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0 is DEAD
2025-10-02T09:36:27.748832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:27.748843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Write session will restart in 0.007923s
2025-10-02T09:36:27.748863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Write session: Do CDS request
2025-10-02T09:36:27.748869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.748879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.748915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915615935:5886]
2025-10-02T09:36:27.749497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.758233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.758272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.758285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3209
2025-10-02T09:36:27.758409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.758433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.758439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.758442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.758995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3209 sessionId:  describe result for acl check
2025-10-02T09:36:27.759023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.759024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.759025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.759029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.759443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.761161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.763418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.763428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.763430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915616121:6013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.763435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.763909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.768006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.768126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.768133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.768140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.768170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.768192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840031671:12126]
2025-10-02T09:36:27.768554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.768719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.768741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.768940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.768978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.768983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.768984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.768985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.768985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.768986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.768986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.768987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.768987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.768988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.768989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.768989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.768992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.768998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.769000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.769002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.769004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.769006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.769010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.769012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.769014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.769016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.769018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.769024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.769028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.769031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.769034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.769036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.769039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.769041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.769046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.769049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.769056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.769059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.769065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.769069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.769076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.769078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.769080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.769083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.769085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.769087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.769090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.769094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.769097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.769099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.769101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.769118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.776465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.778562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.778573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.778574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.778577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.778580Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3208 [2:7556555956840031671:12126]
2025-10-02T09:36:27.778588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.778598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.778601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.778603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.778604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.778613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.778617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.778621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.778653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.778659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.778660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.778662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.778664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.778701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.778706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.778712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.778717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.778725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.778740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915615949:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.778746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915616249:6013], now have 1 active actors on pipe
2025-10-02T09:36:27.778750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.778751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.778752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.778760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.778771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.778773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.778775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.778776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.778786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.778792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.778807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.778796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3208
2025-10-02T09:36:27.778824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3208
2025-10-02T09:36:27.778815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.778822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.778839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.778841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.778856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.778863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.778865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.778866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.778881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.778888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.778897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.779007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.779012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.779019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.779091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3209 partition: 0 MaxSeqNo: 36 sessionId: src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0
2025-10-02T09:36:27.779384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250496fd-2443d3d8-cd26bb2d-a8a339d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.781713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Write session: try to update token
2025-10-02T09:36:27.781726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.788590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.788601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.788603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.788604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.788608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.788610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.788616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840031666:12126]
2025-10-02T09:36:27.788634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.788637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.788638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.788639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.788647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.788652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.788759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.798836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId: src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.801246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:27.849275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555956915616263:5886]
2025-10-02T09:36:27.849497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3208, pipe: [1:7556555956915616263:5886]
2025-10-02T09:36:27.902661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:27.903169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.903178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.903192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915616263:5886], now have 1 active actors on pipe
2025-10-02T09:36:27.903340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:27.903380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:27.903389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:27.903393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:27.903439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555956915616263:5886]
2025-10-02T09:36:27.903441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3209 reason: error at write: Disconnected sessionId: src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0
2025-10-02T09:36:27.903575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3209 sessionId: src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0 is DEAD
2025-10-02T09:36:27.903713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:27.903723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Write session will restart in 0.008096s
2025-10-02T09:36:27.903743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Write session: Do CDS request
2025-10-02T09:36:27.903748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:27.913180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.913310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:27.913324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3210
2025-10-02T09:36:27.913423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:27.913448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:27.913456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:27.913460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:27.914037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3210 sessionId:  describe result for acl check
2025-10-02T09:36:27.914070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:27.914076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:27.914078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:27.914082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:27.914533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:27.916668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:27.918042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:27.919498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:27.919606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:27.919612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:27.919618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:27.919646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:27.919672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555956840031969:12130]
2025-10-02T09:36:27.919763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:27.919773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:27.919775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555956915616405:6051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:27.919780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:27.920035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:27.920192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:27.920216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:27.920400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:27.920433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.920437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.920438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.920438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.920439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.920439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.920440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.920440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.920441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.920441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.920442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.920442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.920445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.920451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.920453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.920455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.920457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.920459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.920461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.920463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.920465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.920467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.920469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.920472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.920475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.920479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:27.920482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.920485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:27.920487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.920490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:27.920492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.920495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:27.920497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.920500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:27.920502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.920504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:27.920506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.920509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:27.920511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.920513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:27.920515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.920518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:27.920520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.920523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.920524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.920527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.920529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.920532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.920549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:27.927921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:27.929758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:27.929769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:27.929770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:27.929772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:27.929776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3209 [2:7556555956840031969:12130]
2025-10-02T09:36:27.929784Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:27.929792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:27.929795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.929797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.929798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.929806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:27.929811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:27.929817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:27.929851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.929857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.929858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.929859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:27.929861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:27.929896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:27.929901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.929907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:27.929912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:27.929920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:27.929935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915616265:2446], now have 1 active actors on pipe
2025-10-02T09:36:27.929940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555956915616562:6051], now have 1 active actors on pipe
2025-10-02T09:36:27.929943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.929945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.929946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.929953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:27.929963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:27.929968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:27.929970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:27.929971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:27.929972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:27.929974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:27.929986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.929991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:27.929982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3209
2025-10-02T09:36:27.930003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:27.930007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.930009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.930027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:27.930031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:27.930033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:27.930034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:27.930039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:27.930044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:27.929993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3209
2025-10-02T09:36:27.930051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.930166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:27.930172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:27.930181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:27.930250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3210 partition: 0 MaxSeqNo: 36 sessionId: src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0
2025-10-02T09:36:27.930582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c8e374-1d49dba7-57b3de09-cdbc93a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:27.932869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Write session: try to update token
2025-10-02T09:36:27.932880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:27.938944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:27.938954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:27.938955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:27.938956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:27.938959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.938962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.938964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555956840031964:12130]
2025-10-02T09:36:27.938982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:27.938985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:27.938985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:27.938986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:27.938987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:27.938989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:27.939130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:27.952075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId: src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:27.954443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.003381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210583875:5886]
2025-10-02T09:36:28.003632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3209, pipe: [1:7556555961210583875:5886]
2025-10-02T09:36:28.052050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.052269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.052277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.052290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210583875:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.052441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.052500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:28.052509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210583875:5886]
2025-10-02T09:36:28.052536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.052568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0
2025-10-02T09:36:28.052702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3210 sessionId: src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0 is DEAD
2025-10-02T09:36:28.052881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:28.052893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Write session will restart in 0.008438s
2025-10-02T09:36:28.052919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Write session: Do CDS request
2025-10-02T09:36:28.052924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.062205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.062294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.062308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3211
2025-10-02T09:36:28.062418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.062444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.062452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.062455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.062787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3211 sessionId:  describe result for acl check
2025-10-02T09:36:28.062815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.062822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.062823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.062826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.063191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.065241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.066713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.068220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.068318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.068325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.068333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.068361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.068385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961134999565:12132]
2025-10-02T09:36:28.068460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.068470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.068473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210584015:6061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.068477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.068740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.068930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.068957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.069153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.069184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.069188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.069189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.069189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.069190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.069190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.069191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.069191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.069192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.069192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.069193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.069193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.069196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.069202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.069204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.069206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.069208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.069210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.069212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.069214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.069216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.069218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.069220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.069222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.069226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.069229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.069232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.069235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.069237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.069240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.069242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.069244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.069246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.069249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.069251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.069253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.069256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.069259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.069261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.069264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.069266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.069269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.069271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.069274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.069280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.069283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.069285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.069288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.069305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.076631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.078270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.078280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.078281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.078284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.078287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3210 [2:7556555961134999565:12132]
2025-10-02T09:36:28.078296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.078307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.078310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.078313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.078314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.078325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.078332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.078337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.078366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.078370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.078371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.078373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.078375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.078408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.078413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.078419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.078424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.078432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.078447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210583877:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.078452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584173:6061], now have 1 active actors on pipe
2025-10-02T09:36:28.078455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.078456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.078457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.078464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.078473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.078478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.078480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.078481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.078483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.078485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.078500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.078505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.078506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.078494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3210
2025-10-02T09:36:28.078531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.078535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.078525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3210
2025-10-02T09:36:28.078549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.078557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.078560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.078561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.078567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.078578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.078588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.078719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.078726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.078735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.078801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3211 partition: 0 MaxSeqNo: 36 sessionId: src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0
2025-10-02T09:36:28.079071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abfe4f46-9936b7ba-47d3ab43-14ed32b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.081374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Write session: try to update token
2025-10-02T09:36:28.081387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.087668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.087679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.087681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.087681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.087685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.087687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.087689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961134999560:12132]
2025-10-02T09:36:28.087706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.087709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.087710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.087710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.087713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.087715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.087863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.097414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId: src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.099749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.152905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210584185:5886]
2025-10-02T09:36:28.153113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3210, pipe: [1:7556555961210584185:5886]
2025-10-02T09:36:28.198268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.198471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.198480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.198492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584185:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.198606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.198623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.198642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210584185:5886]
2025-10-02T09:36:28.198660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:28.198815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0
2025-10-02T09:36:28.198948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3211 sessionId: src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0 is DEAD
2025-10-02T09:36:28.199108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:28.199117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Write session will restart in 0.005321s
2025-10-02T09:36:28.199137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Write session: Do CDS request
2025-10-02T09:36:28.199142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.205152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.205256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.205267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3212
2025-10-02T09:36:28.205391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.205417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.205427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.205430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.205776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3212 sessionId:  describe result for acl check
2025-10-02T09:36:28.205804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.205810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.205811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.205815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.206263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.208172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.210976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.210985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.210987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210584237:6084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.210992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.213026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.214738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.214843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.214849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.214855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.214890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.214914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961134999881:12135]
2025-10-02T09:36:28.215273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.215459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.215485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.215673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.215703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.215707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.215708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.215708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.215709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.215709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.215710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.215710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.215711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.215711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.215712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.215712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.215715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.215720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.215723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.215725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.215726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.215729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.215730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.215732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.215734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.215736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.215738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.215740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.215744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.215747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.215750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.215753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.215755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.215758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.215760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.215763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.215767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.215771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.215775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.215779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.215783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.215787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.215790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.215792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.215795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.215798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.215800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.215802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.215805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.215807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.215809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.215812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.215831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.223142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.224658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.224669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.224671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.224672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.224676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3211 [2:7556555961134999881:12135]
2025-10-02T09:36:28.224683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.224691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.224693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.224694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.224695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.224703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.224709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.224713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.224747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.224753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.224755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.224758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.224760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.224796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.224811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.224820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.224827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.224835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.224849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584428:6084], now have 1 active actors on pipe
2025-10-02T09:36:28.224855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584187:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.224858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.224859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.224860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.224868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.224878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.224883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.224885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.224886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.224887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.224888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.224901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.224906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.224910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.224898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3211
2025-10-02T09:36:28.224929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.224933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.224923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3211
2025-10-02T09:36:28.224947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.224953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.224955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.224956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.224961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.224966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.224975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.225102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.225109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.225117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.225189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3212 partition: 0 MaxSeqNo: 36 sessionId: src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0
2025-10-02T09:36:28.225475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a894d84d-7f9d746d-d36b9f51-fb04b3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.227878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Write session: try to update token
2025-10-02T09:36:28.227894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.233968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.233980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.233981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.233983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.233988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.233990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.233992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961134999876:12135]
2025-10-02T09:36:28.234011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.234016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.234018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.234024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.234035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.234038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.234135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.243006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId: src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.245395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.298807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210584496:5886]
2025-10-02T09:36:28.299008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3211, pipe: [1:7556555961210584496:5886]
2025-10-02T09:36:28.344674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.345123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.345133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.345145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584496:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.345460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.345494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210584496:5886]
2025-10-02T09:36:28.345496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.345516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:28.345567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0
2025-10-02T09:36:28.345709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3212 sessionId: src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0 is DEAD
2025-10-02T09:36:28.345863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:28.345875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Write session will restart in 0.005849s
2025-10-02T09:36:28.345902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Write session: Do CDS request
2025-10-02T09:36:28.345907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.353158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.353293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.353306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3213
2025-10-02T09:36:28.353429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.353454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.353463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.353466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.353913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3213 sessionId:  describe result for acl check
2025-10-02T09:36:28.353941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.353945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.353946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.353949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.354298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.356688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.359080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.359088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.359090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210584597:6113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.359095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.359723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.361432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.361619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.361628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.361635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.361666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.361699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961135000183:12138]
2025-10-02T09:36:28.362053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.362222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.362247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.362424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.362452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.362457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.362458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.362459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.362460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.362460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.362461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.362462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.362463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.362464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.362465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.362466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.362470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.362479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.362482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.362484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.362486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.362488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.362490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.362492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.362494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.362496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.362498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.362500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.362503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.362507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.362512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.362515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.362517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.362521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.362524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.362526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.362529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.362531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.362535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.362538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.362540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.362543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.362546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.362549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.362552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.362558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.362560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.362562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.362564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.362567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.362570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.362572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.362588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.370133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.371726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.371737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.371738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.371740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.371744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3212 [2:7556555961135000183:12138]
2025-10-02T09:36:28.371793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.371806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.371809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.371811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.371812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.371819Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.371823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.371828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.371855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.371859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.371860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.371862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.371864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.371896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.371900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.371907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.371912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.371924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.371941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584511:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.371948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584808:6113], now have 1 active actors on pipe
2025-10-02T09:36:28.371953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.371957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.371958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.371966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.371975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.371980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.371982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.371983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.371985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.371986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.371999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.372004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.372005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.372025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3212
2025-10-02T09:36:28.372028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3212
2025-10-02T09:36:28.372085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.372092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.372107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|858669e8-a27609d1-e64cc816-3110e9fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.372114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.372116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.372117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.372122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.372128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.372137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.372283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.372289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.372297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.372369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3213 partition: 0 MaxSeqNo: 36 sessionId: src_id|858669e8-a27609d1-e64cc816-3110e9fc_0
2025-10-02T09:36:28.372650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331dc480-37d27ec1-a72f7e9c-4315d202_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|858669e8-a27609d1-e64cc816-3110e9fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.374980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Write session: try to update token
2025-10-02T09:36:28.374994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.385111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:28.385120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.385124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.385145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:28.385168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:28.385522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:28.385678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:28.385788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:28.385914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:28.386081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:28.386105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:28.387512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId: src_id|858669e8-a27609d1-e64cc816-3110e9fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.389596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.389607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.389609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.389610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.389615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.389617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.389620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961135000177:12138]
2025-10-02T09:36:28.389638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.389643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.389644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.389646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.389646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.389648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.389758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.390759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.445762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210584822:5886]
2025-10-02T09:36:28.445954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3212, pipe: [1:7556555961210584822:5886]
2025-10-02T09:36:28.499387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.499719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.499728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.499740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584822:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.499861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.499936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210584822:5886]
2025-10-02T09:36:28.499988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:28.499994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.500086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|858669e8-a27609d1-e64cc816-3110e9fc_0
2025-10-02T09:36:28.500246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3213 sessionId: src_id|858669e8-a27609d1-e64cc816-3110e9fc_0 is DEAD
2025-10-02T09:36:28.500374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:28.500387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Write session will restart in 0.008317s
2025-10-02T09:36:28.500407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Write session: Do CDS request
2025-10-02T09:36:28.500412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.510134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.510356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.510370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3214
2025-10-02T09:36:28.510463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.510489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.510498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.510502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.510830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3214 sessionId:  describe result for acl check
2025-10-02T09:36:28.510862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.510868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.510869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.510872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.511239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.513111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.513999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.515648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.515787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.515793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.515801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.515836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.515858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961135000486:12141]
2025-10-02T09:36:28.515860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.515868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.515869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210584987:6122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.515884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.516201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.516373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.516399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.516592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.516625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.516629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.516629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.516630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.516630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.516631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.516631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.516632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.516632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.516633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.516633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.516634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.516636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.516642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.516644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.516646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.516648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.516650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.516652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.516654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.516656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.516658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.516660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.516662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.516665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.516669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.516673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.516676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.516678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.516681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.516683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.516686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.516688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.516691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.516693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.516696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.516698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.516701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.516703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.516705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.516708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.516710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.516712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.516715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.516718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.516720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.516722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.516725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.516740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.524086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.525783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.525796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.525798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.525801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.525805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3213 [2:7556555961135000486:12141]
2025-10-02T09:36:28.525815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.525824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.525829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.525830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.525832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.525840Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.525843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.525847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.525875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.525879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.525880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.525882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.525883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.525919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.525924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.525930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.525936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.525943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.525957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210584823:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.525962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585122:6122], now have 1 active actors on pipe
2025-10-02T09:36:28.525966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.525967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.525968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.525976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.525985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.525990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.525993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.525994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.525995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.525996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.526008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.526013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.526014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.526039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3213
2025-10-02T09:36:28.526047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3213
2025-10-02T09:36:28.526078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.526084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.526098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.526104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.526106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.526107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.526112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.526118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.526125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.526257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.526263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.526272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.526342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3214 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0
2025-10-02T09:36:28.526575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858669e8-a27609d1-e64cc816-3110e9fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.528897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Write session: try to update token
2025-10-02T09:36:28.528910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.535050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.535059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.535061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.535062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.535065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.535067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.535069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961135000481:12141]
2025-10-02T09:36:28.535088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.535090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.535091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.535098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.535103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.535107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.535201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.540867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId: src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.543192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.599863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210585135:5886]
2025-10-02T09:36:28.600104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3213, pipe: [1:7556555961210585135:5886]
2025-10-02T09:36:28.644483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.644866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.644877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.644890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585135:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.645030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.645065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:28.645082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:28.645108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.645147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210585135:5886]
2025-10-02T09:36:28.645159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3214 reason: error at write: Disconnected sessionId: src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0
2025-10-02T09:36:28.645328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3214 sessionId: src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0 is DEAD
2025-10-02T09:36:28.645477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:28.645490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Write session will restart in 0.006926s
2025-10-02T09:36:28.645514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Write session: Do CDS request
2025-10-02T09:36:28.645520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.653153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.653260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.653274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3215
2025-10-02T09:36:28.653363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.653388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.653398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.653401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.653765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3215 sessionId:  describe result for acl check
2025-10-02T09:36:28.653795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.653800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.653801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.653805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.654165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.656403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.658571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.658579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.658581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210585238:6143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.658585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.658936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.660681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.660784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.660791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.660811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.661014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.661155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961135000796:12143]
2025-10-02T09:36:28.661516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.661704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.661740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.661929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.661958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.661962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.661962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.661963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.661964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.661964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.661965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.661965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.661966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.661966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.661967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.661967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.661970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.661979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.661983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.661986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.661990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.661993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.661997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.662000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.662003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.662006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.662008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.662011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.662015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.662019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.662022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.662024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.662030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.662032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.662034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.662037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.662042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.662045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.662047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.662052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.662054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.662056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.662059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.662061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.662063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.662066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.662068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.662072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.662077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.662079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.662081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.662084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.662101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.669476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.670959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.670972Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.670973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.670975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.670979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3214 [2:7556555961135000796:12143]
2025-10-02T09:36:28.670986Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.670996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.670998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.670999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.671000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.671009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.671011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.671015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.671044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.671050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.671050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.671052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.671054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.671091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.671095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.671102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.671107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.671115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.671130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585136:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.671135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585435:6143], now have 1 active actors on pipe
2025-10-02T09:36:28.671139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.671140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.671142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.671149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.671160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.671162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.671165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.671166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.671170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.671172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.671185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.671194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.671199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.671190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3214
2025-10-02T09:36:28.671199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3214
2025-10-02T09:36:28.671231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.671237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.671254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.671260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.671262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.671263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.671268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.671273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.671280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.671428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.671434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.671444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.671526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3215 partition: 0 MaxSeqNo: 36 sessionId: src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0
2025-10-02T09:36:28.671780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8cbf3f-ec7ea24f-86df9707-3c27e5a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.674158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Write session: try to update token
2025-10-02T09:36:28.674172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.680236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.680247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.680248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.680249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.680253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.680255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.680257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961135000786:12143]
2025-10-02T09:36:28.680275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.680281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.680282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.680289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.680300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.680303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.680392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.686887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId: src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.689155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.745257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210585452:5886]
2025-10-02T09:36:28.745448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3214, pipe: [1:7556555961210585452:5886]
2025-10-02T09:36:28.791669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.791978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.791987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.791999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585452:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.792134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:28.792149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:28.792170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210585452:5886]
2025-10-02T09:36:28.792200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3215 reason: error at write: Disconnected sessionId: src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0
2025-10-02T09:36:28.792206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.792335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3215 sessionId: src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0 is DEAD
2025-10-02T09:36:28.792475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:28.792488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Write session will restart in 0.005051s
2025-10-02T09:36:28.792506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Write session: Do CDS request
2025-10-02T09:36:28.792511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.792989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.796915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.797810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.797919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.797927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.797936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.797968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.797992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961135000893:12157]
2025-10-02T09:36:28.798131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.798208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.798221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3216
2025-10-02T09:36:28.798318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.798342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.798350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.798343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.798353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.798519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.798543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.798690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3216 sessionId:  describe result for acl check
2025-10-02T09:36:28.798716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.798723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.798725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.798729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.798745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.798781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.798785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.798785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.798786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.798787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.798787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.798788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.798788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.798789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.798789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.798790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.798791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.798793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.798800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.798802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.798804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.798808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.798810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.798812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.798814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.798816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.798818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.798820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.798822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.798826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.798830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.798833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.798836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.798839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.798842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.798844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.798846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.798850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.798853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.798855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.798857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.798859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.798862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.798864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.798866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.798869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.798871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.798873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.798890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.798892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.798894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.798896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.798900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.798917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.799146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.800910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.805706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.805716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.805718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210585500:6189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.805723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.806292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.807824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.807837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.807838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.807841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.807844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3215 [2:7556555961135000893:12157]
2025-10-02T09:36:28.807850Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.807859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.807864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.807865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.807867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.807875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.807878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.807887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.807926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.807931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.807932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.807934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.807935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.807969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.807975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.807981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.807987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.807996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.808010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585534:6189], now have 1 active actors on pipe
2025-10-02T09:36:28.808016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.808018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.808019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.808024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.808030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585478:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.808030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.808033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.808034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.808035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.808043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.808046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.808062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.808067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.808071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.808058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3215
2025-10-02T09:36:28.808069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3215
2025-10-02T09:36:28.808087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.808092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.808108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5877f23-6198681d-1b45774b-143ecb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.808114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.808117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.808118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.808124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.808132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.808142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.808278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.808288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.808305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.808379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3216 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5877f23-6198681d-1b45774b-143ecb8_0
2025-10-02T09:36:28.808600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21c3a8e-a440b796-4b0114ea-20232dcf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5877f23-6198681d-1b45774b-143ecb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.810965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Write session: try to update token
2025-10-02T09:36:28.810978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.817064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.817075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.817078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.817078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.817082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.817085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.817087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961135000888:12157]
2025-10-02T09:36:28.817107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.817114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.817115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.817118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.817121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.817124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.817226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.823092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId: src_id|e5877f23-6198681d-1b45774b-143ecb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.825390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:28.892214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555961210585542:5886]
2025-10-02T09:36:28.892400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3215, pipe: [1:7556555961210585542:5886]
2025-10-02T09:36:28.925638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:28.925863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.925874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.925888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585542:5886], now have 1 active actors on pipe
2025-10-02T09:36:28.926008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:28.926093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:28.926095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555961210585542:5886]
2025-10-02T09:36:28.926118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:28.926155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3216 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5877f23-6198681d-1b45774b-143ecb8_0
2025-10-02T09:36:28.926296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3216 sessionId: src_id|e5877f23-6198681d-1b45774b-143ecb8_0 is DEAD
2025-10-02T09:36:28.926440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:28.926455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Write session will restart in 0.007715s
2025-10-02T09:36:28.926474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Write session: Do CDS request
2025-10-02T09:36:28.926479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:28.930791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:28.931792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:28.931890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:28.931896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:28.931901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:28.931927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:28.931952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555961135000950:12159]
2025-10-02T09:36:28.932297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:28.932456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:28.932479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:28.932652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:28.932682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.932686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.932686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.932687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.932688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.932688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.932690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.932691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.932691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.932692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.932693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.932693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.932696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.932703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.932705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.932707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.932709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.932711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.932713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.932715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.932718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.932720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.932722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.932725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.932728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.932732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:28.932735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.932738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:28.932740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.932743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:28.932745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.932748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:28.932752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.932755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:28.932756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.932759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:28.932762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.932765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:28.932767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.932770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:28.932773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.932775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:28.932777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.932781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.932785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.932787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.932789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.932792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.932821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:28.935181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.935312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:28.935328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3217
2025-10-02T09:36:28.935462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:28.935493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:28.935502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:28.935506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:28.935795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3217 sessionId:  describe result for acl check
2025-10-02T09:36:28.935822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:28.935827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:28.935828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:28.935831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:28.936172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:28.937791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:28.939682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:28.939690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:28.939692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555961210585572:6194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:28.939696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:28.940207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:28.941774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:28.941786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:28.941789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:28.941792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:28.941795Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3216 [2:7556555961135000950:12159]
2025-10-02T09:36:28.941802Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:28.941812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:28.941813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.941815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.941817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.941825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:28.941828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:28.941832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:28.941863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.941869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.941869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.941871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:28.941873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:28.941909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:28.941914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.941920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:28.941925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:28.941937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:28.941951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585607:6194], now have 1 active actors on pipe
2025-10-02T09:36:28.941956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555961210585546:2446], now have 1 active actors on pipe
2025-10-02T09:36:28.941959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.941961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.941962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.941969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:28.941976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:28.941981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:28.941983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:28.941984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:28.941986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:28.941988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:28.942002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.941993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3216
2025-10-02T09:36:28.942007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:28.942005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3216
2025-10-02T09:36:28.942009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:28.942023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.942028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.942046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:28.942052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:28.942054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:28.942055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:28.942060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:28.942066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:28.942078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.942187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:28.942197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:28.942212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:28.942281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3217 partition: 0 MaxSeqNo: 36 sessionId: src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0
2025-10-02T09:36:28.942481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5877f23-6198681d-1b45774b-143ecb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:28.944886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Write session: try to update token
2025-10-02T09:36:28.944899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:28.951158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:28.951171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:28.951172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:28.951173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:28.951176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.951178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.951180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555961135000945:12159]
2025-10-02T09:36:28.951201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:28.951204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:28.951205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:28.951209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:28.951213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:28.951217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:28.951320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:28.957645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId: src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:28.959904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.026335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505552914:5886]
2025-10-02T09:36:29.026585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3216, pipe: [1:7556555965505552914:5886]
2025-10-02T09:36:29.060685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.060981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.060993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.061007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505552914:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.061203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505552914:5886]
2025-10-02T09:36:29.061220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:29.061225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:29.061227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.061294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3217 reason: error at write: Disconnected sessionId: src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0
2025-10-02T09:36:29.061459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3217 sessionId: src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0 is DEAD
2025-10-02T09:36:29.061485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.061588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:29.061595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Write session will restart in 0.008408s
2025-10-02T09:36:29.061613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Write session: Do CDS request
2025-10-02T09:36:29.061617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.065980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.066987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.067083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.067089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.067096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.067120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.067148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968305:12161]
2025-10-02T09:36:29.067495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.067655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.067677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.067859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.067889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.067892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.067893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.067894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.067894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.067895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.067897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.067898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.067898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.067899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.067899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.067900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.067903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.067909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.067911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.067913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.067915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.067917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.067919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.067921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.067923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.067925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.067927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.067929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.067935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.067938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.067941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.067944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.067946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.067949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.067951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.067954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.067956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.067960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.067962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.067964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.067966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.067969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.067971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.067974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.067976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.067978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.067980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.067982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.067984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.067987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.067988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.067991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.068008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.071216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.071302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.071316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3218
2025-10-02T09:36:29.071423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.071447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.071456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.071460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.071808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3218 sessionId:  describe result for acl check
2025-10-02T09:36:29.071836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.071843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.071844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.071849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.072291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.073955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.075333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.075853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.075861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.075863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505552940:6218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.075867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.076770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.076781Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.076782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.076784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.076787Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3217 [2:7556555965429968305:12161]
2025-10-02T09:36:29.076796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.076818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.076820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.076821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.076823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.076833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.076839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.076844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.076876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.076881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.076882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.076885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.076886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.076922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.076926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.076932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.076937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.076945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.076958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505552915:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.076967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505552975:6218], now have 1 active actors on pipe
2025-10-02T09:36:29.076971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.076972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.076973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.076980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.076988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.076989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3217
2025-10-02T09:36:29.076993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.077000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3217
2025-10-02T09:36:29.076995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.076997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.077000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.077003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.077010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.077012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.077013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.077023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.077027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.077053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.077062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.077064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.077065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.077070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.077078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.077088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.077190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.077197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.077204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.077265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3218 partition: 0 MaxSeqNo: 36 sessionId: src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0
2025-10-02T09:36:29.077491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d67501-3c15c1ff-261c901e-3cc07c90_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.080284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Write session: try to update token
2025-10-02T09:36:29.080294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.086382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.086395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.086396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.086397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.086402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.086407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.086409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968300:12161]
2025-10-02T09:36:29.086429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.086432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.086435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.086446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.086458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.086461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.086566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.092053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId: src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.094365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.161534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505552982:5886]
2025-10-02T09:36:29.161709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3217, pipe: [1:7556555965505552982:5886]
2025-10-02T09:36:29.194305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.194529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.194539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.194553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505552982:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.194679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.194696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505552982:5886]
2025-10-02T09:36:29.194716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:29.194725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:29.194775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3218 reason: error at write: Disconnected sessionId: src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0
2025-10-02T09:36:29.194901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3218 sessionId: src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0 is DEAD
2025-10-02T09:36:29.194923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.195040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:29.195053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Write session will restart in 0.006540s
2025-10-02T09:36:29.195086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Write session: Do CDS request
2025-10-02T09:36:29.195091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.199986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.201153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.201248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.201254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.201260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.201285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.201309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968367:12164]
2025-10-02T09:36:29.201649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.201814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.201838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.202014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.202044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.202048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.202049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.202050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.202050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.202051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.202051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.202053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.202053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.202054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.202055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.202055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.202058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.202065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.202067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.202069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.202071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.202073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.202075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.202077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.202079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.202081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.202083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.202085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.202089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.202093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.202097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.202100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.202103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.202106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.202108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.202112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.202115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.202120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.202118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.202120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.202122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.202125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.202127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.202129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.202132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.202135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.202137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.202139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.202142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.202144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.202147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.202149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.202151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.202167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.202252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.202266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3219
2025-10-02T09:36:29.202364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.202388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.202397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.202400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.202700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3219 sessionId:  describe result for acl check
2025-10-02T09:36:29.202732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.202738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.202740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.202744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.203180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.205005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.209029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.209039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.209041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553010:6234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.209045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.209567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.211035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.211046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.211047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.211049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.211053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3218 [2:7556555965429968367:12164]
2025-10-02T09:36:29.211059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.211069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.211074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.211075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.211077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.211086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.211092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.211096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.211127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.211132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.211133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.211135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.211136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.211171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.211176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.211182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.211187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.211194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.211206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553045:6234], now have 1 active actors on pipe
2025-10-02T09:36:29.211212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505552984:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.211215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.211216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.211217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.211224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.211235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.211236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.211238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.211239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.211246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.211247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.211250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3218
2025-10-02T09:36:29.211261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.211254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3218
2025-10-02T09:36:29.211267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.211269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.211284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.211289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.211305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.211312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.211314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.211315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.211320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.211326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.211338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.211454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.211458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.211465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.211527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3219 partition: 0 MaxSeqNo: 36 sessionId: src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0
2025-10-02T09:36:29.211749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c6b615-8f9eaede-57d7acf2-82d570e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.214474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Write session: try to update token
2025-10-02T09:36:29.214485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.220297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.220311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.220312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.220313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.220317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.220320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.220322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968362:12164]
2025-10-02T09:36:29.220342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.220346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.220347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.220356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.220361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.220369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.220477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.228625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId: src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.230908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.294652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553052:5886]
2025-10-02T09:36:29.294852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3218, pipe: [1:7556555965505553052:5886]
2025-10-02T09:36:29.329420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.329693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.329704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.329718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553052:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.330077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553052:5886]
2025-10-02T09:36:29.330078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:29.330082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:29.330097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.330149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3219 reason: error at write: Disconnected sessionId: src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0
2025-10-02T09:36:29.330265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.330311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3219 sessionId: src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0 is DEAD
2025-10-02T09:36:29.330428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:29.330436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Write session will restart in 0.008350s
2025-10-02T09:36:29.330452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Write session: Do CDS request
2025-10-02T09:36:29.330457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.334752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.335818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.335915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.335921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.335927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.335952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.335976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968439:12167]
2025-10-02T09:36:29.336316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.336478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.336501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.336675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.336704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.336709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.336709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.336710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.336710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.336711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.336712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.336712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.336713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.336713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.336714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.336714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.336717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.336723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.336726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.336728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.336730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.336732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.336734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.336736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.336738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.336740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.336742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.336744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.336748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.336752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.336756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.336759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.336762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.336765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.336767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.336771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.336773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.336775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.336777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.336780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.336782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.336784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.336786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.336789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.336791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.336794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.336798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.336811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.336814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.336816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.336819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.336821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.336839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.340182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.340305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.340319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3220
2025-10-02T09:36:29.340408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.340433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.340442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.340445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.340783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3220 sessionId:  describe result for acl check
2025-10-02T09:36:29.340821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.340828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.340830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.340834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.341241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.342727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.344158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.344652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.344661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.344663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553094:6259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.344668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.345619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.345630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.345632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.345635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.345638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3219 [2:7556555965429968439:12167]
2025-10-02T09:36:29.345646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.345658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.345663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.345665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.345666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.345675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.345681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.345685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.345717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.345722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.345723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.345726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.345727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.345762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.345768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.345774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.345779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.345787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.345802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553067:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.345808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553129:6259], now have 1 active actors on pipe
2025-10-02T09:36:29.345812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.345813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.345814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.345821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.345831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.345835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.345837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.345838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.345840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.345842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.345836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3219
2025-10-02T09:36:29.345856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.345861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.345851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3219
2025-10-02T09:36:29.345873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.345880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.345882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.345900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.345907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.345908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.345909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.345915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.345920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.345931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.346042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.346046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.346054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.346124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3220 partition: 0 MaxSeqNo: 36 sessionId: src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0
2025-10-02T09:36:29.346329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf775d-5d6360f0-5c55bc8a-f9a26ac0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.348891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Write session: try to update token
2025-10-02T09:36:29.348907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.354806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.354818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.354819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.354820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.354823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.354825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.354827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968434:12167]
2025-10-02T09:36:29.354846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.354850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.354851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.354856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.354860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.354863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.354978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.360900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId: src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.363151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.430331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553137:5886]
2025-10-02T09:36:29.430522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3219, pipe: [1:7556555965505553137:5886]
2025-10-02T09:36:29.462032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.462254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.462264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.462279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553137:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.462394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.462442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553137:5886]
2025-10-02T09:36:29.462451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.462467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:29.462519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3220 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0
2025-10-02T09:36:29.462648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3220 sessionId: src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0 is DEAD
2025-10-02T09:36:29.462791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:29.462803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Write session will restart in 0.005477s
2025-10-02T09:36:29.462843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Write session: Do CDS request
2025-10-02T09:36:29.462849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.466846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.467844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.467938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.467944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.467949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.467973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.467998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968503:12170]
2025-10-02T09:36:29.468337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.468497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.468519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.468696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.468724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.468728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.468729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.468729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.468730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.468730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.468731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.468732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.468732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.468733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.468734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.468734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.468737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.468743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.468746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.468748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.468750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.468752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.468754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.468755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.468757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.468759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.468761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.468763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.468769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.468773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.468775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.468779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.468781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.468784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.468786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.468788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.468790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.468793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.468795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.468798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.468812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.468815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.468817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.468819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.468821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.468824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.468826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.468828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.468831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.468834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.468836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.468838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.468855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.470139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.470244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.470262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3221
2025-10-02T09:36:29.470380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.470405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.470415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.470418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.470725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3221 sessionId:  describe result for acl check
2025-10-02T09:36:29.470756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.470762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.470764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.470768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.471134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.472788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.475666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.475675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.475677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553166:6275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.475681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.476173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.477630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.477643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.477645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.477647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.477650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3220 [2:7556555965429968503:12170]
2025-10-02T09:36:29.477658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.477669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.477675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.477677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.477678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.477686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.477689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.477693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.477722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.477727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.477728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.477730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.477731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.477769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.477774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.477780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.477785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.477793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.477808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553138:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.477813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553200:6275], now have 1 active actors on pipe
2025-10-02T09:36:29.477817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.477818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.477820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.477827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.477839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.477839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.477841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.477843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.477849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.477850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.477843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3220
2025-10-02T09:36:29.477856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3220
2025-10-02T09:36:29.477866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.477871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.477872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.477881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.477885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.477912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.477918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.477921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.477922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.477927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.477933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.477941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.478047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.478051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.478059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.478158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3221 partition: 0 MaxSeqNo: 36 sessionId: src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0
2025-10-02T09:36:29.478415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58ac32e-2d95b8d9-af032d86-49e29b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.480754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Write session: try to update token
2025-10-02T09:36:29.480773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.487015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.487027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.487028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.487029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.487032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.487037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.487038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968498:12170]
2025-10-02T09:36:29.487057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.487063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.487064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.487070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.487075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.487081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.487190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.493069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId: src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.495314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.562430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553209:5886]
2025-10-02T09:36:29.562645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3220, pipe: [1:7556555965505553209:5886]
2025-10-02T09:36:29.595456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.595708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.595719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.595732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553209:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.595859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.595919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553209:5886]
2025-10-02T09:36:29.595928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.595947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:29.596016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0
2025-10-02T09:36:29.596146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3221 sessionId: src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0 is DEAD
2025-10-02T09:36:29.596304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:29.596317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Write session will restart in 0.009448s
2025-10-02T09:36:29.596338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Write session: Do CDS request
2025-10-02T09:36:29.596343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.600462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.601574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.601674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.601681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.601687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.601713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.601740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968565:12172]
2025-10-02T09:36:29.602350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.602513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.602535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.602812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.602841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.602845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.602846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.602847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.602847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.602848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.602849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.602850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.602851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.602852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.602852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.602853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.602856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.602862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.602865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.602867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.602869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.602871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.602873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.602876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.602878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.602880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.602891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.602893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.602899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.602904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.602907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.602910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.602913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.602915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.602917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.602920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.602923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.602926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.602928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.602934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.602936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.602939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.602941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.602943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.602945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.602948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.602951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.602954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.602957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.602959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.602964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.602967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.602985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.607179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.607302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.607318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3222
2025-10-02T09:36:29.607454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.607480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.607490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.607493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.607823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3222 sessionId:  describe result for acl check
2025-10-02T09:36:29.607856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.607863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.607864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.607869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.608306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.610021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.610327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.611824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.611835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.611837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.611839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.611844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3221 [2:7556555965429968565:12172]
2025-10-02T09:36:29.611852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.611861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.611863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.611864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.611865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.611874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.611881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.611885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.611919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.611917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.611923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.611926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.611925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.611928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553240:6289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.611927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.611932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.611928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.611964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.611970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.611976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.611981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.611989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.612000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553210:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.612007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.612008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.612009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.612019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.612029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.612030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.612033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.612033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.612037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.612013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3221
2025-10-02T09:36:29.612039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.612056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.612060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.612061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.612062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553274:6289], now have 1 active actors on pipe
2025-10-02T09:36:29.612062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3221
2025-10-02T09:36:29.612077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.612081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.612099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|466730c-d071580f-5f2558d2-67de402a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.612105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.612108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.612111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.612117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.612125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.612135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.612267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.612271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.612279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.612348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3222 partition: 0 MaxSeqNo: 36 sessionId: src_id|466730c-d071580f-5f2558d2-67de402a_0
2025-10-02T09:36:29.612595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47c3f27-5bfc7869-8777eef5-56b4cf51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|466730c-d071580f-5f2558d2-67de402a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.614930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Write session: try to update token
2025-10-02T09:36:29.614943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.621055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.621068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.621068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.621069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.621073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.621075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.621077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968560:12172]
2025-10-02T09:36:29.621095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.621103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.621104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.621104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.621108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.621112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.621238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.626667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId: src_id|466730c-d071580f-5f2558d2-67de402a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.628948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.696041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553283:5886]
2025-10-02T09:36:29.696226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3221, pipe: [1:7556555965505553283:5886]
2025-10-02T09:36:29.731559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.731807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.731821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.731836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553283:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.731979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.731984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.731996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553283:5886]
2025-10-02T09:36:29.732020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:29.732023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:29.732094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3222 reason: error at write: Disconnected sessionId: src_id|466730c-d071580f-5f2558d2-67de402a_0
2025-10-02T09:36:29.732255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3222 sessionId: src_id|466730c-d071580f-5f2558d2-67de402a_0 is DEAD
2025-10-02T09:36:29.732400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:29.732415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Write session will restart in 0.008442s
2025-10-02T09:36:29.732436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Write session: Do CDS request
2025-10-02T09:36:29.732441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.737135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.738136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.738296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.738307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.738317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.738373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.738409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968643:12180]
2025-10-02T09:36:29.738975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.739194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.739239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.739534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.739597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.739603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.739604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.739605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.739606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.739607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.739608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.739608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.739609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.739611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.739612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.739613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.739617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.739626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.739630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.739634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.739638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.739644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.739648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.739654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.739658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.739664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.739667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.739677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.739684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.739691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.739701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.739707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.739713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.739717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.739723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.739729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.739737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.739742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.739750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.739755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.739761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.739766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.739774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.739782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.739789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.739793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.739802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.739806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.739813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.739818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.739827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.739833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.739870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.742157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.742304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.742320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3223
2025-10-02T09:36:29.742455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.742481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.742489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.742493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.742856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3223 sessionId:  describe result for acl check
2025-10-02T09:36:29.742896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.742905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.742907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.742913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.743359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.745256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.747092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.747100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.747102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553315:6294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.747107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.747622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.749292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.749311Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.749314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.749319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.749324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3222 [2:7556555965429968643:12180]
2025-10-02T09:36:29.749334Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.749351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.749358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.749360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.749362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.749373Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.749382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.749387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.749436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.749443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.749445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.749448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.749450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.749502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.749509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.749522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.749537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.749558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.749578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553350:6294], now have 1 active actors on pipe
2025-10-02T09:36:29.749586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553285:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.749570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3222
2025-10-02T09:36:29.749591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.749583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3222
2025-10-02T09:36:29.749597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.749600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.749607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.749613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.749615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.749616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.749620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.749635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.749641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.749659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.749667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.749692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.749703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.749710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.749717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.749723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.749726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.749730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.749738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.749749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.749781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.749913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.749922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.749935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.750009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3223 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0
2025-10-02T09:36:29.750291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466730c-d071580f-5f2558d2-67de402a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.752676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Write session: try to update token
2025-10-02T09:36:29.752691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.759254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.759267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.759268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.759269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.759272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.759274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.759276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968638:12180]
2025-10-02T09:36:29.759298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.759301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.759302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.759302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.759305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.759307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.759424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.764721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId: src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.767029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.832241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553384:5886]
2025-10-02T09:36:29.832425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3222, pipe: [1:7556555965505553384:5886]
2025-10-02T09:36:29.868344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:29.868553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.868565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.868580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553384:5886], now have 1 active actors on pipe
2025-10-02T09:36:29.868699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:29.868731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:29.868735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553384:5886]
2025-10-02T09:36:29.868743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:29.868755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:29.868792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3223 reason: error at write: Disconnected sessionId: src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0
2025-10-02T09:36:29.868936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3223 sessionId: src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0 is DEAD
2025-10-02T09:36:29.869090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:29.869104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Write session will restart in 0.009215s
2025-10-02T09:36:29.869132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Write session: Do CDS request
2025-10-02T09:36:29.869137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:29.873471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:29.874488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:29.874594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:29.874601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:29.874607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:29.874632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:29.874655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555965429968731:12188]
2025-10-02T09:36:29.875029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:29.875197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:29.875220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:29.875397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:29.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.875432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.875433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.875433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.875435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.875435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.875436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.875437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.875437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.875438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.875441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.875447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.875450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.875452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.875454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.875456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.875458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.875459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.875461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.875464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.875466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.875468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.875472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.875476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:29.875479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.875483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:29.875486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.875488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:29.875494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.875497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:29.875499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.875502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:29.875504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.875510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:29.875513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.875517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:29.875519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.875522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:29.875525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.875528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:29.875530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.875532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.875534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.875537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.875539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.875541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.875559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:29.879188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.879297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:29.879314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3224
2025-10-02T09:36:29.879435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:29.879461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:29.879471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:29.879474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:29.879778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3224 sessionId:  describe result for acl check
2025-10-02T09:36:29.879804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:29.879808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:29.879809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:29.879812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:29.880167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:29.881867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:29.882864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:29.884247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:29.884259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:29.884261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:29.884264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:29.884268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3223 [2:7556555965429968731:12188]
2025-10-02T09:36:29.884275Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:29.884287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:29.884292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.884293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.884294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.884303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:29.884306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:29.884312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:29.884342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.884346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.884348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.884350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:29.884351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:29.884358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:29.884367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:29.884369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555965505553417:6340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:29.884373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:29.884386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:29.884391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.884397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:29.884402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:29.884412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:29.884426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553386:2446], now have 1 active actors on pipe
2025-10-02T09:36:29.884433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.884434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.884435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.884442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:29.884451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:29.884456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:29.884447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3223
2025-10-02T09:36:29.884459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:29.884460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:29.884462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:29.884464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:29.884482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.884486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:29.884488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:29.884490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553452:6340], now have 1 active actors on pipe
2025-10-02T09:36:29.884490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3223
2025-10-02T09:36:29.884506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.884511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.884526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:29.884532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:29.884537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:29.884541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:29.884547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:29.884551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:29.884559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.884762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:29.884767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:29.884773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:29.884842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3224 partition: 0 MaxSeqNo: 36 sessionId: src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0
2025-10-02T09:36:29.885031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1938377-f70cb0c8-ece670c6-14a5c503_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:29.887422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Write session: try to update token
2025-10-02T09:36:29.887436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:29.893476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:29.893487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:29.893489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:29.893490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:29.893493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.893495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.893497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555965429968726:12188]
2025-10-02T09:36:29.893516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:29.893522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:29.893523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:29.893528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:29.893533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:29.893543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:29.893639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:29.899927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId: src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:29.902114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:29.968961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555965505553464:5886]
2025-10-02T09:36:29.969169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3223, pipe: [1:7556555965505553464:5886]
2025-10-02T09:36:30.001766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.001987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.001998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.002013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555965505553464:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.002179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.002184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.002197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555965505553464:5886]
2025-10-02T09:36:30.002217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:30.002219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:30.002269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3224 reason: error at write: Disconnected sessionId: src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0
2025-10-02T09:36:30.002399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3224 sessionId: src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0 is DEAD
2025-10-02T09:36:30.002540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:30.002555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Write session will restart in 0.008981s
2025-10-02T09:36:30.002576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Write session: Do CDS request
2025-10-02T09:36:30.002582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.007700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.008775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.008910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.008917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.008923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.008953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.008975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936092:12190]
2025-10-02T09:36:30.009323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.009498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.009521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.009716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.009749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.009753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.009753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.009754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.009755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.009755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.009756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.009756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.009757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.009757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.009758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.009758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.009761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.009769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.009771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.009773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.009775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.009777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.009779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.009781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.009783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.009785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.009787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.009789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.009793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.009797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.009801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.009804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.009806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.009809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.009811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.009815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.009819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.009821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.009823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.009826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.009828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.009834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.009835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.009838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.009840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.009843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.009845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.009848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.009850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.009855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.009858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.009862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.009891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.012184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.012327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.012341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3225
2025-10-02T09:36:30.012441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.012467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.012476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.012480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.012859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3225 sessionId:  describe result for acl check
2025-10-02T09:36:30.012890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.012898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.012903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.012907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.013332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.015009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.016981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.016990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.016992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800520796:6350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.016997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.017294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.018766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.018779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.018780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.018782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.018786Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3224 [2:7556555969724936092:12190]
2025-10-02T09:36:30.018797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.018809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.018811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.018812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.018814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.018826Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.018829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.018833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.018866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.018871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.018872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.018874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.018876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.018921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.018926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.018932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.018937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.018946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.018960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520831:6350], now have 1 active actors on pipe
2025-10-02T09:36:30.018966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520764:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.018969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.018970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.018971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.018979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.018990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.018994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.018996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.018997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.019002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.019003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.018986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3224
2025-10-02T09:36:30.019005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3224
2025-10-02T09:36:30.019018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.019023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.019025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.019042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.019046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.019068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.019074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.019076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.019077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.019082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.019087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.019098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.019217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.019221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.019229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.019297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3225 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0
2025-10-02T09:36:30.019581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22bf1b83-8de344dd-237fd178-d4e95c6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.022037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Write session: try to update token
2025-10-02T09:36:30.022055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.028307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.028321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.028323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.028324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.028329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.028332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.028334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936087:12190]
2025-10-02T09:36:30.028358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.028359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.028362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.028364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.028364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.028365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.028483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.035035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId: src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.037444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.102595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800520842:5886]
2025-10-02T09:36:30.103006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3224, pipe: [1:7556555969800520842:5886]
2025-10-02T09:36:30.141411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.141672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.141684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.141697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520842:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.141827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.141872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800520842:5886]
2025-10-02T09:36:30.141874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:30.141878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:30.141904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.141952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3225 reason: error at write: Disconnected sessionId: src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0
2025-10-02T09:36:30.142109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3225 sessionId: src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0 is DEAD
2025-10-02T09:36:30.142255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:30.142265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Write session will restart in 0.008296s
2025-10-02T09:36:30.142280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Write session: Do CDS request
2025-10-02T09:36:30.142284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.147152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.148322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.148420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.148427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.148433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.148457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.148481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936164:12195]
2025-10-02T09:36:30.148834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.148998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.149021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.149191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.149225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.149228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.149230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.149230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.149231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.149232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.149232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.149233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.149234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.149235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.149237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.149243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.149245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.149247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.149249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.149251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.149253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.149255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.149257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.149259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.149261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.149263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.149266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.149270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.149274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.149276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.149279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.149282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.149285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.149288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.149292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.149294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.149296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.149298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.149300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.149303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.149305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.149308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.149311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.149314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.149316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.149318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.149321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.149325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.149327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.149329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.149345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.151218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.151324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.151340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3226
2025-10-02T09:36:30.151439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.151464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.151473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.151479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.151796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3226 sessionId:  describe result for acl check
2025-10-02T09:36:30.151826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.151830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.151832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.151837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.152187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.153814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.156194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.156202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.156204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800520876:6374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.156208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.156672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.158153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.158166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.158167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.158169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.158173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3225 [2:7556555969724936164:12195]
2025-10-02T09:36:30.158180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.158190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.158192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.158193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.158195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.158203Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.158206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.158210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.158242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.158247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.158248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.158250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.158252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.158286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.158291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.158297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.158302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.158310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.158324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520911:6374], now have 1 active actors on pipe
2025-10-02T09:36:30.158329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520843:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.158333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.158334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.158335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.158344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.158355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.158356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.158359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.158360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.158365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.158366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.158364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3225
2025-10-02T09:36:30.158381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.158385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.158387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.158379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3225
2025-10-02T09:36:30.158401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.158406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.158422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.158429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.158431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.158432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.158437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.158445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.158455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.158554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.158559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.158567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.158631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3226 partition: 0 MaxSeqNo: 36 sessionId: src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0
2025-10-02T09:36:30.158849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc2ea77-4d8bc11-2497f762-495b8950_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.161238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Write session: try to update token
2025-10-02T09:36:30.161255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.167399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.167412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.167413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.167413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.167416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.167418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.167420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936159:12195]
2025-10-02T09:36:30.167440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.167443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.167444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.167445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.167451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.167455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.167562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.174074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId: src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.176331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.241855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800520919:5886]
2025-10-02T09:36:30.242096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3225, pipe: [1:7556555969800520919:5886]
2025-10-02T09:36:30.278989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.279227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.279238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.279254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520919:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.279377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.279473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:30.279502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800520919:5886]
2025-10-02T09:36:30.279533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.279544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0
2025-10-02T09:36:30.279675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3226 sessionId: src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0 is DEAD
2025-10-02T09:36:30.279847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:30.279861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Write session will restart in 0.005253s
2025-10-02T09:36:30.279898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Write session: Do CDS request
2025-10-02T09:36:30.279903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.284623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.285818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.285930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.285938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.285944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.285972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.285999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936244:12198]
2025-10-02T09:36:30.286230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.286296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.286311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3227
2025-10-02T09:36:30.286414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.286440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.286450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.286454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.286630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.286811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.286823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3227 sessionId:  describe result for acl check
2025-10-02T09:36:30.286833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.286852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.286857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.286858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.286861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.287146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.287182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.287186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.287186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.287187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.287188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.287189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.287190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.287191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.287191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.287192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.287193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.287193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.287196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.287202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.287204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.287207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.287209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.287211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.287213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.287215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.287218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.287221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.287223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.287225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.287229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.287233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.287236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.287239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.287241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.287244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.287246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.287249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.287252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.287255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.287257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.287259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.287262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.287265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.287267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.287270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.287272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.287275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.287277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.287280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.287282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.287284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.287288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.287292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.287279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.287310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.289005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.292624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.292635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.292637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800520952:6391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.292641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.294771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.296249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.296263Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.296264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.296266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.296269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3226 [2:7556555969724936244:12198]
2025-10-02T09:36:30.296277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.296287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.296288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.296289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.296290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.296299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.296302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.296306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.296339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.296345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.296345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.296347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.296349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.296387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.296391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.296398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.296404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.296413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.296428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520920:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.296433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800520992:6391], now have 1 active actors on pipe
2025-10-02T09:36:30.296437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.296438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.296441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.296448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.296458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.296462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.296464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.296465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.296466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.296468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.296468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3226
2025-10-02T09:36:30.296480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3226
2025-10-02T09:36:30.296484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.296488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.296490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.296503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.296508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.296527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.296534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.296538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.296541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.296545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.296551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.296563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.296683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.296688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.296695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.296757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3227 partition: 0 MaxSeqNo: 36 sessionId: src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0
2025-10-02T09:36:30.297029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894312c4-7ece3ec8-271537dd-ce90ee91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.299381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Write session: try to update token
2025-10-02T09:36:30.299394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.305567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.305580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.305581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.305582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.305587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.305590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.305592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936239:12198]
2025-10-02T09:36:30.305612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.305619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.305620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.305622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.305625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.305627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.305831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.311474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId: src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.313817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.379570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800521014:5886]
2025-10-02T09:36:30.379748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3226, pipe: [1:7556555969800521014:5886]
2025-10-02T09:36:30.415099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.415413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.415426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.415442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521014:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.415572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.415617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.415632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:30.415656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800521014:5886]
2025-10-02T09:36:30.415726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0
2025-10-02T09:36:30.415896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3227 sessionId: src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0 is DEAD
2025-10-02T09:36:30.416023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:30.416036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Write session will restart in 0.005590s
2025-10-02T09:36:30.416057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Write session: Do CDS request
2025-10-02T09:36:30.416062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.420875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.422078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.422177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.422184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.422189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.422203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.422214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.422241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936314:12201]
2025-10-02T09:36:30.422257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.422270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3228
2025-10-02T09:36:30.422364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.422389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.422398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.422402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.422619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.422750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3228 sessionId:  describe result for acl check
2025-10-02T09:36:30.422778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.422782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.422783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.422786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.422791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.422815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.423008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.423042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.423048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.423049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.423049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.423050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.423051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.423052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.423052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.423053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.423053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.423054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.423054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.423057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.423064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.423066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.423068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.423070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.423072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.423074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.423076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.423078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.423081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.423083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.423085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.423089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.423092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.423096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.423100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.423103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.423106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.423108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.423112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.423115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.423117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.423120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.423126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.423128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.423131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.423133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.423135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.423137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.423140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.423144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.423147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.423149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.423151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.423154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.423157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.423146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.423175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.424643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.428406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.428414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.428428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800521048:6418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.428432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.430510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.431933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.431947Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.431948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.431950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.431955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3227 [2:7556555969724936314:12201]
2025-10-02T09:36:30.431962Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.431973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.431976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.431977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.431978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.431987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.431993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.431998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.432029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.432034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.432035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.432036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.432038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.432072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.432077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.432084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.432089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.432098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.432113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521015:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.432119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521086:6418], now have 1 active actors on pipe
2025-10-02T09:36:30.432123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.432126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.432127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.432135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.432146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.432146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.432153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.432154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.432149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3227
2025-10-02T09:36:30.432154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.432156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.432158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3227
2025-10-02T09:36:30.432171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.432178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.432180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.432193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.432198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.432217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1272f4-835fff00-90b82507-e927b46c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.432224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.432227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.432229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.432234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.432239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.432253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.432357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.432361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.432370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.432439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3228 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd1272f4-835fff00-90b82507-e927b46c_0
2025-10-02T09:36:30.432682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90996e64-cb5e9c58-234e0080-34b9e2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd1272f4-835fff00-90b82507-e927b46c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.435087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Write session: try to update token
2025-10-02T09:36:30.435102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.441216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.441228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.441230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.441231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.441235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.441237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.441239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936309:12201]
2025-10-02T09:36:30.441258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.441261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.441262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.441262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.441265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.441267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.441392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.447006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId: src_id|dd1272f4-835fff00-90b82507-e927b46c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.449272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.515775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800521094:5886]
2025-10-02T09:36:30.516001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3227, pipe: [1:7556555969800521094:5886]
2025-10-02T09:36:30.551696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.551983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.551994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.552010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521094:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.552136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.552195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800521094:5886]
2025-10-02T09:36:30.552211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.552230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:30.552315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3228 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd1272f4-835fff00-90b82507-e927b46c_0
2025-10-02T09:36:30.552464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3228 sessionId: src_id|dd1272f4-835fff00-90b82507-e927b46c_0 is DEAD
2025-10-02T09:36:30.552613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:30.552626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Write session will restart in 0.005193s
2025-10-02T09:36:30.552645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Write session: Do CDS request
2025-10-02T09:36:30.552651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.557263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.558392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.558489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.558496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.558501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.558525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.558552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936384:12203]
2025-10-02T09:36:30.559121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.559176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.559213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.559224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3229
2025-10-02T09:36:30.559347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.559361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.559369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.559383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.559391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.559394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.559643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.559673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.559677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.559678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.559679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.559680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.559680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.559682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.559683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.559684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.559684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.559685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.559685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.559688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.559695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.559698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.559700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.559702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.559704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.559706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.559708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.559711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.559713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.559707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3229 sessionId:  describe result for acl check
2025-10-02T09:36:30.559715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.559717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.559722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.559726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.559729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.559732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.559735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.559738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.559740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.559740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.559743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.559745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.559748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.559747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.559750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.559748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.559753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.559753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.559755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.559759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.559762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.559765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.559769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.559771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.559774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.559776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.559779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.559782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.559784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.559787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.559806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.560119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.561889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.566002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.566013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.566015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800521129:6421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.566019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.567189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.568725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.568736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.568737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.568740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.568743Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3228 [2:7556555969724936384:12203]
2025-10-02T09:36:30.568751Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.568760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.568764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.568765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.568766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.568775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.568778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.568782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.568829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.568830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.568831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.568833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.568834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.568871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.568872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.568879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.568885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.568893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.568903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.568909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.568910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.568914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.568921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.568923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521095:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.568923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.568925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.568927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.568933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.568935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.568938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521166:6421], now have 1 active actors on pipe
2025-10-02T09:36:30.568952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.568960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.568965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.568983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3228
2025-10-02T09:36:30.568990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3228
2025-10-02T09:36:30.569019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.569025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.569042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.569048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.569050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.569051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.569057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.569062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.569072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.569193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.569198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.569206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.569275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3229 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0
2025-10-02T09:36:30.569522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1272f4-835fff00-90b82507-e927b46c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.571861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Write session: try to update token
2025-10-02T09:36:30.571877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.578279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.578292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.578293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.578294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.578299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.578303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.578304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936379:12203]
2025-10-02T09:36:30.578324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.578326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.578327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.578328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.578330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.578332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.578434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.584677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId: src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.587040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.652465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800521174:5886]
2025-10-02T09:36:30.652685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3228, pipe: [1:7556555969800521174:5886]
2025-10-02T09:36:30.688618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.688875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.688887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.688904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521174:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.689061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.689098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:30.689112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:30.689115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800521174:5886]
2025-10-02T09:36:30.689141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.689166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3229 reason: error at write: Disconnected sessionId: src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0
2025-10-02T09:36:30.689302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3229 sessionId: src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0 is DEAD
2025-10-02T09:36:30.689459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:30.689470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Write session will restart in 0.006558s
2025-10-02T09:36:30.689506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Write session: Do CDS request
2025-10-02T09:36:30.689511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.694339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.695343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.695441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.695448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.695454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.695481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.695508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936454:12205]
2025-10-02T09:36:30.695853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.696017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.696040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.696216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.696244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.696248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.696248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.696249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.696250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.696250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.696251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.696252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.696252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.696253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.696253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.696254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.696257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.696264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.696266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.696268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.696270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.696272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.696274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.696276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.696278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.696280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.696282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.696284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.696288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.696292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.696296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.696299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.696301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.696304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.696306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.696308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.696310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.696313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.696315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.696317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.696320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.696324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.696326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.696329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.696331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.696334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.696336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.696339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.696343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.696346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.696348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.696352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.696370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.697196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.697284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.697298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3230
2025-10-02T09:36:30.697398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.697424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.697432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.697436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.697759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3230 sessionId:  describe result for acl check
2025-10-02T09:36:30.697791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.697797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.697798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.697801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.698170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.699549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.703406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.703416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.703418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800521212:6452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.703423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.703941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.705428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.705441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.705443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.705445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.705449Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3229 [2:7556555969724936454:12205]
2025-10-02T09:36:30.705459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.705471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.705476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.705479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.705480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.705490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.705494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.705499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.705530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.705535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.705536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.705538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.705539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.705577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.705582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.705590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.705596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.705606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.705620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521247:6452], now have 1 active actors on pipe
2025-10-02T09:36:30.705625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521175:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.705629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.705630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.705631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.705639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.705638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3229
2025-10-02T09:36:30.705650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.705654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.705658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.705659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.705660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.705662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.705681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.705688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.705696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3229
2025-10-02T09:36:30.705709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.705746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.705752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.705766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|975a2670-957ea334-baa38682-4a7104bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.705773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.705777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.705780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.705786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.705793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.705804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.705925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.705932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.705939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.706006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3230 partition: 0 MaxSeqNo: 36 sessionId: src_id|975a2670-957ea334-baa38682-4a7104bf_0
2025-10-02T09:36:30.706258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7db44b-32fe8b50-8de692cc-7663d4b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|975a2670-957ea334-baa38682-4a7104bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.708623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Write session: try to update token
2025-10-02T09:36:30.708641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.714905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.714915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.714916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.714917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.714920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.714922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.714924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936449:12205]
2025-10-02T09:36:30.714944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.714947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.714948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.714949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.714952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.714954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.715057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.721614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId: src_id|975a2670-957ea334-baa38682-4a7104bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.724053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.789164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800521254:5886]
2025-10-02T09:36:30.789359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3229, pipe: [1:7556555969800521254:5886]
2025-10-02T09:36:30.833886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.834135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.834148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.834164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521254:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.834352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.834371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:30.834387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:30.834461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3230 reason: error at write: Disconnected sessionId: src_id|975a2670-957ea334-baa38682-4a7104bf_0
2025-10-02T09:36:30.834632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3230 sessionId: src_id|975a2670-957ea334-baa38682-4a7104bf_0 is DEAD
2025-10-02T09:36:30.834794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:30.834820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Write session will restart in 0.007164s
2025-10-02T09:36:30.834815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.834840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Write session: Do CDS request
2025-10-02T09:36:30.834846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.834863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800521254:5886]
2025-10-02T09:36:30.839802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.840848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.840956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.840963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.840969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.840996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.841022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936556:12217]
2025-10-02T09:36:30.841652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.841821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.841845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.842123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.842154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.842158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.842158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.842159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.842160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.842160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.842161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.842162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.842162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.842163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.842164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.842164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.842167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.842173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.842176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.842178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.842180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.842182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.842184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.842187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.842189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.842191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.842193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.842195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.842200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.842204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.842208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.842211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.842213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.842216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.842219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.842221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.842224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.842226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.842228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.842231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.842234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.842237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.842239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.842242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.842244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.842247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.842249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.842252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.842254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.842257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.842259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.842262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.842280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.843132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.843223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.843234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3231
2025-10-02T09:36:30.843314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.843334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.843341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.843344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.843616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3231 sessionId:  describe result for acl check
2025-10-02T09:36:30.843650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.843656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.843657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.843659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.843947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.845239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.849280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.849293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.849296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800521318:6494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.849301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.849673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.851183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.851194Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.851196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.851198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.851201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3230 [2:7556555969724936556:12217]
2025-10-02T09:36:30.851209Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.851220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.851221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.851223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.851225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.851235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.851241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.851245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.851278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.851282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.851283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.851285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.851287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.851325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.851331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.851337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.851342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.851352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.851366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521350:6494], now have 1 active actors on pipe
2025-10-02T09:36:30.851372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521269:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.851376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.851377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.851378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.851385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.851396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.851397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.851399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.851400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.851406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.851408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.851398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3230
2025-10-02T09:36:30.851400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3230
2025-10-02T09:36:30.851425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.851430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.851431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.851442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.851447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.851494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.851501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.851503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.851504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.851509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.851515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.851525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.851640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.851644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.851651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.851711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3231 partition: 0 MaxSeqNo: 36 sessionId: src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0
2025-10-02T09:36:30.851929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|975a2670-957ea334-baa38682-4a7104bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.854187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Write session: try to update token
2025-10-02T09:36:30.854200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:30.860557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:30.860569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:30.860570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:30.860571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:30.860575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.860577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.860582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936551:12217]
2025-10-02T09:36:30.860601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:30.860603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:30.860604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.860606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:30.860607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:30.860609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:30.860711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:30.865931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId: src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:30.868198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:30.935071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555969800521360:5886]
2025-10-02T09:36:30.935297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3230, pipe: [1:7556555969800521360:5886]
2025-10-02T09:36:30.974574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:30.974836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.974848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.974863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521360:5886], now have 1 active actors on pipe
2025-10-02T09:36:30.975012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:30.975037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555969800521360:5886]
2025-10-02T09:36:30.975039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:30.975043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:30.975072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:30.975092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3231 reason: error at write: Disconnected sessionId: src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0
2025-10-02T09:36:30.975237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3231 sessionId: src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0 is DEAD
2025-10-02T09:36:30.975446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:30.975461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Write session will restart in 0.005820s
2025-10-02T09:36:30.975487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Write session: Do CDS request
2025-10-02T09:36:30.975495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:30.980361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:30.981360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:30.981460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:30.981467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:30.981473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:30.981499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:30.981526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555969724936635:12221]
2025-10-02T09:36:30.982145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:30.982207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.982291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:30.982303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3232
2025-10-02T09:36:30.982318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:30.982341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:30.982408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:30.982432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:30.982441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:30.982444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:30.982618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:30.982650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.982656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.982656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.982657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.982658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.982659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.982660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.982661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.982662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.982663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.982664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.982665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.982669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.982678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.982682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.982685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.982688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.982691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.982694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.982697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.982700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.982705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.982708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.982711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.982720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.982725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:30.982729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.982732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:30.982736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.982738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:30.982741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.982744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:30.982746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.982750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:30.982753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.982756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:30.982759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.982763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:30.982765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.982769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:30.982773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.982776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:30.982778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.982781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.982783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.982786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.982789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.982792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.982810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:30.982823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3232 sessionId:  describe result for acl check
2025-10-02T09:36:30.982856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:30.982861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:30.982863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:30.982867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:30.983326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:30.984817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:30.989733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:30.989746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:30.989749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555969800521401:6518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:30.989754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:30.990173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:30.991629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:30.991642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:30.991643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:30.991648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:30.991651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3231 [2:7556555969724936635:12221]
2025-10-02T09:36:30.991660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:30.991670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:30.991675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.991677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.991678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.991687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:30.991690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:30.991694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:30.991725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.991730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.991731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.991734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:30.991735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:30.991770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:30.991776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:30.991782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:30.991788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:30.991797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:30.991811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521438:6518], now have 1 active actors on pipe
2025-10-02T09:36:30.991817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555969800521364:2446], now have 1 active actors on pipe
2025-10-02T09:36:30.991821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:30.991822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:30.991823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:30.991831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:30.991842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:30.991842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:30.991844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:30.991845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:30.991852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:30.991854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:30.991849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3231
2025-10-02T09:36:30.991858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3231
2025-10-02T09:36:30.991871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:30.991878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:30.991879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:30.991890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.991897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.991936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:30.991944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:30.991948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:30.991949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:30.991957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:30.991966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:30.991984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.992083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:30.992088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:30.992097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:30.992166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3232 partition: 0 MaxSeqNo: 36 sessionId: src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0
2025-10-02T09:36:30.992405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64578ef7-96f3140d-3dc94c22-5db92c1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:30.994727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Write session: try to update token
2025-10-02T09:36:30.994742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.000967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.000977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.000979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.000980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.000983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:31.000986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:31.000988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555969724936630:12221]
2025-10-02T09:36:31.001008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.001012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.001014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.001015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.001016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.001017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.001139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.006980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId: src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.009331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.075364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095488744:5886]
2025-10-02T09:36:31.075617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3231, pipe: [1:7556555974095488744:5886]
2025-10-02T09:36:31.116902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.117220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.117232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.117247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488744:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.117471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.117470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:31.117482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095488744:5886]
2025-10-02T09:36:31.117486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:31.117507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.117533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3232 reason: error at write: Disconnected sessionId: src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0
2025-10-02T09:36:31.117682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3232 sessionId: src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0 is DEAD
2025-10-02T09:36:31.117776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:31.117787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Write session will restart in 0.007086s
2025-10-02T09:36:31.117806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Write session: Do CDS request
2025-10-02T09:36:31.117810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.122721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.123754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.123866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.123873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.123878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.123905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.123934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904004:12223]
2025-10-02T09:36:31.124277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.124446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.124471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.124658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.124690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.124693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.124694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.124694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.124695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.124695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.124696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.124697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.124698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.124698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.124699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.124699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.124702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.124709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.124711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.124713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.124715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.124717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.124719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.124721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.124723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.124725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.124727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.124729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.124733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.124736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.124740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.124742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.124744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.124748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.124750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.124753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.124756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.124758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.124760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.124762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.124766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.124769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.124771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.124774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.124776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.124779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.124784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.124786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.124788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.124791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.124796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.124799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.124832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.126137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.126229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.126243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3233
2025-10-02T09:36:31.126392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.126417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.126426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.126430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.126814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3233 sessionId:  describe result for acl check
2025-10-02T09:36:31.126844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.126850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.126851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.126855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.127212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.128902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.131689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.131702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.131704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095488786:6534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.131708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.132236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.133788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.133801Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.133802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.133809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3232 [2:7556555974019904004:12223]
2025-10-02T09:36:31.133817Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.133830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.133835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.133837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.133838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.133847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.133850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.133854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.133886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.133891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.133892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.133894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.133895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.133936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.133941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.133947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.133953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.133962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.133977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488820:6534], now have 1 active actors on pipe
2025-10-02T09:36:31.133983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488745:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.133986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.133987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.133988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.133997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.134007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.134003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3232
2025-10-02T09:36:31.134017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.134021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.134021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.134023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.134025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.134021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3232
2025-10-02T09:36:31.134048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.134052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.134059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.134065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.134077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.134084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa1c01c8-11d6cada-754692e3-1e507538_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.134087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.134089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.134090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.134095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.134102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.134114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.134233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.134238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.134248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.134314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3233 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa1c01c8-11d6cada-754692e3-1e507538_0
2025-10-02T09:36:31.134634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe572e6-df51ee24-9a57654-dcfa84e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa1c01c8-11d6cada-754692e3-1e507538_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.137447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Write session: try to update token
2025-10-02T09:36:31.137458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.143315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.143330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.143334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.143335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.143340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.143343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.143345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019903999:12223]
2025-10-02T09:36:31.143368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.143371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.143374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.143374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.143376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.143376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.143497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.149933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId: src_id|aa1c01c8-11d6cada-754692e3-1e507538_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.152286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.217741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095488828:5886]
2025-10-02T09:36:31.217966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3232, pipe: [1:7556555974095488828:5886]
2025-10-02T09:36:31.258862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.259202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.259214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.259228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488828:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.259392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.259415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.259465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:31.259558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa1c01c8-11d6cada-754692e3-1e507538_0
2025-10-02T09:36:31.259597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095488828:5886]
2025-10-02T09:36:31.259743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3233 sessionId: src_id|aa1c01c8-11d6cada-754692e3-1e507538_0 is DEAD
2025-10-02T09:36:31.259878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:31.259888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Write session will restart in 0.007201s
2025-10-02T09:36:31.259903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Write session: Do CDS request
2025-10-02T09:36:31.259907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.264409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.265491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.265586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.265592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.265598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.265623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.265648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904094:12227]
2025-10-02T09:36:31.265995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.266159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.266181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.266356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.266384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.266388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.266389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.266389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.266390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.266390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.266391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.266391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.266392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.266392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.266393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.266394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.266396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.266403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.266405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.266408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.266410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.266412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.266414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.266416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.266418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.266420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.266422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.266424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.266429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.266432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.266435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.266438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.266441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.266443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.266446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.266449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.266452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.266455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.266457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.266460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.266462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.266465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.266468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.266471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.266474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.266477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.266479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.266481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.266487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.266490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.266492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.266495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.266513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.268223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.268362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.268377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3234
2025-10-02T09:36:31.268469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.268494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.268504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.268508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.268838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3234 sessionId:  describe result for acl check
2025-10-02T09:36:31.268866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.268871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.268872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.268875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.269213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.270992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.273366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.273376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.273378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095488870:6543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.273382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.273866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.275368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.275382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.275383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.275385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.275389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3233 [2:7556555974019904094:12227]
2025-10-02T09:36:31.275397Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.275407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.275412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.275414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.275415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.275423Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.275426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.275431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.275469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.275474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.275475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.275477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.275479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.275513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.275519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.275525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.275530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.275538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.275552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488829:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.275558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488904:6543], now have 1 active actors on pipe
2025-10-02T09:36:31.275561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.275562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.275563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.275570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.275582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.275583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.275585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.275586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.275591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.275594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.275591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3233
2025-10-02T09:36:31.275611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.275615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.275617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.275609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3233
2025-10-02T09:36:31.275627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.275632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.275656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.275664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.275667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.275670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.275676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.275681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.275693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.275800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.275804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.275812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.275879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3234 partition: 0 MaxSeqNo: 36 sessionId: src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0
2025-10-02T09:36:31.276119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c01c8-11d6cada-754692e3-1e507538_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.278826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Write session: try to update token
2025-10-02T09:36:31.278843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.284707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.284721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.284722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.284724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.284729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.284732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.284735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904089:12227]
2025-10-02T09:36:31.284755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.284759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.284764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.284765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.284766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.284769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.284885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.291061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId: src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.293519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.359520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095488926:5886]
2025-10-02T09:36:31.359724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3233, pipe: [1:7556555974095488926:5886]
2025-10-02T09:36:31.395541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.395786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.395797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.395812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488926:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.395938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.395978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095488926:5886]
2025-10-02T09:36:31.395992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.396008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:31.396076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3234 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0
2025-10-02T09:36:31.396194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3234 sessionId: src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0 is DEAD
2025-10-02T09:36:31.396363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:31.396378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Write session will restart in 0.006925s
2025-10-02T09:36:31.396402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Write session: Do CDS request
2025-10-02T09:36:31.396407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.401275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.402292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.402394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.402400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.402406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.402432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.402456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904171:12229]
2025-10-02T09:36:31.402798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.402969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.402991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.403167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.403195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.403199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.403200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.403200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.403201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.403201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.403202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.403202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.403203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.403203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.403204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.403204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.403207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.403214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.403216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.403218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.403220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.403222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.403224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.403226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.403228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.403230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.403232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.403235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.403239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.403242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.403246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.403249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.403251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.403254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.403256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.403260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.403263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.403266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.403268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.403270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.403273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.403275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.403277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.403279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.403281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.403284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.403288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.403290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.403292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.403295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.403297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.403299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.403315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.404197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.404299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.404319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3235
2025-10-02T09:36:31.404439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.404468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.404478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.404482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.404876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3235 sessionId:  describe result for acl check
2025-10-02T09:36:31.404912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.404922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.404924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.404930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.405364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.407189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.410241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.410253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.410255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095488969:6568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.410260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.410647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.412178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.412190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.412194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.412196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.412199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3234 [2:7556555974019904171:12229]
2025-10-02T09:36:31.412207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.412220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.412225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.412226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.412227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.412237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.412241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.412245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.412274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.412279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.412280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.412282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.412284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.412319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.412324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.412331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.412336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.412345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.412357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489003:6568], now have 1 active actors on pipe
2025-10-02T09:36:31.412362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095488927:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.412365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.412367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.412369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.412377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.412387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.412380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3234
2025-10-02T09:36:31.412388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.412390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.412391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.412396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.412397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.412400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3234
2025-10-02T09:36:31.412417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.412424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.412429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.412433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.412434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.412457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.412464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.412465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.412466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.412471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.412477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.412486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.412577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.412582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.412589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.412656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3235 partition: 0 MaxSeqNo: 36 sessionId: src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0
2025-10-02T09:36:31.412957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bc8ca7-725f47e0-c33ac840-21da7f6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.415356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Write session: try to update token
2025-10-02T09:36:31.415371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.421494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.421505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.421507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.421507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.421512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.421514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.421516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904166:12229]
2025-10-02T09:36:31.421538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.421538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.421540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.421542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.421542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.421543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.421656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.427696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId: src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.430157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.496270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095489012:5886]
2025-10-02T09:36:31.496461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3234, pipe: [1:7556555974095489012:5886]
2025-10-02T09:36:31.530693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.530974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.530985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.531001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489012:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.531179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.531220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.531238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095489012:5886]
2025-10-02T09:36:31.531270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:31.531352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3235 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0
2025-10-02T09:36:31.531496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3235 sessionId: src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0 is DEAD
2025-10-02T09:36:31.531661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:31.531675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Write session will restart in 0.008125s
2025-10-02T09:36:31.531699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Write session: Do CDS request
2025-10-02T09:36:31.531705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.536159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.537377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.537473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.537479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.537485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.537510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.537547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904249:12232]
2025-10-02T09:36:31.537896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.538067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.538089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.538274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.538304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.538308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.538309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.538309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.538310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.538311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.538311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.538312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.538314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.538314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.538315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.538315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.538318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.538325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.538327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.538330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.538331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.538334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.538335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.538337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.538340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.538342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.538344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.538346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.538350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.538354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.538357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.538360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.538362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.538365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.538367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.538370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.538374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.538377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.538379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.538382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.538385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.538388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.538391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.538395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.538398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.538400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.538404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.538407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.538409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.538412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.538414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.538416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.538436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.541155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.541290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.541302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3236
2025-10-02T09:36:31.541451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.541475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.541484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.541487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.541849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3236 sessionId:  describe result for acl check
2025-10-02T09:36:31.541876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.541881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.541883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.541887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.542331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.543849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.545748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.545759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.545761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095489056:6594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.545766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.545831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.547317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.547328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.547331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.547333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.547336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3235 [2:7556555974019904249:12232]
2025-10-02T09:36:31.547343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.547353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.547358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.547360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.547361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.547371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.547376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.547380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.547410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.547415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.547416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.547418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.547419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.547457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.547462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.547469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.547474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.547483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.547497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489092:6594], now have 1 active actors on pipe
2025-10-02T09:36:31.547503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489013:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.547506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.547508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.547509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.547516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.547526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.547529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.547531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.547532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.547537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.547539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.547522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3235
2025-10-02T09:36:31.547559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.547565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.547572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.547580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.547586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.547597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b203af26-73715251-46ea62ad-c48b8586_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.547604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.547595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3235
2025-10-02T09:36:31.547606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.547607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.547614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.547619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.547636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.547732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.547737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.547744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.547811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3236 partition: 0 MaxSeqNo: 36 sessionId: src_id|b203af26-73715251-46ea62ad-c48b8586_0
2025-10-02T09:36:31.548071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc4d430-771c5eda-7ae0b0bf-e1970ce8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b203af26-73715251-46ea62ad-c48b8586_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.550465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Write session: try to update token
2025-10-02T09:36:31.550483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.556564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.556575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.556577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.556577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.556581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.556583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.556585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904244:12232]
2025-10-02T09:36:31.556606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.556613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.556614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.556615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.556620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.556623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.556727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.562508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId: src_id|b203af26-73715251-46ea62ad-c48b8586_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.564858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.631398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095489103:5886]
2025-10-02T09:36:31.631640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3235, pipe: [1:7556555974095489103:5886]
2025-10-02T09:36:31.671822Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.672140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.672152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.672165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489103:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.672295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.672370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095489103:5886]
2025-10-02T09:36:31.672388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:31.672392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:31.672403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.672469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3236 reason: error at write: Disconnected sessionId: src_id|b203af26-73715251-46ea62ad-c48b8586_0
2025-10-02T09:36:31.672635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3236 sessionId: src_id|b203af26-73715251-46ea62ad-c48b8586_0 is DEAD
2025-10-02T09:36:31.672759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:31.672771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Write session will restart in 0.009124s
2025-10-02T09:36:31.672787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Write session: Do CDS request
2025-10-02T09:36:31.672791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.677852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.679032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.679130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.679136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.679142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.679168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.679194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904326:12234]
2025-10-02T09:36:31.679535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.679699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.679722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.679899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.679927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.679932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.679933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.679933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.679934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.679935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.679935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.679936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.679936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.679937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.679941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.679947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.679949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.679951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.679953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.679955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.679957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.679959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.679962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.679964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.679966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.679968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.679971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.679976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.679979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.679982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.679984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.679987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.679989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.679992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.679994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.679996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.679998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.680002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.680004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.680007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.680009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.680011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.680013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.680017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.680021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.680024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.680026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.680029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.680031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.680033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.680052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.683179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.683294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.683309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3237
2025-10-02T09:36:31.683432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.683456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.683465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.683469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.683798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3237 sessionId:  describe result for acl check
2025-10-02T09:36:31.683829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.683837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.683838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.683841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.684201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.685720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.687411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.687583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.687593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.687596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095489148:6607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.687600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.688882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.688893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.688895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.688897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.688900Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3236 [2:7556555974019904326:12234]
2025-10-02T09:36:31.688907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.688917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.688920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.688924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.688925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.688934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.688940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.688945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.688977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.688982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.688983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.688988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.688989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.689026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.689032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.689039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.689044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.689052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.689067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489104:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.689073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489183:6607], now have 1 active actors on pipe
2025-10-02T09:36:31.689076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.689078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.689079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.689086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.689097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.689098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.689100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.689102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.689107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.689109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.689100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3236
2025-10-02T09:36:31.689108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3236
2025-10-02T09:36:31.689124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.689129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.689131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.689139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.689144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.689172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.689179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.689181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.689183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.689188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.689196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.689209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.689311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.689316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.689323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.689386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3237 partition: 0 MaxSeqNo: 36 sessionId: src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0
2025-10-02T09:36:31.689604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b203af26-73715251-46ea62ad-c48b8586_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.691891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Write session: try to update token
2025-10-02T09:36:31.691906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.698331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.698345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.698346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.698350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.698354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.698356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.698359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904321:12234]
2025-10-02T09:36:31.698378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.698385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.698386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.698387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.698390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.698392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.698568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.704317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId: src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.706615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.772717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095489190:5886]
2025-10-02T09:36:31.772957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3236, pipe: [1:7556555974095489190:5886]
2025-10-02T09:36:31.813911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.814289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.814306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.814321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489190:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.814479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.814487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:31.814500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:31.814504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095489190:5886]
2025-10-02T09:36:31.814523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.814541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3237 reason: error at write: Disconnected sessionId: src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0
2025-10-02T09:36:31.814684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3237 sessionId: src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0 is DEAD
2025-10-02T09:36:31.814856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:31.814869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Write session will restart in 0.009792s
2025-10-02T09:36:31.814894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Write session: Do CDS request
2025-10-02T09:36:31.814910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.819994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.821065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.821219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.821229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.821238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.821283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.821334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904418:12242]
2025-10-02T09:36:31.821882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.822099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.822142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.822431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.822482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.822488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.822489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.822489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.822490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.822491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.822492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.822493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.822494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.822496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.822497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.822498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.822503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.822511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.822515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.822519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.822523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.822527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.822531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.822539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.822542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.822545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.822548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.822553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.822559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.822569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.822575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.822580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.822585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.822593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.822596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.822601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.822605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.822610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.822614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.822619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.822623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.822628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.822632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.822638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.822641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.822647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.822650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.822656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.822660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.822668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.822674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.822683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.822719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.826211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.826347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.826367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3238
2025-10-02T09:36:31.826526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.826562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.826570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.826575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.827056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3238 sessionId:  describe result for acl check
2025-10-02T09:36:31.827097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.827102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.827104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.827111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.827575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.829053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.830306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.831003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.831013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.831015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095489238:6618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.831029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.831943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.831961Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.831963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.831966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.831972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3237 [2:7556555974019904418:12242]
2025-10-02T09:36:31.831986Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.832004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.832011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.832013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.832015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.832029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.832036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.832042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.832092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.832099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.832100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.832103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.832105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.832161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.832169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.832181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.832196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.832217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.832220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3237
2025-10-02T09:36:31.832236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489272:6618], now have 1 active actors on pipe
2025-10-02T09:36:31.832240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3237
2025-10-02T09:36:31.832243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489192:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.832249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.832253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.832255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.832262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.832267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.832270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.832271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.832274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.832288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.832295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.832309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.832316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.832348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.832360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.832366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.832375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4aab4771-ff6240d0-47141940-3888fc4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.832384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.832389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.832391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.832398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.832408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.832485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.832611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.832620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.832632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.832705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3238 partition: 0 MaxSeqNo: 36 sessionId: src_id|4aab4771-ff6240d0-47141940-3888fc4f_0
2025-10-02T09:36:31.833005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c415abb3-c02af566-bd9180fd-b01ec7d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4aab4771-ff6240d0-47141940-3888fc4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.835317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Write session: try to update token
2025-10-02T09:36:31.835333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.841753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.841772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.841773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.841774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.841779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.841782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.841785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904413:12242]
2025-10-02T09:36:31.841814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.841821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.841823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.841822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.841827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.841833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.841952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.847400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId: src_id|4aab4771-ff6240d0-47141940-3888fc4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.849693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:31.914554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555974095489301:5886]
2025-10-02T09:36:31.915006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3237, pipe: [1:7556555974095489301:5886]
2025-10-02T09:36:31.959803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:31.960081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.960094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.960109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489301:5886], now have 1 active actors on pipe
2025-10-02T09:36:31.960297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:31.960289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:31.960302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555974095489301:5886]
2025-10-02T09:36:31.960326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:31.960329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:31.960388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3238 reason: error at write: Disconnected sessionId: src_id|4aab4771-ff6240d0-47141940-3888fc4f_0
2025-10-02T09:36:31.960544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3238 sessionId: src_id|4aab4771-ff6240d0-47141940-3888fc4f_0 is DEAD
2025-10-02T09:36:31.960703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:31.960716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Write session will restart in 0.005250s
2025-10-02T09:36:31.960738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Write session: Do CDS request
2025-10-02T09:36:31.960745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:31.965619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:31.966657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:31.966755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:31.966763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:31.966789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:31.966821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:31.966843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555974019904521:12250]
2025-10-02T09:36:31.967156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.967185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:31.967279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:31.967291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3239
2025-10-02T09:36:31.967343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:31.967364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:31.967388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:31.967411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:31.967418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:31.967421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:31.967535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:31.967566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.967569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.967570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.967570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.967571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.967572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.967572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.967573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.967574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.967575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.967575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.967576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.967579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.967585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.967587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.967589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.967591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.967593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.967595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.967597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.967599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.967601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.967603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.967604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.967609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.967612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:31.967616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.967619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:31.967621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.967624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:31.967626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.967629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:31.967631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.967634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:31.967637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.967639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:31.967642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.967644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:31.967646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.967649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:31.967651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.967654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:31.967660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.967662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.967664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.967667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.967669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.967672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.967689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:31.967729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3239 sessionId:  describe result for acl check
2025-10-02T09:36:31.967757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:31.967763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:31.967764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:31.967767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:31.968107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:31.970173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:31.974539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:31.974549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:31.974551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555974095489357:6666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:31.974555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:31.975022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:31.976445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:31.976457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:31.976459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:31.976461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:31.976465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3238 [2:7556555974019904521:12250]
2025-10-02T09:36:31.976472Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:31.976483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:31.976489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.976491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.976492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.976501Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:31.976506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:31.976510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:31.976542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.976547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.976548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.976550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:31.976551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:31.976595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:31.976600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.976606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:31.976612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:31.976623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:31.976638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489390:6666], now have 1 active actors on pipe
2025-10-02T09:36:31.976640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555974095489313:2446], now have 1 active actors on pipe
2025-10-02T09:36:31.976643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.976645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.976646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.976653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:31.976664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:31.976666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:31.976653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3238
2025-10-02T09:36:31.976681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3238
2025-10-02T09:36:31.976668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:31.976669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:31.976675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:31.976676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:31.976694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.976698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:31.976699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:31.976710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.976715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.976740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:31.976746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:31.976748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:31.976749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:31.976754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:31.976760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:31.976769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.976887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:31.976892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:31.976900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:31.976971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3239 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0
2025-10-02T09:36:31.977172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aab4771-ff6240d0-47141940-3888fc4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:31.979458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Write session: try to update token
2025-10-02T09:36:31.979472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:31.985785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:31.985798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:31.985800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:31.985801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:31.985805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.985808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.985810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555974019904515:12250]
2025-10-02T09:36:31.985829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:31.985830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:31.985834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:31.985835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:31.985838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:31.985841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:31.986030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:31.994233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId: src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:31.996523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.060448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390456697:5886]
2025-10-02T09:36:32.060655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3238, pipe: [1:7556555978390456697:5886]
2025-10-02T09:36:32.101468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.101770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.101782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.101799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456697:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.102035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:32.102050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:32.102083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.102121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3239 reason: error at write: Disconnected sessionId: src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0
2025-10-02T09:36:32.102273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3239 sessionId: src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0 is DEAD
2025-10-02T09:36:32.102317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.102365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390456697:5886]
2025-10-02T09:36:32.102431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:32.102441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Write session will restart in 0.006086s
2025-10-02T09:36:32.102463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Write session: Do CDS request
2025-10-02T09:36:32.102469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.107430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.108513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.108614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.108621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.108627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.108651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.108677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314871897:12252]
2025-10-02T09:36:32.109034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.109139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.109204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.109227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.109254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.109268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3240
2025-10-02T09:36:32.109375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.109396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.109404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.109408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.109405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.109433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.109439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.109439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.109440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.109440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.109441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.109441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.109442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.109442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.109443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.109444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.109444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.109447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.109454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.109456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.109458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.109460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.109462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.109464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.109466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.109468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.109470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.109472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.109474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.109478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.109482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.109485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.109488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.109490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.109493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.109495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.109498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.109501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.109505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.109508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.109511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.109513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.109515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.109519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.109522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.109524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.109527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.109534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.109536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.109539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.109542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.109544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.109546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.109563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.109746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3240 sessionId:  describe result for acl check
2025-10-02T09:36:32.109771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.109777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.109779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.109783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.110234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.111638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.115754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.115764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.115766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390456745:6674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.115771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.117008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.118544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.118557Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.118559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.118561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.118565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3239 [2:7556555978314871897:12252]
2025-10-02T09:36:32.118573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.118583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.118590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.118592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.118593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.118605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.118608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.118612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.118644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.118649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.118650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.118652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.118653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.118693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.118697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.118703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.118708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.118718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.118734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456698:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.118740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456779:6674], now have 1 active actors on pipe
2025-10-02T09:36:32.118744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.118745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.118746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.118754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.118763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.118773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.118778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.118778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.118780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.118781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.118772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3239
2025-10-02T09:36:32.118795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.118801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.118803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.118805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3239
2025-10-02T09:36:32.118821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.118826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.118846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.118853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.118856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.118857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.118862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.118869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.118877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.118985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.118990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.118998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.119067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3240 partition: 0 MaxSeqNo: 36 sessionId: src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0
2025-10-02T09:36:32.119339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6b201d-73659fb6-e34a5d68-2e2d6750_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.121652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Write session: try to update token
2025-10-02T09:36:32.121670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.128120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.128138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.128139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.128140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.128144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.128147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.128150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314871892:12252]
2025-10-02T09:36:32.128171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.128176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.128177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.128185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.128190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.128194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.128320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.135083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId: src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.137459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.202297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390456788:5886]
2025-10-02T09:36:32.202461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3239, pipe: [1:7556555978390456788:5886]
2025-10-02T09:36:32.243245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.243544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.243556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.243570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456788:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.243717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.243741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.243746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:32.243749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:32.243784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390456788:5886]
2025-10-02T09:36:32.243823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3240 reason: error at write: Disconnected sessionId: src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0
2025-10-02T09:36:32.243991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3240 sessionId: src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0 is DEAD
2025-10-02T09:36:32.244138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:32.244150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Write session will restart in 0.006712s
2025-10-02T09:36:32.244169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Write session: Do CDS request
2025-10-02T09:36:32.244175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.249286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.250463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.250572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.250579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.250585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.250611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.250635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314871993:12256]
2025-10-02T09:36:32.250989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.251164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.251185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.251359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.251388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.251392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.251393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.251394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.251394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.251395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.251396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.251396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.251397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.251397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.251400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.251400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.251403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.251410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.251412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.251414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.251416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.251418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.251420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.251422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.251423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.251425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.251427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.251429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.251433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.251437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.251441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.251444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.251446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.251450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.251452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.251455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.251457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.251460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.251462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.251465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.251469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.251472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.251474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.251476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.251481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.251484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.251487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.251489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.251493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.251495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.251497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.251500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.251516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.252174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.252245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.252257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3241
2025-10-02T09:36:32.252348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.252369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.252376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.252379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.252737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3241 sessionId:  describe result for acl check
2025-10-02T09:36:32.252763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.252771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.252772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.252776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.253263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.255046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.258377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.258388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.258390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390456837:6686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.258395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.258867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.260383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.260394Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.260395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.260400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3240 [2:7556555978314871993:12256]
2025-10-02T09:36:32.260407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.260418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.260420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.260421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.260423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.260435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.260440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.260443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.260473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.260480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.260481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.260483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.260484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.260527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.260531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.260537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.260542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.260550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.260564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456789:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.260570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456872:6686], now have 1 active actors on pipe
2025-10-02T09:36:32.260573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.260575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.260576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.260583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.260591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.260596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.260598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.260599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.260600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.260602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.260617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.260622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.260608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3240
2025-10-02T09:36:32.260614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3240
2025-10-02T09:36:32.260634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.260643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.260644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.260662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.260669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.260671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.260672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.260677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.260683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.260692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.260798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.260816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.260824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.260894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3241 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0
2025-10-02T09:36:32.261125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86a1968-285badca-11505eb1-4f9b0ef4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.263404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Write session: try to update token
2025-10-02T09:36:32.263417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.269642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.269653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.269654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.269655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.269659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.269662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.269665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314871988:12256]
2025-10-02T09:36:32.269685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.269688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.269689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.269695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.269707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.269711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.269862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.275528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId: src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.277929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.344120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390456894:5886]
2025-10-02T09:36:32.344351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3240, pipe: [1:7556555978390456894:5886]
2025-10-02T09:36:32.379841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.380089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.380101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.380115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456894:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.380235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.380282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390456894:5886]
2025-10-02T09:36:32.380283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.380317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:32.380401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0
2025-10-02T09:36:32.380553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3241 sessionId: src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0 is DEAD
2025-10-02T09:36:32.380717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:32.380729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Write session will restart in 0.006005s
2025-10-02T09:36:32.380749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Write session: Do CDS request
2025-10-02T09:36:32.380754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.385310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.386321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.386419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.386426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.386432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.386459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.386482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314872076:12258]
2025-10-02T09:36:32.386833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.387006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.387028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.387203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.387230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.387234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.387234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.387235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.387236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.387236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.387237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.387237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.387238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.387238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.387242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.387249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.387251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.387253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.387255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.387257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.387259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.387261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.387263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.387266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.387268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.387270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.387273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.387277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.387281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.387283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.387287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.387289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.387292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.387294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.387296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.387299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.387301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.387303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.387306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.387309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.387311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.387313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.387316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.387318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.387325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.387327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.387331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.387333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.387336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.387338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.387355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.388186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.388314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.388325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3242
2025-10-02T09:36:32.388428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.388450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.388453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.388456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.388889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3242 sessionId:  describe result for acl check
2025-10-02T09:36:32.388922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.388928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.388929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.388932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.389272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.390674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.394143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.394154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.394156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390456944:6698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.394160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.394663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.396086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.396098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.396099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.396101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.396105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3241 [2:7556555978314872076:12258]
2025-10-02T09:36:32.396111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.396122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.396127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.396129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.396130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.396141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.396146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.396150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.396181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.396186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.396188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.396190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.396192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.396232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.396237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.396243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.396248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.396256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.396271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456978:6698], now have 1 active actors on pipe
2025-10-02T09:36:32.396276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456895:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.396279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.396280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.396281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.396288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.396299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.396302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.396304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.396305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.396309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.396289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3241
2025-10-02T09:36:32.396310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.396308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3241
2025-10-02T09:36:32.396335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.396340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.396348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.396357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.396364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.396375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.396379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.396381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.396382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.396387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.396395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.396409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.396505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.396510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.396517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.396581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3242 partition: 0 MaxSeqNo: 36 sessionId: src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0
2025-10-02T09:36:32.396814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c7c567-bd9df179-8682748f-74d5d0b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.399056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Write session: try to update token
2025-10-02T09:36:32.399070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.405355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.405367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.405368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.405369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.405373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.405375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.405376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314872071:12258]
2025-10-02T09:36:32.405397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.405401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.405402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.405408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.405418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.405422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.405509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.411459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId: src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.413807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.480323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390456987:5886]
2025-10-02T09:36:32.480765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3241, pipe: [1:7556555978390456987:5886]
2025-10-02T09:36:32.515116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.515379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.515391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.515405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456987:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.515782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390456987:5886]
2025-10-02T09:36:32.515793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.515815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:32.515816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:32.515861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3242 reason: error at write: Disconnected sessionId: src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0
2025-10-02T09:36:32.516004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3242 sessionId: src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0 is DEAD
2025-10-02T09:36:32.516075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.516300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:32.516313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Write session will restart in 0.009273s
2025-10-02T09:36:32.516337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Write session: Do CDS request
2025-10-02T09:36:32.516342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.520876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.522059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.522173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.522180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.522186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.522212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.522241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314872161:12261]
2025-10-02T09:36:32.522589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.522757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.522779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.522976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.523006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.523010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.523011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.523012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.523012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.523013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.523014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.523014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.523015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.523015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.523016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.523016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.523019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.523026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.523028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.523030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.523032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.523034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.523036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.523038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.523040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.523043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.523044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.523046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.523052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.523055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.523058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.523067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.523070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.523072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.523075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.523077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.523079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.523081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.523084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.523086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.523089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.523091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.523095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.523097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.523103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.523105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.523108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.523109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.523112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.523131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.526183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.526341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.526358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3243
2025-10-02T09:36:32.526482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.526507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.526516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.526519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.526845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3243 sessionId:  describe result for acl check
2025-10-02T09:36:32.526873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.526879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.526880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.526883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.527237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.529022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.530544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.530869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.530878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.530880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390457038:6733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.530884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.532024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.532036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.532037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.532041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.532045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3242 [2:7556555978314872161:12261]
2025-10-02T09:36:32.532054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.532068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.532071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.532072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.532073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.532084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.532090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.532094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.532128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.532132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.532133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.532135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.532136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.532172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.532177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.532184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.532190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.532200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.532212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390456988:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.532218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457072:6733], now have 1 active actors on pipe
2025-10-02T09:36:32.532222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.532223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.532224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.532232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.532243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.532247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.532249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.532251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.532254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.532256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.532249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3242
2025-10-02T09:36:32.532271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3242
2025-10-02T09:36:32.532271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.532275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.532277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.532291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.532297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.532317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.532324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.532325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.532326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.532331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.532337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.532346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.532447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.532452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.532460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.532539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3243 partition: 0 MaxSeqNo: 36 sessionId: src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0
2025-10-02T09:36:32.532770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59df9360-2c888a64-304824fd-b0d4ebb3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.535035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Write session: try to update token
2025-10-02T09:36:32.535048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.541412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.541423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.541424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.541425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.541429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.541432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.541434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314872156:12261]
2025-10-02T09:36:32.541454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.541461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.541462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.541466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.541471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.541483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.541585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.546947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId: src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.549280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.616019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390457080:5886]
2025-10-02T09:36:32.616460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3242, pipe: [1:7556555978390457080:5886]
2025-10-02T09:36:32.651899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.652187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.652198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.652211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457080:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.652659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390457080:5886]
2025-10-02T09:36:32.652674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.652693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:32.652695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:32.652737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3243 reason: error at write: Disconnected sessionId: src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0
2025-10-02T09:36:32.652885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3243 sessionId: src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0 is DEAD
2025-10-02T09:36:32.653007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.653042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:32.653054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Write session will restart in 0.005415s
2025-10-02T09:36:32.653076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Write session: Do CDS request
2025-10-02T09:36:32.653081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.657868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.658977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.659075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.659082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.659088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.659113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.659146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314872246:12263]
2025-10-02T09:36:32.659205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.659271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.659285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3244
2025-10-02T09:36:32.659414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.659439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.659447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.659451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.659515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.659675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.659697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.659870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.659874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3244 sessionId:  describe result for acl check
2025-10-02T09:36:32.659899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.659904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.659906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.659912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.659910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.659914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.659915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.659915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.659916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.659916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.659917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.659917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.659918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.659918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.659919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.659919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.659922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.659929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.659931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.659934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.659936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.659938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.659941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.659943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.659946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.659948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.659950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.659952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.659957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.659961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.659964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.659967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.659969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.659972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.659974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.659977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.659979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.659982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.659984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.659987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.659989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.659992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.659994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.659996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.659998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.660001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.660007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.660009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.660011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.660014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.660017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.660019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.660035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.660403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.662047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.666938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.666951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.666953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390457131:6734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.666958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.667387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.668798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.668823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.668824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.668826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.668830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3243 [2:7556555978314872246:12263]
2025-10-02T09:36:32.668838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.668848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.668853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.668854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.668855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.668865Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.668868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.668872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.668904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.668909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.668910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.668912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.668913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.668948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.668952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.668959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.668964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.668973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.668988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457082:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.668993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457168:6734], now have 1 active actors on pipe
2025-10-02T09:36:32.668997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.668999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.669002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.668999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3243
2025-10-02T09:36:32.669012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.669018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.669020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.669022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.669023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.669030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.669035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.669052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.669057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.669059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.669047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3243
2025-10-02T09:36:32.669070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.669074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.669094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.669100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.669104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.669104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.669109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.669114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.669125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.669235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.669239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.669247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.669314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3244 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0
2025-10-02T09:36:32.669558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1acb4ef9-4e097130-56fa857c-e2aeec2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.672378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Write session: try to update token
2025-10-02T09:36:32.672389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.678266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.678283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.678285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.678287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.678293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.678297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.678302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314872241:12263]
2025-10-02T09:36:32.678329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.678337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.678339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.678340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.678342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.678347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.678457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.684637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId: src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.686977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.752687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390457175:5886]
2025-10-02T09:36:32.752898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3243, pipe: [1:7556555978390457175:5886]
2025-10-02T09:36:32.787622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.787896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.787905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.787918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457175:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.788072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.788116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.788125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390457175:5886]
2025-10-02T09:36:32.788151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:32.788242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0
2025-10-02T09:36:32.788404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3244 sessionId: src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0 is DEAD
2025-10-02T09:36:32.788541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:32.788555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Write session will restart in 0.008458s
2025-10-02T09:36:32.788579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Write session: Do CDS request
2025-10-02T09:36:32.788585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.793588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.794602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.794715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.794723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.794728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.794755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.794780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314872331:12265]
2025-10-02T09:36:32.795124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.795284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.795306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.795482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.795517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.795521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.795522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.795522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.795523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.795523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.795524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.795525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.795525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.795526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.795526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.795527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.795529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.795536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.795538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.795540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.795544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.795546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.795548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.795550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.795552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.795555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.795557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.795558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.795562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.795566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.795570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.795572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.795574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.795577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.795580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.795582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.795586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.795589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.795590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.795593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.795596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.795598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.795600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.795603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.795606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.795609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.795611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.795614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.795617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.795623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.795626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.795629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.795647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.798192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.798301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.798312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3245
2025-10-02T09:36:32.798428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.798450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.798458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.798462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.798801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3245 sessionId:  describe result for acl check
2025-10-02T09:36:32.798828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.798833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.798834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.798841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.799297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.800854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.802685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.802696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.802698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390457229:6759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.802704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.803004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.804510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.804523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.804524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.804527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.804530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3244 [2:7556555978314872331:12265]
2025-10-02T09:36:32.804538Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.804547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.804549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.804550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.804552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.804561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.804568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.804572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.804602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.804606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.804608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.804609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.804611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.804647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.804652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.804658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.804663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.804674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.804689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457263:6759], now have 1 active actors on pipe
2025-10-02T09:36:32.804694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457176:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.804697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.804698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.804699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.804707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.804718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.804722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.804724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.804725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.804728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.804729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.804726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3244
2025-10-02T09:36:32.804742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3244
2025-10-02T09:36:32.804743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.804748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.804750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.804757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.804762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.804824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.804832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.804833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.804835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.804840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.804845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.804858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.804977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.804982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.804990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.805059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3245 partition: 0 MaxSeqNo: 36 sessionId: src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0
2025-10-02T09:36:32.805306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2815d36-a645c2c7-b47fcba2-a4fba407_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.807872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Write session: try to update token
2025-10-02T09:36:32.807886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.813792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.813805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.813806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.813807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.813811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.813815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.813818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314872326:12265]
2025-10-02T09:36:32.813837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.813842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.813844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.813848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.813852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.813855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.813960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.820783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId: src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.823257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:32.888348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555978390457284:5886]
2025-10-02T09:36:32.888486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3244, pipe: [1:7556555978390457284:5886]
2025-10-02T09:36:32.923525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:32.923795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.923805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.923817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457284:5886], now have 1 active actors on pipe
2025-10-02T09:36:32.923928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:32.923976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:32.924010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555978390457284:5886]
2025-10-02T09:36:32.924030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:32.924036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0
2025-10-02T09:36:32.924181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3245 sessionId: src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0 is DEAD
2025-10-02T09:36:32.924336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:32.924348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Write session will restart in 0.008744s
2025-10-02T09:36:32.924373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Write session: Do CDS request
2025-10-02T09:36:32.924378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:32.929389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:32.930574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:32.930717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:32.930724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:32.930730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:32.930763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:32.930786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555978314872454:12279]
2025-10-02T09:36:32.931143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:32.931300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:32.931324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:32.931500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:32.931529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.931533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.931534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.931534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.931535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.931536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.931536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.931538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.931538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.931539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.931539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.931540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.931543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.931549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.931551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.931553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.931557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.931559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.931561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.931563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.931565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.931567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.931569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.931571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.931575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.931579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:32.931582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.931585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:32.931587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.931590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:32.931592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.931594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:32.931596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.931599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:32.931601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.931603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:32.931605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.931608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:32.931611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.931613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:32.931616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.931620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:32.931622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.931625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.931628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.931630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.931634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.931637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.931654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:32.934165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.934704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:32.934720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3246
2025-10-02T09:36:32.934836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:32.934864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:32.934876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:32.934884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:32.935277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3246 sessionId:  describe result for acl check
2025-10-02T09:36:32.935308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:32.935313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:32.935314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:32.935317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:32.935643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:32.937629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:32.939010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:32.939969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:32.939979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:32.939981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555978390457352:6811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:32.939985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:32.940474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:32.940486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:32.940487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:32.940489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:32.940493Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3245 [2:7556555978314872454:12279]
2025-10-02T09:36:32.940499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:32.940509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:32.940511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.940514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.940515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.940525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:32.940527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:32.940533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:32.940565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.940570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.940571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.940573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:32.940574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:32.940617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:32.940621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.940628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:32.940633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:32.940640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:32.940656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457388:6811], now have 1 active actors on pipe
2025-10-02T09:36:32.940662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555978390457297:2446], now have 1 active actors on pipe
2025-10-02T09:36:32.940665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.940667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.940668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.940675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:32.940686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:32.940688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:32.940690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:32.940680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3245
2025-10-02T09:36:32.940691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:32.940693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3245
2025-10-02T09:36:32.940697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:32.940699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:32.940711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.940716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:32.940717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:32.940728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.940732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.940756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|788c3a63-1c54034b-8030842b-c0854b5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:32.940763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:32.940765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:32.940766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:32.940772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:32.940779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:32.940788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.940906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:32.940911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:32.940918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:32.940988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3246 partition: 0 MaxSeqNo: 36 sessionId: src_id|788c3a63-1c54034b-8030842b-c0854b5f_0
2025-10-02T09:36:32.941222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f664c8e4-1dc341e4-4413d8e7-31ba7574_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|788c3a63-1c54034b-8030842b-c0854b5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:32.944030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Write session: try to update token
2025-10-02T09:36:32.944040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:32.949861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:32.949877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:32.949878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:32.949880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:32.949884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.949888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.949890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555978314872449:12279]
2025-10-02T09:36:32.949912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:32.949919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:32.949921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:32.949921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:32.949927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:32.949930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:32.950038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:32.956186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId: src_id|788c3a63-1c54034b-8030842b-c0854b5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:32.958670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.024081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685424696:5886]
2025-10-02T09:36:33.024305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3245, pipe: [1:7556555982685424696:5886]
2025-10-02T09:36:33.061668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.061910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.061921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.061933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424696:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.062129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.062149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:33.062155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:33.062176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685424696:5886]
2025-10-02T09:36:33.062227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3246 reason: error at write: Disconnected sessionId: src_id|788c3a63-1c54034b-8030842b-c0854b5f_0
2025-10-02T09:36:33.062395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3246 sessionId: src_id|788c3a63-1c54034b-8030842b-c0854b5f_0 is DEAD
2025-10-02T09:36:33.062521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:33.062528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Write session will restart in 0.008006s
2025-10-02T09:36:33.062548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Write session: Do CDS request
2025-10-02T09:36:33.062554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.062729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.067309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.068378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.068473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.068480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.068485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.068508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.068532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609839838:12281]
2025-10-02T09:36:33.068889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.069047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.069069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.069243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.069272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.069276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.069277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.069278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.069278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.069279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.069279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.069280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.069282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.069282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.069283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.069283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.069286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.069293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.069295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.069297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.069299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.069301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.069303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.069305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.069307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.069309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.069311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.069313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.069317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.069320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.069323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.069326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.069328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.069331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.069333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.069335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.069337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.069339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.069341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.069344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.069349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.069351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.069354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.069356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.069359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.069362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.069364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.069366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.069369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.069371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.069373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.069388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.071106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.071301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.071311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3247
2025-10-02T09:36:33.071421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.071445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.071449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.071454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.071811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3247 sessionId:  describe result for acl check
2025-10-02T09:36:33.071841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.071848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.071851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.071855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.072206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.073759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.076208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.076220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.076222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685424751:6832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.076226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.076691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.078222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.078236Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.078237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.078239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.078243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3246 [2:7556555982609839838:12281]
2025-10-02T09:36:33.078250Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.078260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.078262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.078264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.078265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.078275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.078279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.078283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.078314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.078319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.078321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.078323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.078324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.078360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.078364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.078371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.078376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.078384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.078399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424697:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.078404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424786:6832], now have 1 active actors on pipe
2025-10-02T09:36:33.078408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.078410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.078410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.078418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.078428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.078429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.078431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.078433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.078437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.078439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.078432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3246
2025-10-02T09:36:33.078449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3246
2025-10-02T09:36:33.078454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.078459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.078461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.078470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.078473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.078496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.078503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.078506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.078507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.078511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.078518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.078529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.078629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.078634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.078642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.078705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3247 partition: 0 MaxSeqNo: 36 sessionId: src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0
2025-10-02T09:36:33.078917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788c3a63-1c54034b-8030842b-c0854b5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.081738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Write session: try to update token
2025-10-02T09:36:33.081750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.087636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.087649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.087651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.087652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.087656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.087658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.087661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609839833:12281]
2025-10-02T09:36:33.087681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.087684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.087685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.087690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.087695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.087699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.087818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.094406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId: src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.096781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.162298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685424794:5886]
2025-10-02T09:36:33.162485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3246, pipe: [1:7556555982685424794:5886]
2025-10-02T09:36:33.196518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.196749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.196759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.196772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424794:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.196952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.196959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.196983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685424794:5886]
2025-10-02T09:36:33.197002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:33.197063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0
2025-10-02T09:36:33.197190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3247 sessionId: src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0 is DEAD
2025-10-02T09:36:33.197303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:33.197314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Write session will restart in 0.009206s
2025-10-02T09:36:33.197330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Write session: Do CDS request
2025-10-02T09:36:33.197334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.202119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.203204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.203318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.203327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.203336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.203371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.203395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609839929:12284]
2025-10-02T09:36:33.203740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.203896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.203919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.204096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.204123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.204127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.204127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.204129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.204130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.204130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.204131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.204131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.204132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.204132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.204133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.204133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.204136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.204143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.204145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.204147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.204149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.204151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.204153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.204155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.204157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.204159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.204161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.204163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.204167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.204171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.204174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.204176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.204178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.204181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.204183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.204186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.204188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.204191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.204193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.204196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.204198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.204201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.204202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.204205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.204207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.204210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.204212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.204214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.204216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.204219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.204221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.204224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.204243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.207150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.207494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.207510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3248
2025-10-02T09:36:33.207640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.207668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.207672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.207676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.208076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3248 sessionId:  describe result for acl check
2025-10-02T09:36:33.208108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.208115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.208118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.208123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.208611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.210539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.211575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.212285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.212295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.212297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685424850:6825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.212302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.213010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.213022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.213023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.213026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.213029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3247 [2:7556555982609839929:12284]
2025-10-02T09:36:33.213036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.213046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.213049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.213051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.213051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.213060Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.213063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.213067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.213100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.213105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.213106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.213108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.213109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.213146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.213151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.213157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.213162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.213172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.213186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424795:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.213192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424884:6825], now have 1 active actors on pipe
2025-10-02T09:36:33.213195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.213196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.213198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.213204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.213216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.213217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.213219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.213220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.213225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.213227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.213214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3247
2025-10-02T09:36:33.213241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.213246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.213247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.213259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.213261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.213237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3247
2025-10-02T09:36:33.213299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.213306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.213308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.213311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.213317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.213322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.213335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.213430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.213435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.213443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.213511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3248 partition: 0 MaxSeqNo: 36 sessionId: src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0
2025-10-02T09:36:33.213781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4282ea6-735c7f68-be72a94a-1ee4d361_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.216745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Write session: try to update token
2025-10-02T09:36:33.216756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.222408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.222424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.222426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.222427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.222431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.222433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.222436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609839924:12284]
2025-10-02T09:36:33.222457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.222460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.222463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.222468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.222473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.222477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.222589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.229705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId: src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.232016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.296926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685424893:5886]
2025-10-02T09:36:33.297121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3247, pipe: [1:7556555982685424893:5886]
2025-10-02T09:36:33.333424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.333784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.333794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.333807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424893:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.333931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.334072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:33.334082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.334128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685424893:5886]
2025-10-02T09:36:33.334160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3248 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0
2025-10-02T09:36:33.334298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3248 sessionId: src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0 is DEAD
2025-10-02T09:36:33.334431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:33.334443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Write session will restart in 0.007505s
2025-10-02T09:36:33.334469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Write session: Do CDS request
2025-10-02T09:36:33.334475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.339368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.340622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.340716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.340723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.340729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.340753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.340779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609840030:12287]
2025-10-02T09:36:33.341135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.341299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.341322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.341534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.341575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.341581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.341582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.341582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.341583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.341583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.341584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.341584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.341585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.341585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.341586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.341586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.341589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.341595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.341597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.341599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.341601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.341603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.341604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.341606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.341608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.341612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.341614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.341616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.341620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.341627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.341631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.341634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.341636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.341638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.341640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.341643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.341646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.341649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.341652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.341654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.341656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.341659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.341661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.341663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.341666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.341668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.341670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.341673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.341675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.341677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.341681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.341684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.341701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.343125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.343324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.343338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3249
2025-10-02T09:36:33.343439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.343462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.343470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.343473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.343819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3249 sessionId:  describe result for acl check
2025-10-02T09:36:33.343846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.343851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.343853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.343859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.344291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.346059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.348506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.348516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.348518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685424964:6859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.348522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.349041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.350539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.350553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.350554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.350556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.350560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3248 [2:7556555982609840030:12287]
2025-10-02T09:36:33.350609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.350623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.350624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.350626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.350628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.350637Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.350643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.350648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.350679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.350683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.350684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.350686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.350687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.350724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.350729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.350736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.350742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.350750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.350764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424908:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.350769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685424999:6859], now have 1 active actors on pipe
2025-10-02T09:36:33.350773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.350774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.350776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.350785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.350796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.350800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.350804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.350805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.350812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.350814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.350821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3248
2025-10-02T09:36:33.350832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.350828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3248
2025-10-02T09:36:33.350838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.350840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.350855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.350860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.350878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.350885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.350887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.350888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.350893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.350901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.350925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.351038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.351045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.351054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.351121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3249 partition: 0 MaxSeqNo: 36 sessionId: src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0
2025-10-02T09:36:33.351379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d85340a5-9e7bf2e6-2fb68f10-4a341047_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.354144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Write session: try to update token
2025-10-02T09:36:33.354155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.359937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.359952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.359954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.359955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.359960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.359962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.359964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609840025:12287]
2025-10-02T09:36:33.359984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.359990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.359991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.360000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.360011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.360013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.360103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.366586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId: src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.368981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.434167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685425006:5886]
2025-10-02T09:36:33.434406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3248, pipe: [1:7556555982685425006:5886]
2025-10-02T09:36:33.469341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.469569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.469578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.469591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425006:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.469711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.469729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685425006:5886]
2025-10-02T09:36:33.469733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:33.469737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:33.469752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.469820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3249 reason: error at write: Disconnected sessionId: src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0
2025-10-02T09:36:33.469977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3249 sessionId: src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0 is DEAD
2025-10-02T09:36:33.470096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:33.470105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Write session will restart in 0.006130s
2025-10-02T09:36:33.470121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Write session: Do CDS request
2025-10-02T09:36:33.470127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.475101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.476235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.476339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.476346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.476352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.476377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.476402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609840123:2747]
2025-10-02T09:36:33.476743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.476918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.476940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.477123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.477128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.477177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.477183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.477184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.477185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.477186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.477187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.477188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.477189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.477189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.477190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.477191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.477192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.477196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.477206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.477210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.477214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.477216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.477218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.477220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.477222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.477224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.477227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.477229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.477231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.477235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.477239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.477242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.477245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.477248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.477251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.477253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.477256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.477258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.477261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.477263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.477266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.477277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3250
2025-10-02T09:36:33.477266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.477268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.477271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.477273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.477275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.477277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.477280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.477282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.477285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.477287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.477290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.477292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.477295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.477311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.477379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.477405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.477411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.477420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.477721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3250 sessionId:  describe result for acl check
2025-10-02T09:36:33.477751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.477758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.477759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.477762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.478107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.479714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.483533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.483544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.483546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685425065:6875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.483549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.484688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.486246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.486258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.486260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.486262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.486265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3249 [2:7556555982609840123:2747]
2025-10-02T09:36:33.486272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.486283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.486284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.486286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.486287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.486296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.486302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.486306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.486337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.486342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.486343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.486345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.486346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.486384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.486389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.486396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.486401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.486410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.486425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425008:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.486430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425099:6875], now have 1 active actors on pipe
2025-10-02T09:36:33.486433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.486435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.486436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.486444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.486454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.486456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.486458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.486459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.486462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.486464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.486458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3249
2025-10-02T09:36:33.486479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.486484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.486485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.486482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3249
2025-10-02T09:36:33.486493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.486496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.486520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.486528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.486530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.486535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.486540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.486545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.486557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.486660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.486665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.486673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.486738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3250 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0
2025-10-02T09:36:33.486991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642ec33a-4c5cc9ab-73279534-3e0b4fd3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.489692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Write session: try to update token
2025-10-02T09:36:33.489702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.495621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.495638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.495639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.495640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.495644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.495646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.495649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609840118:2747]
2025-10-02T09:36:33.495668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.495672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.495673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.495680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.495685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.495689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.495779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.500955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId: src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.503347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.569844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685425107:5886]
2025-10-02T09:36:33.570056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3249, pipe: [1:7556555982685425107:5886]
2025-10-02T09:36:33.607241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.607487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.607496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.607509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425107:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.607703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.607696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:33.607712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:33.607718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.607762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3250 reason: error at write: Disconnected sessionId: src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0
2025-10-02T09:36:33.607769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685425107:5886]
2025-10-02T09:36:33.607893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3250 sessionId: src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0 is DEAD
2025-10-02T09:36:33.608019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:33.608026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Write session will restart in 0.009710s
2025-10-02T09:36:33.608041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Write session: Do CDS request
2025-10-02T09:36:33.608045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.613527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.614610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.614711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.614718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.614724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.614749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.614770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609840214:2750]
2025-10-02T09:36:33.615120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.615292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.615314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.615491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.615523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.615527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.615527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.615528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.615529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.615529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.615530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.615530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.615531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.615532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.615532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.615533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.615536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.615542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.615544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.615547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.615549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.615551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.615553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.615555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.615557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.615559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.615561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.615563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.615567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.615571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.615574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.615578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.615580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.615582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.615584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.615587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.615589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.615591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.615593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.615596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.615598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.615601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.615603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.615606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.615608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.615610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.615612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.615615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.615617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.615620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.615622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.615625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.615642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.619171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.619261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.619273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3251
2025-10-02T09:36:33.619415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.619445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.619454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.619458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.619784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3251 sessionId:  describe result for acl check
2025-10-02T09:36:33.619817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.619823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.619824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.619829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.620276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.622122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.623044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.623949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.623959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.623961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685425167:6877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.623966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.624542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.624555Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.624557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.624559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.624563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3250 [2:7556555982609840214:2750]
2025-10-02T09:36:33.624570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.624581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.624586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.624589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.624591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.624601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.624607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.624612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.624644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.624649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.624650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.624652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.624654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.624689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.624694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.624701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.624706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.624714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.624729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425201:6877], now have 1 active actors on pipe
2025-10-02T09:36:33.624735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425108:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.624738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.624739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.624741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.624748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.624760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.624762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.624764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.624765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.624770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.624772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.624762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3250
2025-10-02T09:36:33.624778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3250
2025-10-02T09:36:33.624786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.624791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.624793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.624817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.624821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.624847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.624854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.624856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.624857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.624862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.624868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.624879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.624995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.625000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.625007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.625074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3251 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0
2025-10-02T09:36:33.625326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1c7a9-5c1ffd3f-3d22a66-7777fca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.628164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Write session: try to update token
2025-10-02T09:36:33.628176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.634033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.634050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.634054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.634055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.634059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.634061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.634063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609840209:2750]
2025-10-02T09:36:33.634084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.634087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.634089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.634094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.634098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.634101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.634243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.640968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId: src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.643254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.708096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685425209:5886]
2025-10-02T09:36:33.708270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3250, pipe: [1:7556555982685425209:5886]
2025-10-02T09:36:33.744542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.744816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.744826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.744839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425209:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.744999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.745040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.745052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:33.745089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685425209:5886]
2025-10-02T09:36:33.745135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0
2025-10-02T09:36:33.745292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3251 sessionId: src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0 is DEAD
2025-10-02T09:36:33.745432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:33.745443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Write session will restart in 0.006707s
2025-10-02T09:36:33.745461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Write session: Do CDS request
2025-10-02T09:36:33.745465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.750587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.751734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.751835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.751842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.751847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.751873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.751898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609840307:2753]
2025-10-02T09:36:33.752360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.752524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.752550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.752728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.752757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.752761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.752762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.752762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.752763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.752763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.752764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.752764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.752765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.752766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.752766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.752767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.752769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.752776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.752778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.752780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.752782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.752785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.752787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.752789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.752791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.752793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.752795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.752797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.752813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.752817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.752820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.752823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.752825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.752828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.752830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.752833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.752835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.752837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.752843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.752846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.752848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.752850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.752853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.752855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.752858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.752861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.752867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.752869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.752872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.752875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.752877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.752879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.752897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.753150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.753327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.753340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3252
2025-10-02T09:36:33.753452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.753474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.753482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.753485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.753812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3252 sessionId:  describe result for acl check
2025-10-02T09:36:33.753836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.753841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.753843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.753848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.754280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.755651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.759738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.759749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.759753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685425269:6892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.759758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.760299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.761815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.761826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.761828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.761830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.761834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3251 [2:7556555982609840307:2753]
2025-10-02T09:36:33.761841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.761852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.761856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.761858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.761860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.761868Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.761872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.761878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.761914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.761920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.761921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.761923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.761924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.761961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.761965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.761972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.761978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.761986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.762000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425303:6892], now have 1 active actors on pipe
2025-10-02T09:36:33.762005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425210:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.762009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.762010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.762011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.762019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.762032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.762033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.762035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.762036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.762047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.762051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.762036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3251
2025-10-02T09:36:33.762051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3251
2025-10-02T09:36:33.762072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.762079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.762084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.762087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.762089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.762112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.762119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.762121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.762122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.762128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.762133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.762142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.762253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.762258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.762265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.762326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3252 partition: 0 MaxSeqNo: 36 sessionId: src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0
2025-10-02T09:36:33.762618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc761ee1-891fba3e-c5ee7c41-bbf01358_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.765534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Write session: try to update token
2025-10-02T09:36:33.765547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.771281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.771295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.771296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.771297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.771302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.771304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.771306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609840302:2753]
2025-10-02T09:36:33.771326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.771328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.771330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.771340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.771354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.771357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.771477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.778046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId: src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.780360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.845319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685425312:5886]
2025-10-02T09:36:33.845744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3251, pipe: [1:7556555982685425312:5886]
2025-10-02T09:36:33.880124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:33.880411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.880419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.880432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425312:5886], now have 1 active actors on pipe
2025-10-02T09:36:33.880525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:33.880528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:33.880529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:33.880542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:33.880579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685425312:5886]
2025-10-02T09:36:33.880586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3252 reason: error at write: Disconnected sessionId: src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0
2025-10-02T09:36:33.880710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3252 sessionId: src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0 is DEAD
2025-10-02T09:36:33.880850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:33.880860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Write session will restart in 0.005932s
2025-10-02T09:36:33.880873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Write session: Do CDS request
2025-10-02T09:36:33.880878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:33.886250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:33.887322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:33.887430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:33.887437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:33.887443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:33.887468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:33.887490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555982609840414:2772]
2025-10-02T09:36:33.887833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:33.888017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:33.888043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:33.888110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.888220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:33.888209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:33.888222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3253
2025-10-02T09:36:33.888253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.888259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.888260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.888261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.888261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.888262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.888263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.888264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.888265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.888266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.888267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.888269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.888274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.888280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.888283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.888285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.888287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.888289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.888291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.888293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.888295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.888297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.888299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.888301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.888305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.888308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:33.888311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.888316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:33.888318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.888321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:33.888323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.888326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:33.888328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.888331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:33.888333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.888339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:33.888342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.888344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:33.888346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.888349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:33.888351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.888353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:33.888359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.888362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.888364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.888366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.888370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.888373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.888389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:33.888385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:33.888412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:33.888422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:33.888426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:33.888726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3253 sessionId:  describe result for acl check
2025-10-02T09:36:33.888751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:33.888757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:33.888758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:33.888761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:33.889108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:33.890802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:33.895178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:33.895187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:33.895188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555982685425373:6924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:33.895192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:33.895697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:33.897188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:33.897200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:33.897201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:33.897203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:33.897206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3252 [2:7556555982609840414:2772]
2025-10-02T09:36:33.897213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:33.897222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:33.897227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.897229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.897230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.897240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:33.897243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:33.897247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:33.897276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.897281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.897282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.897284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:33.897285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:33.897321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:33.897326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.897333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:33.897338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:33.897346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:33.897360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425407:6924], now have 1 active actors on pipe
2025-10-02T09:36:33.897365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425313:2446], now have 1 active actors on pipe
2025-10-02T09:36:33.897369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.897370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.897371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.897378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:33.897388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:33.897392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:33.897394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:33.897395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:33.897397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:33.897398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:33.897397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3252
2025-10-02T09:36:33.897414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3252
2025-10-02T09:36:33.897412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.897417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:33.897424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:33.897437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.897439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.897455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:33.897463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:33.897466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:33.897469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:33.897474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:33.897479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:33.897489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.897606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:33.897611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:33.897618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:33.897685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3253 partition: 0 MaxSeqNo: 36 sessionId: src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0
2025-10-02T09:36:33.897988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863f2e25-93cd26e7-3ee0c29f-87b9118d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:33.900723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Write session: try to update token
2025-10-02T09:36:33.900736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:33.906502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:33.906517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:33.906518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:33.906519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:33.906523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.906525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.906527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555982609840409:2772]
2025-10-02T09:36:33.906549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:33.906551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:33.906553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:33.906552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:33.906556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:33.906557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:33.906672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:33.913119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId: src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:33.915530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:33.980973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555982685425445:5886]
2025-10-02T09:36:33.981138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3252, pipe: [1:7556555982685425445:5886]
2025-10-02T09:36:34.018151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.018454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.018470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.018483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555982685425445:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.018668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.018691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.018697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.018712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555982685425445:5886]
2025-10-02T09:36:34.018774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3253 reason: error at write: Disconnected sessionId: src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0
2025-10-02T09:36:34.018831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.018982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3253 sessionId: src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0 is DEAD
2025-10-02T09:36:34.019117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.019131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Write session will restart in 0.007718s
2025-10-02T09:36:34.019152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Write session: Do CDS request
2025-10-02T09:36:34.019157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.024406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.025539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.025773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.025790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.025802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.025854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.025885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904807827:2796]
2025-10-02T09:36:34.026242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.026415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.026439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.026623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.026656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.026660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.026660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.026661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.026662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.026663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.026664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.026665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.026665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.026666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.026666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.026667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.026669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.026677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.026679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.026681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.026683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.026685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.026687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.026689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.026690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.026693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.026695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.026697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.026701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.026705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.026708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.026711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.026714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.026717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.026719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.026722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.026724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.026726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.026728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.026731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.026734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.026737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.026740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.026742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.026744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.026747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.026749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.026751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.026753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.026756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.026758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.026760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.026778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.028236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.028315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.028331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3254
2025-10-02T09:36:34.028450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.028478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.028488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.028492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.028857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3254 sessionId:  describe result for acl check
2025-10-02T09:36:34.028895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.028901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.028903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.028907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.029286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.031168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.034002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.034011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.034014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980392806:6975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.034018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.034287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.035677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.035690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.035692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.035694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.035697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3253 [2:7556555986904807827:2796]
2025-10-02T09:36:34.035705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.035716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.035718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.035719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.035720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.035729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.035736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.035740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.035774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.035779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.035780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.035782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.035783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.035822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.035827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.035835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.035840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.035852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.035865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392841:6975], now have 1 active actors on pipe
2025-10-02T09:36:34.035870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392745:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.035874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.035875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.035878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.035885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.035895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.035899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.035901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.035902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.035906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.035908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.035922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.035927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.035916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3253
2025-10-02T09:36:34.035919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3253
2025-10-02T09:36:34.035941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.035948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.035951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.035968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea763a33-7b27d03e-c30553f-2b1821db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.035975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.035977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.035978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.035983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.035990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.035999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.036116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.036121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.036128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.036197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3254 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea763a33-7b27d03e-c30553f-2b1821db_0
2025-10-02T09:36:34.036438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe3f971-75bd336d-157b1526-3089d1ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea763a33-7b27d03e-c30553f-2b1821db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.038960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Write session: try to update token
2025-10-02T09:36:34.038973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.045128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.045140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.045141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.045142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.045147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.045150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.045151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904807822:2796]
2025-10-02T09:36:34.045171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.045177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.045177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.045179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.045180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.045182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.045313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.050613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId: src_id|ea763a33-7b27d03e-c30553f-2b1821db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.052869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.118712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980392848:5886]
2025-10-02T09:36:34.118954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3253, pipe: [1:7556555986980392848:5886]
2025-10-02T09:36:34.156265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.156514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.156523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.156535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392848:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.156717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.156727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980392848:5886]
2025-10-02T09:36:34.156730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.156756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.156811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3254 reason: error at write: Disconnected sessionId: src_id|ea763a33-7b27d03e-c30553f-2b1821db_0
2025-10-02T09:36:34.156847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.156954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3254 sessionId: src_id|ea763a33-7b27d03e-c30553f-2b1821db_0 is DEAD
2025-10-02T09:36:34.157085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.157093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Write session will restart in 0.007467s
2025-10-02T09:36:34.157113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Write session: Do CDS request
2025-10-02T09:36:34.157117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.162216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.163405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.163511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.163519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.163524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.163552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.163575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904807925:2798]
2025-10-02T09:36:34.163920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.164084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.164107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.164282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.164311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.164315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.164315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.164316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.164318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.164319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.164319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.164320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.164321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.164322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.164322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.164323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.164325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.164332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.164334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.164336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.164338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.164340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.164342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.164344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.164346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.164348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.164350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.164352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.164355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.164359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.164363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.164365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.164367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.164370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.164372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.164375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.164381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.164384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.164386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.164389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.164391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.164394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.164396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.164398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.164401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.164404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.164407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.164411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.164413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.164415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.164417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.164420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.164436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.165152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.165255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.165272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3255
2025-10-02T09:36:34.165395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.165423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.165432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.165436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.165948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3255 sessionId:  describe result for acl check
2025-10-02T09:36:34.165974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.165978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.165979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.165982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.166368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.167838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.171281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.171291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.171293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980392912:7005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.171298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.171844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.173387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.173399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.173400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.173402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.173405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3254 [2:7556555986904807925:2798]
2025-10-02T09:36:34.173412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.173423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.173424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.173427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.173430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.173439Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.173445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.173451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.173481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.173485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.173486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.173488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.173489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.173527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.173531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.173538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.173543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.173553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.173566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392947:7005], now have 1 active actors on pipe
2025-10-02T09:36:34.173572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392850:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.173576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.173577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.173578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.173585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.173595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.173585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3254
2025-10-02T09:36:34.173601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.173604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.173605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.173611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.173613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.173620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.173623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.173602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3254
2025-10-02T09:36:34.173624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.173632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.173637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.173661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f89f4846-9705009-5028beb8-3874b8a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.173668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.173671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.173672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.173677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.173685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.173694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.173809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.173814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.173821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.173887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3255 partition: 0 MaxSeqNo: 36 sessionId: src_id|f89f4846-9705009-5028beb8-3874b8a9_0
2025-10-02T09:36:34.174135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea763a33-7b27d03e-c30553f-2b1821db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f89f4846-9705009-5028beb8-3874b8a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.176840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Write session: try to update token
2025-10-02T09:36:34.176850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.182958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.182971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.182972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.182973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.182978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.182980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.182983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904807920:2798]
2025-10-02T09:36:34.183005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.183008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.183009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.183012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.183019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.183022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.183248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.188959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId: src_id|f89f4846-9705009-5028beb8-3874b8a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.191292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.256962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980392954:5886]
2025-10-02T09:36:34.257191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3254, pipe: [1:7556555986980392954:5886]
2025-10-02T09:36:34.293679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.293975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.293990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.294003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392954:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.294178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980392954:5886]
2025-10-02T09:36:34.294193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.294202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.294204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.294249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3255 reason: error at write: Disconnected sessionId: src_id|f89f4846-9705009-5028beb8-3874b8a9_0
2025-10-02T09:36:34.294386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3255 sessionId: src_id|f89f4846-9705009-5028beb8-3874b8a9_0 is DEAD
2025-10-02T09:36:34.294477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.294530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.294541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Write session will restart in 0.006028s
2025-10-02T09:36:34.294561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Write session: Do CDS request
2025-10-02T09:36:34.294567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.300145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.301118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.301230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.301244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3256
2025-10-02T09:36:34.301289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.301375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.301387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.301394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.301399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.301401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.301411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.301415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.301425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.301448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808033:2790]
2025-10-02T09:36:34.301721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3256 sessionId:  describe result for acl check
2025-10-02T09:36:34.301746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.301750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.301752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.301754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.301788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.301959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.301980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.302089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.302154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.302184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.302188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.302189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.302190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.302190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.302191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.302191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.302192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.302192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.302193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.302193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.302194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.302197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.302203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.302205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.302207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.302209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.302211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.302213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.302215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.302217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.302219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.302222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.302224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.302229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.302233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.302236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.302239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.302241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.302244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.302245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.302248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.302254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.302256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.302258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.302261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.302263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.302266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.302268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.302271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.302273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.302278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.302283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.302286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.302288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.302291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.302292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.302295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.302311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.303518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.307500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.307508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.307509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980393015:7007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.307513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.309724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.311130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.311141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.311143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.311149Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3255 [2:7556555986904808033:2790]
2025-10-02T09:36:34.311157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.311167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.311172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.311173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.311174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.311182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.311185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.311190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.311221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.311226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.311227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.311229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.311230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.311265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.311270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.311277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.311282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.311290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.311302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.311307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.311309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.311314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.311320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.311321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.311322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.311324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980392955:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.311326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393053:7007], now have 1 active actors on pipe
2025-10-02T09:36:34.311331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.311339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.311344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.311336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3255
2025-10-02T09:36:34.311353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3255
2025-10-02T09:36:34.311360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.311364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.311366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.311373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.311378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.311403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.311410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.311412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.311413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.311418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.311426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.311435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.311554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.311567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.311582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.311640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3256 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0
2025-10-02T09:36:34.311845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f89f4846-9705009-5028beb8-3874b8a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.314594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Write session: try to update token
2025-10-02T09:36:34.314607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.320690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.320706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.320708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.320710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.320715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.320718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.320720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808028:2790]
2025-10-02T09:36:34.320746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.320751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.320752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.320752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.320755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.320756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.320880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.326574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId: src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.328718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.394173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980393075:5886]
2025-10-02T09:36:34.394374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3255, pipe: [1:7556555986980393075:5886]
2025-10-02T09:36:34.435023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.435266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.435276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.435289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393075:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.435440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.435470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.435481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.435490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980393075:5886]
2025-10-02T09:36:34.435514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.435527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3256 reason: error at write: Disconnected sessionId: src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0
2025-10-02T09:36:34.435671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3256 sessionId: src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0 is DEAD
2025-10-02T09:36:34.435794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.435803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Write session will restart in 0.007577s
2025-10-02T09:36:34.435822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Write session: Do CDS request
2025-10-02T09:36:34.435826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.441111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.442137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.442234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.442241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.442246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.442270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.442292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808134:2814]
2025-10-02T09:36:34.442634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.442783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.442805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.442985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.443013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.443018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.443018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.443019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.443019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.443020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.443020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.443021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.443021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.443022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.443022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.443023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.443026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.443032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.443034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.443036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.443039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.443041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.443043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.443045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.443047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.443050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.443052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.443054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.443058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.443062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.443065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.443068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.443070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.443073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.443075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.443077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.443080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.443085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.443087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.443089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.443092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.443094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.443096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.443099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.443101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.443103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.443105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.443107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.443109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.443112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.443115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.443117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.443133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.444136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.444218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.444232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3257
2025-10-02T09:36:34.444384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.444411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.444421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.444425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.444794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3257 sessionId:  describe result for acl check
2025-10-02T09:36:34.444845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.444854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.444857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.444862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.445345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.446853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.449924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.449933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.449935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980393140:7040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.449939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.450477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.452002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.452014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.452017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.452019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.452023Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3256 [2:7556555986904808134:2814]
2025-10-02T09:36:34.452030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.452040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.452045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.452047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.452048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.452057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.452060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.452064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.452099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.452104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.452105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.452107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.452108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.452145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.452149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.452156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.452161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.452171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.452185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393076:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.452191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393174:7040], now have 1 active actors on pipe
2025-10-02T09:36:34.452195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.452196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.452198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.452207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.452218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.452218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.452220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.452221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.452228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.452230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.452222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3256
2025-10-02T09:36:34.452232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3256
2025-10-02T09:36:34.452248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.452253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.452254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.452263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.452267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.452294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.452301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.452303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.452304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.452309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.452317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.452328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.452458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.452464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.452471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.452539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3257 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0
2025-10-02T09:36:34.452814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad90f0a3-a250074b-548cc8c1-643f10cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.455602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Write session: try to update token
2025-10-02T09:36:34.455613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.461450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.461465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.461466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.461469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.461473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.461476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.461478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808129:2814]
2025-10-02T09:36:34.461502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.461506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.461507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.461518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.461532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.461535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.461625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.467262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId: src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.469740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.535494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980393182:5886]
2025-10-02T09:36:34.535773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3256, pipe: [1:7556555986980393182:5886]
2025-10-02T09:36:34.573559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.573803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.573812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.573823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393182:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.574019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980393182:5886]
2025-10-02T09:36:34.574033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.574036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.574104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.574110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.574158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3257 reason: error at write: Disconnected sessionId: src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0
2025-10-02T09:36:34.574292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3257 sessionId: src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0 is DEAD
2025-10-02T09:36:34.574449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.574459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Write session will restart in 0.008626s
2025-10-02T09:36:34.574476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Write session: Do CDS request
2025-10-02T09:36:34.574481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.579988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.581301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.581401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.581408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.581414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.581437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.581461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808232:2804]
2025-10-02T09:36:34.581802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.581969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.582166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.582196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.582200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.582200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.582201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.582202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.582202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.582203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.582203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.582204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.582204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.582205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.582205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.582208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.582215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.582217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.582219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.582221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.582223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.582225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.582227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.582228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.582231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.582232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.582234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.582238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.582242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.582246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.582249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.582251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.582253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.582255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.582258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.582260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.582263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.582265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.582268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.582270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.582273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.582275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.582278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.582280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.582283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.582289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.582292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.582294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.582296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.582298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.582302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.582323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.584130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.584288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.584304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3258
2025-10-02T09:36:34.584422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.584447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.584457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.584461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.584784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3258 sessionId:  describe result for acl check
2025-10-02T09:36:34.584834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.584844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.584846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.584853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.585322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.587165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.589525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.589534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.589536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980393248:7059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.589540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.590003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.591355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.591367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.591368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.591370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.591374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3257 [2:7556555986904808232:2804]
2025-10-02T09:36:34.591381Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.591390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.591395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.591397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.591398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.591407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.591410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.591415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.591445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.591449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.591451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.591453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.591454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.591491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.591496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.591502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.591507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.591517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.591532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393283:7059], now have 1 active actors on pipe
2025-10-02T09:36:34.591537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393183:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.591541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.591542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.591543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.591550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.591561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.591564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.591566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.591567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.591571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.591572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.591569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3257
2025-10-02T09:36:34.591576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3257
2025-10-02T09:36:34.591587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.591591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.591593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.591601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.591606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.591671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2382f1ea-dec34743-56a9f46-662ed251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.591679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.591681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.591682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.591687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.591692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.591707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.591829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.591836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.591847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.591916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3258 partition: 0 MaxSeqNo: 36 sessionId: src_id|2382f1ea-dec34743-56a9f46-662ed251_0
2025-10-02T09:36:34.592161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2e42e-dd9a6193-d4c9161d-3b7a6004_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2382f1ea-dec34743-56a9f46-662ed251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.594927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Write session: try to update token
2025-10-02T09:36:34.594939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.601311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.601328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.601329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.601331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.601336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.601339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.601341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808227:2804]
2025-10-02T09:36:34.601364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.601368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.601367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.601370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.601371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.601372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.601505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.606638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId: src_id|2382f1ea-dec34743-56a9f46-662ed251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.609072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.674224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980393291:5886]
2025-10-02T09:36:34.674448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3257, pipe: [1:7556555986980393291:5886]
2025-10-02T09:36:34.713788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.714084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.714093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.714107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393291:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.714277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.714273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980393291:5886]
2025-10-02T09:36:34.714284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.714289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.714299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.714338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3258 reason: error at write: Disconnected sessionId: src_id|2382f1ea-dec34743-56a9f46-662ed251_0
2025-10-02T09:36:34.714483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3258 sessionId: src_id|2382f1ea-dec34743-56a9f46-662ed251_0 is DEAD
2025-10-02T09:36:34.714634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.714644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Write session will restart in 0.009840s
2025-10-02T09:36:34.714660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Write session: Do CDS request
2025-10-02T09:36:34.714665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.720202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.721377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.721486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.721493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.721499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.721526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.721550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808332:2812]
2025-10-02T09:36:34.721899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.722061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.722083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.722260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.722290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.722294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.722296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.722296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.722297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.722297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.722300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.722302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.722310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.722312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.722314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.722316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.722318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.722320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.722322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.722324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.722327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.722329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.722331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.722335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.722339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.722343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.722346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.722348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.722351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.722353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.722356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.722358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.722361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.722363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.722366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.722369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.722371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.722376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.722379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.722381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.722383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.722386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.722388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.722392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.722394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.722396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.722414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.725154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.725244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.725256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3259
2025-10-02T09:36:34.725396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.725424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.725433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.725437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.725759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3259 sessionId:  describe result for acl check
2025-10-02T09:36:34.725786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.725787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.725788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.725791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.726143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.727996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.729863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.729899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.729909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.729911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980393358:7072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.729915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.731347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.731361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.731362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.731364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.731368Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3258 [2:7556555986904808332:2812]
2025-10-02T09:36:34.731375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.731386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.731387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.731391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.731393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.731402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.731405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.731409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.731445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.731449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.731450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.731452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.731453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.731490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.731495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.731502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.731507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.731515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.731530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393292:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.731534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393393:7072], now have 1 active actors on pipe
2025-10-02T09:36:34.731537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.731538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.731539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.731547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.731557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.731561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.731563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.731564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.731569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.731570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.731588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.731596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.731596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.731570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3258
2025-10-02T09:36:34.731577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3258
2025-10-02T09:36:34.731619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.731626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.731645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c41a086-21136d3f-81849ba-1a80214d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.731653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.731655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.731656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.731661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.731669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.731681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.731784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.731788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.731796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.731861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3259 partition: 0 MaxSeqNo: 36 sessionId: src_id|c41a086-21136d3f-81849ba-1a80214d_0
2025-10-02T09:36:34.732140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2382f1ea-dec34743-56a9f46-662ed251_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c41a086-21136d3f-81849ba-1a80214d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.734878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Write session: try to update token
2025-10-02T09:36:34.734891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.741056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.741069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.741070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.741071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.741075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.741078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.741081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808327:2812]
2025-10-02T09:36:34.741104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.741109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.741109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.741110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.741112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.741114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.741223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.746735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId: src_id|c41a086-21136d3f-81849ba-1a80214d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.749208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.814497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980393401:5886]
2025-10-02T09:36:34.814678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3258, pipe: [1:7556555986980393401:5886]
2025-10-02T09:36:34.852621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.852892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.852901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.852914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393401:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.853087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.853114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980393401:5886]
2025-10-02T09:36:34.853137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.853146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:34.853151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:34.853231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3259 reason: error at write: Disconnected sessionId: src_id|c41a086-21136d3f-81849ba-1a80214d_0
2025-10-02T09:36:34.853402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3259 sessionId: src_id|c41a086-21136d3f-81849ba-1a80214d_0 is DEAD
2025-10-02T09:36:34.853544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:34.853556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Write session will restart in 0.009869s
2025-10-02T09:36:34.853581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Write session: Do CDS request
2025-10-02T09:36:34.853586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.859353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.860514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.860634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.860641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.860647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:34.860679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:34.860702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808432:2822]
2025-10-02T09:36:34.861060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:34.861226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:34.861248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:34.861422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:34.861448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.861452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.861452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.861453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.861454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.861454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.861455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.861456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.861456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.861458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.861458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.861459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.861462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.861468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.861470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.861472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.861474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.861476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.861478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.861480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.861482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.861484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.861486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.861488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.861491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.861495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:34.861498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.861501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:34.861505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.861508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:34.861511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.861514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:34.861516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.861518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:34.861520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.861523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:34.861525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.861529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:34.861531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.861534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:34.861537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.861540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:34.861542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.861546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.861548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.861550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.861552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.861555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.861570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:34.864222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.864281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:34.864296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3260
2025-10-02T09:36:34.864438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:34.864463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:34.864472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:34.864476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:34.864795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3260 sessionId:  describe result for acl check
2025-10-02T09:36:34.864836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:34.864840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:34.864841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:34.864843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:34.865201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:34.866758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:34.868700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:34.868708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:34.868710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555986980393470:7089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:34.868715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:34.869009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:34.870390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:34.870400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:34.870401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:34.870403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:34.870406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3259 [2:7556555986904808432:2822]
2025-10-02T09:36:34.870413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:34.870422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:34.870424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.870425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.870426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.870436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:34.870442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:34.870446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:34.870477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.870483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.870484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.870485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:34.870487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:34.870523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:34.870527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.870534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:34.870539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:34.870548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:34.870563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393402:2446], now have 1 active actors on pipe
2025-10-02T09:36:34.870569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393504:7089], now have 1 active actors on pipe
2025-10-02T09:36:34.870572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.870574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.870576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.870584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:34.870596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:34.870596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:34.870598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:34.870599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:34.870611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:34.870615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:34.870602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3259
2025-10-02T09:36:34.870619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3259
2025-10-02T09:36:34.870633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.870638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:34.870639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:34.870650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.870655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.870706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:34.870714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:34.870716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:34.870717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:34.870721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:34.870727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:34.870737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.870839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.870844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.870852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:34.870926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3260 partition: 0 MaxSeqNo: 36 sessionId: src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0
2025-10-02T09:36:34.871164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41a086-21136d3f-81849ba-1a80214d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:34.873949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Write session: try to update token
2025-10-02T09:36:34.873960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:34.879939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:34.879951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:34.879954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:34.879955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:34.879961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.879963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.879965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808427:2822]
2025-10-02T09:36:34.879985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:34.879987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:34.879990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:34.879991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:34.879993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:34.879993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:34.880112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:34.885166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId: src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:34.887520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:34.953252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555986980393529:5886]
2025-10-02T09:36:34.953467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3259, pipe: [1:7556555986980393529:5886]
2025-10-02T09:36:34.992333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:34.992589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:34.992597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:34.992609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393529:5886], now have 1 active actors on pipe
2025-10-02T09:36:34.992738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:34.992765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555986980393529:5886]
2025-10-02T09:36:34.992768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:34.992789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:34.992848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3260 reason: status is not ok: tablet will be restarted right now sessionId: src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0
2025-10-02T09:36:34.992992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3260 sessionId: src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0 is DEAD
2025-10-02T09:36:34.993100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:34.993108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Write session will restart in 0.009868s
2025-10-02T09:36:34.993123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Write session: Do CDS request
2025-10-02T09:36:34.993129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:34.998773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:34.999859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:34.999972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:34.999979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:34.999984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.000011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.000034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555986904808570:2842]
2025-10-02T09:36:35.000375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.000541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.000562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.000735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.000764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.000768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.000768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.000769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.000770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.000770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.000771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.000771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.000772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.000772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.000773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.000773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.000776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.000782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.000784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.000786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.000788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.000790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.000792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.000794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.000796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.000798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.000816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.000817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.000821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.000825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.000828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.000831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.000833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.000836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.000838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.000844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.000846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.000850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.000852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.000855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.000857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.000859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.000866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.000868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.000870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.000873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.000875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.000880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.000882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.000885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.000886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.000889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.000905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.004177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.004284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.004299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3261
2025-10-02T09:36:35.004451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.004476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.004486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.004489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.004752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3261 sessionId:  describe result for acl check
2025-10-02T09:36:35.004774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.004778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.004779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.004782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.005113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.006764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.008557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.008913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.008921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.008924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275360908:7128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.008927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.010028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.010039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.010041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.010043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.010046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3260 [2:7556555986904808570:2842]
2025-10-02T09:36:35.010052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.010062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.010063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.010065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.010066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.010075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.010077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.010081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.010118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.010123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.010124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.010126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.010127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.010166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.010171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.010178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.010183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.010191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.010205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555986980393540:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.010210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275360941:7128], now have 1 active actors on pipe
2025-10-02T09:36:35.010214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.010215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.010216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.010224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.010234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.010237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.010238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.010240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.010242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.010244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.010238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3260
2025-10-02T09:36:35.010242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3260
2025-10-02T09:36:35.010258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.010263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.010265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.010276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.010281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.010345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.010352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.010355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.010356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.010362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.010368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.010384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.010516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.010522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.010530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.010593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3261 partition: 0 MaxSeqNo: 36 sessionId: src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0
2025-10-02T09:36:35.010830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945fe14f-6fd4e199-75d7bc3-7f49155c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.013349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Write session: try to update token
2025-10-02T09:36:35.013363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.019608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.019619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.019620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.019621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.019625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.019627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.019629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555986904808565:2842]
2025-10-02T09:36:35.019648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.019652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.019652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.019653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.019656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.019658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.019761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.026009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId: src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.028473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.093060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275360949:5886]
2025-10-02T09:36:35.093278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3260, pipe: [1:7556555991275360949:5886]
2025-10-02T09:36:35.130889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.131164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.131173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.131186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275360949:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.131307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.131376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.131430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.131516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0
2025-10-02T09:36:35.131655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275360949:5886]
2025-10-02T09:36:35.131661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3261 sessionId: src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0 is DEAD
2025-10-02T09:36:35.131799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:35.131812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Write session will restart in 0.008232s
2025-10-02T09:36:35.131831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Write session: Do CDS request
2025-10-02T09:36:35.131836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.137534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.138764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.138878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.138886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.138893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.138933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.138958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199775971:2858]
2025-10-02T09:36:35.139302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.139478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.139501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.139680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.139708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.139711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.139712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.139713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.139713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.139714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.139714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.139715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.139715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.139716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.139716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.139717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.139719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.139726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.139728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.139730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.139732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.139734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.139736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.139738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.139740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.139742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.139744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.139746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.139750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.139754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.139757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.139760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.139762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.139764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.139766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.139772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.139774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.139776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.139779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.139781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.139784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.139786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.139789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.139791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.139794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.139797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.139800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.139802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.139806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.139808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.139814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.139832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.141193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.141304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.141320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3262
2025-10-02T09:36:35.141437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.141464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.141476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.141479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.141804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3262 sessionId:  describe result for acl check
2025-10-02T09:36:35.141832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.141837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.141838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.141841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.142186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.143738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.146624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.146632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.146634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361020:7146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.146638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.147162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.148655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.148666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.148668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.148670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.148674Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3261 [2:7556555991199775971:2858]
2025-10-02T09:36:35.148680Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.148690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.148695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.148697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.148698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.148706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.148708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.148714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.148743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.148748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.148749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.148750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.148752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.148784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.148789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.148795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.148828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.148840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.148850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361055:7146], now have 1 active actors on pipe
2025-10-02T09:36:35.148856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275360950:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.148860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.148862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.148863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.148872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.148886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.148887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.148890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.148891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.148865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3261
2025-10-02T09:36:35.148902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.148884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3261
2025-10-02T09:36:35.148906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.148937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.148943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.148950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.148958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.148968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.148975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8984da73-94487406-8e34f1df-4d23e251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.148978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.148980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.148981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.148986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.148995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.149009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.149117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.149121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.149131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.149201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3262 partition: 0 MaxSeqNo: 36 sessionId: src_id|8984da73-94487406-8e34f1df-4d23e251_0
2025-10-02T09:36:35.149431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18819c5e-d1dff22c-58f46b03-b9de26de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8984da73-94487406-8e34f1df-4d23e251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.152257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Write session: try to update token
2025-10-02T09:36:35.152268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.158101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.158112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.158114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.158114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.158118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.158121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.158123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199775965:2858]
2025-10-02T09:36:35.158144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.158146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.158149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.158149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.158150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.158152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.158289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.163726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId: src_id|8984da73-94487406-8e34f1df-4d23e251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.166137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.231801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361062:5886]
2025-10-02T09:36:35.231992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3261, pipe: [1:7556555991275361062:5886]
2025-10-02T09:36:35.267233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.267469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.267479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.267491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361062:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.267662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.267720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361062:5886]
2025-10-02T09:36:35.267752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.267776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.267832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8984da73-94487406-8e34f1df-4d23e251_0
2025-10-02T09:36:35.267970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3262 sessionId: src_id|8984da73-94487406-8e34f1df-4d23e251_0 is DEAD
2025-10-02T09:36:35.268123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:35.268131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Write session will restart in 0.006483s
2025-10-02T09:36:35.268151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Write session: Do CDS request
2025-10-02T09:36:35.268155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.273887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.275094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.275202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.275203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.275210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.275216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.275244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.275269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776086:2873]
2025-10-02T09:36:35.275274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.275289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3263
2025-10-02T09:36:35.275420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.275446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.275455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.275458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.275661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.275832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.275830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3263 sessionId:  describe result for acl check
2025-10-02T09:36:35.275863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.275860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.275867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.275869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.275873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.276067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.276103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.276107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.276108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.276108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.276109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.276109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.276110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.276110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.276111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.276112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.276112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.276113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.276115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.276122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.276124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.276126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.276128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.276130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.276132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.276134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.276136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.276138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.276140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.276142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.276146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.276150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.276154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.276157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.276159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.276161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.276163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.276166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.276169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.276171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.276175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.276180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.276184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.276189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.276192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.276199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.276203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.276211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.276214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.276217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.276220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.276224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.276227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.276245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.276314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.277962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.282475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.282487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.282489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361131:7166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.282494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.283620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.285021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.285033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.285034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.285037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.285040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3262 [2:7556555991199776086:2873]
2025-10-02T09:36:35.285095Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.285108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.285110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.285111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.285112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.285121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.285127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.285131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.285164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.285168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.285169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.285171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.285172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.285208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.285213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.285220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.285225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.285235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.285248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361168:7166], now have 1 active actors on pipe
2025-10-02T09:36:35.285253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361063:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.285257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.285258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.285259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.285266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.285276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.285278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.285280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.285281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.285288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.285291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.285281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3262
2025-10-02T09:36:35.285309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.285296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3262
2025-10-02T09:36:35.285315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.285316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.285327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.285334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.285360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a1aa27-88984946-5d3cafd-e14b653_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.285367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.285370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.285371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.285377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.285385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.285397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.285506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.285512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.285520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.285589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3263 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a1aa27-88984946-5d3cafd-e14b653_0
2025-10-02T09:36:35.285855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8984da73-94487406-8e34f1df-4d23e251_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a1aa27-88984946-5d3cafd-e14b653_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.288559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Write session: try to update token
2025-10-02T09:36:35.288570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.294687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.294700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.294701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.294703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.294708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.294710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.294713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776081:2873]
2025-10-02T09:36:35.294736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.294739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.294740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.294741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.294744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.294747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.294862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.301099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId: src_id|7a1aa27-88984946-5d3cafd-e14b653_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.303365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.354637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:36:35.354660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-02T09:36:35.367972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361220:5886]
2025-10-02T09:36:35.368144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3262, pipe: [1:7556555991275361220:5886]
2025-10-02T09:36:35.404279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.404585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.404594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.404619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361220:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.404734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.404769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361220:5886]
2025-10-02T09:36:35.404789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.404814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.404823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-02T09:36:35.404908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a1aa27-88984946-5d3cafd-e14b653_0
2025-10-02T09:36:35.405065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3263 sessionId: src_id|7a1aa27-88984946-5d3cafd-e14b653_0 is DEAD
2025-10-02T09:36:35.405184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:35.405190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Write session will restart in 0.009970s
2025-10-02T09:36:35.405206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Write session: Do CDS request
2025-10-02T09:36:35.405209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.410986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.412166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.412281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.412288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.412295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.412323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.412347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776194:2881]
2025-10-02T09:36:35.412689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.412864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.412886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.413066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.413094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.413098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.413099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.413099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.413100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.413101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.413101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.413102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.413102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.413103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.413103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.413104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.413106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.413113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.413115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.413117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.413119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.413121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.413123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.413125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.413127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.413129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.413131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.413133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.413137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.413141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.413144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.413147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.413149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.413152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.413154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.413157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.413159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.413162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.413168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.413170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.413173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.413175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.413177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.413180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.413183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.413187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.413190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.413193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.413195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.413198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.413200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.413206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.413223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.416162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.416294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.416311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3264
2025-10-02T09:36:35.416440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.416466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.416476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.416479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.416856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3264 sessionId:  describe result for acl check
2025-10-02T09:36:35.416894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.416902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.416904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.416911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.417416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.419248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.420612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.421098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.421106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.421108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361293:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.421112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.422064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.422075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.422076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.422080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.422084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3263 [2:7556555991199776194:2881]
2025-10-02T09:36:35.422141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.422154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.422155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.422157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.422157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.422166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.422170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.422174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.422206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.422211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.422212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.422214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.422215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.422251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.422255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.422262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.422267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.422275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.422286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361221:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.422291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361327:7186], now have 1 active actors on pipe
2025-10-02T09:36:35.422295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.422298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.422299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.422307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.422314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.422320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.422322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.422323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.422323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.422324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.422330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3263
2025-10-02T09:36:35.422339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.422342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.422344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3263
2025-10-02T09:36:35.422368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.422374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.422381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.422387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.422392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.422394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.422395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.422402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.422407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.422428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.422469Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:36:35.422550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.422555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.422562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.422602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 23 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:36:35.422619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3264 partition: 0 MaxSeqNo: 36 sessionId: src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0
2025-10-02T09:36:35.422647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:36:35.422775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1aa27-88984946-5d3cafd-e14b653_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.425543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Write session: try to update token
2025-10-02T09:36:35.425554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.435378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:35.435391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.435396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.435421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:35.435441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:35.435557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:35.435673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.435822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.435964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.436164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:35.436190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:35.436743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId: src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.439243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.440392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.440404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.440414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.440420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.440421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.440422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.440426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.440428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.440430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776189:2881]
2025-10-02T09:36:35.440453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.440455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.440458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.440460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.440461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.440461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.440570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.504685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361337:5886]
2025-10-02T09:36:35.504900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3263, pipe: [1:7556555991275361337:5886]
2025-10-02T09:36:35.550000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.550232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:35.550253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361337:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.550336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.550419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.550459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361337:5886]
2025-10-02T09:36:35.556627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.557769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.557888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.557895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.557901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.557929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.557962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776301:2888]
2025-10-02T09:36:35.558319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.558490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.558514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.558700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.558731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.558735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.558736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.558737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.558737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.558738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.558738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.558739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.558739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.558740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.558740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.558741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.558743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.558751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.558753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.558755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.558757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.558759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.558761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.558763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.558765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.558767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.558769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.558771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.558775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.558780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.558783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.558786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.558788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.558791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.558793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.558796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.558798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.558801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.558803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.558806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.558808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.558810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.558816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.558819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.558821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.558825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.558828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.558831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.558833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.558836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.558839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.558841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.558859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.565453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:35.565468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:35.565491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3264 reason: error at write: Disconnected sessionId: src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0
2025-10-02T09:36:35.565620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3264 sessionId: src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0 is DEAD
2025-10-02T09:36:35.565729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:35.565741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Write session will restart in 0.009991s
2025-10-02T09:36:35.565759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Write session: Do CDS request
2025-10-02T09:36:35.565764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.569777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.571260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.571271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.571272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.571274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.571277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3264 [2:7556555991199776301:2888]
2025-10-02T09:36:35.571287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.571296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.571298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.571299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.571300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.571309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.571311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.571319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.571349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.571354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.571355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.571357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.571359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.571397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.571401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.571407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.571413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.571427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.571447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361342:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.571456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.571461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.571462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.571488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.571500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.571501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.571504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.571505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.571510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.571512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.571526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.571531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.571542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.571527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3264
2025-10-02T09:36:35.577183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.577277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.577286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3265
2025-10-02T09:36:35.577412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.577440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.577449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.577453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.577860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3265 sessionId:  describe result for acl check
2025-10-02T09:36:35.577893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.577899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.577901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.577906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.578724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.580522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:35.580537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.580542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.580565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:35.580568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:35.580700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:35.580830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.580942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.581058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:35.581059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.581258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:35.581283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:35.586149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.586159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.586161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361419:7217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.586166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.586309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361455:7217], now have 1 active actors on pipe
2025-10-02T09:36:35.586388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3264
2025-10-02T09:36:35.586431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.586437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.586454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.586463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.586465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.586467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.586474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.586485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.586496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.586616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.586620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.586627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.586686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3265 partition: 0 MaxSeqNo: 36 sessionId: src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0
2025-10-02T09:36:35.586934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f9c007-2fa14834-44d3792d-1fe7651a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.588874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.588882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.588883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.588884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.588888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.588892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.588894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776296:2888]
2025-10-02T09:36:35.588912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.588916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.588919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.588919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.588920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.588921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.589029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.589437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Write session: try to update token
2025-10-02T09:36:35.589450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.601067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId: src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.603320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.650619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361456:5886]
2025-10-02T09:36:35.650805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3264, pipe: [1:7556555991275361456:5886]
2025-10-02T09:36:35.699425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.699787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.699800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.699815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361456:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.700032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:35.700033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361456:5886]
2025-10-02T09:36:35.700048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:35.700063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.700081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.700128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3265 reason: error at write: Disconnected sessionId: src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0
2025-10-02T09:36:35.700289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3265 sessionId: src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0 is DEAD
2025-10-02T09:36:35.700412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:35.700425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Write session will restart in 0.008105s
2025-10-02T09:36:35.700445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Write session: Do CDS request
2025-10-02T09:36:35.700451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.706322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.707459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.707558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.707564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.707570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.707596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.707621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776407:2896]
2025-10-02T09:36:35.707974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.708139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.708161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.708344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.708372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.708376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.708377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.708377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.708379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.708379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.708380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.708381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.708381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.708382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.708384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.708392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.708394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.708396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.708398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.708400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.708402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.708404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.708406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.708411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.708413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.708417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.708421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.708424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.708427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.708430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.708432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.708435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.708437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.708442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.708447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.708449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.708452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.708454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.708456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.708459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.708467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.708470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.708472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.708476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.708479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.708482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.708484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.708486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.708504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.709169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.709319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.709330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3266
2025-10-02T09:36:35.709448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.709473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.709482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.709485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.709791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3266 sessionId:  describe result for acl check
2025-10-02T09:36:35.709819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.709824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.709825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.709829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.710179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.712022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.715572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.715582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.715584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361531:7230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.715588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.716131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.717603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.717614Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.717615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.717619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.717622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3265 [2:7556555991199776407:2896]
2025-10-02T09:36:35.717630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.717639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.717640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.717642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.717643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.717651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.717656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.717660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.717690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.717695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.717696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.717698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.717699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.717742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.717747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.717753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.717759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.717767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.717782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361458:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.717788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361565:7230], now have 1 active actors on pipe
2025-10-02T09:36:35.717792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.717795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.717796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.717802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3265
2025-10-02T09:36:35.717807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.717817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.717823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.717824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.717825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.717826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.717828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.717819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3265
2025-10-02T09:36:35.717847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.717853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.717860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.717868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.717884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.717886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10588d68-baa26e4a-c6944a95-48756c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.717890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.717892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.717893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.717898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.717903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.717914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.718042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.718046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.718054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.718123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3266 partition: 0 MaxSeqNo: 36 sessionId: src_id|10588d68-baa26e4a-c6944a95-48756c9c_0
2025-10-02T09:36:35.718440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c92b2e-5d080243-9b54ef87-d637c2bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10588d68-baa26e4a-c6944a95-48756c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.721283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Write session: try to update token
2025-10-02T09:36:35.721297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.727940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.727956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.727957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.727958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.727963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.727966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.727969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776402:2896]
2025-10-02T09:36:35.727994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.727997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.727998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.728004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.728007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.728011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.728114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.733441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId: src_id|10588d68-baa26e4a-c6944a95-48756c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.735953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.800105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361573:5886]
2025-10-02T09:36:35.800314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3265, pipe: [1:7556555991275361573:5886]
2025-10-02T09:36:35.843692Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.843981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.843995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.844026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361573:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.844191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.844243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361573:5886]
2025-10-02T09:36:35.844267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.844269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.844361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10588d68-baa26e4a-c6944a95-48756c9c_0
2025-10-02T09:36:35.844536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3266 sessionId: src_id|10588d68-baa26e4a-c6944a95-48756c9c_0 is DEAD
2025-10-02T09:36:35.844674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:35.844685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Write session will restart in 0.006824s
2025-10-02T09:36:35.844699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Write session: Do CDS request
2025-10-02T09:36:35.844703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.850609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.851724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.851847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.851855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.851861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.851891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.851917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776515:2905]
2025-10-02T09:36:35.852168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.852288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.852275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.852289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3267
2025-10-02T09:36:35.852398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.852424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.852434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.852438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.852469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.852497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.852696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.852725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.852730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.852730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.852731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.852731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.852733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.852733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.852742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3267 sessionId:  describe result for acl check
2025-10-02T09:36:35.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.852735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.852738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.852744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.852746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.852748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.852750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.852770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.852775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.852752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.852755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.852758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.852775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.852764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.852778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.852768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.852779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.852783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.852788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.852792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.852796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.852798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.852814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.852817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.852819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.852822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.852826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.852829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.852831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.852834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.852836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.852839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.852841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.852843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.852846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.852849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.852852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.852854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.852856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.852859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.852861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.852864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.852885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.853184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.854882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.859766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.859776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.859777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361647:7245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.859782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.860302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:35.861980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:35.861993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:35.861995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:35.861998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:35.862002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3266 [2:7556555991199776515:2905]
2025-10-02T09:36:35.862010Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:35.862019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:35.862024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.862026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.862027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.862035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:35.862039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:35.862043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:35.862074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.862079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.862081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.862083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:35.862084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:35.862128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:35.862133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.862141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.862147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.862159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:35.862173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361574:2446], now have 1 active actors on pipe
2025-10-02T09:36:35.862179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361684:7245], now have 1 active actors on pipe
2025-10-02T09:36:35.862183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.862184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.862187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.862195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:35.862205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:35.862207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:35.862209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:35.862205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3266
2025-10-02T09:36:35.862219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3266
2025-10-02T09:36:35.862211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:35.862216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:35.862217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:35.862233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.862237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:35.862238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:35.862249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.862256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.862284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:35.862292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:35.862294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:35.862295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:35.862300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:35.862309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:35.862320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.862433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.862439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.862449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:35.862513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3267 partition: 0 MaxSeqNo: 36 sessionId: src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0
2025-10-02T09:36:35.862730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10588d68-baa26e4a-c6944a95-48756c9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:35.865243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Write session: try to update token
2025-10-02T09:36:35.865260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:35.866083Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:36:35.871450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:35.871462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:35.871464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:35.871466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:35.871471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.871475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.871480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776510:2905]
2025-10-02T09:36:35.871501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:35.871507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.871509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:35.871510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:35.871514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:35.871517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:35.871614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:35.877430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId: src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:35.879817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:35.944478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555991275361696:5886]
2025-10-02T09:36:35.944667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3266, pipe: [1:7556555991275361696:5886]
2025-10-02T09:36:35.983308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:35.983524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:35.983532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:35.983544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361696:5886], now have 1 active actors on pipe
2025-10-02T09:36:35.983665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:35.983666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:35.983714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555991275361696:5886]
2025-10-02T09:36:35.983737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:35.983806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0
2025-10-02T09:36:35.983972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3267 sessionId: src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0 is DEAD
2025-10-02T09:36:35.984118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:35.984130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Write session will restart in 0.009447s
2025-10-02T09:36:35.984154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Write session: Do CDS request
2025-10-02T09:36:35.984159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:35.989823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:35.990910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:35.991015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:35.991021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:35.991026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:35.991051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:35.991113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555991199776653:2955]
2025-10-02T09:36:35.991461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:35.991645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:35.991668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:35.991844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:35.991875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.991879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.991880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.991880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.991881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.991882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.991882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.991883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.991883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.991884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.991884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.991885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.991888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.991895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.991897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.991899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.991902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.991904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.991906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.991908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.991909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.991913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.991915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.991916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.991920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.991924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:35.991927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.991930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:35.991932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.991935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:35.991937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.991941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:35.991945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.991948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:35.991950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.991954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:35.991956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.991958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:35.991960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.991963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:35.991965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.991968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:35.991970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.991973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:35.991977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.991980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:35.991982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.991985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:35.992002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:35.994199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.994393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:35.994405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3268
2025-10-02T09:36:35.994503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:35.994524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:35.994530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:35.994533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:35.994783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3268 sessionId:  describe result for acl check
2025-10-02T09:36:35.994802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:35.994806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:35.994807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:35.994810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:35.995162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:35.996613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:35.998936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:35.998947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:35.998950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555991275361785:7289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:35.998955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:35.999421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.000953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.000964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.000965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.000967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.000970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3267 [2:7556555991199776653:2955]
2025-10-02T09:36:36.000977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.000986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.000988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.000989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.000990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.000999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.001006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.001010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.001039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.001043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.001044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.001047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.001049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.001084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.001090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.001097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.001102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.001113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.001127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361710:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.001133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555991275361819:7289], now have 1 active actors on pipe
2025-10-02T09:36:36.001136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.001138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.001140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.001148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.001155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.001161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.001163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.001163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.001164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.001165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.001155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3267
2025-10-02T09:36:36.001174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3267
2025-10-02T09:36:36.001177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.001182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.001184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.001198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.001203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.001220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.001227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.001246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.001250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.001256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.001263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.001274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.001375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.001380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.001387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.001428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3268 partition: 0 MaxSeqNo: 36 sessionId: src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0
2025-10-02T09:36:36.001639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf46ea7-97c90ca7-299a6ab6-3c410df9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.004388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Write session: try to update token
2025-10-02T09:36:36.004399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.010547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.010560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.010561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.010562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.010566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.010568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.010570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555991199776648:2955]
2025-10-02T09:36:36.010593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.010596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.010596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.010598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.010599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.010602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.010712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.016470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId: src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.018876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.083772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329136:5886]
2025-10-02T09:36:36.084013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3267, pipe: [1:7556555995570329136:5886]
2025-10-02T09:36:36.123198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.123449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.123462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.123476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329136:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.123639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.123674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.123709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329136:5886]
2025-10-02T09:36:36.123714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:36.123771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0
2025-10-02T09:36:36.123909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3268 sessionId: src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0 is DEAD
2025-10-02T09:36:36.124030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:36.124040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Write session will restart in 0.007509s
2025-10-02T09:36:36.124057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Write session: Do CDS request
2025-10-02T09:36:36.124061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.130415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.131730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.131848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.131854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.131861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.131891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.131915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744067:2958]
2025-10-02T09:36:36.132145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.132275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.132295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.132312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3269
2025-10-02T09:36:36.132461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.132472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.132489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.132499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.132498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.132503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.132691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.132723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.132728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.132728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.132729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.132729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.132730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.132731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.132731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.132733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.132733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.132736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.132743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.132745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.132747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.132749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.132752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.132754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.132755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.132757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.132760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.132762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.132763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.132768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.132772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.132775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.132778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.132780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.132783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.132785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.132788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.132790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.132792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.132794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.132797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.132810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.132815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.132817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.132822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.132829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.132835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.132839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.132845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.132835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3269 sessionId:  describe result for acl check
2025-10-02T09:36:36.132847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.132851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.132853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.132856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.132860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.132864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.132867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.132870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.132872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.133212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.135355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.139785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.139795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.139797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329211:7313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.139800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.140254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.141737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.141748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.141749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.141751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.141755Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3268 [2:7556555995494744067:2958]
2025-10-02T09:36:36.141762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.141773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.141775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.141776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.141777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.141787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.141793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.141797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.141826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.141830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.141831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.141833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.141835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.141870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.141875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.141882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.141887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.141895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.141909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329137:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.141915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329248:7313], now have 1 active actors on pipe
2025-10-02T09:36:36.141919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.141920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.141921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.141930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.141941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.141943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.141945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.141946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.141951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.141953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.141950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3268
2025-10-02T09:36:36.141970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.141974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.141977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.141969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3268
2025-10-02T09:36:36.141986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.141991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.142015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.142021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.142024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.142025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.142030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.142036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.142045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.142160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.142165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.142172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.142240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3269 partition: 0 MaxSeqNo: 36 sessionId: src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0
2025-10-02T09:36:36.142526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1591d07d-1a9a2cc0-548f7103-fb28d342_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.145329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Write session: try to update token
2025-10-02T09:36:36.145341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.151226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.151239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.151241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.151242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.151247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.151253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.151255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744061:2958]
2025-10-02T09:36:36.151277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.151280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.151280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.151281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.151283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.151286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.151400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.156945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId: src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.159438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.224053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329256:5886]
2025-10-02T09:36:36.224225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3268, pipe: [1:7556555995570329256:5886]
2025-10-02T09:36:36.259650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.259914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.259923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.259935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329256:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.260070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.260110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:36.260117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.260123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:36.260160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329256:5886]
2025-10-02T09:36:36.260168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3269 reason: error at write: Disconnected sessionId: src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0
2025-10-02T09:36:36.260307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3269 sessionId: src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0 is DEAD
2025-10-02T09:36:36.260443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:36.260452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Write session will restart in 0.007338s
2025-10-02T09:36:36.260472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Write session: Do CDS request
2025-10-02T09:36:36.260476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.266358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.267640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.267736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.267742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.267747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.267770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.267794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744190:2977]
2025-10-02T09:36:36.268132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.268304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.268326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.268501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.268529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.268533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.268534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.268535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.268535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.268536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.268536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.268537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.268537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.268538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.268538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.268539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.268541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.268550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.268553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.268557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.268559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.268563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.268566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.268569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.268572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.268575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.268578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.268582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.268588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.268595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.268600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.268608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.268612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.268618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.268621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.268630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.268634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.268637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.268639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.268641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.268643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.268646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.268648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.268651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.268655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.268657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.268660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.268662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.268664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.268668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.268673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.268675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.268692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.269107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.269217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.269230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3270
2025-10-02T09:36:36.269366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.269393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.269403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.269407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.269722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3270 sessionId:  describe result for acl check
2025-10-02T09:36:36.269747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.269752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.269753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.269756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.270086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.271647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.275554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.275563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.275565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329334:7330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.275569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.276054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.277464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.277475Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.277476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.277479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.277483Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3269 [2:7556555995494744190:2977]
2025-10-02T09:36:36.277489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.277498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.277504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.277505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.277506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.277515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.277520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.277525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.277555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.277560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.277561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.277563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.277565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.277601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.277606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.277612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.277617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.277626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.277640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329257:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.277646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329372:7330], now have 1 active actors on pipe
2025-10-02T09:36:36.277649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.277650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.277652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.277660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.277670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.277674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.277677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.277678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.277685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.277689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.277668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3269
2025-10-02T09:36:36.277690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3269
2025-10-02T09:36:36.277718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.277725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.277732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.277740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.277749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.277757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f45534f-a4f3abee-686cafda-81f767ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.277761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.277763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.277764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.277769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.277777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.277824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.277934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.277939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.277946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.278014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3270 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f45534f-a4f3abee-686cafda-81f767ef_0
2025-10-02T09:36:36.278276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2591d800-cde9fe83-4f67e646-9d1cc1c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f45534f-a4f3abee-686cafda-81f767ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.281004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Write session: try to update token
2025-10-02T09:36:36.281014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.286914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.286931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.286933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.286934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.286939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.286942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.286946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744185:2977]
2025-10-02T09:36:36.286968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.286973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.286974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.286980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.286985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.286988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.287082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.292820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId: src_id|7f45534f-a4f3abee-686cafda-81f767ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.295261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.360214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329395:5886]
2025-10-02T09:36:36.360571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3269, pipe: [1:7556555995570329395:5886]
2025-10-02T09:36:36.396746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.397007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.397019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.397035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329395:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.397157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.397208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:36.397223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329395:5886]
2025-10-02T09:36:36.397248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.397271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f45534f-a4f3abee-686cafda-81f767ef_0
2025-10-02T09:36:36.397403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3270 sessionId: src_id|7f45534f-a4f3abee-686cafda-81f767ef_0 is DEAD
2025-10-02T09:36:36.397535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:36.397545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Write session will restart in 0.005604s
2025-10-02T09:36:36.397564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Write session: Do CDS request
2025-10-02T09:36:36.397569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.403639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.404115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.404216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.404233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3271
2025-10-02T09:36:36.404364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.404390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.404399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.404402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.404719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3271 sessionId:  describe result for acl check
2025-10-02T09:36:36.404741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.404745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.404746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.404749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.404869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.404974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.404982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.404988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.405016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.405038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744305:3000]
2025-10-02T09:36:36.405096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.405385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.405554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.405577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.405766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.405798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.405802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.405803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.405803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.405804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.405804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.405805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.405805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.405806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.405807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.405807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.405808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.405810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.405816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.405818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.405820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.405822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.405824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.405826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.405828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.405830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.405832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.405834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.405836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.405840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.405843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.405847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.405850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.405853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.405856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.405858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.405861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.405863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.405866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.405868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.405870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.405873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.405875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.405877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.405880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.405882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.405885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.405887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.405889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.405891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.405894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.405896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.405899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.405920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.406807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.411161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.411170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.411173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329470:7359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.411177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.413304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.414745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.414756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.414757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.414759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.414763Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3270 [2:7556555995494744305:3000]
2025-10-02T09:36:36.414770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.414779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.414785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.414786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.414787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.414796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.414800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.414806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.414835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.414841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.414842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.414844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.414845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.414887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.414892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.414898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.414903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.414912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.414936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329509:7359], now have 1 active actors on pipe
2025-10-02T09:36:36.414943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329396:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.414947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.414951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.414952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.414963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.414967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3270
2025-10-02T09:36:36.414975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.414976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.414978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.414981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.414986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.414987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.414985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3270
2025-10-02T09:36:36.415002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.415006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.415008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.415018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.415022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.415046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a26c6200-dad7724f-b13c7f23-63246377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.415053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.415055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.415056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.415061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.415069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.415080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.415185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.415193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.415204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.415280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3271 partition: 0 MaxSeqNo: 36 sessionId: src_id|a26c6200-dad7724f-b13c7f23-63246377_0
2025-10-02T09:36:36.415545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f45534f-a4f3abee-686cafda-81f767ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a26c6200-dad7724f-b13c7f23-63246377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.418278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Write session: try to update token
2025-10-02T09:36:36.418291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.424223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.424236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.424237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.424238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.424243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.424245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.424247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744300:3000]
2025-10-02T09:36:36.424267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.424270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.424272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.424277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.424281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.424283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.424378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.429755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId: src_id|a26c6200-dad7724f-b13c7f23-63246377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.432194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.497466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329517:5886]
2025-10-02T09:36:36.497691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3270, pipe: [1:7556555995570329517:5886]
2025-10-02T09:36:36.533332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.533629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.533640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.533653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329517:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.533929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.533972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:36.533982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:36.533986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.534027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3271 reason: error at write: Disconnected sessionId: src_id|a26c6200-dad7724f-b13c7f23-63246377_0
2025-10-02T09:36:36.534028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329517:5886]
2025-10-02T09:36:36.534116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3271 sessionId: src_id|a26c6200-dad7724f-b13c7f23-63246377_0 is DEAD
2025-10-02T09:36:36.534193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:36.534200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Write session will restart in 0.005287s
2025-10-02T09:36:36.534213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Write session: Do CDS request
2025-10-02T09:36:36.534218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.540114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.540210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.540223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3272
2025-10-02T09:36:36.540302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.540355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.540382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.540393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.540397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.540829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3272 sessionId:  describe result for acl check
2025-10-02T09:36:36.540866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.540873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.540877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.540881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.541314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.541592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.541699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.541706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.541712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.541740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.541765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744417:2998]
2025-10-02T09:36:36.542206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.542407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.542443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.542630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.542661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.542665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.542666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.542666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.542667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.542667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.542668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.542668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.542669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.542670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.542670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.542671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.542673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.542683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.542687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.542690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.542694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.542697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.542701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.542703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.542705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.542707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.542709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.542711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.542715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.542718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.542722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.542724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.542726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.542729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.542731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.542734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.542740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.542743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.542745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.542748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.542750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.542753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.542755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.542757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.542759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.542762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.542765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.542768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.542771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.542775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.542777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.542780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.542795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.543018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.547576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.547588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.547590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329594:7381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.547596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.550196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.551696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.551707Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.551708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.551710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.551713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3271 [2:7556555995494744417:2998]
2025-10-02T09:36:36.551722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.551731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.551733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.551734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.551735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.551744Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.551748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.551753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.551799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.551806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.551808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.551810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.551812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.551849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.551854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.551861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.551866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.551873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.551887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329633:7381], now have 1 active actors on pipe
2025-10-02T09:36:36.551892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329519:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.551897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.551899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.551901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.551911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.551921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.551924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.551929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.551930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.551937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.551939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.551926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3271
2025-10-02T09:36:36.551932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3271
2025-10-02T09:36:36.551956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.551961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.551964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.551974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.551978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.552004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.552010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.552013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.552014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.552020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.552028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.552037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.552151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.552160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.552172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.552251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3272 partition: 0 MaxSeqNo: 36 sessionId: src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0
2025-10-02T09:36:36.552504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26c6200-dad7724f-b13c7f23-63246377_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.555216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Write session: try to update token
2025-10-02T09:36:36.555227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.561463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.561476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.561477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.561479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.561483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.561485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.561487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744412:2998]
2025-10-02T09:36:36.561508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.561511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.561513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.561514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.561517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.561519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.561626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.566821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId: src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.569329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.634173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329643:5886]
2025-10-02T09:36:36.634410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3271, pipe: [1:7556555995570329643:5886]
2025-10-02T09:36:36.673146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.673407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.673417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.673429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329643:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.673575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.673647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.673652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:36.673703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329643:5886]
2025-10-02T09:36:36.673741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0
2025-10-02T09:36:36.673909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3272 sessionId: src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0 is DEAD
2025-10-02T09:36:36.674048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:36.674058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Write session will restart in 0.005259s
2025-10-02T09:36:36.674076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Write session: Do CDS request
2025-10-02T09:36:36.674081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.680116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.680218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.680231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3273
2025-10-02T09:36:36.680363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.680399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.680408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.680412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.680530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.680740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3273 sessionId:  describe result for acl check
2025-10-02T09:36:36.680765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.680772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.680773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.680777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.681281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.682016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.682116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.682122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.682128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.682152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.682174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744531:3002]
2025-10-02T09:36:36.682535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.682703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.682732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.682796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.682914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.682954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.682958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.682959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.682959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.682960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.682960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.682961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.682961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.682962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.682963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.682964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.682965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.682969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.682978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.682982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.682985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.682989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.682992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.682995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.682997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.682999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.683001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.683005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.683007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.683012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.683016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.683021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.683024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.683026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.683031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.683033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.683036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.683038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.683041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.683044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.683048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.683050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.683053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.683055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.683059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.683062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.683064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.683067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.683072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.683078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.683080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.683084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.683102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.687833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.687845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.687848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329720:7393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.687862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.690504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.691963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.691974Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.691975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.691977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.691980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3272 [2:7556555995494744531:3002]
2025-10-02T09:36:36.691987Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.691996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.691998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.692000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.692001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.692008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.692015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.692019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.692050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.692054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.692055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.692057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.692059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.692094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.692099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.692106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.692114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.692122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.692136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329761:7393], now have 1 active actors on pipe
2025-10-02T09:36:36.692141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329644:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.692144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.692145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.692147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.692154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.692164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.692169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.692171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.692173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.692175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.692176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.692192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.692198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.692183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3272
2025-10-02T09:36:36.692186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3272
2025-10-02T09:36:36.692211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.692220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.692224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.692242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.692250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.692253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.692256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.692261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.692266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.692276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.692400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.692407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.692416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.692481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3273 partition: 0 MaxSeqNo: 36 sessionId: src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0
2025-10-02T09:36:36.692723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04058fe-2ef2e251-541a5fb7-b6d493b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.695404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Write session: try to update token
2025-10-02T09:36:36.695415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.701537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.701552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.701553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.701554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.701558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.701560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.701562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744526:3002]
2025-10-02T09:36:36.701584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.701588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.701589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.701592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.701595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.701597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.701754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.707363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId: src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.709826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.773931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329768:5886]
2025-10-02T09:36:36.774171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3272, pipe: [1:7556555995570329768:5886]
2025-10-02T09:36:36.816434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.816692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.816700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.816713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329768:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.816843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.816906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329768:5886]
2025-10-02T09:36:36.816906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:36.816938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.816994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0
2025-10-02T09:36:36.817163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3273 sessionId: src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0 is DEAD
2025-10-02T09:36:36.817276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:36.817290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Write session will restart in 0.007833s
2025-10-02T09:36:36.817309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Write session: Do CDS request
2025-10-02T09:36:36.817314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.823769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.825068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.825174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.825180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.825185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.825210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.825234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744646:2999]
2025-10-02T09:36:36.825609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.825805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.825841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.826028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.826057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.826061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.826062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.826063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.826063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.826064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.826064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.826065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.826065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.826066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.826067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.826067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.826071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.826081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.826085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.826089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.826092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.826096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.826098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.826100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.826102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.826104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.826106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.826108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.826112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.826116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.826119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.826122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.826126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.826129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.826131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.826134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.826136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.826139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.826142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.826146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.826148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.826152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.826155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.826158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.826160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.826163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.826169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.826169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.826172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.826174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.826177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.826180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.826183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.826201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.826281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.826297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3274
2025-10-02T09:36:36.826429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.826467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.826480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.826490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.826853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3274 sessionId:  describe result for acl check
2025-10-02T09:36:36.826886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.826887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.826889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.826893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.827342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.828715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.833078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.833088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.833091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329850:7406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.833097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.833582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.835057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.835071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.835073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.835075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.835079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3273 [2:7556555995494744646:2999]
2025-10-02T09:36:36.835086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.835096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.835101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.835102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.835104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.835112Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.835119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.835124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.835156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.835160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.835161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.835163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.835165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.835261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.835267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.835274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.835280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.835297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.835302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3273
2025-10-02T09:36:36.835316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329885:7406], now have 1 active actors on pipe
2025-10-02T09:36:36.835323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329769:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.835327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.835304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3273
2025-10-02T09:36:36.835328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.835329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.835334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.835342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.835345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.835347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.835349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.835351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.835353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.835366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.835371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.835388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.835396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.835405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.835408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.835411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.835413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.835414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.835419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.835424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.835440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.835571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.835579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.835588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.835672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3274 partition: 0 MaxSeqNo: 36 sessionId: src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0
2025-10-02T09:36:36.835940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d805efc1-124e1bfa-cf54572f-dbd9889e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.838582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Write session: try to update token
2025-10-02T09:36:36.838596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.844275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:36.844286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.844290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.844312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:36.844330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:36.844450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:36.844572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:36.844687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:36.844817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:36.844986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:36.845008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:36.850776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId: src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.852585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.852597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.852598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.852600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.852604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.852606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.852608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744641:2999]
2025-10-02T09:36:36.852627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.852631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.852633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.852634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.852634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.852636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.852759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.853067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:36.917318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555995570329893:5886]
2025-10-02T09:36:36.917525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3273, pipe: [1:7556555995570329893:5886]
2025-10-02T09:36:36.962052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:36.962409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.962419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.962431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329893:5886], now have 1 active actors on pipe
2025-10-02T09:36:36.962566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:36.962619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555995570329893:5886]
2025-10-02T09:36:36.962646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:36.962665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:36.962778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3274 reason: status is not ok: tablet will be restarted right now sessionId: src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0
2025-10-02T09:36:36.962961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3274 sessionId: src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0 is DEAD
2025-10-02T09:36:36.963074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:36.963081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Write session will restart in 0.009895s
2025-10-02T09:36:36.963116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Write session: Do CDS request
2025-10-02T09:36:36.963121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:36.968812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:36.970123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:36.970235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:36.970242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:36.970248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:36.970274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:36.970298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555995494744774:3044]
2025-10-02T09:36:36.970651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:36.970813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:36.970838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:36.971044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:36.971078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.971082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.971083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.971083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.971084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.971084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.971086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.971086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.971087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.971088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.971090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.971096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.971098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.971100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.971102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.971104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.971106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.971108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.971110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.971112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.971114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.971116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.971120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.971123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:36.971126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.971130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:36.971132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.971135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:36.971137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.971140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:36.971142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.971145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:36.971147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.971149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:36.971151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.971154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:36.971156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.971158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:36.971161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.971163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:36.971167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.971169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.971172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.971174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.971176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.971178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.971195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:36.974151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.974301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:36.974314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3275
2025-10-02T09:36:36.974439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:36.974462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:36.974465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:36.974469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:36.974828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3275 sessionId:  describe result for acl check
2025-10-02T09:36:36.974857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:36.974863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:36.974864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:36.974867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:36.975233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:36.976539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:36.978564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:36.978575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:36.978576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555995570329985:7432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:36.978580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:36.978583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:36.980142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:36.980154Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:36.980155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:36.980157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:36.980161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3274 [2:7556555995494744774:3044]
2025-10-02T09:36:36.980168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:36.980177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:36.980182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.980185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.980186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.980197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:36.980206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:36.980212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:36.980240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.980246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.980247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.980249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:36.980250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:36.980286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:36.980290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.980297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:36.980302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:36.980311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:36.980325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570330015:7432], now have 1 active actors on pipe
2025-10-02T09:36:36.980330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555995570329899:2446], now have 1 active actors on pipe
2025-10-02T09:36:36.980333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.980334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.980335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.980343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:36.980351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:36.980356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:36.980358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:36.980359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:36.980360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:36.980362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:36.980376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.980365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3274
2025-10-02T09:36:36.980381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:36.980382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:36.980369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3274
2025-10-02T09:36:36.980400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.980405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.980420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67023ac7-6477e495-4156a482-5f79967a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:36.980427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:36.980429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:36.980430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:36.980435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:36.980445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:36.980458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.980576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:36.980583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:36.980592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:36.980656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3275 partition: 0 MaxSeqNo: 36 sessionId: src_id|67023ac7-6477e495-4156a482-5f79967a_0
2025-10-02T09:36:36.980912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255ab167-f4b1029c-65ea83a4-a54ece8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67023ac7-6477e495-4156a482-5f79967a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:36.983640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Write session: try to update token
2025-10-02T09:36:36.983652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:36.989545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:36.989559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:36.989562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:36.989563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:36.989568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.989571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.989573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555995494744769:3044]
2025-10-02T09:36:36.989593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:36.989600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:36.989599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:36.989602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:36.989603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:36.989606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:36.989762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:36.995253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId: src_id|67023ac7-6477e495-4156a482-5f79967a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:36.997864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.062696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865297345:5886]
2025-10-02T09:36:37.062886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3274, pipe: [1:7556555999865297345:5886]
2025-10-02T09:36:37.100638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.100918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.100927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.100939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297345:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.101082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.101135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.101149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.101203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3275 reason: error at write: Disconnected sessionId: src_id|67023ac7-6477e495-4156a482-5f79967a_0
2025-10-02T09:36:37.101345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3275 sessionId: src_id|67023ac7-6477e495-4156a482-5f79967a_0 is DEAD
2025-10-02T09:36:37.101467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.101477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Write session will restart in 0.009721s
2025-10-02T09:36:37.101492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Write session: Do CDS request
2025-10-02T09:36:37.101496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.101511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.101811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865297345:5886]
2025-10-02T09:36:37.107621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.108792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.108912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.108918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.108924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.108952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.108982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712211:3065]
2025-10-02T09:36:37.109338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.109520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.109548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.109743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.109778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.109783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.109783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.109784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.109784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.109785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.109785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.109786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.109787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.109787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.109788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.109788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.109791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.109798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.109800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.109802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.109804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.109806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.109808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.109810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.109812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.109814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.109816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.109818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.109822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.109826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.109829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.109831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.109834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.109837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.109839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.109841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.109843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.109846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.109848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.109850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.109852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.109855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.109857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.109861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.109863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.109866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.109872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.109875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.109877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.109879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.109881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.109884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.109901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.112208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.112288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.112299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3276
2025-10-02T09:36:37.112423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.112449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.112457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.112461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.112871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3276 sessionId:  describe result for acl check
2025-10-02T09:36:37.112908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.112914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.112916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.112922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.113444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.114992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.117258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.117693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.117706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.117708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865297429:7481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.117712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.118835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.118847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.118849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.118851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.118854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3275 [2:7556555999789712211:3065]
2025-10-02T09:36:37.118862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.118871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.118877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.118879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.118880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.118888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.118894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.118900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.118939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.118945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.118947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.118949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.118951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.118991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.118997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.119004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.119009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.119017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.119030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297463:7481], now have 1 active actors on pipe
2025-10-02T09:36:37.119035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297346:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.119039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.119040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.119041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.119049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.119060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.119064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.119066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.119067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.119069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.119071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.119061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3275
2025-10-02T09:36:37.119076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3275
2025-10-02T09:36:37.119085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.119090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.119091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.119102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.119106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.119132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.119139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.119141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.119143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.119148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.119154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.119164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.119268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.119275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.119284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.119356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3276 partition: 0 MaxSeqNo: 36 sessionId: src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0
2025-10-02T09:36:37.119600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67023ac7-6477e495-4156a482-5f79967a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.122091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Write session: try to update token
2025-10-02T09:36:37.122104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.128094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.128106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.128107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.128108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.128113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.128115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.128117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712206:3065]
2025-10-02T09:36:37.128135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.128138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.128140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.128141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.128143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.128143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.128322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.134442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId: src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.137040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.201999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865297471:5886]
2025-10-02T09:36:37.202216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3275, pipe: [1:7556555999865297471:5886]
2025-10-02T09:36:37.237593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.237866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.237876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.237888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297471:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.238015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.238059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.238060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.238064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.238100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865297471:5886]
2025-10-02T09:36:37.238135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3276 reason: error at write: Disconnected sessionId: src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0
2025-10-02T09:36:37.238296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3276 sessionId: src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0 is DEAD
2025-10-02T09:36:37.238424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.238429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Write session will restart in 0.006546s
2025-10-02T09:36:37.238447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Write session: Do CDS request
2025-10-02T09:36:37.238453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.244189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.245503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.245607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.245613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.245619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.245644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.245673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712342:3081]
2025-10-02T09:36:37.246096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.246169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.246273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.246297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.246298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.246309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3277
2025-10-02T09:36:37.246404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.246432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.246442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.246446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.246484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.246516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.246520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.246521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.246521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.246522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.246522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.246523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.246523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.246524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.246525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.246525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.246526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.246529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.246535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.246537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.246539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.246541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.246543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.246546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.246548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.246550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.246552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.246554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.246556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.246560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.246563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.246566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.246569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.246571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.246574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.246576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.246579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.246581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.246584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.246586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.246589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.246591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.246593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.246597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.246600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.246602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.246605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.246607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.246609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.246615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.246617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.246620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.246622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.246639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.246881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3277 sessionId:  describe result for acl check
2025-10-02T09:36:37.246909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.246916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.246918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.246924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.247370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.249005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.253494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.253505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.253507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865297556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.253512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.253990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.255465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.255477Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.255478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.255480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.255483Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3276 [2:7556555999789712342:3081]
2025-10-02T09:36:37.255490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.255500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.255505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.255506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.255508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.255517Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.255521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.255525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.255553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.255558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.255559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.255561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.255562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.255598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.255603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.255610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.255615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.255623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.255637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297472:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.255644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297591:7486], now have 1 active actors on pipe
2025-10-02T09:36:37.255648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.255654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.255656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.255668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.255677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.255674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3276
2025-10-02T09:36:37.255684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3276
2025-10-02T09:36:37.255681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.255685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.255687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.255688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.255690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.255705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.255707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.255709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.255717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.255720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.255748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.255755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.255758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.255759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.255766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.255774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.255784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.255902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.255911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.255924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.255995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3277 partition: 0 MaxSeqNo: 36 sessionId: src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0
2025-10-02T09:36:37.256242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e83cc1e4-460e64b3-8b08f68e-df85e280_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.259111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Write session: try to update token
2025-10-02T09:36:37.259124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.265007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.265020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.265022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.265023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.265028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.265031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.265033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712337:3081]
2025-10-02T09:36:37.265054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.265058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.265059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.265078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.265089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.265092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.265177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.271027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId: src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.273510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.338157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865297612:5886]
2025-10-02T09:36:37.338349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3276, pipe: [1:7556555999865297612:5886]
2025-10-02T09:36:37.375597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.375907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.375916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.375928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297612:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.376073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.376065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.376069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865297612:5886]
2025-10-02T09:36:37.376086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.376088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.376134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3277 reason: error at write: Disconnected sessionId: src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0
2025-10-02T09:36:37.376256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3277 sessionId: src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0 is DEAD
2025-10-02T09:36:37.376379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.376389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Write session will restart in 0.008182s
2025-10-02T09:36:37.376407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Write session: Do CDS request
2025-10-02T09:36:37.376411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.383916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.385016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.385128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.385124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.385130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.385137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.385163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.385248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712460:3089]
2025-10-02T09:36:37.385255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.385267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3278
2025-10-02T09:36:37.385411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.385444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.385453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.385457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.385609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.385768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.385770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3278 sessionId:  describe result for acl check
2025-10-02T09:36:37.385796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.385798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.385805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.385806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.385808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.385987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.386021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.386025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.386026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.386027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.386027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.386028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.386029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.386029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.386030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.386030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.386031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.386031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.386034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.386040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.386042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.386044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.386046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.386048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.386050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.386052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.386054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.386056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.386058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.386060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.386064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.386067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.386070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.386073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.386075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.386078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.386080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.386083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.386085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.386088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.386090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.386092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.386095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.386099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.386101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.386104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.386108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.386110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.386113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.386115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.386117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.386120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.386122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.386126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.386144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.386146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.387918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.392288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.392298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.392300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865297704:7511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.392304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.393483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.394992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.395003Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.395004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.395008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.395011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3277 [2:7556555999789712460:3089]
2025-10-02T09:36:37.395020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.395029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.395035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.395036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.395037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.395046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.395048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.395054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.395083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.395087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.395088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.395090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.395092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.395127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.395132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.395138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.395145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.395154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.395172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297740:7511], now have 1 active actors on pipe
2025-10-02T09:36:37.395179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297614:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.395184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.395188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.395190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.395200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.395211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.395200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3277
2025-10-02T09:36:37.395212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.395215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.395212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3277
2025-10-02T09:36:37.395216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.395222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.395223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.395243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.395248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.395256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.395264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.395272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.395281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|178a6c10-ef72754c-e941ce60-f70602c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.395285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.395289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.395290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.395295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.395300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.395311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.395416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.395422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.395432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.395498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3278 partition: 0 MaxSeqNo: 36 sessionId: src_id|178a6c10-ef72754c-e941ce60-f70602c7_0
2025-10-02T09:36:37.395762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e4c7fe-f664e8a8-c04e37b6-e5e2e8af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|178a6c10-ef72754c-e941ce60-f70602c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.398203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Write session: try to update token
2025-10-02T09:36:37.398216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.404233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.404245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.404246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.404247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.404250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.404252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.404256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712455:3089]
2025-10-02T09:36:37.404275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.404276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.404278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.404280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.404283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.404284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.404406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.410511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId: src_id|178a6c10-ef72754c-e941ce60-f70602c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.412989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.476425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865297748:5886]
2025-10-02T09:36:37.476586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3277, pipe: [1:7556555999865297748:5886]
2025-10-02T09:36:37.513153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.513406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.513414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.513427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297748:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.513554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.513615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.513647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:37.513657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865297748:5886]
2025-10-02T09:36:37.513734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3278 reason: status is not ok: tablet will be restarted right now sessionId: src_id|178a6c10-ef72754c-e941ce60-f70602c7_0
2025-10-02T09:36:37.513894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3278 sessionId: src_id|178a6c10-ef72754c-e941ce60-f70602c7_0 is DEAD
2025-10-02T09:36:37.514041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:37.514047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Write session will restart in 0.008790s
2025-10-02T09:36:37.514066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Write session: Do CDS request
2025-10-02T09:36:37.514071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.519669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.520899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.521074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.521081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.521087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.521122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.521153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712582:3086]
2025-10-02T09:36:37.521510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.521707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.521735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.521934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.521967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.521971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.521971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.521972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.521973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.521973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.521974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.521974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.521975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.521976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.521976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.521977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.521980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.521986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.521988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.521990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.521992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.521994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.521996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.521998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.522000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.522003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.522005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.522007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.522011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.522015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.522018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.522022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.522024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.522026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.522029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.522031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.522034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.522037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.522039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.522042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.522045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.522047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.522049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.522052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.522054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.522056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.522060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.522063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.522065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.522067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.522070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.522072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.522092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.524195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.524299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.524312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3279
2025-10-02T09:36:37.524423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.524447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.524455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.524459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.524837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3279 sessionId:  describe result for acl check
2025-10-02T09:36:37.524871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.524877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.524879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.524888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.525343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.527120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.529008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.529017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.529019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865297836:7514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.529024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.529434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.530834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.530848Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.530850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.530853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.530858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3278 [2:7556555999789712582:3086]
2025-10-02T09:36:37.530869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.530883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.530886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.530888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.530889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.530898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.530904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.530908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.530945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.530951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.530952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.530954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.530955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.530991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.530996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.531002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.531008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.531018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.531031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297871:7514], now have 1 active actors on pipe
2025-10-02T09:36:37.531037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297749:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.531040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.531042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.531043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.531050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.531063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.531062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.531064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.531066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.531072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.531074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.531071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3278
2025-10-02T09:36:37.531087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.531074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3278
2025-10-02T09:36:37.531092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.531093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.531104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.531110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.531167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.531175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.531178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.531179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.531184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.531191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.531203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.531322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.531329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.531338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.531413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3279 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0
2025-10-02T09:36:37.531662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a6c10-ef72754c-e941ce60-f70602c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.534478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Write session: try to update token
2025-10-02T09:36:37.534489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.540237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.540251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.540253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.540254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.540259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.540263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.540267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712577:3086]
2025-10-02T09:36:37.540290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.540291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.540293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.540294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.540296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.540296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.540420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.546305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId: src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.548765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.613654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865297878:5886]
2025-10-02T09:36:37.613866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3278, pipe: [1:7556555999865297878:5886]
2025-10-02T09:36:37.649962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.650202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.650211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.650224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297878:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.650341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.650366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.650381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.650388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.650408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865297878:5886]
2025-10-02T09:36:37.650462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3279 reason: error at write: Disconnected sessionId: src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0
2025-10-02T09:36:37.650615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3279 sessionId: src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0 is DEAD
2025-10-02T09:36:37.650750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.650760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Write session will restart in 0.006949s
2025-10-02T09:36:37.650774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Write session: Do CDS request
2025-10-02T09:36:37.650779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.657001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.658253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.658446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.658455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.658462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.658498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.658523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712703:3087]
2025-10-02T09:36:37.658883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.659062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.659092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.659140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.659251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.659263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3280
2025-10-02T09:36:37.659289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.659340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.659345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.659346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.659347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.659348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.659349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.659350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.659350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.659351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.659351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.659352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.659353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.659356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.659363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.659365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.659367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.659369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.659371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.659373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.659375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.659377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.659379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.659381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.659383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.659388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.659392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.659395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.659389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.659398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.659400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.659403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.659405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.659408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.659412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.659412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.659420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.659424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.659415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.659417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.659420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.659422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.659425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.659427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.659429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.659431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.659434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.659436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.659439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.659442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.659445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.659447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.659450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.659467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.659858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3280 sessionId:  describe result for acl check
2025-10-02T09:36:37.659890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.659896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.659898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.659904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.660384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.662330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.666312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.666322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.666324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865297966:7527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.666328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.666850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.668385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.668396Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.668397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.668399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.668402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3279 [2:7556555999789712703:3087]
2025-10-02T09:36:37.668410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.668421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.668426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.668427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.668429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.668437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.668440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.668444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.668472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.668477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.668479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.668481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.668482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.668518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.668523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.668529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.668535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.668543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.668557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298000:7527], now have 1 active actors on pipe
2025-10-02T09:36:37.668563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865297879:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.668567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.668569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.668572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.668584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.668596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.668590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3279
2025-10-02T09:36:37.668607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3279
2025-10-02T09:36:37.668598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.668604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.668605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.668606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.668607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.668629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.668635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.668642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.668649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.668654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.668668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.668675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.668677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.668678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.668683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.668690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.668703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.668819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.668828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.668839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.668923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3280 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0
2025-10-02T09:36:37.669211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d49d0e4-52f5174a-841fe92b-db7bd644_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.671993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Write session: try to update token
2025-10-02T09:36:37.672003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.677882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.677895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.677896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.677897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.677904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.677906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.677908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712698:3087]
2025-10-02T09:36:37.677931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.677935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.677937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.677938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.677939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.677941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.678062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.683596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId: src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.686025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.750359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865298009:5886]
2025-10-02T09:36:37.750619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3279, pipe: [1:7556555999865298009:5886]
2025-10-02T09:36:37.790700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.790917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.790927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.790949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298009:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.791073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.791123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.791123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.791139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.791158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865298009:5886]
2025-10-02T09:36:37.791220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3280 reason: error at write: Disconnected sessionId: src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0
2025-10-02T09:36:37.791384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3280 sessionId: src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0 is DEAD
2025-10-02T09:36:37.791508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.791518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Write session will restart in 0.007421s
2025-10-02T09:36:37.791539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Write session: Do CDS request
2025-10-02T09:36:37.791544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.797375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.798558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.798709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.798717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.798724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.798756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.798781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712824:3092]
2025-10-02T09:36:37.799156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.799335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.799363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.799557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.799587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.799591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.799592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.799592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.799593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.799594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.799594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.799595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.799595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.799596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.799596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.799597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.799599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.799606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.799608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.799610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.799612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.799615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.799618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.799620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.799622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.799624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.799625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.799627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.799631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.799636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.799642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.799648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.799652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.799658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.799662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.799669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.799672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.799675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.799678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.799681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.799683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.799686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.799688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.799691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.799693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.799697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.799699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.799702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.799704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.799706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.799710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.799712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.799728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.800112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.800229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.800242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3281
2025-10-02T09:36:37.800375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.800408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.800419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.800424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.800835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3281 sessionId:  describe result for acl check
2025-10-02T09:36:37.800872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.800878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.800881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.800887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.801345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.803075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.806516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.806526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.806528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865298098:7538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.806534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.807063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.808484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.808495Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.808496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.808498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.808502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3280 [2:7556555999789712824:3092]
2025-10-02T09:36:37.808509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.808518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.808521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.808523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.808524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.808533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.808541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.808545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.808577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.808582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.808583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.808585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.808586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.808631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.808637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.808644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.808650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.808658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.808671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298133:7538], now have 1 active actors on pipe
2025-10-02T09:36:37.808677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298010:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.808680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.808683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.808685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.808690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.808695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.808697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.808697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.808699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.808691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3280
2025-10-02T09:36:37.808707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3280
2025-10-02T09:36:37.808711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.808716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.808739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.808743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.808750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.808755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.808764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.808773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.808780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.808782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.808783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.808787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.808794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.808820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.808939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.808946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.808956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.809023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3281 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0
2025-10-02T09:36:37.809257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff36a6fc-5ad1d1d3-94082a12-8c0aeb52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.812041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Write session: try to update token
2025-10-02T09:36:37.812051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.817889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.817901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.817902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.817905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.817909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.817911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.817940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712819:3092]
2025-10-02T09:36:37.817965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.817967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.817970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.817971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.817972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.817973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.818088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.823779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId: src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.826214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:37.891126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555999865298141:5886]
2025-10-02T09:36:37.891308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3280, pipe: [1:7556555999865298141:5886]
2025-10-02T09:36:37.927697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:37.927948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.927957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.927970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298141:5886], now have 1 active actors on pipe
2025-10-02T09:36:37.928103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:37.928148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:37.928149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555999865298141:5886]
2025-10-02T09:36:37.928164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:37.928164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:37.928242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3281 reason: error at write: Disconnected sessionId: src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0
2025-10-02T09:36:37.928415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3281 sessionId: src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0 is DEAD
2025-10-02T09:36:37.928553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:37.928564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Write session will restart in 0.008737s
2025-10-02T09:36:37.928579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Write session: Do CDS request
2025-10-02T09:36:37.928584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:37.934552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:37.935792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:37.935900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:37.935908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:37.935913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:37.935940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:37.935965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555999789712947:3108]
2025-10-02T09:36:37.936320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:37.936485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:37.936508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:37.936693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:37.936725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.936731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.936731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.936732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.936733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.936733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.936734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.936734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.936735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.936735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.936736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.936736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.936739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.936745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.936748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.936750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.936752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.936754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.936756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.936758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.936760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.936762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.936764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.936766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.936769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.936773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:37.936777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.936780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:37.936782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.936784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:37.936786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.936789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:37.936792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.936794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:37.936796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.936799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:37.936809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.936811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:37.936817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.936820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:37.936822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.936825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:37.936827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.936829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.936831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.936837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.936839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.936842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.936865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:37.938139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.938246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:37.938260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3282
2025-10-02T09:36:37.938395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:37.938430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:37.938440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:37.938444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:37.938843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3282 sessionId:  describe result for acl check
2025-10-02T09:36:37.938874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:37.938880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:37.938885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:37.938892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:37.939447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:37.941404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:37.943709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:37.943721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:37.943723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555999865298238:7561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:37.943728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:37.944225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:37.945774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:37.945786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:37.945787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:37.945789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:37.945793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3281 [2:7556555999789712947:3108]
2025-10-02T09:36:37.945800Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:37.945809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:37.945815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.945817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.945819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.945830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:37.945839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:37.945846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:37.945881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.945886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.945887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.945889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:37.945890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:37.945946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:37.945950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.945956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:37.945962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:37.945975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:37.945988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298272:7561], now have 1 active actors on pipe
2025-10-02T09:36:37.945994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555999865298145:2446], now have 1 active actors on pipe
2025-10-02T09:36:37.945997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.945998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.945999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.946007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:37.946001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3281
2025-10-02T09:36:37.946017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:37.946022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:37.946024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:37.946025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:37.946027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:37.946030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:37.946021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3281
2025-10-02T09:36:37.946051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.946057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.946069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.946079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:37.946090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:37.946097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|674016ff-7f2f1033-14c24c04-65abed95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:37.946101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:37.946103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:37.946105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:37.946111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:37.946119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:37.946132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.946247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:37.946254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:37.946264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:37.946339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3282 partition: 0 MaxSeqNo: 36 sessionId: src_id|674016ff-7f2f1033-14c24c04-65abed95_0
2025-10-02T09:36:37.946591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7342a8-206a2bbb-2054b7aa-ee7c7381_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|674016ff-7f2f1033-14c24c04-65abed95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:37.949369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Write session: try to update token
2025-10-02T09:36:37.949379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:37.955311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:37.955327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:37.955328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:37.955332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:37.955338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.955341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.955343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555999789712942:3108]
2025-10-02T09:36:37.955366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:37.955369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:37.955371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:37.955372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:37.955376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:37.955378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:37.955493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:37.960908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId: src_id|674016ff-7f2f1033-14c24c04-65abed95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:37.963373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.028336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160265580:5886]
2025-10-02T09:36:38.028551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3281, pipe: [1:7556556004160265580:5886]
2025-10-02T09:36:38.066013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.066280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.066289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.066302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265580:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.066434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.066446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:38.066459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:38.066510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3282 reason: error at write: Disconnected sessionId: src_id|674016ff-7f2f1033-14c24c04-65abed95_0
2025-10-02T09:36:38.066644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3282 sessionId: src_id|674016ff-7f2f1033-14c24c04-65abed95_0 is DEAD
2025-10-02T09:36:38.066760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:38.066772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Write session will restart in 0.006654s
2025-10-02T09:36:38.066769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.066788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Write session: Do CDS request
2025-10-02T09:36:38.066793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.066795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160265580:5886]
2025-10-02T09:36:38.072688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.073904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.074026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.074033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.074039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.074072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.074102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084680404:3139]
2025-10-02T09:36:38.074146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.074301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.074316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3283
2025-10-02T09:36:38.074464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.074468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.074491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.074497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.074501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.074650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.074673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.074771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3283 sessionId:  describe result for acl check
2025-10-02T09:36:38.074800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.074806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.074807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.074810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.074867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.074901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.074905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.074905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.074906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.074907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.074907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.074908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.074908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.074909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.074909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.074910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.074910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.074913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.074919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.074921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.074923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.074925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.074927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.074929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.074937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.074940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.074944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.074947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.074949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.074953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.074957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.074961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.074963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.074966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.074968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.074970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.074973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.074977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.074979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.074982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.074984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.074987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.074990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.074992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.074994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.074997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.074999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.075005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.075008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.075010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.075013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.075015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.075017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.075035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.075168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.077209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.082089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.082103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.082105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160265694:7626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.082109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.082795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.084258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.084269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.084270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.084272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.084275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3282 [2:7556556004084680404:3139]
2025-10-02T09:36:38.084282Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.084291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.084292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.084294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.084294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.084303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.084309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.084314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.084352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.084358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.084359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.084361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.084362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.084398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.084403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.084410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.084417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.084425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.084439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265594:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.084445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265726:7626], now have 1 active actors on pipe
2025-10-02T09:36:38.084448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.084449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.084451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.084458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.084466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.084470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.084472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.084473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.084477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.084479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.084493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.084498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.084499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.084481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3282
2025-10-02T09:36:38.084502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3282
2025-10-02T09:36:38.084517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.084522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.084537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.084544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.084546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.084548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.084552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.084558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.084569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.084690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.084697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.084706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.084781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3283 partition: 0 MaxSeqNo: 36 sessionId: src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0
2025-10-02T09:36:38.085063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674016ff-7f2f1033-14c24c04-65abed95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.087842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Write session: try to update token
2025-10-02T09:36:38.087853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.094091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.094105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.094106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.094109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.094114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.094117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.094119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084680399:3139]
2025-10-02T09:36:38.094138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.094140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.094141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.094142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.094143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.094145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.094252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.099158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId: src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.101607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.167089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160265734:5886]
2025-10-02T09:36:38.167264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3282, pipe: [1:7556556004160265734:5886]
2025-10-02T09:36:38.203276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.203499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.203508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.203533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265734:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.203650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.203705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.203721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160265734:5886]
2025-10-02T09:36:38.203748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:38.203830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3283 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0
2025-10-02T09:36:38.203977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3283 sessionId: src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0 is DEAD
2025-10-02T09:36:38.204110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:38.204120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Write session will restart in 0.007018s
2025-10-02T09:36:38.204141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Write session: Do CDS request
2025-10-02T09:36:38.204145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.210294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.211484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.211634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.211642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.211648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.211678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.211700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084680529:3159]
2025-10-02T09:36:38.212051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.212117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.212219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.212242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.212240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.212251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3284
2025-10-02T09:36:38.212367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.212389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.212397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.212400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.212432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.212467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.212471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.212472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.212472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.212475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.212475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.212476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.212476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.212479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.212486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.212488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.212490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.212492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.212494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.212496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.212498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.212499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.212501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.212503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.212505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.212509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.212513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.212516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.212519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.212521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.212523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.212525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.212528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.212530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.212533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.212535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.212538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.212540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.212543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.212545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.212548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.212550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.212553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.212556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.212558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.212565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.212570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.212574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.212582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.212602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.212718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3284 sessionId:  describe result for acl check
2025-10-02T09:36:38.212748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.212754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.212755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.212758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.213114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.214660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.218987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.218998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.219000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160265827:7615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.219004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.220194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.221740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.221753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.221754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.221756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.221760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3283 [2:7556556004084680529:3159]
2025-10-02T09:36:38.221767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.221778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.221784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.221786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.221787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.221799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.221807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.221813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.221845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.221850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.221853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.221855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.221857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.221894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.221898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.221905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.221910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.221920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.221934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265736:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.221940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265862:7615], now have 1 active actors on pipe
2025-10-02T09:36:38.221943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.221944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.221945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.221952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.221962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.221964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.221965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.221966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.221973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.221974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.221987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.221992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.221994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.221972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3283
2025-10-02T09:36:38.222005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.222010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.221983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3283
2025-10-02T09:36:38.222031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.222038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.222041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.222045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.222051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.222060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.222078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.222202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.222207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.222214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.222280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3284 partition: 0 MaxSeqNo: 36 sessionId: src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0
2025-10-02T09:36:38.222530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61ce04d1-f56bbe06-beecdd91-b2bdad91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.225340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Write session: try to update token
2025-10-02T09:36:38.225351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.231085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.231098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.231099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.231100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.231105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.231107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.231110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084680524:3159]
2025-10-02T09:36:38.231132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.231135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.231136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.231139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.231143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.231146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.231258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.236931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId: src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.239280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.303801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160265869:5886]
2025-10-02T09:36:38.304043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3283, pipe: [1:7556556004160265869:5886]
2025-10-02T09:36:38.340942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.341262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.341275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.341288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265869:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.341450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.341457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:38.341460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:38.341502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160265869:5886]
2025-10-02T09:36:38.341510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3284 reason: error at write: Disconnected sessionId: src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0
2025-10-02T09:36:38.341638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3284 sessionId: src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0 is DEAD
2025-10-02T09:36:38.341727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.341950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:38.341959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Write session will restart in 0.007587s
2025-10-02T09:36:38.341976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Write session: Do CDS request
2025-10-02T09:36:38.341980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.347822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.349057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.349152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.349159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.349165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.349188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.349212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084680667:3166]
2025-10-02T09:36:38.349548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.349702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.349725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.349908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.349939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.349943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.349944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.349944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.349945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.349945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.349946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.349947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.349947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.349952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.349958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.349960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.349962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.349964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.349966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.349968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.349970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.349972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.349974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.349976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.349978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.349982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.349987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.349990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.349993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.349995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.349998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.350000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.350003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.350006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.350008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.350010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.350013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.350015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.350018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.350020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.350023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.350025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.350028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.350030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.350032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.350034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.350037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.350039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.350043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.350073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.350087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.350216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.350227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3285
2025-10-02T09:36:38.350345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.350369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.350378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.350381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.350657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3285 sessionId:  describe result for acl check
2025-10-02T09:36:38.350682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.350687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.350688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.350690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.351027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.352410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.356193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.356201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.356205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160265977:7652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.356208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.357403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.358834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.358844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.358845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.358847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.358850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3284 [2:7556556004084680667:3166]
2025-10-02T09:36:38.358856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.358865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.358871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.358872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.358874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.358883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.358885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.358890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.358920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.358925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.358926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.358928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.358930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.358976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.358981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.358987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.358992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.359004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.359021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266012:7652], now have 1 active actors on pipe
2025-10-02T09:36:38.359028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160265884:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.359033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.359038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.359040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.359049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.359059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.359060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.359061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.359058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3284
2025-10-02T09:36:38.359067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3284
2025-10-02T09:36:38.359063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.359070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.359071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.359086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.359090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.359092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.359102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.359106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.359129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.359136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.359139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.359140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.359146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.359152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.359163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.359270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.359277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.359285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.359354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3285 partition: 0 MaxSeqNo: 36 sessionId: src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0
2025-10-02T09:36:38.359620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ba9c31-9e96b73c-cf0cb121-94cbddc8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.362401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Write session: try to update token
2025-10-02T09:36:38.362412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.368163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.368177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.368178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.368179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.368184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.368187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.368189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084680662:3166]
2025-10-02T09:36:38.368210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.368211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.368214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.368216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.368216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.368218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.368353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.374441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId: src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.376777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.441536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160266019:5886]
2025-10-02T09:36:38.441738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3284, pipe: [1:7556556004160266019:5886]
2025-10-02T09:36:38.477110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.477380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.477388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.477401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266019:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.477540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.477591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160266019:5886]
2025-10-02T09:36:38.477598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:38.477616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.477682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3285 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0
2025-10-02T09:36:38.477836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3285 sessionId: src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0 is DEAD
2025-10-02T09:36:38.477987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:38.477996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Write session will restart in 0.009675s
2025-10-02T09:36:38.478013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Write session: Do CDS request
2025-10-02T09:36:38.478017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.484285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.485547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.485645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.485651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.485657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.485683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.485705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084680796:3177]
2025-10-02T09:36:38.486046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.486222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.486244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.486417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.486445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.486449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.486449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.486450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.486450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.486451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.486452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.486452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.486453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.486453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.486454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.486454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.486457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.486464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.486466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.486468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.486470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.486472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.486474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.486476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.486478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.486480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.486482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.486484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.486488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.486493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.486496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.486499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.486501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.486504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.486506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.486508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.486510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.486513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.486515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.486517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.486520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.486522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.486524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.486527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.486533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.486536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.486538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.486541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.486543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.486546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.486547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.486554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.486570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.489124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.489220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.489231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3286
2025-10-02T09:36:38.489356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.489390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.489404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.489408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.489735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3286 sessionId:  describe result for acl check
2025-10-02T09:36:38.489766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.489767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.489769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.489773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.490214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.491700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.493620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.493630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.493632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160266114:7664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.493636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.493948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.495394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.495407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.495408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.495410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.495413Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3285 [2:7556556004084680796:3177]
2025-10-02T09:36:38.495420Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.495430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.495434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.495436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.495437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.495447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.495450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.495455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.495488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.495493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.495494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.495496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.495497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.495533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.495539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.495546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.495551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.495562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.495576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266148:7664], now have 1 active actors on pipe
2025-10-02T09:36:38.495581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266020:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.495585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.495586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.495587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.495595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.495603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.495605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.495607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.495609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.495613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.495615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.495609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3285
2025-10-02T09:36:38.495619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3285
2025-10-02T09:36:38.495629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.495634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.495635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.495649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.495654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.495675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.495681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.495683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.495684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.495689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.495696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.495710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.495825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.495829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.495837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.495900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3286 partition: 0 MaxSeqNo: 36 sessionId: src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0
2025-10-02T09:36:38.496164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a491c8-b14c2546-2846668a-1f9c05bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.498960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Write session: try to update token
2025-10-02T09:36:38.498972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.504768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.504781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.504782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.504783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.504787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.504790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.504793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084680791:3177]
2025-10-02T09:36:38.504816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.504819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.504824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.504827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.504829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.504831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.504954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.510175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId: src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.512535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.577720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160266156:5886]
2025-10-02T09:36:38.577919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3285, pipe: [1:7556556004160266156:5886]
2025-10-02T09:36:38.614710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.615097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.615107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.615119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266156:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.615265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.615321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.615320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160266156:5886]
2025-10-02T09:36:38.615338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:38.615343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:38.615391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3286 reason: error at write: Disconnected sessionId: src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0
2025-10-02T09:36:38.615518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3286 sessionId: src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0 is DEAD
2025-10-02T09:36:38.615640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:38.615650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Write session will restart in 0.006534s
2025-10-02T09:36:38.615670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Write session: Do CDS request
2025-10-02T09:36:38.615674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.621907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.623116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.623155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.623243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.623254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3287
2025-10-02T09:36:38.623276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.623283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.623289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.623318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.623341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084680923:3190]
2025-10-02T09:36:38.623394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.623419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.623428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.623431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.623692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.623736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3287 sessionId:  describe result for acl check
2025-10-02T09:36:38.623764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.623770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.623771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.623774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.623886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.623912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.624107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.624121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.624138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.624142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.624142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.624143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.624143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.624144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.624144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.624145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.624146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.624146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.624147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.624147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.624150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.624156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.624158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.624160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.624162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.624164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.624166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.624168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.624170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.624172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.624174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.624175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.624180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.624184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.624187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.624190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.624192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.624195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.624197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.624199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.624202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.624204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.624206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.624209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.624212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.624217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.624220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.624227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.624231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.624239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.624241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.624244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.624249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.624252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.624254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.624257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.624275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.625879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.630533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.630545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.630547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160266247:7670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.630551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.631754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.633174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.633186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.633187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.633189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.633193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3286 [2:7556556004084680923:3190]
2025-10-02T09:36:38.633202Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.633213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.633219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.633221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.633222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.633231Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.633236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.633240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.633268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.633273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.633274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.633276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.633277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.633314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.633318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.633325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.633330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.633341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.633356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266286:7670], now have 1 active actors on pipe
2025-10-02T09:36:38.633362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266157:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.633366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.633367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.633368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.633376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.633386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.633390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.633393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.633394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.633395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.633397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.633377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3286
2025-10-02T09:36:38.633391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3286
2025-10-02T09:36:38.633410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.633415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.633424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.633427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.633429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.633451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b87e58a-5ab38078-98424b71-76e5853c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.633458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.633460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.633461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.633467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.633473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.633481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.633596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.633604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.633613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.633682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3287 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b87e58a-5ab38078-98424b71-76e5853c_0
2025-10-02T09:36:38.633938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23543bd-704ec745-3c8cc424-b5e5c5c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b87e58a-5ab38078-98424b71-76e5853c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.636689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Write session: try to update token
2025-10-02T09:36:38.636699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.642686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.642700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.642701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.642702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.642708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.642710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.642713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084680918:3190]
2025-10-02T09:36:38.642736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.642739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.642740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.642741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.642742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.642744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.642868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.648955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId: src_id|2b87e58a-5ab38078-98424b71-76e5853c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.651353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.715441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160266294:5886]
2025-10-02T09:36:38.715647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3286, pipe: [1:7556556004160266294:5886]
2025-10-02T09:36:38.753189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.753563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.753573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.753586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266294:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.753778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.753832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.753852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:38.753878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160266294:5886]
2025-10-02T09:36:38.753949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b87e58a-5ab38078-98424b71-76e5853c_0
2025-10-02T09:36:38.754105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3287 sessionId: src_id|2b87e58a-5ab38078-98424b71-76e5853c_0 is DEAD
2025-10-02T09:36:38.754249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:38.754261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Write session will restart in 0.009238s
2025-10-02T09:36:38.754278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Write session: Do CDS request
2025-10-02T09:36:38.754283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.761502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.762845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.762980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.762987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.762996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.763032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.763064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084681052:3182]
2025-10-02T09:36:38.763647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.763837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.763864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.764074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.764116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.764108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.764113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.764113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.764114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.764114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.764115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.764115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.764116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.764116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.764117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.764117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.764118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.764121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.764127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.764129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.764131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.764133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.764135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.764137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.764139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.764141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.764144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.764146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.764147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.764151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.764155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.764158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.764161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.764163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.764166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.764169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.764172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.764174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.764177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.764180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.764182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.764184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.764187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.764190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.764194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.764196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.764199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.764201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.764204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.764208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.764211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.764213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.764215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.764232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.764238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.764248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3288
2025-10-02T09:36:38.764368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.764392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.764400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.764403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.764776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3288 sessionId:  describe result for acl check
2025-10-02T09:36:38.764824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.764831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.764835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.764840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.765317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.767165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.771145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.771155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.771158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160266390:7681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.771163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.771659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.773126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.773138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.773139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.773142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.773145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3287 [2:7556556004084681052:3182]
2025-10-02T09:36:38.773152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.773162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.773168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.773169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.773170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.773180Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.773183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.773187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.773222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.773229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.773231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.773234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.773236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.773274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.773279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.773285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.773290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.773300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.773312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266295:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.773318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266425:7681], now have 1 active actors on pipe
2025-10-02T09:36:38.773321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.773323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.773324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.773332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.773342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.773349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.773351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.773353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.773353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.773355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.773368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.773373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.773375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.773369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3287
2025-10-02T09:36:38.773379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3287
2025-10-02T09:36:38.773456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.773464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.773484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.773492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.773495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.773496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.773501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.773511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.773520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.773647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.773653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.773662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.773725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3288 partition: 0 MaxSeqNo: 36 sessionId: src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0
2025-10-02T09:36:38.773932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b87e58a-5ab38078-98424b71-76e5853c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.776689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Write session: try to update token
2025-10-02T09:36:38.776699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.782579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.782593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.782594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.782595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.782601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.782604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.782606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084681047:3182]
2025-10-02T09:36:38.782629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.782632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.782632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.782633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.782636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.782638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.782751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.788321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId: src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.790729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.854174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160266433:5886]
2025-10-02T09:36:38.854372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3287, pipe: [1:7556556004160266433:5886]
2025-10-02T09:36:38.891133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:38.891436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.891446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.891458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266433:5886], now have 1 active actors on pipe
2025-10-02T09:36:38.891578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:38.891614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:38.891662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:38.891695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160266433:5886]
2025-10-02T09:36:38.891743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0
2025-10-02T09:36:38.891897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3288 sessionId: src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0 is DEAD
2025-10-02T09:36:38.892023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:38.892034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Write session will restart in 0.005071s
2025-10-02T09:36:38.892050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Write session: Do CDS request
2025-10-02T09:36:38.892054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:38.898099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.898215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:38.898225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3289
2025-10-02T09:36:38.898323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:38.898345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:38.898352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:38.898355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:38.898526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:38.898670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3289 sessionId:  describe result for acl check
2025-10-02T09:36:38.898694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:38.898699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:38.898701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:38.898705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:38.899151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:38.899730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:38.899831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:38.899838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:38.899844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:38.899870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:38.899894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556004084681182:3194]
2025-10-02T09:36:38.900235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:38.900391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:38.900413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:38.900589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:38.900619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.900623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.900624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.900624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.900625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.900625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.900626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.900626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.900627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.900627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.900628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.900628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.900631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.900637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.900639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.900641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.900643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.900645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.900647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.900649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.900651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.900653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.900655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.900657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.900661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.900665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:38.900668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.900671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:38.900673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.900676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:38.900678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.900680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:38.900683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.900686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:38.900691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.900694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:38.900696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.900699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:38.900701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.900704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:38.900708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.900711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:38.900713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.900715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.900718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.900721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.900723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.900726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.900743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:38.900810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:38.905519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:38.905529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:38.905531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556004160266525:7696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:38.905535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:38.908125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:38.909583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:38.909596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:38.909597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:38.909599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:38.909603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3288 [2:7556556004084681182:3194]
2025-10-02T09:36:38.909612Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:38.909625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:38.909626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.909628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.909629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.909638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:38.909642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:38.909646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:38.909690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.909695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.909696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.909698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:38.909699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:38.909738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:38.909743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.909749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:38.909754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:38.909762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:38.909774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266434:2446], now have 1 active actors on pipe
2025-10-02T09:36:38.909780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266565:7696], now have 1 active actors on pipe
2025-10-02T09:36:38.909783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.909785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.909786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.909793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:38.909801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:38.909805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:38.909807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:38.909808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:38.909808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:38.909809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:38.909822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.909827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:38.909828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:38.909828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3288
2025-10-02T09:36:38.909831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3288
2025-10-02T09:36:38.909872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.909879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.909901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:38.909910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:38.909915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:38.909916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:38.909923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:38.909934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:38.909948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.910078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:38.910083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:38.910090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:38.910151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3289 partition: 0 MaxSeqNo: 36 sessionId: src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0
2025-10-02T09:36:38.910346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956f0a2-73dffabf-8884f4e5-24ed6c96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:38.913196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Write session: try to update token
2025-10-02T09:36:38.913209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:38.918932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:38.918955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:38.918957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:38.918958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:38.918963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.918966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.918968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556004084681177:3194]
2025-10-02T09:36:38.918989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:38.918992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:38.918992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:38.918993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:38.918994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:38.918997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:38.919114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:38.924954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId: src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:38.927499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:38.991931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556004160266579:5886]
2025-10-02T09:36:38.992111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3288, pipe: [1:7556556004160266579:5886]
2025-10-02T09:36:39.029543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.029989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.029999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.030012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556004160266579:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.030144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.030208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556004160266579:5886]
2025-10-02T09:36:39.030226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.030240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.030309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3289 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0
2025-10-02T09:36:39.030461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3289 sessionId: src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0 is DEAD
2025-10-02T09:36:39.030582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.030591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Write session will restart in 0.008561s
2025-10-02T09:36:39.030612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Write session: Do CDS request
2025-10-02T09:36:39.030616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.037188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.038344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.038444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.038451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.038457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.038483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.038503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379648637:3221]
2025-10-02T09:36:39.038848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.039021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.039044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.039218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.039247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.039251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.039252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.039252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.039253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.039253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.039254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.039254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.039255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.039255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.039256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.039256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.039259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.039266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.039268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.039270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.039272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.039274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.039275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.039277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.039280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.039282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.039283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.039285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.039289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.039293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.039296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.039299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.039301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.039304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.039306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.039309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.039312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.039316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.039318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.039321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.039323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.039326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.039328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.039334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.039337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.039340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.039342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.039344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.039350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.039352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.039354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.039357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.039374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.040108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.040222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.040230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3290
2025-10-02T09:36:39.040330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.040350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.040353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.040356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.040672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3290 sessionId:  describe result for acl check
2025-10-02T09:36:39.040701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.040702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.040704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.040707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.041172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.042422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.046220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.046230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.046232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455233980:7713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.046236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.046709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.048244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.048255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.048256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.048258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.048261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3289 [2:7556556008379648637:3221]
2025-10-02T09:36:39.048268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.048278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.048279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.048281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.048282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.048291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.048294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.048298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.048327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.048332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.048333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.048335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.048336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.048373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.048378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.048385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.048390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.048399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.048415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455233880:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.048420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234012:7713], now have 1 active actors on pipe
2025-10-02T09:36:39.048423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.048424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.048425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.048433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.048442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.048446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.048447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.048448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.048452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.048454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.048447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3289
2025-10-02T09:36:39.048450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3289
2025-10-02T09:36:39.048468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.048473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.048475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.048488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.048493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.048553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.048560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.048563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.048564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.048569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.048575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.048589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.048709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.048714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.048721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.048785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3290 partition: 0 MaxSeqNo: 36 sessionId: src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0
2025-10-02T09:36:39.049017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f191e29-97c0febf-9c578a4e-4ba5f33e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.051806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Write session: try to update token
2025-10-02T09:36:39.051816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.057624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.057639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.057640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.057641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.057645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.057649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.057651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379648632:3221]
2025-10-02T09:36:39.057672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.057675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.057675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.057677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.057679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.057681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.057802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.063333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId: src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.065731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.130157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234041:5886]
2025-10-02T09:36:39.130345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3289, pipe: [1:7556556008455234041:5886]
2025-10-02T09:36:39.165932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.166149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.166157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.166169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234041:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.166287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.166325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.166360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234041:5886]
2025-10-02T09:36:39.166367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.166422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0
2025-10-02T09:36:39.166554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3290 sessionId: src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0 is DEAD
2025-10-02T09:36:39.166707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.166718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Write session will restart in 0.009918s
2025-10-02T09:36:39.166733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Write session: Do CDS request
2025-10-02T09:36:39.166738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.173118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.174394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.174489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.174496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.174501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.174527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.174551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379648778:3238]
2025-10-02T09:36:39.174903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.175084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.175106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.175282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.175310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.175314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.175314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.175315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.175316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.175316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.175317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.175317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.175318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.175318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.175319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.175319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.175322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.175328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.175330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.175332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.175334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.175336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.175338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.175340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.175342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.175344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.175346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.175348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.175353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.175357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.175360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.175362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.175364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.175368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.175370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.175373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.175375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.175377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.175379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.175382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.175384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.175386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.175389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.175391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.175394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.175396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.175398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.175401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.175403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.175406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.175408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.175411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.175427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.177124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.177230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.177244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3291
2025-10-02T09:36:39.177382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.177406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.177415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.177418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.177775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3291 sessionId:  describe result for acl check
2025-10-02T09:36:39.177802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.177807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.177809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.177813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.178246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.179835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.182273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.182287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.182289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234141:7762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.182295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.182765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.184205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.184215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.184216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.184219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.184222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3290 [2:7556556008379648778:3238]
2025-10-02T09:36:39.184229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.184239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.184242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.184243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.184244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.184254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.184256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.184260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.184291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.184295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.184297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.184299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.184301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.184337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.184341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.184348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.184353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.184361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.184375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234042:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.184380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234175:7762], now have 1 active actors on pipe
2025-10-02T09:36:39.184384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.184385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.184386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.184394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.184402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.184407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.184396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3290
2025-10-02T09:36:39.184409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.184410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.184411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.184413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.184428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.184402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3290
2025-10-02T09:36:39.184430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.184431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.184441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.184443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.184469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.184475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.184477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.184478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.184484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.184491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.184500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.184604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.184609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.184616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.184683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3291 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0
2025-10-02T09:36:39.184949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0b5d87-7994ceb3-b5186c34-1cb9240c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.187624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Write session: try to update token
2025-10-02T09:36:39.187636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.193577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.193592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.193593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.193594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.193598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.193601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.193603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379648773:3238]
2025-10-02T09:36:39.193623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.193624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.193626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.193627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.193628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.193629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.193745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.198929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId: src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.201351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.266345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234183:5886]
2025-10-02T09:36:39.266541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3290, pipe: [1:7556556008455234183:5886]
2025-10-02T09:36:39.303712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.303974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.303983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.303996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234183:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.304135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.304244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.304288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234183:5886]
2025-10-02T09:36:39.304342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.304407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3291 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0
2025-10-02T09:36:39.304538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3291 sessionId: src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0 is DEAD
2025-10-02T09:36:39.304664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.304671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Write session will restart in 0.005110s
2025-10-02T09:36:39.304689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Write session: Do CDS request
2025-10-02T09:36:39.304695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.311099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.311196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.311206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3292
2025-10-02T09:36:39.311355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.311380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.311388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.311392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.311426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.311699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3292 sessionId:  describe result for acl check
2025-10-02T09:36:39.311730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.311736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.311737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.311740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.312087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.312674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.312769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.312775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.312781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.312824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.312849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379648922:3228]
2025-10-02T09:36:39.313236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.313393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.313415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.313590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.313657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.313661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.313662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.313662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.313663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.313663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.313664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.313664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.313665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.313665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.313666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.313666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.313669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.313675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.313677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.313679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.313681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.313683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.313685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.313686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.313688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.313690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.313692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.313694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.313698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.313702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.313705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.313708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.313710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.313713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.313715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.313718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.313720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.313723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.313725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.313727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.313731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.313734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.313737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.313740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.313742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.313745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.313747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.313750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.313751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.313754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.313757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.313760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.313777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.314052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.318517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.318528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.318530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234279:7773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.318534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.321153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.324437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.324452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.324454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.324456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.324459Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3291 [2:7556556008379648922:3228]
2025-10-02T09:36:39.324474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.324487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.324488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.324491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.324493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.324518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.324521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.324526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.324595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.324601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.324602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.324604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.324606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.324667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.324672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.324679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.324684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.324696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.324713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234318:7773], now have 1 active actors on pipe
2025-10-02T09:36:39.324719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234184:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.324722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.324725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.324727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.324735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.324748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.324749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.324751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.324753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.324760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.324764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.324782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.324788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.324789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.324817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.324824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.324765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3291
2025-10-02T09:36:39.324780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3291
2025-10-02T09:36:39.324862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.324883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.324898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.324905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.324913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.324927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.324951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.325080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.325088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.325098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.325184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3292 partition: 0 MaxSeqNo: 36 sessionId: src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0
2025-10-02T09:36:39.325474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bce22f3-70ccc1a3-e5297c5f-627bc290_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.328329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Write session: try to update token
2025-10-02T09:36:39.328340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.334178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.334191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.334192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.334193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.334197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.334199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.334203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379648917:3228]
2025-10-02T09:36:39.334222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.334230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.334232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.334233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.334236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.334239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.334337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.344397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId: src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.346580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.404591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234340:5886]
2025-10-02T09:36:39.404843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3291, pipe: [1:7556556008455234340:5886]
2025-10-02T09:36:39.442641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.442915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.442925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.442937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234340:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.443173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.443302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234340:5886]
2025-10-02T09:36:39.443322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.443337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.443370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3292 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0
2025-10-02T09:36:39.443500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3292 sessionId: src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0 is DEAD
2025-10-02T09:36:39.443638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.443648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Write session will restart in 0.009671s
2025-10-02T09:36:39.443663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Write session: Do CDS request
2025-10-02T09:36:39.443676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.450171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.451469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.451582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.451589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.451596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.451623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.451646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379649058:3247]
2025-10-02T09:36:39.451989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.452157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.452179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.452353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.452389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.452394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.452394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.452395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.452396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.452396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.452397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.452397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.452398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.452398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.452399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.452400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.452404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.452413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.452417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.452420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.452423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.452426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.452428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.452431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.452434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.452437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.452440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.452442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.452450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.452455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.452460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.452464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.452468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.452472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.452474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.452479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.452484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.452491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.452495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.452499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.452503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.452507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.452514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.452517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.452519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.452523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.452526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.452531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.452534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.452540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.452544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.452548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.452570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.454113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.454291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.454303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3293
2025-10-02T09:36:39.454391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.454410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.454413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.454416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.454687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3293 sessionId:  describe result for acl check
2025-10-02T09:36:39.454712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.454720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.454722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.454725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.455075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.456647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.459353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.459362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.459364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234441:7799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.459367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.459902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.461595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.461608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.461609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.461611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.461614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3292 [2:7556556008379649058:3247]
2025-10-02T09:36:39.461620Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.461630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.461631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.461633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.461634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.461643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.461650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.461654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.461691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.461696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.461697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.461699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.461701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.461735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.461740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.461746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.461751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.461759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.461774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234341:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.461780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234476:7799], now have 1 active actors on pipe
2025-10-02T09:36:39.461784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.461785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.461786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.461793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.461801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.461806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.461808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.461810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.461811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.461812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.461804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3292
2025-10-02T09:36:39.461809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3292
2025-10-02T09:36:39.461828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.461833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.461834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.461844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.461846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.461871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.461878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.461880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.461881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.461885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.461892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.461901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.462001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.462006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.462013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.462068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3293 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0
2025-10-02T09:36:39.462267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ebbf26-6a35ac31-eb664440-951ac1ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.464944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Write session: try to update token
2025-10-02T09:36:39.464954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.470966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.470978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.470979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.470983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.470987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.470989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.470991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379649053:3247]
2025-10-02T09:36:39.471015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.471017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.471019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.471019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.471023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.471025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.471178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.479066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId: src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.481212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.543324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234484:5886]
2025-10-02T09:36:39.543494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3292, pipe: [1:7556556008455234484:5886]
2025-10-02T09:36:39.579307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.579606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.579614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.579626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234484:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.579761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.580003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.580037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.580048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234484:5886]
2025-10-02T09:36:39.580084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3293 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0
2025-10-02T09:36:39.580228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3293 sessionId: src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0 is DEAD
2025-10-02T09:36:39.580453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.580463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Write session will restart in 0.008636s
2025-10-02T09:36:39.580478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Write session: Do CDS request
2025-10-02T09:36:39.580482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.586737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.588055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.588178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.588185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.588191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.588221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.588243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379649193:3254]
2025-10-02T09:36:39.588594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.588763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.588787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.588977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.589006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.589010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.589010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.589011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.589011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.589012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.589012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.589013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.589013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.589014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.589014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.589015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.589018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.589025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.589027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.589029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.589031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.589033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.589035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.589037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.589039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.589041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.589043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.589045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.589049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.589053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.589056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.589059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.589062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.589064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.589066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.589069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.589071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.589077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.589079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.589082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.589085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.589087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.589090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.589092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.589095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.589097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.589099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.589102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.589104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.589107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.589110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.589112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.589130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.590095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.590243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.590253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3294
2025-10-02T09:36:39.590349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.590366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.590381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.590386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.590643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3294 sessionId:  describe result for acl check
2025-10-02T09:36:39.590667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.590671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.590673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.590676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.591022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.592282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.595842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.595850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.595852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234586:7815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.595856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.596392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.597866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.597879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.597880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.597883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.597886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3293 [2:7556556008379649193:3254]
2025-10-02T09:36:39.597892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.597902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.597904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.597905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.597906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.597915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.597922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.597926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.597954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.597959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.597960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.597962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.597964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.597997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.598002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.598008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.598014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.598025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.598039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234620:7815], now have 1 active actors on pipe
2025-10-02T09:36:39.598044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234485:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.598047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.598049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.598050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.598057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.598064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.598063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3293
2025-10-02T09:36:39.598069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.598064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3293
2025-10-02T09:36:39.598071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.598072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.598075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.598076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.598089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.598091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.598092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.598100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.598103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.598129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.598135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.598137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.598139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.598144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.598150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.598159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.598244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.598251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.598258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.598310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3294 partition: 0 MaxSeqNo: 36 sessionId: src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0
2025-10-02T09:36:39.598533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9bbf056-cd3ff7ed-9736b012-ae98370d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.601029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Write session: try to update token
2025-10-02T09:36:39.601043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.607100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.607111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.607112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.607113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.607116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.607118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.607120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379649188:3254]
2025-10-02T09:36:39.607138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.607140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.607141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.607143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.607148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.607150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.607245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.613227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId: src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.615367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.680034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234628:5886]
2025-10-02T09:36:39.680185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3293, pipe: [1:7556556008455234628:5886]
2025-10-02T09:36:39.715498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.715747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.715755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.715768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234628:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.715874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:39.715884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:39.715897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.715912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.715933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3294 reason: error at write: Disconnected sessionId: src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0
2025-10-02T09:36:39.715944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234628:5886]
2025-10-02T09:36:39.716079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3294 sessionId: src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0 is DEAD
2025-10-02T09:36:39.716234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:39.716248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Write session will restart in 0.009755s
2025-10-02T09:36:39.716272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Write session: Do CDS request
2025-10-02T09:36:39.716277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.723101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.724311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.724413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.724421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.724426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.724451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.724476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379649330:3258]
2025-10-02T09:36:39.724831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.725005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.725027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.725240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.725273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.725278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.725278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.725281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.725281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.725281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.725282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.725283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.725285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.725292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.725296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.725298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.725300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.725302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.725304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.725306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.725308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.725310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.725312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.725316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.725320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.725324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.725327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.725329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.725332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.725334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.725337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.725340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.725343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.725345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.725348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.725350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.725353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.725355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.725358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.725360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.725362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.725364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.725367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.725370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.725373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.725375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.725378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.725394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.727212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.727361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.727369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3295
2025-10-02T09:36:39.727450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.727467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.727473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.727476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.727742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3295 sessionId:  describe result for acl check
2025-10-02T09:36:39.727766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.727771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.727772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.727775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.728119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.729556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.732185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.732194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.732196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234735:7825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.732199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.732692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.734181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.734194Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.734195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.734197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.734200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3294 [2:7556556008379649330:3258]
2025-10-02T09:36:39.734208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.734217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.734218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.734220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.734221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.734230Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.734238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.734243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.734269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.734274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.734275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.734276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.734277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.734311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.734316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.734322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.734327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.734335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.734349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234769:7825], now have 1 active actors on pipe
2025-10-02T09:36:39.734355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234631:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.734358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.734359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.734360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.734368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.734375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.734380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.734381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.734383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.734387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.734387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3294
2025-10-02T09:36:39.734389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.734395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.734397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.734406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.734412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3294
2025-10-02T09:36:39.734442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.734448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.734461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.734469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.734471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.734472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.734477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.734485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.734494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.734602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.734607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.734614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.734668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3295 partition: 0 MaxSeqNo: 36 sessionId: src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0
2025-10-02T09:36:39.734911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23b7e19-fe1781be-f2f61a3-cec94623_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.737278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Write session: try to update token
2025-10-02T09:36:39.737290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.747398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:39.747410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.747414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.747435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:39.747437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:39.747577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:39.747698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:39.747819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:39.747941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:39.748097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:39.748122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:39.749781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId: src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.751690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.751701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.751702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.751703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.751707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.751710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.751712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379649325:3258]
2025-10-02T09:36:39.751734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.751734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.751736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.751737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.751738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.751739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.751892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.752012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.816217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234779:5886]
2025-10-02T09:36:39.816348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3294, pipe: [1:7556556008455234779:5886]
2025-10-02T09:36:39.860522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.860821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.860829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.860842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234779:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.860991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.861002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.861038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:39.861040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234779:5886]
2025-10-02T09:36:39.861102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3295 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0
2025-10-02T09:36:39.861236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3295 sessionId: src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0 is DEAD
2025-10-02T09:36:39.861400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:39.861415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Write session will restart in 0.007260s
2025-10-02T09:36:39.861436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Write session: Do CDS request
2025-10-02T09:36:39.861452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:39.867809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:39.869056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:39.869171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:39.869178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:39.869183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:39.869209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:39.869234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556008379649466:3276]
2025-10-02T09:36:39.869624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:39.869801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:39.869826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:39.870014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:39.870045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.870049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.870050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.870050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.870051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.870051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.870052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.870052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.870053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.870053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.870054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.870054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.870057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.870064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.870067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.870069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.870071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.870073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.870075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.870077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.870079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.870081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.870083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.870085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.870089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.870093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:39.870096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.870099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:39.870101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.870104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:39.870108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.870113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:39.870115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.870118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:39.870120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.870123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:39.870125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.870127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:39.870129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.870132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:39.870134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.870136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:39.870138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.870145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.870147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.870150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.870151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.870154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.870171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:39.870203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.870249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:39.870257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3296
2025-10-02T09:36:39.870444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:39.870463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:39.870469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:39.870471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:39.870724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3296 sessionId:  describe result for acl check
2025-10-02T09:36:39.870747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:39.870751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:39.870753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:39.870756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:39.871094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:39.872349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:39.876285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:39.876293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:39.876295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556008455234884:7849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:39.876300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:39.877503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:39.878905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:39.878916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:39.878917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:39.878919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:39.878922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3295 [2:7556556008379649466:3276]
2025-10-02T09:36:39.878929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:39.878939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:39.878953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.878954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.878955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.878965Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:39.878967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:39.878971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:39.879002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.879007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.879008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.879010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:39.879012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:39.879054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:39.879059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.879065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:39.879071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:39.879079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:39.879093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234781:2446], now have 1 active actors on pipe
2025-10-02T09:36:39.879098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234919:7849], now have 1 active actors on pipe
2025-10-02T09:36:39.879103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.879104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.879105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.879112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:39.879119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:39.879114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3295
2025-10-02T09:36:39.879118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3295
2025-10-02T09:36:39.879125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:39.879126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:39.879128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:39.879129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:39.879130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:39.879144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.879146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:39.879147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:39.879155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.879157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.879183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:39.879189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:39.879192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:39.879193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:39.879198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:39.879204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:39.879213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.879296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.879302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.879309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:39.879362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3296 partition: 0 MaxSeqNo: 36 sessionId: src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0
2025-10-02T09:36:39.879551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41045c06-38f844bc-53aadb4c-14b1d9df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:39.882364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Write session: try to update token
2025-10-02T09:36:39.882375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:39.888277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:39.888294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:39.888295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:39.888296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:39.888301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.888304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.888305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556008379649461:3276]
2025-10-02T09:36:39.888327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:39.888330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:39.888331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:39.888332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:39.888335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:39.888337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:39.888480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:39.894328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId: src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:39.896325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:39.961115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556008455234933:5886]
2025-10-02T09:36:39.961267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3295, pipe: [1:7556556008455234933:5886]
2025-10-02T09:36:39.996911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:39.997178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:39.997186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:39.997199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234933:5886], now have 1 active actors on pipe
2025-10-02T09:36:39.997306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:39.997316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:39.997333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:39.997340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556008455234933:5886]
2025-10-02T09:36:39.997343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:39.997391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3296 reason: error at write: Disconnected sessionId: src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0
2025-10-02T09:36:39.997519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3296 sessionId: src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0 is DEAD
2025-10-02T09:36:39.997737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:39.997742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Write session will restart in 0.009614s
2025-10-02T09:36:39.997762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Write session: Do CDS request
2025-10-02T09:36:39.997767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.004240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.005524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.005622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.005628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.005634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.005659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.005682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674616900:3278]
2025-10-02T09:36:40.006025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.006181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.006203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.006377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.006405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.006409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.006410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.006410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.006411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.006411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.006412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.006412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.006413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.006413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.006414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.006414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.006417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.006424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.006426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.006428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.006430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.006432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.006434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.006436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.006438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.006440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.006442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.006444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.006448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.006452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.006455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.006458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.006460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.006463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.006465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.006467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.006469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.006472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.006474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.006476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.006478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.006481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.006482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.006485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.006488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.006491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.006493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.006495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.006499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.006501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.006503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.006508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.006523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.008205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.008300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.008315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3297
2025-10-02T09:36:40.008398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.008425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.008434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.008437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.008720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3297 sessionId:  describe result for acl check
2025-10-02T09:36:40.008748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.008754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.008755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.008758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.009119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.010635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.013299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.013311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.013313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750202338:7867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.013316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.013843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.015400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.015412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.015413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.015415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.015418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3296 [2:7556556012674616900:3278]
2025-10-02T09:36:40.015424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.015434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.015439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.015441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.015442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.015450Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.015453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.015457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.015488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.015493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.015494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.015497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.015498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.015535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.015539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.015546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.015551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.015559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.015573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556008455234934:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.015579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202371:7867], now have 1 active actors on pipe
2025-10-02T09:36:40.015582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.015584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.015585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.015593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.015603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.015604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.015606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.015608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.015601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3296
2025-10-02T09:36:40.015613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.015615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.015606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3296
2025-10-02T09:36:40.015629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.015630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.015632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.015643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.015648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.015673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.015682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.015684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.015685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.015691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.015697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.015706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.015785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.015790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.015798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.015841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3297 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0
2025-10-02T09:36:40.016040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796deca3-bdd32dc0-a3350b14-5fee8e1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.018839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Write session: try to update token
2025-10-02T09:36:40.018850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.025015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.025029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.025031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.025032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.025036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.025039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.025042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674616895:3278]
2025-10-02T09:36:40.025063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.025066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.025068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.025099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.025120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.025135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.025185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.030539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId: src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.032854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.097332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750202380:5886]
2025-10-02T09:36:40.097707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3296, pipe: [1:7556556012750202380:5886]
2025-10-02T09:36:40.135833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.136100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.136108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.136119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202380:5886], now have 1 active actors on pipe
2025-10-02T09:36:40.136224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.136247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.136263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:40.136285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750202380:5886]
2025-10-02T09:36:40.136318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0
2025-10-02T09:36:40.136454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3297 sessionId: src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0 is DEAD
2025-10-02T09:36:40.136591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:40.136603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Write session will restart in 0.006766s
2025-10-02T09:36:40.136621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Write session: Do CDS request
2025-10-02T09:36:40.136625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.143248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.144085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.144343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.144354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3298
2025-10-02T09:36:40.144438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.144459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.144466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.144469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.144556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.144655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.144662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.144667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.144693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.144719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617076:3313]
2025-10-02T09:36:40.144727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3298 sessionId:  describe result for acl check
2025-10-02T09:36:40.144752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.144758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.144759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.144761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.145071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.145091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.145237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.145259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.145432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.145463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.145467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.145468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.145468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.145469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.145469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.145470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.145470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.145471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.145471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.145472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.145472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.145476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.145482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.145484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.145486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.145488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.145490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.145492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.145494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.145496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.145498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.145500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.145502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.145506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.145510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.145513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.145516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.145518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.145520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.145522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.145525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.145527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.145530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.145532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.145535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.145537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.145540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.145542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.145548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.145550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.145553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.145555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.145557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.145560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.145562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.145564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.145568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.145585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.146250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.151297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.151308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.151310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750202504:7917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.151313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.152932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.154434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.154446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.154448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.154450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.154453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3297 [2:7556556012674617076:3313]
2025-10-02T09:36:40.154460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.154470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.154473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.154475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.154476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.154485Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.154488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.154492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.154520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.154526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.154526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.154529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.154530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.154570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.154574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.154581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.154587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.154596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.154609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202403:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.154615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202543:7917], now have 1 active actors on pipe
2025-10-02T09:36:40.154618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.154619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.154621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.154629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.154637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.154641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.154643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.154644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.154644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.154645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.154659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.154660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.154647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3297
2025-10-02T09:36:40.154650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3297
2025-10-02T09:36:40.154662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.154674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.154676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.154720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.154728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.154730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.154732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.154737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.154742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.154754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.154855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.154860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.154868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.154917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3298 partition: 0 MaxSeqNo: 36 sessionId: src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0
2025-10-02T09:36:40.155134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab41b83-df2836f2-d97c8598-8bd084da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.157844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Write session: try to update token
2025-10-02T09:36:40.157855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.163751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.163767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.163769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.163772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.163776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.163779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.163781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617071:3313]
2025-10-02T09:36:40.163802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.163805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.163806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.163807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.163810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.163814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.163921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.170216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId: src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.172473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.236723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750202551:5886]
2025-10-02T09:36:40.236884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3297, pipe: [1:7556556012750202551:5886]
2025-10-02T09:36:40.274663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.274955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.274966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.274979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202551:5886], now have 1 active actors on pipe
2025-10-02T09:36:40.275147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.275171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.275210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:40.275269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0
2025-10-02T09:36:40.275310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750202551:5886]
2025-10-02T09:36:40.275395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3298 sessionId: src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0 is DEAD
2025-10-02T09:36:40.275522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:40.275532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Write session will restart in 0.008245s
2025-10-02T09:36:40.275547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Write session: Do CDS request
2025-10-02T09:36:40.275551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.282019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.283268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.283410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.283418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.283453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.283477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617228:3331]
2025-10-02T09:36:40.283815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.283979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.284003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.284215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.284215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.284216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.284216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.284218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.284218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.284218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.284222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.284229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.284231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.284233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.284235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.284237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.284239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.284243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.284245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.284247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.284249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.284251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.284259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.284263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.284267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.284270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.284272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.284275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.284277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.284280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.284282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.284285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.284287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.284289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.284291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.284296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.284299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.284301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.284303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.284305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.284308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.284310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.284313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.284331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.285129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.285271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.285282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3299
2025-10-02T09:36:40.285381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.285401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.285408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.285411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.285709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3299 sessionId:  describe result for acl check
2025-10-02T09:36:40.285735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.285741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.285743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.285746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.286083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.287606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.291152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.291164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.291166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750202658:7930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.291170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.291658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.293209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.293221Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.293224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.293225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.293228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3298 [2:7556556012674617228:3331]
2025-10-02T09:36:40.293235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.293245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.293250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.293251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.293252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.293261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.293263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.293270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.293299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.293303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.293305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.293306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.293308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.293343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.293347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.293354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.293359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.293368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.293380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202552:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.293386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202693:7930], now have 1 active actors on pipe
2025-10-02T09:36:40.293389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.293390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.293391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.293400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.293411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.293412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.293414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.293415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.293421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.293423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.293411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3298
2025-10-02T09:36:40.293416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3298
2025-10-02T09:36:40.293435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.293441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.293442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.293452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.293458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.293489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.293499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.293501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.293504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.293509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.293514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.293526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.293605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.293610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.293617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.293670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3299 partition: 0 MaxSeqNo: 36 sessionId: src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0
2025-10-02T09:36:40.293857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63553abf-bb21bc13-a62338b7-a057a7a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.296574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Write session: try to update token
2025-10-02T09:36:40.296585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.303213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.303227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.303228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.303229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.303235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.303237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.303239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617223:3331]
2025-10-02T09:36:40.303265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.303273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.303274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.303310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.303332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.303338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.303393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.308855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId: src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.311144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.375321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750202716:5886]
2025-10-02T09:36:40.375471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3298, pipe: [1:7556556012750202716:5886]
2025-10-02T09:36:40.412512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.412787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.412796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.412821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202716:5886], now have 1 active actors on pipe
2025-10-02T09:36:40.412942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.412962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750202716:5886]
2025-10-02T09:36:40.412968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.413037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:40.413089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3299 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0
2025-10-02T09:36:40.413221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3299 sessionId: src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0 is DEAD
2025-10-02T09:36:40.413369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:40.413381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Write session will restart in 0.008239s
2025-10-02T09:36:40.413395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Write session: Do CDS request
2025-10-02T09:36:40.413399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.419779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.421031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.421170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.421178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.421184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.421213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.421236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617371:3333]
2025-10-02T09:36:40.421575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.421729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.421752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.421929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.421955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.421959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.421960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.421960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.421960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.421961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.421962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.421962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.421963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.421963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.421964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.421965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.421967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.421975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.421978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.421980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.421981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.421984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.421985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.421987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.421989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.421991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.421993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.421995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.421999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.422002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.422006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.422009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.422011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.422013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.422016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.422018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.422025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.422028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.422030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.422032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.422035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.422037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.422039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.422042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.422044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.422047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.422049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.422051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.422055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.422059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.422061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.422063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.422080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.422080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.422213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.422229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3300
2025-10-02T09:36:40.422332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.422352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.422355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.422357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.422622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3300 sessionId:  describe result for acl check
2025-10-02T09:36:40.422648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.422655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.422657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.422660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.423000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.424284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.428244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.428253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.428255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750202824:7941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.428259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.429463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.430889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.430901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.430903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.430905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.430908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3299 [2:7556556012674617371:3333]
2025-10-02T09:36:40.430915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.430925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.430929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.430931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.430932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.430941Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.430943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.430956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.430989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.430994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.430995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.430997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.430999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.431034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.431038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.431045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.431051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.431061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.431075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202717:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.431080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202859:7941], now have 1 active actors on pipe
2025-10-02T09:36:40.431084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.431086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.431087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.431095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.431101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.431105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.431107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.431108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.431109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.431110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.431104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3299
2025-10-02T09:36:40.431123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.431107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3299
2025-10-02T09:36:40.431128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.431129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.431144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.431147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.431166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.431174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.431176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.431177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.431182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.431190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.431205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.431297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.431302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.431309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.431358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3300 partition: 0 MaxSeqNo: 36 sessionId: src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0
2025-10-02T09:36:40.431584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2737d497-78d60b06-f9fb51dc-f67cc2a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.434365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Write session: try to update token
2025-10-02T09:36:40.434376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.440320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.440338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.440340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.440342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.440351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.440355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.440358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617366:3333]
2025-10-02T09:36:40.440381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.440383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.440386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.440388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.440388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.440389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.440515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.446877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId: src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.449165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.513072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750202866:5886]
2025-10-02T09:36:40.513249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3299, pipe: [1:7556556012750202866:5886]
2025-10-02T09:36:40.548999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.549238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.549247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.549259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202866:5886], now have 1 active actors on pipe
2025-10-02T09:36:40.549376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.549432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.549437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750202866:5886]
2025-10-02T09:36:40.549454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:40.549508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0
2025-10-02T09:36:40.549648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3300 sessionId: src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0 is DEAD
2025-10-02T09:36:40.549775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:40.549787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Write session will restart in 0.009049s
2025-10-02T09:36:40.549805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Write session: Do CDS request
2025-10-02T09:36:40.549810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.556974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.558236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.558345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.558352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.558358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.558387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.558412Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617512:3341]
2025-10-02T09:36:40.558753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.558917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.558940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.559128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.559157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.559161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.559161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.559162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.559163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.559163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.559164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.559164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.559165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.559165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.559166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.559166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.559169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.559176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.559178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.559180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.559182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.559184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.559186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.559188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.559190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.559192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.559194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.559196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.559200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.559204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.559207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.559210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.559212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.559215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.559217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.559220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.559222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.559225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.559227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.559229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.559231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.559234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.559236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.559238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.559240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.559243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.559245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.559248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.559250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.559254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.559256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.559259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.559275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.560094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.560195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.560206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3301
2025-10-02T09:36:40.560272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.560293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.560301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.560303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.560643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3301 sessionId:  describe result for acl check
2025-10-02T09:36:40.560669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.560675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.560677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.560680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.561034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.562605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.566129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.566140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.566144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750202976:7962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.566147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.566644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.568148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.568162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.568163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.568165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.568168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3300 [2:7556556012674617512:3341]
2025-10-02T09:36:40.568174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.568184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.568185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.568187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.568188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.568197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.568201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.568205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.568236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.568242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.568243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.568244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.568246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.568282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.568286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.568293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.568298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.568308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.568322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203011:7962], now have 1 active actors on pipe
2025-10-02T09:36:40.568327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750202868:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.568330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.568332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.568333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.568341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.568348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.568352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.568354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.568356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.568356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.568358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.568356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3300
2025-10-02T09:36:40.568358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3300
2025-10-02T09:36:40.568372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.568376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.568378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.568388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.568389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.568447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.568454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.568456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.568457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.568463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.568468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.568479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.568560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.568565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.568574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.568631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3301 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0
2025-10-02T09:36:40.568835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2155d0fa-fa6ea708-19ae2546-8a863a46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.571575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Write session: try to update token
2025-10-02T09:36:40.571585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.577775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.577793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.577794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.577796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.577801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.577804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.577806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617507:3341]
2025-10-02T09:36:40.577827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.577832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.577834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.577844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.577848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.577851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.577956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.583916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId: src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.586218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.649763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750203018:5886]
2025-10-02T09:36:40.650354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3300, pipe: [1:7556556012750203018:5886]
2025-10-02T09:36:40.687281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.687544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.687554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.687565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203018:5886], now have 1 active actors on pipe
2025-10-02T09:36:40.687693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.687730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.687749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750203018:5886]
2025-10-02T09:36:40.687763Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:36:40.687764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:40.687815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3301 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0
2025-10-02T09:36:40.687864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3301 sessionId: src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0 is DEAD
2025-10-02T09:36:40.687910Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 33 consumer shared/user session shared/user_1_33_14522621208006915550_v1 is DEAD
2025-10-02T09:36:40.688024Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555952620646553:5839] disconnected; active server actors: 1
2025-10-02T09:36:40.688032Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555952620646553:5839] client user disconnected session shared/user_1_33_14522621208006915550_v1
2025-10-02T09:36:40.688050Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:36:40.688097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:40.688105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Write session will restart in 0.007318s
2025-10-02T09:36:40.688119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Write session: Do CDS request
2025-10-02T09:36:40.688124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.688158Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:40.688163Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:40.688170Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008315s
2025-10-02T09:36:40.695065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.696112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.696235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.696247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3302
2025-10-02T09:36:40.696347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.696369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.696377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.696380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.696385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.696551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.696559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.696565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.696598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.696620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617655:3346]
2025-10-02T09:36:40.696643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3302 sessionId:  describe result for acl check
2025-10-02T09:36:40.696668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.696673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.696674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.696677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.696980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.697052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.697100Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:36:40.697156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.697180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.697215Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:36:40.697220Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 34
2025-10-02T09:36:40.697322Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 34 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:40.697349Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:40.697355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.697382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.697386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.697387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.697387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.697393Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 auth for : user
2025-10-02T09:36:40.697388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.697388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.697389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.697389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.697389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.697390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.697390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.697391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.697394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.697399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.697401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.697404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.697405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.697408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.697410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.697412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.697414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.697416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.697418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.697420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.697424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.697428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.697432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.697447Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 Handle describe topics response
2025-10-02T09:36:40.697434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.697460Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 auth is DEAD
2025-10-02T09:36:40.697438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.697463Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:36:40.697441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.697443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.697446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.697448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.697451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.697453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.697456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.697458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.697461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.697464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.697466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.697469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.697471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.697473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.697476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.697478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.697480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.697482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.697485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.697501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.697631Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:36:40.697671Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556012750203147:7996] connected; active server actors: 1
2025-10-02T09:36:40.697679Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556012750203147:7996] session shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:40.697683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:36:40.697690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:36:40.697694Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_34_8835201686720473460_v1" (Sender=[1:7556556012750203131:7996], Pipe=[1:7556556012750203147:7996], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:40.697699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:36:40.697701Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:40.697704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:36:40.697709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_34_8835201686720473460_v1" (Sender=[1:7556556012750203131:7996], Pipe=[1:7556556012750203147:7996], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:40.697714Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_34_8835201686720473460_v1" sender [1:7556556012750203131:7996] lock partition 0 for ReadingSession "shared/user_1_34_8835201686720473460_v1" (Sender=[1:7556556012750203131:7996], Pipe=[1:7556556012750203147:7996], Partitions=[], ActiveFamilyCount=1) generation 1 step 34
2025-10-02T09:36:40.697719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:36:40.697721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000015s
2025-10-02T09:36:40.697829Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 34 Session: "shared/user_1_34_8835201686720473460_v1" ClientId: "user" PipeClient { RawX1: 7556556012750203147 RawX2: 4503603922345788 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:36:40.697840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:36:40.698205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.702242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.702250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.702252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750203125:7990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.702256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.704909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.706497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.706509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.706511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.706513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.706516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3301 [2:7556556012674617655:3346]
2025-10-02T09:36:40.706523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.706533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.706536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.706538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.706539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.706548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.706553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.706557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.706588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.706594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.706596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.706598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.706600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.706645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.706650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.706657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.706662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.706673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.706687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203154:8014], now have 1 active actors on pipe
2025-10-02T09:36:40.706693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203171:7990], now have 1 active actors on pipe
2025-10-02T09:36:40.706695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203020:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.706699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.706700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.706701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.706709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.706719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.706721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.706714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3301
2025-10-02T09:36:40.706723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.706724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.706719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3301, pipe: [1:7556556012750203154:8014]
2025-10-02T09:36:40.706730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.706732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3301
2025-10-02T09:36:40.706732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.706752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.706757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.706765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.706772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.706778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.706779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.706782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.706785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_34_8835201686720473460_v1 on pipe: [1:7556556012750203154:8014]
2025-10-02T09:36:40.706812Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_34_8835201686720473460_v1:1 with generation 3301
2025-10-02T09:36:40.706815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.706819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.706821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.706823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.706827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.706832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.706843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.706849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.706850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.706858Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:40.706862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.706877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.706894Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:36:40.706985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.706991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.706999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.707077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3302 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0
2025-10-02T09:36:40.707302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e461bd6-4e4a612b-78328451-a7327f4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.710090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Write session: try to update token
2025-10-02T09:36:40.710104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.710253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:36:40.710271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:36:40.710276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.710281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.710282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.710284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:36:40.710288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:36:40.710363Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397800706 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:36:40.710375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:36:40.710394Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 sending to client partition status
2025-10-02T09:36:40.716106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.716120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.716122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.716123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.716128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.716134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.716136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617650:3346]
2025-10-02T09:36:40.716156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.716162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.716162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.716163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.716166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.716169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.716273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.721923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId: src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.724102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.827282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.827601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.827615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.827778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:40.827793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.827783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:40.827789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.827796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:40.827819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750203154:8014]
2025-10-02T09:36:40.827814Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:40.827840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3302 reason: error at write: Disconnected sessionId: src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0
2025-10-02T09:36:40.827974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3302 sessionId: src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0 is DEAD
2025-10-02T09:36:40.828133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:40.828148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Write session will restart in 0.009322s
2025-10-02T09:36:40.828170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Write session: Do CDS request
2025-10-02T09:36:40.828175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.835122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.836347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.836446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.836453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.836458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.836482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.836506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617802:3344]
2025-10-02T09:36:40.836879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.837073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.837105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.837344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.837385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.837390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.837392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.837392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.837393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.837393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.837395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.837395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.837398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.837405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.837407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.837409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.837411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.837413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.837415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.837417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.837419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.837421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.837423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.837425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.837428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.837432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.837435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.837438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.837440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.837443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.837445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.837447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.837450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.837452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.837455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.837457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.837460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.837463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.837465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.837467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.837469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.837472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.837475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.837478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.837480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.837483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.837485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.837487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.837507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.838120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.838224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.838234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3303
2025-10-02T09:36:40.838301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.838318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.838324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.838326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.838580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3303 sessionId:  describe result for acl check
2025-10-02T09:36:40.838599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.838601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.838602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.838605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.838958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.840634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.844294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.844302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.844303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750203289:8011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.844307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.844837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.846348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.846360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.846361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.846363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.846367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3302 [2:7556556012674617802:3344]
2025-10-02T09:36:40.846372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.846382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.846387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.846389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.846390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.846399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.846401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.846406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.846434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.846438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.846439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.846441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.846443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.846478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.846483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.846489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.846494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.846504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.846518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203324:8011], now have 1 active actors on pipe
2025-10-02T09:36:40.846523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203179:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.846527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.846528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.846529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.846536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.846532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3302
2025-10-02T09:36:40.846545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.846539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3302
2025-10-02T09:36:40.846554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.846555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.846560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.846568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.846569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.846576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.846578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.846592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.846602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.846612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.846617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.846621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.846623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.846624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.846628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.846633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.846647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.846724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.846732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.846742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.846796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3303 partition: 0 MaxSeqNo: 36 sessionId: src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0
2025-10-02T09:36:40.846985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f2bf94-b1507810-d22b6710-a79bfb8f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.849811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Write session: try to update token
2025-10-02T09:36:40.849821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.856250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.856266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.856267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.856268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.856272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.856275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.856278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617797:3344]
2025-10-02T09:36:40.856299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.856303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.856305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.856305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.856309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.856313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.856427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:40.862287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId: src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:40.864604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:40.927775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556012750203335:8014]
2025-10-02T09:36:40.927962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3302, pipe: [1:7556556012750203335:8014]
2025-10-02T09:36:40.965375Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:40.965619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.965629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.965640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203335:8014], now have 1 active actors on pipe
2025-10-02T09:36:40.965782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:40.965804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556012750203335:8014]
2025-10-02T09:36:40.965810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:40.965814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:40.965831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:40.965869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3303 reason: error at write: Disconnected sessionId: src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0
2025-10-02T09:36:40.966023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3303 sessionId: src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0 is DEAD
2025-10-02T09:36:40.966139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:40.966148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Write session will restart in 0.005016s
2025-10-02T09:36:40.966163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Write session: Do CDS request
2025-10-02T09:36:40.966167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:40.972163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.972237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:40.972246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3304
2025-10-02T09:36:40.972361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:40.972382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:40.972388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:40.972391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:40.972682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3304 sessionId:  describe result for acl check
2025-10-02T09:36:40.972705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:40.972709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:40.972710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:40.972713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:40.973076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:40.973347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:40.974633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:40.974764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:40.974772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:40.974778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:40.974785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:40.974813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:40.974845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556012674617946:3345]
2025-10-02T09:36:40.975210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:40.975377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:40.975403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:40.975624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:40.975663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.975668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.975668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.975669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.975669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.975670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.975671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.975671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.975672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.975672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.975673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.975674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.975676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.975682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.975685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.975687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.975689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.975691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.975693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.975695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.975697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.975699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.975701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.975703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.975707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.975711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:40.975716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.975719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:40.975721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.975723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:40.975725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.975728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:40.975730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.975732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:40.975734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.975737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:40.975739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.975742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:40.975744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.975746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:40.975749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.975751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:40.975754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.975758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.975761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.975764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.975766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.975768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.975786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:40.979612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:40.979622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:40.979624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556012750203442:8030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:40.979627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:40.983194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:40.984661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:40.984672Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:40.984674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:40.984676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:40.984679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3303 [2:7556556012674617946:3345]
2025-10-02T09:36:40.984685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:40.984694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:40.984698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.984699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.984700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.984709Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:40.984714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:40.984717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:40.984746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.984752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.984752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.984754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:40.984756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:40.984794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:40.984798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.984817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:40.984823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:40.984833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:40.984848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203338:2446], now have 1 active actors on pipe
2025-10-02T09:36:40.984854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556012750203484:8030], now have 1 active actors on pipe
2025-10-02T09:36:40.984857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.984859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.984860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.984866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:40.984857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3303
2025-10-02T09:36:40.984873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:40.984873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:40.984860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3303
2025-10-02T09:36:40.984875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:40.984877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:40.984884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:40.984885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:40.984898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.984903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.984920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.984927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:40.984937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:40.984942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:40.984943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:40.984945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:40.984947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:40.984951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:40.984956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:40.985005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.985098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:40.985103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:40.985111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:40.985156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3304 partition: 0 MaxSeqNo: 36 sessionId: src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0
2025-10-02T09:36:40.985358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577b5d6b-fb5df54e-ae32a580-bde43ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:40.988092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Write session: try to update token
2025-10-02T09:36:40.988103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:40.994164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:40.994178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:40.994180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:40.994181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:40.994185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.994188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.994190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556012674617941:3345]
2025-10-02T09:36:40.994212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:40.994215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:40.994216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:40.994217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:40.994220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:40.994224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:40.994340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.000331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId: src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.002627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.066006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045170791:8014]
2025-10-02T09:36:41.066130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3303, pipe: [1:7556556017045170791:8014]
2025-10-02T09:36:41.105381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.105645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.105653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.105665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045170791:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.105781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.105808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045170791:8014]
2025-10-02T09:36:41.105826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.105836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:41.105892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0
2025-10-02T09:36:41.106027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3304 sessionId: src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0 is DEAD
2025-10-02T09:36:41.106166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:41.106175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Write session will restart in 0.006554s
2025-10-02T09:36:41.106189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Write session: Do CDS request
2025-10-02T09:36:41.106193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.113361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.114108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.114218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.114227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3305
2025-10-02T09:36:41.114343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.114367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.114375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.114378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.114664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3305 sessionId:  describe result for acl check
2025-10-02T09:36:41.114684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.114689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.114690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.114703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.114693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.114843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.114851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.114857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.114887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.114909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969585417:3373]
2025-10-02T09:36:41.115038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.115255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.115426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.115448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.115627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.115655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.115659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.115660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.115660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.115661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.115662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.115662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.115663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.115663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.115664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.115664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.115665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.115667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.115673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.115675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.115677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.115679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.115682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.115684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.115686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.115688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.115690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.115692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.115694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.115697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.115701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.115704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.115707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.115709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.115712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.115714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.115716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.115719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.115722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.115724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.115726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.115729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.115731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.115733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.115736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.115738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.115741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.115745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.115748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.115750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.115752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.115754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.115757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.115774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.116479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.120592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.120600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.120602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045170900:8039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.120606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.123307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.124772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.124785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.124786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.124788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.124791Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3304 [2:7556556016969585417:3373]
2025-10-02T09:36:41.124797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.124821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.124822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.124824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.124825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.124834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.124837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.124841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.124870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.124876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.124879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.124881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.124882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.124918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.124923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.124929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.124935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.124942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.124956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045170792:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.124962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045170939:8039], now have 1 active actors on pipe
2025-10-02T09:36:41.124966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.124967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.124968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.124975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.124985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.124988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.124990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.124991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.124994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.124995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.124993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3304
2025-10-02T09:36:41.124995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3304
2025-10-02T09:36:41.125008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.125013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.125014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.125025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.125029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.125080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.125087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.125089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.125090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.125095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.125100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.125116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.125207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.125212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.125219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.125280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3305 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0
2025-10-02T09:36:41.125485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29fe02a5-70c52c6e-4b00578d-8d9e865e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.128219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Write session: try to update token
2025-10-02T09:36:41.128229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.134286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.134302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.134303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.134304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.134310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.134314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.134315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969585412:3373]
2025-10-02T09:36:41.134336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.134342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.134344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.134380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.134394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.134397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.134466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.140593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId: src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.142849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.205791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045170969:8014]
2025-10-02T09:36:41.205976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3304, pipe: [1:7556556017045170969:8014]
2025-10-02T09:36:41.244464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.244731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.244741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.244752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045170969:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.244917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.244892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.244903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:41.244906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:41.244928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045170969:8014]
2025-10-02T09:36:41.244962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3305 reason: error at write: Disconnected sessionId: src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0
2025-10-02T09:36:41.245087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3305 sessionId: src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0 is DEAD
2025-10-02T09:36:41.245375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:41.245385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Write session will restart in 0.005803s
2025-10-02T09:36:41.245407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Write session: Do CDS request
2025-10-02T09:36:41.245412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.252203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.252273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.252281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3306
2025-10-02T09:36:41.252398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.252426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.252429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.252432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.252550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.252723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3306 sessionId:  describe result for acl check
2025-10-02T09:36:41.252748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.252752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.252753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.252757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.253105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.254200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.254310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.254317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.254323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.254352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.254377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969585585:3378]
2025-10-02T09:36:41.254499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.254739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.254929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.254963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.255151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.255188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.255192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.255193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.255193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.255194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.255195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.255195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.255196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.255196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.255197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.255197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.255198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.255201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.255207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.255209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.255211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.255213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.255215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.255217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.255219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.255221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.255223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.255226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.255228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.255231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.255235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.255239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.255242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.255244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.255247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.255249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.255252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.255254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.255257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.255259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.255261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.255264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.255267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.255269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.255272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.255275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.255278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.255280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.255283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.255289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.255292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.255294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.255297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.255315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.259250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.259261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.259266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171079:8098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.259271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.262823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.264548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.264562Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.264563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.264565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.264568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3305 [2:7556556016969585585:3378]
2025-10-02T09:36:41.264575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.264586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.264589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.264590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.264591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.264600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.264603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.264607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.264653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.264659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.264661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.264664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.264665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.264708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.264713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.264719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.264725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.264734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.264748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171118:8098], now have 1 active actors on pipe
2025-10-02T09:36:41.264754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045170970:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.264757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.264759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.264760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.264767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.264776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.264780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.264782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.264783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.264787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.264788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.264782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3305
2025-10-02T09:36:41.264793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3305
2025-10-02T09:36:41.264814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.264818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.264823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.264828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.264831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.264861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.264868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.264870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.264872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.264879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.264885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.264901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.264987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.264992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.264999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.265054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3306 partition: 0 MaxSeqNo: 36 sessionId: src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0
2025-10-02T09:36:41.265284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4814603-85a89596-e04070ea-6e6e1bc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.268311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Write session: try to update token
2025-10-02T09:36:41.268322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.273988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.274004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.274006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.274007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.274011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.274014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.274017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969585580:3378]
2025-10-02T09:36:41.274038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.274044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.274045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.274049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.274054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.274057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.274157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.282133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId: src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.284325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.345046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045171139:8014]
2025-10-02T09:36:41.345212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3305, pipe: [1:7556556017045171139:8014]
2025-10-02T09:36:41.384424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.384681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.384690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.384702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171139:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.384834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.384861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:41.384868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:41.384882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.384910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3306 reason: error at write: Disconnected sessionId: src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0
2025-10-02T09:36:41.384913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045171139:8014]
2025-10-02T09:36:41.385045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3306 sessionId: src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0 is DEAD
2025-10-02T09:36:41.385165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:41.385174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Write session will restart in 0.009466s
2025-10-02T09:36:41.385192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Write session: Do CDS request
2025-10-02T09:36:41.385196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.392601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.393914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.394031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.394038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.394044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.394075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.394101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969585732:3394]
2025-10-02T09:36:41.394474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.394633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.394657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.394848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.394878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.394882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.394883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.394884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.394884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.394885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.394885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.394886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.394886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.394887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.394887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.394888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.394891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.394898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.394900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.394902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.394904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.394906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.394908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.394910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.394912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.394914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.394918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.394921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.394927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.394933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.394938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.394945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.394947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.394957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.394961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.394964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.394966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.394969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.394971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.394974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.394976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.394979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.394982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.394985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.394987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.394990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.394992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.395002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.395005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.395007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.395024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.395147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.395317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.395325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3307
2025-10-02T09:36:41.395397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.395413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.395419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.395422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.395672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3307 sessionId:  describe result for acl check
2025-10-02T09:36:41.395695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.395702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.395703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.395705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.396025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.397606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.401352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.401361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.401363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171255:8108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.401367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.402589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.404194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.404206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.404208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.404209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.404212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3306 [2:7556556016969585732:3394]
2025-10-02T09:36:41.404219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.404230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.404233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.404234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.404235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.404244Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.404251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.404255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.404289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.404294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.404295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.404297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.404298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.404336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.404341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.404348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.404354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.404364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.404377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171290:8108], now have 1 active actors on pipe
2025-10-02T09:36:41.404382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171141:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.404386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.404387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.404389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.404400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.404405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.404394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3306
2025-10-02T09:36:41.404407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.404409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.404400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3306
2025-10-02T09:36:41.404413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.404424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.404429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.404457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.404462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.404469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.404475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.404484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.404493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.404497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.404499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.404500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.404506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.404515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.404528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.404614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.404622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.404631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.404693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3307 partition: 0 MaxSeqNo: 36 sessionId: src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0
2025-10-02T09:36:41.404897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239ab26-3a958e05-7ed1778d-8ac6f24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.407740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Write session: try to update token
2025-10-02T09:36:41.407750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.413924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.413939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.413942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.413945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.413951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.413955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.413958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969585727:3394]
2025-10-02T09:36:41.413986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.413988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.413992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.413994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.413995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.413998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.414112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.420245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId: src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.422424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.484838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045171297:8014]
2025-10-02T09:36:41.485013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3306, pipe: [1:7556556017045171297:8014]
2025-10-02T09:36:41.524324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.524576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.524584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.524596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171297:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.524770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045171297:8014]
2025-10-02T09:36:41.524786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.524793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:41.524797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:41.524846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3307 reason: error at write: Disconnected sessionId: src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0
2025-10-02T09:36:41.524941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3307 sessionId: src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0 is DEAD
2025-10-02T09:36:41.525021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.525051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:41.525060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Write session will restart in 0.008118s
2025-10-02T09:36:41.525074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Write session: Do CDS request
2025-10-02T09:36:41.525078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.532290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.533657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.533829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.533836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.533843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.533875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.533898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969585883:3388]
2025-10-02T09:36:41.534081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.534172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.534180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3308
2025-10-02T09:36:41.534260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.534269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.534287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.534293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.534295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.534448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.534479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.534559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3308 sessionId:  describe result for acl check
2025-10-02T09:36:41.534582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.534586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.534587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.534591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.534667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.534707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.534712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.534713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.534714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.534714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.534715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.534715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.534716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.534716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.534717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.534717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.534718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.534721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.534727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.534729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.534731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.534733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.534735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.534738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.534739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.534741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.534744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.534746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.534748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.534753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.534757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.534760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.534763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.534765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.534767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.534770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.534773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.534775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.534778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.534780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.534783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.534787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.534790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.534792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.534795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.534797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.534800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.534803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.534806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.534808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.534811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.534813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.534817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.534835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.535008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.536397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.540114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.540122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.540125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171412:8123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.540128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.542291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.543782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.543795Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.543796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.543797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.543800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3307 [2:7556556016969585883:3388]
2025-10-02T09:36:41.543807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.543816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.543819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.543821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.543822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.543830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.543834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.543838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.543870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.543875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.543876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.543878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.543879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.543924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.543931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.543938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.543943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.543953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.543966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171448:8123], now have 1 active actors on pipe
2025-10-02T09:36:41.543972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171299:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.543975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.543977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.543978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.543985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.543995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.543997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.543991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3307
2025-10-02T09:36:41.543999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.544000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.544006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.543992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3307
2025-10-02T09:36:41.544008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.544027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.544032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.544039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.544045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.544052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.544062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.544069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.544071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.544072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.544076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.544082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.544097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.544190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.544198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.544207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.544266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3308 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0
2025-10-02T09:36:41.544430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75aba77-cbbe8a3f-6f8de4fe-af270cf4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.547211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Write session: try to update token
2025-10-02T09:36:41.547223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.553216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.553231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.553232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.553233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.553238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.553240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.553242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969585878:3388]
2025-10-02T09:36:41.553261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.553264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.553266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.553271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.553274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.553276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.553375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.559236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId: src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.561514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.625133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045171459:8014]
2025-10-02T09:36:41.625299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3307, pipe: [1:7556556017045171459:8014]
2025-10-02T09:36:41.663006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.663238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.663246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.663258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171459:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.663384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.663409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045171459:8014]
2025-10-02T09:36:41.663425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.663443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:41.663514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0
2025-10-02T09:36:41.663632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3308 sessionId: src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0 is DEAD
2025-10-02T09:36:41.663754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:41.663764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Write session will restart in 0.007148s
2025-10-02T09:36:41.663783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Write session: Do CDS request
2025-10-02T09:36:41.663787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.670912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.672128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.672233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.672240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3309
2025-10-02T09:36:41.672239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.672337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.672356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.672361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.672364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.672368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.672374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.672380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.672410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.672441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969586033:3403]
2025-10-02T09:36:41.672625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3309 sessionId:  describe result for acl check
2025-10-02T09:36:41.672648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.672652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.672653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.672656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.672797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.672977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.673001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.673006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.673190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.673230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.673235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.673235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.673236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.673236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.673237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.673238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.673238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.673239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.673239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.673240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.673240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.673243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.673249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.673251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.673253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.673255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.673257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.673259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.673261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.673263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.673265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.673267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.673269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.673273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.673276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.673279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.673282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.673285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.673288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.673290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.673292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.673298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.673301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.673303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.673306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.673308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.673311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.673313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.673319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.673322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.673325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.673327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.673330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.673332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.673335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.673337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.673342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.673358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.674593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.678574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.678582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.678584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171572:8153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.678587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.680751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.682235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.682247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.682249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.682250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.682253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3308 [2:7556556016969586033:3403]
2025-10-02T09:36:41.682260Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.682271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.682272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.682274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.682275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.682283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.682289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.682293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.682329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.682333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.682334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.682335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.682336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.682371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.682375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.682381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.682386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.682398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.682416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171611:8153], now have 1 active actors on pipe
2025-10-02T09:36:41.682423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171460:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.682426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.682428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.682428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.682436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.682446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.682449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.682451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.682452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.682457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.682447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3308
2025-10-02T09:36:41.682458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.682448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3308
2025-10-02T09:36:41.682471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.682474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.682476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.682484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.682486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.682507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.682514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.682516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.682517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.682521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.682526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.682537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.682620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.682627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.682637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.682701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3309 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0
2025-10-02T09:36:41.682889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0fc169b-59982f5b-c3b38d43-7bcbf4ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.685624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Write session: try to update token
2025-10-02T09:36:41.685634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.691657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.691670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.691671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.691672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.691677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.691680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.691682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969586028:3403]
2025-10-02T09:36:41.691701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.691704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.691704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.691707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.691710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.691711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.691819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.697377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId: src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.699603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.763371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045171619:8014]
2025-10-02T09:36:41.763588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3308, pipe: [1:7556556017045171619:8014]
2025-10-02T09:36:41.803389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.803680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.803691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.803707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171619:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.803876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045171619:8014]
2025-10-02T09:36:41.803882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.803899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:41.803901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:41.803945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3309 reason: error at write: Disconnected sessionId: src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0
2025-10-02T09:36:41.804069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3309 sessionId: src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0 is DEAD
2025-10-02T09:36:41.804134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.804200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:41.804210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Write session will restart in 0.007806s
2025-10-02T09:36:41.804225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Write session: Do CDS request
2025-10-02T09:36:41.804229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.811459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.812747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.812914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.812922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.812928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.812959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.812985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969586183:3425]
2025-10-02T09:36:41.813129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.813211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.813220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3310
2025-10-02T09:36:41.813297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.813314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.813320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.813322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.813329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.813508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.813533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.813584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3310 sessionId:  describe result for acl check
2025-10-02T09:36:41.813608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.813612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.813613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.813616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.813704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.813734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.813740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.813740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.813741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.813741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.813742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.813742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.813743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.813743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.813744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.813747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.813753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.813755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.813757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.813759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.813761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.813763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.813765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.813767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.813770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.813772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.813774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.813778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.813782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.813785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.813788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.813792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.813794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.813796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.813799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.813802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.813804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.813807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.813809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.813812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.813814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.813818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.813820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.813823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.813825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.813827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.813830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.813833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.813836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.813838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.813841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.813857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.813962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.815448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.819058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.819066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.819068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171735:8164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.819071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.821251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.822768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.822780Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.822781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.822783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.822786Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3309 [2:7556556016969586183:3425]
2025-10-02T09:36:41.822793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.822803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.822807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.822809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.822810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.822819Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.822825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.822829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.822860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.822864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.822865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.822867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.822868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.822910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.822915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.822921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.822926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.822935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.822952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171620:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.822987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3309
2025-10-02T09:36:41.822971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171772:8164], now have 1 active actors on pipe
2025-10-02T09:36:41.822976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.822987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3309
2025-10-02T09:36:41.822977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.822978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.822986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.822994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.823001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.823002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.823003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.823003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.823004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.823021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.823023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.823029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.823031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.823032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.823054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.823062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.823064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.823065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.823070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.823076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.823086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.823179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.823184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.823191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.823243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3310 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0
2025-10-02T09:36:41.823407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca68330-78416ffe-9a9bf63e-a8c8e48d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.826191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Write session: try to update token
2025-10-02T09:36:41.826201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.832201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.832216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.832217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.832218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.832222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.832224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.832227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969586178:3425]
2025-10-02T09:36:41.832246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.832249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.832250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.832252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.832254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.832256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.832405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.839488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId: src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.841626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:41.904153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556017045171781:8014]
2025-10-02T09:36:41.904294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3309, pipe: [1:7556556017045171781:8014]
2025-10-02T09:36:41.942301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:41.942515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.942524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.942537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171781:8014], now have 1 active actors on pipe
2025-10-02T09:36:41.942715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:41.942744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556017045171781:8014]
2025-10-02T09:36:41.942759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:41.942768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:41.942819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3310 reason: error at write: Disconnected sessionId: src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0
2025-10-02T09:36:41.942945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3310 sessionId: src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0 is DEAD
2025-10-02T09:36:41.943162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:41.943170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Write session will restart in 0.009238s
2025-10-02T09:36:41.943185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Write session: Do CDS request
2025-10-02T09:36:41.943193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:41.943392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:41.950311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:41.951758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:41.951932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:41.951943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:41.951952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:41.951988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:41.952011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556016969586336:3436]
2025-10-02T09:36:41.952365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:41.952549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:41.952578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:41.952774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:41.952815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.952819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.952820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.952820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.952821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.952821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.952822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.952822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.952823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.952823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.952824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.952825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.952827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.952835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.952837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.952839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.952841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.952843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.952845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.952847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.952849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.952851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.952853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.952855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.952859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.952865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:41.952868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.952871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:41.952873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.952876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:41.952878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.952883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:41.952886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:41.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.952893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:41.952895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.952898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:41.952900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.952903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:41.952905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.952908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:41.952910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.952912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.952915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.952918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.952920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.952926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.952950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:41.953172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.953300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:41.953309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3311
2025-10-02T09:36:41.953411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:41.953430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:41.953436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:41.953439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:41.953704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3311 sessionId:  describe result for acl check
2025-10-02T09:36:41.953727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:41.953732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:41.953733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:41.953736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:41.954062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:41.955147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:41.959581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:41.959590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:41.959592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556017045171907:8172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:41.959595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:41.960331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:41.961840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:41.961852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:41.961853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:41.961855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:41.961858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3310 [2:7556556016969586336:3436]
2025-10-02T09:36:41.961865Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:41.961874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:41.961878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.961879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.961880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.961889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:41.961892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:41.961896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:41.961937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.961942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.961943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.961944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:41.961946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:41.961983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:41.961988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.961995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:41.962000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:41.962010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:41.962023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171787:2446], now have 1 active actors on pipe
2025-10-02T09:36:41.962028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556017045171939:8172], now have 1 active actors on pipe
2025-10-02T09:36:41.962031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.962034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.962035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.962041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:41.962050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:41.962054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:41.962056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:41.962057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:41.962059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:41.962061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:41.962053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3310
2025-10-02T09:36:41.962056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3310
2025-10-02T09:36:41.962072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.962077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:41.962079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:41.962088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.962093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.962117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70784d0f-d017bb50-2d33dc07-947b5425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:41.962123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:41.962125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:41.962126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:41.962131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:41.962137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:41.962145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.962234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:41.962242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:41.962251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:41.962311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3311 partition: 0 MaxSeqNo: 36 sessionId: src_id|70784d0f-d017bb50-2d33dc07-947b5425_0
2025-10-02T09:36:41.962498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5823381-3bccdd2e-4775d82e-140d65b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70784d0f-d017bb50-2d33dc07-947b5425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:41.965364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Write session: try to update token
2025-10-02T09:36:41.965377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:41.971360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:41.971375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:41.971377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:41.971379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:41.971385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.971388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.971391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556016969586330:3436]
2025-10-02T09:36:41.971416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:41.971424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:41.971425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:41.971427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:41.971429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:41.971432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:41.971543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:41.977572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId: src_id|70784d0f-d017bb50-2d33dc07-947b5425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:41.979791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.042915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340139246:8014]
2025-10-02T09:36:42.043105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3310, pipe: [1:7556556021340139246:8014]
2025-10-02T09:36:42.081784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.082046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.082055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.082067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139246:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.082191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.082239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.082245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:42.082277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340139246:8014]
2025-10-02T09:36:42.082303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70784d0f-d017bb50-2d33dc07-947b5425_0
2025-10-02T09:36:42.082436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3311 sessionId: src_id|70784d0f-d017bb50-2d33dc07-947b5425_0 is DEAD
2025-10-02T09:36:42.082565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:42.082577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Write session will restart in 0.008658s
2025-10-02T09:36:42.082596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Write session: Do CDS request
2025-10-02T09:36:42.082600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.090213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.091541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.091663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.091670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.091676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.091707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.091729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264553799:3445]
2025-10-02T09:36:42.092075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.092147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.092255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.092254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.092264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3312
2025-10-02T09:36:42.092279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.092332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.092350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.092356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.092359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.092471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.092500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.092504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.092504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.092505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.092506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.092506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.092507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.092507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.092508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.092508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.092509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.092509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.092512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.092519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.092522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.092524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.092526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.092528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.092532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.092534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.092536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.092538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.092540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.092542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.092546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.092550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.092553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.092556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.092558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.092561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.092563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.092565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.092568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.092570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.092572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.092575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.092577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.092580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.092582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.092585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.092589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.092592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.092595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.092600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.092602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.092606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.092611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.092605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3312 sessionId:  describe result for acl check
2025-10-02T09:36:42.092615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.092630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.092633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.092637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.092638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.092641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.092958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.094445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.097925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.097934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.097936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340139364:8196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.097939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.100036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.101544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.101556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.101558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.101559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.101563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3311 [2:7556556021264553799:3445]
2025-10-02T09:36:42.101571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.101581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.101586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.101588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.101589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.101598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.101604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.101608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.101642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.101647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.101648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.101650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.101651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.101688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.101694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.101701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.101706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.101717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.101731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139247:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.101737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139401:8196], now have 1 active actors on pipe
2025-10-02T09:36:42.101740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.101743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.101744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.101751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.101759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.101765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.101766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.101767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.101762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3311
2025-10-02T09:36:42.101768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.101774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3311
2025-10-02T09:36:42.101768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.101783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.101788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.101789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.101798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.101800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.101840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.101848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.101850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.101851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.101856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.101863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.101875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.101962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.101967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.101975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.102028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3312 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0
2025-10-02T09:36:42.102251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70784d0f-d017bb50-2d33dc07-947b5425_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.105091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Write session: try to update token
2025-10-02T09:36:42.105101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.111054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.111069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.111070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.111071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.111076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.111078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.111083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264553785:3445]
2025-10-02T09:36:42.111107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.111110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.111111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.111112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.111116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.111118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.111221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.116896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId: src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.119154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.182167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340139430:8014]
2025-10-02T09:36:42.182274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3311, pipe: [1:7556556021340139430:8014]
2025-10-02T09:36:42.220932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.221197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.221207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.221218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139430:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.221358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.221381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:42.221390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:42.221406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.221434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340139430:8014]
2025-10-02T09:36:42.221435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3312 reason: error at write: Disconnected sessionId: src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0
2025-10-02T09:36:42.221567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3312 sessionId: src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0 is DEAD
2025-10-02T09:36:42.221692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:42.221701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Write session will restart in 0.007925s
2025-10-02T09:36:42.221715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Write session: Do CDS request
2025-10-02T09:36:42.221719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.228748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.230112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.230235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.230243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3313
2025-10-02T09:36:42.230253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.230378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.230385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.230391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.230403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.230419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.230426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.230434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.230437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.230443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264553990:3483]
2025-10-02T09:36:42.230687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3313 sessionId:  describe result for acl check
2025-10-02T09:36:42.230709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.230714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.230715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.230717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.230795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.230975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.231003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.230998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.231175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.231202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.231207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.231207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.231208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.231210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.231211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.231211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.231212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.231213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.231214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.231215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.231216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.231220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.231228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.231232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.231235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.231238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.231240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.231242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.231244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.231246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.231248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.231250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.231252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.231256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.231259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.231263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.231265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.231267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.231270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.231274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.231276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.231279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.231281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.231283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.231286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.231290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.231293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.231295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.231297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.231299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.231302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.231304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.231306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.231308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.231311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.231313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.231316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.231333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.231972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.236127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.236136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.236138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340139548:8228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.236141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.238781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.240261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.240273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.240274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.240276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.240278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3312 [2:7556556021264553990:3483]
2025-10-02T09:36:42.240285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.240294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.240296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.240297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.240299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.240307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.240313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.240317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.240349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.240354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.240355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.240357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.240359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.240393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.240398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.240405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.240410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.240418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.240429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139587:8228], now have 1 active actors on pipe
2025-10-02T09:36:42.240435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139432:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.240440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.240441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.240444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.240455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.240465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.240467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.240468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.240469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.240474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.240476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.240472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3312
2025-10-02T09:36:42.240476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3312
2025-10-02T09:36:42.240489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.240495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.240496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.240512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.240517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.240538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|120d4469-14104972-22d991a1-7e7143b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.240544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.240546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.240548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.240553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.240562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.240574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.240658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.240663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.240671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.240728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3313 partition: 0 MaxSeqNo: 36 sessionId: src_id|120d4469-14104972-22d991a1-7e7143b1_0
2025-10-02T09:36:42.240900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cd93d1-e0d472c2-1733e707-2ebbf145_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|120d4469-14104972-22d991a1-7e7143b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.243734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Write session: try to update token
2025-10-02T09:36:42.243742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.249635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.249651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.249652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.249653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.249657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.249659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.249661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264553972:3483]
2025-10-02T09:36:42.249681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.249683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.249685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.249686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.249689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.249691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.249898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.257201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId: src_id|120d4469-14104972-22d991a1-7e7143b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.259369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.321431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340139594:8014]
2025-10-02T09:36:42.321582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3312, pipe: [1:7556556021340139594:8014]
2025-10-02T09:36:42.361435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.361733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.361743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.361756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139594:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.361906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.361938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340139594:8014]
2025-10-02T09:36:42.361948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:42.361960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.361997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3313 reason: status is not ok: tablet will be restarted right now sessionId: src_id|120d4469-14104972-22d991a1-7e7143b1_0
2025-10-02T09:36:42.362135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3313 sessionId: src_id|120d4469-14104972-22d991a1-7e7143b1_0 is DEAD
2025-10-02T09:36:42.362258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:42.362266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Write session will restart in 0.008798s
2025-10-02T09:36:42.362285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Write session: Do CDS request
2025-10-02T09:36:42.362289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.369631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.370909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.371020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.371026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.371033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.371066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.371092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264554144:3493]
2025-10-02T09:36:42.371444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.371627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.371655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.371851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.371881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.371885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.371886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.371886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.371887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.371887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.371888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.371888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.371889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.371889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.371890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.371890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.371893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.371900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.371902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.371904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.371906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.371908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.371910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.371912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.371913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.371916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.371917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.371919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.371923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.371927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.371930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.371933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.371935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.371937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.371940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.371942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.371944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.371947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.371949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.371952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.371954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.371957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.371960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.371963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.371965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.371967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.371969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.371971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.371978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.371980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.371982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.371985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.372003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.372164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.372221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.372229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3314
2025-10-02T09:36:42.372339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.372358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.372363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.372367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.372616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3314 sessionId:  describe result for acl check
2025-10-02T09:36:42.372638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.372643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.372644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.372647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.372976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.374489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.378151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.378159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.378161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340139731:8265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.378165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.379381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.381085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.381097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.381098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.381100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.381103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3313 [2:7556556021264554144:3493]
2025-10-02T09:36:42.381110Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.381120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.381121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.381123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.381124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.381131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.381135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.381139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.381167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.381173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.381174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.381176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.381178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.381214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.381219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.381226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.381231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.381240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.381255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139610:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.381260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139766:8265], now have 1 active actors on pipe
2025-10-02T09:36:42.381263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.381264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.381265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.381274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.381284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.381285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.381287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.381288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.381299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.381301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.381300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3313
2025-10-02T09:36:42.381316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.381321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.381323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.381335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.381340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.381346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3313
2025-10-02T09:36:42.381358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.381364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.381367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.381368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.381373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.381378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.381391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.381506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.381514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.381523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.381580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3314 partition: 0 MaxSeqNo: 36 sessionId: src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0
2025-10-02T09:36:42.381765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120d4469-14104972-22d991a1-7e7143b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.384608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Write session: try to update token
2025-10-02T09:36:42.384618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.390443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.390458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.390459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.390460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.390464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.390467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.390469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264554139:3493]
2025-10-02T09:36:42.390492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.390493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.390496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.390496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.390498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.390498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.390608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.397086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId: src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.399215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.462246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340139773:8014]
2025-10-02T09:36:42.462415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3313, pipe: [1:7556556021340139773:8014]
2025-10-02T09:36:42.499748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.499982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.499991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.500002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139773:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.500144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.500169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340139773:8014]
2025-10-02T09:36:42.500176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.500195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:42.500246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3314 reason: status is not ok: tablet will be restarted right now sessionId: src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0
2025-10-02T09:36:42.500367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3314 sessionId: src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0 is DEAD
2025-10-02T09:36:42.500504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:42.500512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Write session will restart in 0.006055s
2025-10-02T09:36:42.500526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Write session: Do CDS request
2025-10-02T09:36:42.500530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.507121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.507209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.507217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3315
2025-10-02T09:36:42.507309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.507327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.507333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.507336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.507589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3315 sessionId:  describe result for acl check
2025-10-02T09:36:42.507606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.507611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.507612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.507614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.507948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.507991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.509168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.509583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.509698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.509705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.509710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.509736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.509761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264554302:3500]
2025-10-02T09:36:42.510102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.510270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.510293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.510463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.510491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.510495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.510495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.510496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.510496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.510497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.510497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.510498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.510498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.510499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.510499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.510500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.510503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.510508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.510510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.510512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.510514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.510516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.510518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.510520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.510522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.510525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.510526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.510528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.510531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.510535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.510539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.510542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.510546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.510548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.510550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.510553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.510555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.510558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.510560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.510563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.510565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.510568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.510570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.510573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.510575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.510578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.510580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.510583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.510585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.510588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.510590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.510593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.510665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.510673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.510675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340139890:8272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.510679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.517949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.519281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.519292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.519293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.519295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.519299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3314 [2:7556556021264554302:3500]
2025-10-02T09:36:42.519306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.519316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.519321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.519322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.519324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.519332Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.519335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.519339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.519369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.519374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.519374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.519377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.519378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.519413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.519417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.519424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.519431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.519439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.519452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139774:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.519457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139930:8272], now have 1 active actors on pipe
2025-10-02T09:36:42.519461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.519462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.519463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.519471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.519478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.519484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.519486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.519487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.519488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.519490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.519490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3314
2025-10-02T09:36:42.519499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3314
2025-10-02T09:36:42.519501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.519504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.519516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.519523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.519525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.519540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.519547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.519550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.519551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.519556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.519562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.519568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.519661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.519666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.519672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.519727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3315 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0
2025-10-02T09:36:42.519919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105ea02-c3a16925-3c1b1e48-15f0b7cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.522657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Write session: try to update token
2025-10-02T09:36:42.522671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.529200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.529221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.529223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.529225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.529233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.529238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.529243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264554297:3500]
2025-10-02T09:36:42.529276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.529283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.529287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.529289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.529289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.529291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.529528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.534840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId: src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.536912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.600479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340139939:8014]
2025-10-02T09:36:42.600665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3314, pipe: [1:7556556021340139939:8014]
2025-10-02T09:36:42.640896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.641294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.641303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.641316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139939:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.641466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.641492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.641510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:42.641533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340139939:8014]
2025-10-02T09:36:42.641568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0
2025-10-02T09:36:42.641698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3315 sessionId: src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0 is DEAD
2025-10-02T09:36:42.641834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:42.641843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Write session will restart in 0.009535s
2025-10-02T09:36:42.641858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Write session: Do CDS request
2025-10-02T09:36:42.641862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.649421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.650638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.650737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.650743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.650749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.650774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.650798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264554458:3503]
2025-10-02T09:36:42.651146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.651309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.651331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.651505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.651534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.651538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.651538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.651539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.651539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.651540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.651540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.651541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.651542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.651542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.651543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.651543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.651546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.651553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.651555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.651557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.651559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.651561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.651563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.651564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.651566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.651568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.651570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.651572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.651577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.651581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.651584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.651587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.651591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.651594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.651596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.651598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.651600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.651603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.651605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.651608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.651610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.651613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.651615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.651618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.651620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.651623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.651625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.651627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.651630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.651633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.651635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.651637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.651654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.652149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.652278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.652288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3316
2025-10-02T09:36:42.652391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.652411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.652417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.652420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.652673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3316 sessionId:  describe result for acl check
2025-10-02T09:36:42.652696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.652699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.652700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.652703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.653058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.654571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.658411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.658420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.658424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340140063:8277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.658427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.658955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.660414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.660426Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.660428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.660430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.660433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3315 [2:7556556021264554458:3503]
2025-10-02T09:36:42.660440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.660449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.660454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.660456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.660457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.660466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.660469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.660473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.660503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.660508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.660509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.660511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.660513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.660548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.660553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.660559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.660564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.660576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.660590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140098:8277], now have 1 active actors on pipe
2025-10-02T09:36:42.660596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340139940:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.660600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.660601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.660602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.660604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3315
2025-10-02T09:36:42.660610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3315
2025-10-02T09:36:42.660610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.660618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.660620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.660620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.660622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.660627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.660628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.660651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.660656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.660664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.660671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.660679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.660686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.660690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.660692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.660693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.660698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.660705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.660715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.660835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.660841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.660847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.660911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3316 partition: 0 MaxSeqNo: 36 sessionId: src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0
2025-10-02T09:36:42.661108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab89fcb-63993dce-8c4d2572-ecff4684_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.663868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Write session: try to update token
2025-10-02T09:36:42.663877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.669830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.669845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.669846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.669848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.669854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.669857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.669859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264554453:3503]
2025-10-02T09:36:42.669880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.669883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.669886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.669886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.669887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.669888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.669996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.675318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId: src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.677549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.741795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340140106:8014]
2025-10-02T09:36:42.741943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3315, pipe: [1:7556556021340140106:8014]
2025-10-02T09:36:42.779110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.779374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.779383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.779395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140106:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.779554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.779555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.779585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340140106:8014]
2025-10-02T09:36:42.779588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:42.779590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:42.779646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3316 reason: error at write: Disconnected sessionId: src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0
2025-10-02T09:36:42.779788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3316 sessionId: src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0 is DEAD
2025-10-02T09:36:42.779912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:42.779921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Write session will restart in 0.006412s
2025-10-02T09:36:42.779939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Write session: Do CDS request
2025-10-02T09:36:42.779943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.787126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.787239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.787250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3317
2025-10-02T09:36:42.787326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.787345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.787351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.787353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.787543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.787683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3317 sessionId:  describe result for acl check
2025-10-02T09:36:42.787705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.787709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.787709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.787712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.788081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.788839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.788940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.788946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.788952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.788978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.789002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264554616:3505]
2025-10-02T09:36:42.789329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.789386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.789535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.789557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.789731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.789759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.789762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.789763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.789764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.789764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.789765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.789765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.789766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.789766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.789767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.789767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.789768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.789771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.789776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.789778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.789780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.789782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.789784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.789786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.789788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.789790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.789792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.789794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.789796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.789800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.789804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.789807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.789809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.789812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.789814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.789816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.789819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.789823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.789825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.789827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.789830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.789832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.789835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.789837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.789839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.789841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.789843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.789846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.789848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.789850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.789853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.789855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.789857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.789873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.793606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.793614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.793616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340140227:8303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.793620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.797191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.798691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.798702Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.798703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.798705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.798708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3316 [2:7556556021264554616:3505]
2025-10-02T09:36:42.798714Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.798724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.798730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.798731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.798732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.798741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.798744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.798748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.798781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.798786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.798787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.798789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.798790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.798824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.798830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.798835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.798841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.798848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.798864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140266:8303], now have 1 active actors on pipe
2025-10-02T09:36:42.798869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140107:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.798872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.798874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.798875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.798883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.798893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.798896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.798898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.798899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.798902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.798903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.798894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3316
2025-10-02T09:36:42.798895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3316
2025-10-02T09:36:42.798917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.798922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.798923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.798932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.798937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.798969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.798977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.798979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.798980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.798985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.798992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.799006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.799088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.799093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.799101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.799155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3317 partition: 0 MaxSeqNo: 36 sessionId: src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0
2025-10-02T09:36:42.799342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cecd1c0-6fe0a3cf-e17b927c-4e4638da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.802070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Write session: try to update token
2025-10-02T09:36:42.802080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.808081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.808097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.808098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.808099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.808104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.808107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.808109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264554611:3505]
2025-10-02T09:36:42.808130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.808137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.808138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.808170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.808190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.808193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.808251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.813367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId: src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.815576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:42.879516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556021340140274:8014]
2025-10-02T09:36:42.879712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3316, pipe: [1:7556556021340140274:8014]
2025-10-02T09:36:42.917257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:42.917512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.917521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.917546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140274:8014], now have 1 active actors on pipe
2025-10-02T09:36:42.917896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556021340140274:8014]
2025-10-02T09:36:42.917913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:42.917916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:42.917922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:42.917958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3317 reason: error at write: Disconnected sessionId: src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0
2025-10-02T09:36:42.918090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3317 sessionId: src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0 is DEAD
2025-10-02T09:36:42.918167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:42.918213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:42.918223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Write session will restart in 0.006193s
2025-10-02T09:36:42.918244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Write session: Do CDS request
2025-10-02T09:36:42.918249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:42.925160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.925235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:42.925244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3318
2025-10-02T09:36:42.925327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:42.925346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:42.925352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:42.925355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:42.925624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3318 sessionId:  describe result for acl check
2025-10-02T09:36:42.925646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:42.925650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:42.925651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:42.925657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:42.925715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:42.926000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:42.927031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:42.927129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:42.927135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:42.927142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:42.927166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:42.927198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556021264554775:3513]
2025-10-02T09:36:42.927532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:42.927562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:42.927695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:42.927717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:42.927888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:42.927916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.927920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.927921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.927921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.927922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.927922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.927923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.927924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.927924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.927925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.927925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.927926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.927929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.927934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.927937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.927939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.927941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.927943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.927945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.927947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.927951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.927953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.927955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.927959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.927962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:42.927965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.927968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:42.927971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.927973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:42.927975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.927978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:42.927980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.927983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:42.927985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.927988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:42.927990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.927992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:42.927995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.927999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:42.928001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.928003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:42.928010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.928012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.928016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.928018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.928021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.928027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.928042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:42.932741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:42.932749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:42.932751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556021340140398:2335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:42.932755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:42.935412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:42.936943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:42.936954Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:42.936955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:42.936957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:42.936960Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3317 [2:7556556021264554775:3513]
2025-10-02T09:36:42.936967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:42.936977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:42.936982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.936983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.936984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.936993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:42.936995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:42.937000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:42.937031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.937035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.937037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.937038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:42.937040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:42.937076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:42.937081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.937088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:42.937093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:42.937103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:42.937117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140438:2335], now have 1 active actors on pipe
2025-10-02T09:36:42.937122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556021340140275:2446], now have 1 active actors on pipe
2025-10-02T09:36:42.937125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.937126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.937127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.937136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:42.937146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:42.937149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:42.937151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:42.937152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:42.937154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:42.937156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:42.937145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3317
2025-10-02T09:36:42.937150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3317
2025-10-02T09:36:42.937169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.937174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:42.937175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:42.937189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.937195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.937212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:42.937220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:42.937246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:42.937251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:42.937256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:42.937261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:42.937274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.937363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:42.937368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:42.937375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:42.937429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3318 partition: 0 MaxSeqNo: 36 sessionId: src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0
2025-10-02T09:36:42.937636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556fb929-9d803a2b-8afaf455-68b8aa09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:42.940396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Write session: try to update token
2025-10-02T09:36:42.940408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:42.946369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:42.946386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:42.946388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:42.946389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:42.946393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.946396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.946398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556021264554770:3513]
2025-10-02T09:36:42.946418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:42.946424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:42.946424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:42.946426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:42.946426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:42.946428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:42.946542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:42.951853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId: src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:42.954046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.018271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635107755:8014]
2025-10-02T09:36:43.018449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3317, pipe: [1:7556556025635107755:8014]
2025-10-02T09:36:43.055537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.055768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.055777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.055789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635107755:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.055939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.055964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:43.055973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.055975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:43.056002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635107755:8014]
2025-10-02T09:36:43.056021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3318 reason: error at write: Disconnected sessionId: src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0
2025-10-02T09:36:43.056147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3318 sessionId: src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0 is DEAD
2025-10-02T09:36:43.056250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:43.056259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Write session will restart in 0.005513s
2025-10-02T09:36:43.056273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Write session: Do CDS request
2025-10-02T09:36:43.056277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.063154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.063227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.063236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3319
2025-10-02T09:36:43.063320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.063339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.063345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.063347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.063634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3319 sessionId:  describe result for acl check
2025-10-02T09:36:43.063659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.063660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.063661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.063663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.063929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.063994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.065248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.065300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.065351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.065357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.065363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.065388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.065414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559522231:3538]
2025-10-02T09:36:43.065856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.066026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.066047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.066229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.066259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.066263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.066263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.066264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.066264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.066265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.066266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.066266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.066267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.066267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.066268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.066268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.066271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.066277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.066279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.066281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.066283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.066285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.066287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.066289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.066291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.066293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.066295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.066297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.066301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.066307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.066310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.066312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.066315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.066317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.066320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.066322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.066325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.066327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.066330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.066332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.066335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.066337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.066340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.066343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.066346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.066350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.066352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.066355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.066358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.066360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.066363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.066384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.070107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.070115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.070117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635107877:2352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.070120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.073736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.075127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.075139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.075140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.075142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.075145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3318 [2:7556556025559522231:3538]
2025-10-02T09:36:43.075152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.075161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.075167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.075168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.075169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.075178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.075181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.075185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.075216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.075220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.075222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.075224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.075225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.075262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.075267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.075273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.075279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.075290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.075305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635107757:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.075310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635107918:2352], now have 1 active actors on pipe
2025-10-02T09:36:43.075314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.075316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.075317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.075324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.075332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.075337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.075339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.075329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3318
2025-10-02T09:36:43.075330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3318
2025-10-02T09:36:43.075340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.075343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.075344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.075360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.075362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.075364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.075370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.075372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.075394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.075402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.075404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.075405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.075410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.075417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.075427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.075526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.075531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.075538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.075597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3319 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0
2025-10-02T09:36:43.075787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8798bd0-b0e3f788-ac7d9bfc-bbb454b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.078557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Write session: try to update token
2025-10-02T09:36:43.078567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.085180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.085206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.085210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.085212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.085220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.085226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.085232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559522226:3538]
2025-10-02T09:36:43.085263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.085273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.085273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.085276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.085278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.085281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.085472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.090373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId: src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.092417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.155997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635107925:8014]
2025-10-02T09:36:43.156118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3318, pipe: [1:7556556025635107925:8014]
2025-10-02T09:36:43.194940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.195142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.195150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.195161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635107925:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.195309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.195339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635107925:8014]
2025-10-02T09:36:43.195363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:43.195409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3319 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0
2025-10-02T09:36:43.195538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3319 sessionId: src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0 is DEAD
2025-10-02T09:36:43.195665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:43.195674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Write session will restart in 0.009814s
2025-10-02T09:36:43.195689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Write session: Do CDS request
2025-10-02T09:36:43.195693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.195719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.203286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.204585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.204685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.204691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.204697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.204721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.204743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559522422:3593]
2025-10-02T09:36:43.205099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.205265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.205287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.205456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.205485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.205489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.205489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.205490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.205491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.205491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.205492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.205492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.205493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.205493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.205494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.205494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.205497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.205503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.205505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.205507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.205509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.205511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.205513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.205515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.205516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.205519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.205521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.205523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.205526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.205530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.205533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.205536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.205538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.205540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.205542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.205545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.205548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.205550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.205553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.205555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.205557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.205560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.205563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.205565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.205567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.205570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.205572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.205574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.205577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.205579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.205581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.205584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.205608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.206133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.206188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.206198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3320
2025-10-02T09:36:43.206271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.206289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.206295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.206297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.206506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3320 sessionId:  describe result for acl check
2025-10-02T09:36:43.206525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.206529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.206530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.206533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.206930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.207842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.212392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.212400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.212402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108077:2373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.212405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.212929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.214303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.214314Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.214316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.214318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.214321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3319 [2:7556556025559522422:3593]
2025-10-02T09:36:43.214327Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.214337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.214343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.214345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.214346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.214355Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.214358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.214362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.214391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.214397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.214398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.214399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.214401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.214438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.214443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.214450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.214455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.214466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.214480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108111:2373], now have 1 active actors on pipe
2025-10-02T09:36:43.214485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635107940:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.214489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.214490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.214491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.214498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.214505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.214511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.214513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.214515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.214514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3319
2025-10-02T09:36:43.214516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.214517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3319
2025-10-02T09:36:43.214517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.214529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.214531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.214539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.214546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.214548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.214565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.214572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.214575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.214576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.214580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.214586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.214599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.214704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.214709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.214715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.214770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3320 partition: 0 MaxSeqNo: 36 sessionId: src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0
2025-10-02T09:36:43.214975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f299e85-c53038bb-e1bc088b-99ce5ce7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.218012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Write session: try to update token
2025-10-02T09:36:43.218022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.223872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.223890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.223892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.223895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.223902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.223907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.223912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559522417:3593]
2025-10-02T09:36:43.223939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.223945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.223946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.223949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.223951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.223953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.224146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.230281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId: src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.232263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.295273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635108118:8014]
2025-10-02T09:36:43.295439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3319, pipe: [1:7556556025635108118:8014]
2025-10-02T09:36:43.333437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.333749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.333758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.333769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108118:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.333879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.333895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:43.333898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.333904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:43.333938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3320 reason: error at write: Disconnected sessionId: src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0
2025-10-02T09:36:43.333947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635108118:8014]
2025-10-02T09:36:43.334061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3320 sessionId: src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0 is DEAD
2025-10-02T09:36:43.334175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:43.334184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Write session will restart in 0.006290s
2025-10-02T09:36:43.334198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Write session: Do CDS request
2025-10-02T09:36:43.334202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.341119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.341276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.341284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3321
2025-10-02T09:36:43.341358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.341374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.341380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.341383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.341554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.341631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3321 sessionId:  describe result for acl check
2025-10-02T09:36:43.341655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.341659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.341660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.341662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.341945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.342881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.342982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.342988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.342993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.343017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.343042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559522603:3629]
2025-10-02T09:36:43.343158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.343379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.343551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.343573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.343748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.343777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.343780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.343781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.343782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.343782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.343783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.343783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.343784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.343784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.343785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.343785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.343785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.343788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.343793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.343796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.343798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.343799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.343801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.343803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.343805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.343807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.343809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.343811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.343813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.343816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.343820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.343823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.343826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.343828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.343830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.343832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.343835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.343838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.343840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.343842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.343845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.343847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.343850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.343852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.343854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.343856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.343859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.343861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.343865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.343869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.343872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.343874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.343876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.343892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.347685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.347694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.347695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108256:2410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.347699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.351313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.352846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.352854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.352855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.352857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.352860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3320 [2:7556556025559522603:3629]
2025-10-02T09:36:43.352866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.352876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.352879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.352880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.352881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.352889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.352892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.352896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.352928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.352932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.352933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.352935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.352936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.352974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.352978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.352984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.352992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.353002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.353012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108133:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.353017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108296:2410], now have 1 active actors on pipe
2025-10-02T09:36:43.353021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.353022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.353024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.353031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.353041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.353031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3320
2025-10-02T09:36:43.353046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.353045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3320
2025-10-02T09:36:43.353048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.353049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.353052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.353053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.353067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.353075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.353082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.353087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.353087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.353111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f9a7a89-f647a250-c232d268-b907e827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.353118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.353120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.353121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.353126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.353135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.353146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.353225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.353230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.353238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.353284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3321 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f9a7a89-f647a250-c232d268-b907e827_0
2025-10-02T09:36:43.353466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3040aca6-489e7ed9-c009d6b1-a536aaf4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f9a7a89-f647a250-c232d268-b907e827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.356557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Write session: try to update token
2025-10-02T09:36:43.356571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.362377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.362389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.362391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.362393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.362399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.362402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.362405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559522598:3629]
2025-10-02T09:36:43.362427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.362430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.362432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.362433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.362433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.362436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.362553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.369687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId: src_id|3f9a7a89-f647a250-c232d268-b907e827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.371647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.434015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635108304:8014]
2025-10-02T09:36:43.434170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3320, pipe: [1:7556556025635108304:8014]
2025-10-02T09:36:43.471277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.471493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.471503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.471515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108304:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.471653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.471654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:43.471662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:43.471682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.471699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3321 reason: error at write: Disconnected sessionId: src_id|3f9a7a89-f647a250-c232d268-b907e827_0
2025-10-02T09:36:43.471708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635108304:8014]
2025-10-02T09:36:43.471817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3321 sessionId: src_id|3f9a7a89-f647a250-c232d268-b907e827_0 is DEAD
2025-10-02T09:36:43.471922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:43.471930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Write session will restart in 0.009171s
2025-10-02T09:36:43.471948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Write session: Do CDS request
2025-10-02T09:36:43.471952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.479441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.480736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.480850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.480857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.480863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.480891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.480915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559522767:3631]
2025-10-02T09:36:43.481256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.481434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.481456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.481634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.481663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.481667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.481667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.481668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.481668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.481669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.481669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.481670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.481670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.481671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.481671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.481672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.481675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.481681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.481683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.481685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.481687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.481689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.481691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.481693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.481695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.481697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.481699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.481701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.481706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.481710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.481713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.481716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.481722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.481724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.481727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.481729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.481734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.481736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.481739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.481741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.481743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.481745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.481748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.481751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.481754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.481756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.481759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.481761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.481764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.481766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.481769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.481785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.482145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.482271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.482279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3322
2025-10-02T09:36:43.482366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.482383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.482389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.482391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.482655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3322 sessionId:  describe result for acl check
2025-10-02T09:36:43.482678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.482683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.482684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.482687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.483025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.484452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.487954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.487962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.487964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108434:2424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.487967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.489179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.490592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.490603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.490604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.490606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.490610Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3321 [2:7556556025559522767:3631]
2025-10-02T09:36:43.490618Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.490627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.490630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.490632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.490633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.490641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.490644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.490648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.490678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.490683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.490684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.490686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.490687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.490735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.490741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.490747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.490753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.490762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.490775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108305:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.490780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108469:2424], now have 1 active actors on pipe
2025-10-02T09:36:43.490783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.490785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.490786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.490793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.490801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.490793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3321
2025-10-02T09:36:43.490808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.490794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3321
2025-10-02T09:36:43.490809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.490810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.490810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.490812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.490828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.490832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.490834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.490840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.490842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.490862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.490870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.490872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.490873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.490878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.490883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.490892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.490993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.490998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.491005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.491060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3322 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0
2025-10-02T09:36:43.491216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9a7a89-f647a250-c232d268-b907e827_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.493996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Write session: try to update token
2025-10-02T09:36:43.494007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.500684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.500701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.500704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.500706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.500715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.500719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.500724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559522762:3631]
2025-10-02T09:36:43.500751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.500759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.500761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.500764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.500771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.500773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.500978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.505797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId: src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.507766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.571740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635108477:8014]
2025-10-02T09:36:43.571869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3321, pipe: [1:7556556025635108477:8014]
2025-10-02T09:36:43.609971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.610194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.610203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.610214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108477:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.610343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.610552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635108477:8014]
2025-10-02T09:36:43.610571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.610575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:43.610621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0
2025-10-02T09:36:43.610752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3322 sessionId: src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0 is DEAD
2025-10-02T09:36:43.611079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:43.611089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Write session will restart in 0.005537s
2025-10-02T09:36:43.611104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Write session: Do CDS request
2025-10-02T09:36:43.611108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.617146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.617233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.617240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3323
2025-10-02T09:36:43.617331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.617350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.617356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.617358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.617611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3323 sessionId:  describe result for acl check
2025-10-02T09:36:43.617634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.617638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.617639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.617642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.617994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.618839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.619129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.620136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.620229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.620235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.620241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.620266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.620290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559522931:3624]
2025-10-02T09:36:43.620624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.620694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.620701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.620703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108582:2444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.620706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.620776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.620799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.620983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.621012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.621016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.621016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.621017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.621017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.621018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.621019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.621019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.621019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.621020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.621021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.621021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.621024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.621029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.621031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.621033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.621035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.621037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.621039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.621041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.621043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.621046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.621048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.621050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.621054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.621057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.621062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.621064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.621067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.621069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.621072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.621075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.621077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.621089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.621094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.621097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.621099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.621102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.621104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.621107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.621109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.621111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.621117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.621119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.621122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.621124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.621129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.621132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.621149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.628608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.630042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.630051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.630053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.630055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.630058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3322 [2:7556556025559522931:3624]
2025-10-02T09:36:43.630065Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.630075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.630080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.630082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.630083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.630091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.630097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.630101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.630131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.630136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.630137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.630139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.630141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.630178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.630182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.630189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.630194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.630205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.630216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108640:2444], now have 1 active actors on pipe
2025-10-02T09:36:43.630221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108478:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.630225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.630226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.630228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.630234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.630241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.630247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.630249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.630250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.630252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.630253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.630242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3322
2025-10-02T09:36:43.630245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3322
2025-10-02T09:36:43.630266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.630271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.630273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.630280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.630283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.630318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.630324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.630326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.630327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.630332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.630337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.630346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.630439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.630444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.630451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.630504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3323 partition: 0 MaxSeqNo: 36 sessionId: src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0
2025-10-02T09:36:43.630694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4627a0-9de13f65-e3dabaf8-7b1ebe0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.633412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Write session: try to update token
2025-10-02T09:36:43.633421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.639447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.639460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.639461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.639462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.639467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.639469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.639471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559522926:3624]
2025-10-02T09:36:43.639492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.639495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.639497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.639497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.639500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.639502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.639627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.644688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId: src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.646665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.710508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635108651:8014]
2025-10-02T09:36:43.710675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3322, pipe: [1:7556556025635108651:8014]
2025-10-02T09:36:43.749092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.749381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.749389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.749414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108651:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.749546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.749596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635108651:8014]
2025-10-02T09:36:43.749613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.749619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:43.749669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0
2025-10-02T09:36:43.749803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3323 sessionId: src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0 is DEAD
2025-10-02T09:36:43.749922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:43.749931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Write session will restart in 0.005749s
2025-10-02T09:36:43.749948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Write session: Do CDS request
2025-10-02T09:36:43.749952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.757122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.757141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.757202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.757208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3324
2025-10-02T09:36:43.757285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.757304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.757309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.757312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.757571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3324 sessionId:  describe result for acl check
2025-10-02T09:36:43.757595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.757599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.757601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.757604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.757961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.758463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.758572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.758579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.758585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.758613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.758635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559523096:3637]
2025-10-02T09:36:43.758986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.759152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.759175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.759350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.759378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.759382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.759382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.759383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.759383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.759384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.759384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.759385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.759386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.759386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.759387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.759387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.759390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.759396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.759398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.759400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.759402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.759404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.759406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.759408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.759410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.759412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.759414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.759416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.759419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.759423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.759426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.759429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.759431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.759435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.759437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.759440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.759442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.759444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.759447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.759449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.759452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.759454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.759456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.759459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.759461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.759463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.759465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.759468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.759470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.759472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.759474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.759477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.759495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.759509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.764310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.764318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.764320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108779:2470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.764324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.766847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.768305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.768314Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.768316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.768318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.768321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3323 [2:7556556025559523096:3637]
2025-10-02T09:36:43.768328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.768338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.768339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.768341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.768342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.768350Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.768353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.768358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.768389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.768393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.768394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.768396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.768397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.768432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.768436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.768443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.768448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.768456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.768469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108652:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.768476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108817:2470], now have 1 active actors on pipe
2025-10-02T09:36:43.768479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.768481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.768482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.768489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.768496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.768502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.768504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.768505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.768505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.768506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.768507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3323
2025-10-02T09:36:43.768519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.768522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.768512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3323
2025-10-02T09:36:43.768524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.768537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.768540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.768556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1580ae16-be7987c4-820bec0e-fab92595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.768563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.768565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.768566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.768571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.768576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.768588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.768681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.768686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.768693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.768750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3324 partition: 0 MaxSeqNo: 36 sessionId: src_id|1580ae16-be7987c4-820bec0e-fab92595_0
2025-10-02T09:36:43.768952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d72b96-ddce6d04-c555235c-1b6830b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1580ae16-be7987c4-820bec0e-fab92595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.771701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Write session: try to update token
2025-10-02T09:36:43.771712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.777715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.777726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.777728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.777729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.777734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.777736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.777738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559523091:3637]
2025-10-02T09:36:43.777760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.777764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.777765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.777767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.777771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.777775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.777870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.783198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId: src_id|1580ae16-be7987c4-820bec0e-fab92595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.785203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.849761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635108825:8014]
2025-10-02T09:36:43.849917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3323, pipe: [1:7556556025635108825:8014]
2025-10-02T09:36:43.886755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:43.887046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.887054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.887066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108825:8014], now have 1 active actors on pipe
2025-10-02T09:36:43.887234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:43.887231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:43.887240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:43.887249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:43.887279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635108825:8014]
2025-10-02T09:36:43.887289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3324 reason: error at write: Disconnected sessionId: src_id|1580ae16-be7987c4-820bec0e-fab92595_0
2025-10-02T09:36:43.887413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3324 sessionId: src_id|1580ae16-be7987c4-820bec0e-fab92595_0 is DEAD
2025-10-02T09:36:43.887527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:43.887535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Write session will restart in 0.005329s
2025-10-02T09:36:43.887553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Write session: Do CDS request
2025-10-02T09:36:43.887557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:43.894083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.894171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:43.894178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3325
2025-10-02T09:36:43.894268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:43.894288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:43.894293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:43.894296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:43.894595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3325 sessionId:  describe result for acl check
2025-10-02T09:36:43.894619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:43.894623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:43.894626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:43.894629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:43.894963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:43.895546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:43.896238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:43.896913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:43.897009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:43.897016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:43.897021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:43.897045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:43.897070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556025559523261:3665]
2025-10-02T09:36:43.897463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:43.897643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:43.897666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:43.897685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:43.897692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:43.897694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556025635108946:2508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:43.897697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:43.897873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:43.897901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.897905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.897906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.897907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.897908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.897909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.897910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.897911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.897911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.897912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.897913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.897914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.897918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.897926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.897928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.897931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.897934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.897937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.897941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.897944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.897947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.897951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.897954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.897956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.897960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.897964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:43.897969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.897972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:43.897974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.897977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:43.897981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.897983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:43.897986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.897988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:43.897990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.897995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:43.897997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.898000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:43.898002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.898005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:43.898007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.898011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:43.898013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.898019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.898021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.898024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.898026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.898028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.898045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:43.905385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:43.906858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:43.906871Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:43.906872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:43.906874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:43.906877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3324 [2:7556556025559523261:3665]
2025-10-02T09:36:43.906884Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:43.906894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:43.906895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.906897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.906898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.906907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:43.906909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:43.906913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:43.906945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.906950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.906951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.906953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:43.906954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:43.906999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:43.907004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.907011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:43.907016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:43.907027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:43.907041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108827:2446], now have 1 active actors on pipe
2025-10-02T09:36:43.907047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635108991:2508], now have 1 active actors on pipe
2025-10-02T09:36:43.907050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.907051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.907052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.907062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:43.907070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:43.907079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:43.907081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:43.907083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:43.907084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:43.907085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:43.907076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3324
2025-10-02T09:36:43.907095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3324
2025-10-02T09:36:43.907100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.907106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:43.907107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:43.907120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.907124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.907154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|846272fa-1f651501-c2659131-aa86275_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:43.907162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:43.907164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:43.907168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:43.907173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:43.907179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:43.907191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.907303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:43.907308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:43.907316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:43.907370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3325 partition: 0 MaxSeqNo: 36 sessionId: src_id|846272fa-1f651501-c2659131-aa86275_0
2025-10-02T09:36:43.907532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1580ae16-be7987c4-820bec0e-fab92595_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|846272fa-1f651501-c2659131-aa86275_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:43.910287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Write session: try to update token
2025-10-02T09:36:43.910296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:43.916293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:43.916305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:43.916307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:43.916308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:43.916313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.916316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.916318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556025559523256:3665]
2025-10-02T09:36:43.916339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:43.916342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:43.916344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:43.916392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:43.916410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:43.916414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:43.916458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:43.921900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId: src_id|846272fa-1f651501-c2659131-aa86275_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:43.923898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:43.987484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556025635109008:8014]
2025-10-02T09:36:43.987616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3324, pipe: [1:7556556025635109008:8014]
2025-10-02T09:36:44.025240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.025552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.025563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.025576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556025635109008:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.025715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556025635109008:8014]
2025-10-02T09:36:44.025731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.025770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.025775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.025798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.025868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3325 reason: error at write: Disconnected sessionId: src_id|846272fa-1f651501-c2659131-aa86275_0
2025-10-02T09:36:44.025970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3325 sessionId: src_id|846272fa-1f651501-c2659131-aa86275_0 is DEAD
2025-10-02T09:36:44.026048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.026057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Write session will restart in 0.006271s
2025-10-02T09:36:44.026071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Write session: Do CDS request
2025-10-02T09:36:44.026075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.033084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.033184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.033193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3326
2025-10-02T09:36:44.033275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.033294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.033300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.033304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.033543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3326 sessionId:  describe result for acl check
2025-10-02T09:36:44.033560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.033564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.033565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.033569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.033903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.034389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.035486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.035710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.035807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.035813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.035819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.035842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.035865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854490724:3642]
2025-10-02T09:36:44.036223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.036403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.036426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.036609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.036637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.036641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.036642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.036642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.036643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.036644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.036644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.036645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.036645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.036646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.036646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.036647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.036650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.036655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.036658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.036660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.036662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.036664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.036666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.036668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.036670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.036672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.036674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.036676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.036679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.036683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.036686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.036689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.036691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.036694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.036696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.036699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.036702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.036704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.036708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.036714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.036717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.036719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.036722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.036724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.036727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.036729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.036731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.036735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.036741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.036744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.036747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.036750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.036768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.040565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.040575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.040576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930076435:2502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.040580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.044155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.045700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.045711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.045713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.045715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.045718Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3325 [2:7556556029854490724:3642]
2025-10-02T09:36:44.045725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.045734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.045740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.045741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.045742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.045751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.045754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.045758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.045794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.045798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.045799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.045801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.045803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.045839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.045844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.045850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.045855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.045863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.045877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076309:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.045883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076477:2502], now have 1 active actors on pipe
2025-10-02T09:36:44.045886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.045887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.045888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.045896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.045904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.045912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.045914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.045905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3325
2025-10-02T09:36:44.045914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.045915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.045916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.045924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3325
2025-10-02T09:36:44.045929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.045934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.045935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.045946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.045950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.045975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69d6be83-9eb13f0d-32d75101-542bc464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.045981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.045984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.045985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.045990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.045995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.046007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.046088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.046093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.046100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.046146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3326 partition: 0 MaxSeqNo: 36 sessionId: src_id|69d6be83-9eb13f0d-32d75101-542bc464_0
2025-10-02T09:36:44.046325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|846272fa-1f651501-c2659131-aa86275_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69d6be83-9eb13f0d-32d75101-542bc464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.049148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Write session: try to update token
2025-10-02T09:36:44.049158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.055380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.055394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.055396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.055398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.055404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.055410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.055415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854490719:3642]
2025-10-02T09:36:44.055453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.055454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.055458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.055461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.055465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.055468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.055662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.061024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId: src_id|69d6be83-9eb13f0d-32d75101-542bc464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.063012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.125730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930076484:8014]
2025-10-02T09:36:44.125903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3325, pipe: [1:7556556029930076484:8014]
2025-10-02T09:36:44.164692Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.164989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.164997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.165009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076484:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.165163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.165152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930076484:8014]
2025-10-02T09:36:44.165172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.165174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.165209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3326 reason: error at write: Disconnected sessionId: src_id|69d6be83-9eb13f0d-32d75101-542bc464_0
2025-10-02T09:36:44.165331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.165334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3326 sessionId: src_id|69d6be83-9eb13f0d-32d75101-542bc464_0 is DEAD
2025-10-02T09:36:44.165458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.165467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Write session will restart in 0.009861s
2025-10-02T09:36:44.165482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Write session: Do CDS request
2025-10-02T09:36:44.165486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.174091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.175502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.175602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.175609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.175614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.175641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.175669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854490923:3661]
2025-10-02T09:36:44.176018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.176163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.176216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.176238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.176258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.176267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3327
2025-10-02T09:36:44.176352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.176369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.176371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.176373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.176417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.176455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.176459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.176459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.176460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.176460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.176461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.176461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.176462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.176462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.176463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.176464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.176464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.176467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.176473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.176475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.176478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.176479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.176481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.176483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.176485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.176487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.176489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.176491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.176493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.176496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.176500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.176503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.176506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.176508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.176511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.176513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.176516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.176519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.176522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.176524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.176527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.176529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.176531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.176533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.176537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.176539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.176541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.176543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.176548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.176550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.176552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.176555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.176571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.176623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3327 sessionId:  describe result for acl check
2025-10-02T09:36:44.176646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.176647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.176648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.176651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.176964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.178096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.182314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.182324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.182326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930076620:2517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.182329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.184016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.185484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.185494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.185495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.185497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.185501Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3326 [2:7556556029854490923:3661]
2025-10-02T09:36:44.185507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.185516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.185518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.185519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.185520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.185528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.185531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.185536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.185565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.185571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.185572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.185574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.185575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.185610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.185614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.185621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.185626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.185635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.185649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.185655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.185657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.185664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.185670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.185673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.185675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.185676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076654:2517], now have 1 active actors on pipe
2025-10-02T09:36:44.185678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076485:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.185683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.185690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.185691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.185705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.185712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.185712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3326
2025-10-02T09:36:44.185713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3326
2025-10-02T09:36:44.185728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.185752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.185757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.185770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.185777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.185779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.185780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.185785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.185794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.185803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.185919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.185925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.185931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.185991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3327 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0
2025-10-02T09:36:44.186151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69d6be83-9eb13f0d-32d75101-542bc464_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.189028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Write session: try to update token
2025-10-02T09:36:44.189038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.194611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:44.194625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.194633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.194656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:44.194666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:44.194784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:44.194905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:44.195025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:44.195144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:44.195302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:44.195326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:44.200583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId: src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.202544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.203041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.203055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.203067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.203069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.203071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.203073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.203080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.203083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.203085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854490918:3661]
2025-10-02T09:36:44.203109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.203112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.203112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.203113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.203115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.203120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.203252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.265506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930076684:8014]
2025-10-02T09:36:44.265657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3326, pipe: [1:7556556029930076684:8014]
2025-10-02T09:36:44.313434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.313717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:44.313740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076684:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.313798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:44.314127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930076684:8014]
2025-10-02T09:36:44.314154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.322129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.322471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.322483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.322498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3327 reason: error at write: Disconnected sessionId: src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0
2025-10-02T09:36:44.322602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3327 sessionId: src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0 is DEAD
2025-10-02T09:36:44.322720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.322729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Write session will restart in 0.008371s
2025-10-02T09:36:44.322747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Write session: Do CDS request
2025-10-02T09:36:44.322751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.325365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.325565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.325568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.325575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.325610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.325636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854491111:3676]
2025-10-02T09:36:44.325999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.326174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.326205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.326388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.326415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.326419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.326419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.326420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.326420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.326421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.326421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.326422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.326422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.326423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.326423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.326424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.326427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.326433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.326437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.326440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.326443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.326447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.326450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.326453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.326456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.326460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.326463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.326466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.326471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.326476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.326479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.326482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.326488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.326491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.326495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.326497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.326502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.326504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.326507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.326510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.326512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.326514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.326516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.326518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.326521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.326523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.326525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.326528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.326530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.326532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.326536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.326538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.326554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.332074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.332162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.332171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3328
2025-10-02T09:36:44.332258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.332274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.332278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.332280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.332537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3328 sessionId:  describe result for acl check
2025-10-02T09:36:44.332574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.332582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.332584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.332588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.332834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.333704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.333918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.335431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.335439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.335440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.335442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.335446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3327 [2:7556556029854491111:3676]
2025-10-02T09:36:44.335452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.335461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.335462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.335472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.335480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.335482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930076834:2570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.335486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.335464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.335465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.335474Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.335477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.335481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.335510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.335511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.335512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.335514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.335515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.335552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.335557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.335563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.335568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.335576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.335587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076685:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.335592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076868:2570], now have 1 active actors on pipe
2025-10-02T09:36:44.335595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.335596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.335597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.335604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.335611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.335616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.335618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.335619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.335619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.335620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.335602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3327
2025-10-02T09:36:44.335607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3327
2025-10-02T09:36:44.335636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.335641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.335642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.335649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.335651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.335676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.335686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.335690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.335691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.335696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.335704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.335714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.335806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.335811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.335819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.335887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3328 partition: 0 MaxSeqNo: 36 sessionId: src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0
2025-10-02T09:36:44.336026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c64ad4e-aa3231a2-8686c284-6dd5437c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.338784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Write session: try to update token
2025-10-02T09:36:44.338794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.344853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.344863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.344865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.344866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.344872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.344875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.344878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854491106:3676]
2025-10-02T09:36:44.344905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.344906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.344910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.344911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.344912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.344913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.345023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.350633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId: src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.352776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.414492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930076876:8014]
2025-10-02T09:36:44.414625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3327, pipe: [1:7556556029930076876:8014]
2025-10-02T09:36:44.452990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.453218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.453226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.453238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076876:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.453501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.453510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.453527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.453549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3328 reason: error at write: Disconnected sessionId: src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0
2025-10-02T09:36:44.453563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930076876:8014]
2025-10-02T09:36:44.453568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.453673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3328 sessionId: src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0 is DEAD
2025-10-02T09:36:44.453805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.453815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Write session will restart in 0.009091s
2025-10-02T09:36:44.453830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Write session: Do CDS request
2025-10-02T09:36:44.453835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.461568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.462932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.463104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.463111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.463118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.463149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.463174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854491282:3690]
2025-10-02T09:36:44.463512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.463671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.463693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.463865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.463892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.463896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.463897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.463897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.463898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.463898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.463899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.463899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.463900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.463900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.463901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.463901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.463904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.463911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.463913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.463915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.463917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.463919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.463921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.463925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.463927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.463929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.463931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.463935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.463940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.463943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.463946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.463948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.463951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.463955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.463958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.463961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.463964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.463966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.463968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.463972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.463976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.463978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.463981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.463983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.463985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.463988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.463990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.463992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.463995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.463997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.464013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.464094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.464188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.464198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3329
2025-10-02T09:36:44.464286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.464304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.464307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.464309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.464562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3329 sessionId:  describe result for acl check
2025-10-02T09:36:44.464584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.464588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.464590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.464592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.465016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.466558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.470226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.470236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.470238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930077013:2568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.470242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.471489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.473154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.473166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.473167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.473170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.473174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3328 [2:7556556029854491282:3690]
2025-10-02T09:36:44.473185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.473197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.473203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.473205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.473206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.473217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.473225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.473230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.473274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.473279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.473280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.473281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.473282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.473326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.473333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.473343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.473350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.473358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.473373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077048:2568], now have 1 active actors on pipe
2025-10-02T09:36:44.473378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930076877:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.473382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.473383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.473384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.473392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.473403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.473407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.473409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.473410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.473388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3328
2025-10-02T09:36:44.473413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.473400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3328
2025-10-02T09:36:44.473415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.473435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.473441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.473450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.473458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.473470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.473475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.473478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.473480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.473481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.473487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.473492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.473506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.473588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.473594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.473602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.473644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3329 partition: 0 MaxSeqNo: 36 sessionId: src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0
2025-10-02T09:36:44.473822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c018905b-66b8a05d-4eb51283-b8d3c5a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.476597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Write session: try to update token
2025-10-02T09:36:44.476608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.482560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.482572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.482574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.482575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.482580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.482584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.482587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854491277:3690]
2025-10-02T09:36:44.482607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.482610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.482614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.482616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.482620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.482624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.482719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.488100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId: src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.490216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.553752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930077056:8014]
2025-10-02T09:36:44.553892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3328, pipe: [1:7556556029930077056:8014]
2025-10-02T09:36:44.591097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.591324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.591334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.591346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077056:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.591455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930077056:8014]
2025-10-02T09:36:44.591480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.591473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.591475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.591498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.591520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3329 reason: error at write: Disconnected sessionId: src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0
2025-10-02T09:36:44.591655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3329 sessionId: src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0 is DEAD
2025-10-02T09:36:44.591790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.591799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Write session will restart in 0.007653s
2025-10-02T09:36:44.591831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Write session: Do CDS request
2025-10-02T09:36:44.591835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.599188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.600093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.600173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.600181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3330
2025-10-02T09:36:44.600247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.600264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.600271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.600273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.600533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.600539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3330 sessionId:  describe result for acl check
2025-10-02T09:36:44.600564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.600569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.600570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.600573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.600649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.600656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.600662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.600691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.600716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854491453:3692]
2025-10-02T09:36:44.600921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.601067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.601227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.601251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.601425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.601453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.601457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.601458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.601458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.601459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.601460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.601460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.601460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.601461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.601461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.601462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.601463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.601465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.601471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.601473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.601475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.601477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.601479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.601481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.601483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.601485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.601487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.601488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.601490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.601495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.601499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.601502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.601505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.601507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.601510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.601512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.601515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.601519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.601522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.601524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.601527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.601529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.601532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.601536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.601538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.601540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.601543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.601545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.601547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.601551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.601555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.601557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.601560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.601577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.602213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.606367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.606377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.606379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930077190:2581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.606383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.609049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.610666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.610676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.610678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.610681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.610685Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3329 [2:7556556029854491453:3692]
2025-10-02T09:36:44.610695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.610711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.610714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.610716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.610718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.610729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.610737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.610742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.610786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.610792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.610794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.610797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.610798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.610849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.610855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.610865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.610877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.610896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.610913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077229:2581], now have 1 active actors on pipe
2025-10-02T09:36:44.610905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3329
2025-10-02T09:36:44.610919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077057:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.610924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.610926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.610928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.610934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.610934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3329
2025-10-02T09:36:44.610941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.610944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.610947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.610949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.610956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.610958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.610980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.610986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.611011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.611021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.611032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.611033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.611038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.611040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.611042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.611049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.611057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.611142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.611234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.611240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.611249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.611305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3330 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0
2025-10-02T09:36:44.611485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b10848-adf70d03-36d84e5a-ffa6ada9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.614277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Write session: try to update token
2025-10-02T09:36:44.614288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.620274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.620285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.620288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.620289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.620295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.620298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.620302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854491448:3692]
2025-10-02T09:36:44.620326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.620327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.620333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.620333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.620335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.620335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.620454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.625556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId: src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.627681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.691497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930077236:8014]
2025-10-02T09:36:44.691644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3329, pipe: [1:7556556029930077236:8014]
2025-10-02T09:36:44.749826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.750114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.750125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.750140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077236:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.750307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.750294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930077236:8014]
2025-10-02T09:36:44.750311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.750314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.750318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.750368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3330 reason: error at write: Disconnected sessionId: src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0
2025-10-02T09:36:44.750503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3330 sessionId: src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0 is DEAD
2025-10-02T09:36:44.750644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.750652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Write session will restart in 0.007374s
2025-10-02T09:36:44.750667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Write session: Do CDS request
2025-10-02T09:36:44.750671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.758849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.759141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.759212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.759221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3331
2025-10-02T09:36:44.759295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.759316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.759324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.759327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.759591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3331 sessionId:  describe result for acl check
2025-10-02T09:36:44.759611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.759616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.759617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.759620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.759971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.760212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.760362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.760370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.760378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.760420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.760452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854491625:3694]
2025-10-02T09:36:44.760994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.761150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.761180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.761443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.761481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.761485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.761486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.761487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.761488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.761489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.761490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.761491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.761492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.761493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.761499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.761493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.761494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.761499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.761507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.761511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.761514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.761518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.761521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.761525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.761528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.761531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.761535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.761538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.761541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.761546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.761553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.761557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.761563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.761566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.761572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.761575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.761580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.761587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.761592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.761599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.761604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.761609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.761614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.761619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.761623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.761629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.761633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.761639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.761643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.761651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.761656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.761663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.761667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.761698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.766575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.766585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.766587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930077371:2598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.766590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.769209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.770824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.770835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.770837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.770840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.770844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3330 [2:7556556029854491625:3694]
2025-10-02T09:36:44.770854Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.770868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.770874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.770876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.770878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.770889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.770897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.770902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.770943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.770949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.770951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.770954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.770957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.771013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.771019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.771029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.771039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.771058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.771056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3330
2025-10-02T09:36:44.771060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3330
2025-10-02T09:36:44.771076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077411:2598], now have 1 active actors on pipe
2025-10-02T09:36:44.771083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077238:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.771087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.771091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.771093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.771099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.771104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.771106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.771107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.771112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.771124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.771130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.771145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.771151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.771172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.771182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.771188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.771194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.771202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.771205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.771210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.771217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.771224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.771250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.771351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.771359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.771370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.771423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3331 partition: 0 MaxSeqNo: 36 sessionId: src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0
2025-10-02T09:36:44.771611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6493c7-ad50cd37-1f9d2374-db32b08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.774461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Write session: try to update token
2025-10-02T09:36:44.774475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.780418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.780433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.780434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.780436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.780444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.780446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.780449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854491620:3694]
2025-10-02T09:36:44.780470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.780474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.780475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.780477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.780477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.780480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.780598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.787330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId: src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.789454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.850207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930077420:8014]
2025-10-02T09:36:44.850348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3330, pipe: [1:7556556029930077420:8014]
2025-10-02T09:36:44.891938Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:44.892248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.892258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.892271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077420:8014], now have 1 active actors on pipe
2025-10-02T09:36:44.892442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:44.892436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930077420:8014]
2025-10-02T09:36:44.892436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:44.892439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:44.892460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:44.892487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3331 reason: error at write: Disconnected sessionId: src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0
2025-10-02T09:36:44.892618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3331 sessionId: src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0 is DEAD
2025-10-02T09:36:44.892718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:44.892728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Write session will restart in 0.008955s
2025-10-02T09:36:44.892747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Write session: Do CDS request
2025-10-02T09:36:44.892751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:44.900568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:44.901970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:44.902073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:44.902080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:44.902086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:44.902110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:44.902131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556029854491798:3700]
2025-10-02T09:36:44.902471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:44.902634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:44.902658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:44.902864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:44.902894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.902898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.902899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.902899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.902900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.902900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.902901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.902902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.902902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.902902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.902903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.902903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.902906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.902913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.902915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.902917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.902919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.902921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.902923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.902925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.902927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.902930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.902932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.902934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.902937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.902941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:44.902945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.902947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:44.902949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.902952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:44.902954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.902957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:44.902959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.902961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:44.902963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.902966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:44.902968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.902981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:44.902984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.902986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:44.902989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.902995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:44.902997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.903001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.903003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.903005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.903007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.903010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.903029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:44.903119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.903249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:44.903260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3332
2025-10-02T09:36:44.903340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:44.903359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:44.903373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:44.903376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:44.903636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3332 sessionId:  describe result for acl check
2025-10-02T09:36:44.903662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:44.903667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:44.903668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:44.903671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:44.904023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:44.905410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:44.909294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:44.909304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:44.909306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556029930077561:2625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:44.909310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:44.910490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:44.911985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:44.911995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:44.911997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:44.911999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:44.912002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3331 [2:7556556029854491798:3700]
2025-10-02T09:36:44.912008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:44.912019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:44.912023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.912025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.912026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.912035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:44.912037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:44.912042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:44.912071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.912076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.912077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.912079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:44.912080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:44.912116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:44.912121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.912127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:44.912134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:44.912142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:44.912157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077595:2625], now have 1 active actors on pipe
2025-10-02T09:36:44.912162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077422:2446], now have 1 active actors on pipe
2025-10-02T09:36:44.912166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.912168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.912169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.912176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:44.912184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:44.912189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:44.912191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:44.912193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:44.912193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:44.912195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:44.912190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3331
2025-10-02T09:36:44.912208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3331
2025-10-02T09:36:44.912210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.912214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:44.912216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:44.912224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.912228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.912253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b50e89d5-b548034e-51e1362-3766ad15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:44.912260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:44.912262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:44.912263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:44.912267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:44.912274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:44.912286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.912377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:44.912381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:44.912389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:44.912439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3332 partition: 0 MaxSeqNo: 36 sessionId: src_id|b50e89d5-b548034e-51e1362-3766ad15_0
2025-10-02T09:36:44.912628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a570fc-77e79a8c-59b8d0fa-14df2813_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b50e89d5-b548034e-51e1362-3766ad15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:44.915392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Write session: try to update token
2025-10-02T09:36:44.915402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:44.921575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:44.921590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:44.921592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:44.921593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:44.921599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.921601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.921603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556029854491793:3700]
2025-10-02T09:36:44.921625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:44.921628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:44.921629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:44.921632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:44.921635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:44.921637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:44.921736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:44.926895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId: src_id|b50e89d5-b548034e-51e1362-3766ad15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:44.929244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:44.992539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556029930077610:8014]
2025-10-02T09:36:44.992686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3331, pipe: [1:7556556029930077610:8014]
2025-10-02T09:36:45.033071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.033366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.033374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.033387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556029930077610:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.033513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.033557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.033594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:45.033594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556029930077610:8014]
2025-10-02T09:36:45.033646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b50e89d5-b548034e-51e1362-3766ad15_0
2025-10-02T09:36:45.033782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3332 sessionId: src_id|b50e89d5-b548034e-51e1362-3766ad15_0 is DEAD
2025-10-02T09:36:45.033924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:45.033929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Write session will restart in 0.006724s
2025-10-02T09:36:45.033944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Write session: Do CDS request
2025-10-02T09:36:45.033949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.041124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.041208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.041218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3333
2025-10-02T09:36:45.041290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.041309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.041315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.041318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.041572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3333 sessionId:  describe result for acl check
2025-10-02T09:36:45.041590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.041594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.041596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.041598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.041953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.041947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.043242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.043371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.043474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.043481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.043487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.043515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.043541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149459267:3706]
2025-10-02T09:36:45.043891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.044063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.044087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.044271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.044303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.044307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.044308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.044308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.044309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.044309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.044310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.044310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.044311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.044311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.044312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.044313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.044315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.044321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.044323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.044325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.044327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.044329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.044331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.044333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.044335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.044337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.044339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.044341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.044345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.044349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.044352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.044355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.044358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.044361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.044363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.044366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.044368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.044370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.044372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.044375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.044377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.044380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.044382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.044384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.044386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.044390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.044392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.044394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.044400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.044403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.044404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.044407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.044423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.048242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.048251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.048252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225045045:2631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.048256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.051814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.053403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.053415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.053417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.053420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.053424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3332 [2:7556556034149459267:3706]
2025-10-02T09:36:45.053433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.053442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.053448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.053449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.053450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.053459Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.053463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.053467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.053499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.053504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.053505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.053506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.053508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.053545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.053549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.053556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.053561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.053572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.053583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225044911:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.053591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045086:2631], now have 1 active actors on pipe
2025-10-02T09:36:45.053594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.053595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.053596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.053603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.053610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.053616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.053618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.053619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.053620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.053620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.053633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.053627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3332
2025-10-02T09:36:45.053638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.053642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.053634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3332
2025-10-02T09:36:45.053662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.053669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.053690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.053697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.053699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.053700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.053705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.053711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.053718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.053811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.053816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.053823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.053876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3333 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0
2025-10-02T09:36:45.054077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b50e89d5-b548034e-51e1362-3766ad15_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.056873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Write session: try to update token
2025-10-02T09:36:45.056884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.062825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.062837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.062838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.062839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.062844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.062847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.062849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149459262:3706]
2025-10-02T09:36:45.062868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.062872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.062873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.062875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.062878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.062881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.062999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.068546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId: src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.070835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.133864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225045093:8014]
2025-10-02T09:36:45.134042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3332, pipe: [1:7556556034225045093:8014]
2025-10-02T09:36:45.182353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.182562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.182572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.182583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045093:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.182701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.182744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225045093:8014]
2025-10-02T09:36:45.182772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.182774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:45.182820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0
2025-10-02T09:36:45.182965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3333 sessionId: src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0 is DEAD
2025-10-02T09:36:45.183109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:45.183114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Write session will restart in 0.006102s
2025-10-02T09:36:45.183128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Write session: Do CDS request
2025-10-02T09:36:45.183132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.190145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.190243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.190252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3334
2025-10-02T09:36:45.190351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.190369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.190375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.190378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.190682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3334 sessionId:  describe result for acl check
2025-10-02T09:36:45.190699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.190703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.190704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.190707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.190751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.191057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.192122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.192225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.192232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.192238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.192270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.192305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149459457:3734]
2025-10-02T09:36:45.192562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.192680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.192860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.192884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.193075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.193211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.193217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.193218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.193218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.193219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.193220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.193220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.193221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.193221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.193222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.193222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.193223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.193226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.193232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.193235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.193237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.193239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.193241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.193243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.193245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.193247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.193250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.193252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.193254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.193259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.193264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.193267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.193270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.193272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.193275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.193278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.193280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.193283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.193288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.193290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.193293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.193295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.193298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.193302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.193305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.193307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.193309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.193311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.193314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.193316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.193319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.193322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.193324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.193341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.197200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.197211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.197213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225045230:2643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.197216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.200737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.202232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.202243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.202244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.202246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.202249Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3333 [2:7556556034149459457:3734]
2025-10-02T09:36:45.202256Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.202265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.202266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.202268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.202269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.202278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.202280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.202285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.202317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.202322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.202323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.202324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.202326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.202363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.202368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.202375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.202380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.202389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.202404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045271:2643], now have 1 active actors on pipe
2025-10-02T09:36:45.202409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045094:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.202413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.202415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.202416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.202422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.202431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.202435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.202437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.202438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.202440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.202442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.202443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3333
2025-10-02T09:36:45.202455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.202446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3333
2025-10-02T09:36:45.202460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.202473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.202511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.202516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.202534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.202541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.202543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.202544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.202549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.202555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.202564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.202656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.202660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.202668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.202722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3334 partition: 0 MaxSeqNo: 36 sessionId: src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0
2025-10-02T09:36:45.202910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d4b6-eb86a08e-15159fd2-7f486b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.205726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Write session: try to update token
2025-10-02T09:36:45.205737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.211850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.211864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.211865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.211866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.211871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.211874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.211876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149459452:3734]
2025-10-02T09:36:45.211897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.211901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.211902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.211907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.211910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.211913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.212028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.217571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId: src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.220092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.282837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225045300:8014]
2025-10-02T09:36:45.283044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3333, pipe: [1:7556556034225045300:8014]
2025-10-02T09:36:45.329287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.329518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.329527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.329539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045300:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.329721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.329764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:45.329778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:45.329795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225045300:8014]
2025-10-02T09:36:45.329809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.329821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3334 reason: error at write: Disconnected sessionId: src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0
2025-10-02T09:36:45.329949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3334 sessionId: src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0 is DEAD
2025-10-02T09:36:45.330072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:45.330080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Write session will restart in 0.005952s
2025-10-02T09:36:45.330098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Write session: Do CDS request
2025-10-02T09:36:45.330102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.337142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.337247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.337257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3335
2025-10-02T09:36:45.337345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.337362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.337368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.337371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.337713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3335 sessionId:  describe result for acl check
2025-10-02T09:36:45.337738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.337742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.337743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.337746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.337836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.338071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.339206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.339304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.339310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.339316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.339341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.339363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149459668:3741]
2025-10-02T09:36:45.339587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.339718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.339890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.339916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.340100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.340128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.340133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.340133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.340134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.340135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.340136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.340137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.340138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.340139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.340140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.340141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.340142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.340146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.340154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.340158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.340161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.340164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.340168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.340171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.340175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.340177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.340179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.340181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.340183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.340187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.340190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.340194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.340198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.340204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.340206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.340209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.340211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.340217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.340219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.340221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.340224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.340226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.340229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.340234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.340236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.340239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.340241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.340243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.340246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.340249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.340252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.340255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.340261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.340278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.344273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.344282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.344284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225045452:2680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.344288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.347741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.349439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.349451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.349453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.349455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.349461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3334 [2:7556556034149459668:3741]
2025-10-02T09:36:45.349470Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.349482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.349485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.349487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.349488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.349499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.349503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.349508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.349548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.349554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.349556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.349558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.349560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.349609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.349614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.349625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.349638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.349657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.349671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045301:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.349678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045492:2680], now have 1 active actors on pipe
2025-10-02T09:36:45.349684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.349686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.349666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3334
2025-10-02T09:36:45.349688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.349694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.349667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3334
2025-10-02T09:36:45.349698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.349703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.349705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.349706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.349715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.349722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.349737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.349743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.349765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.349775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.349783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.349790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.349798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.349803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.349805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.349811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.349822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.349848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.349939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.349945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.349956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.350004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3335 partition: 0 MaxSeqNo: 36 sessionId: src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0
2025-10-02T09:36:45.350207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd1fce-2bb5854-133ffe4d-889263f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.352975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Write session: try to update token
2025-10-02T09:36:45.352985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.359608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.359622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.359624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.359626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.359632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.359636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.359640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149459663:3741]
2025-10-02T09:36:45.359666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.359674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.359676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.359712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.359725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.359732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.359788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.364545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId: src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.367001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.429801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225045500:8014]
2025-10-02T09:36:45.429957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3334, pipe: [1:7556556034225045500:8014]
2025-10-02T09:36:45.479664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.479959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.479968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.479980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045500:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.480101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.480415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.480434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225045500:8014]
2025-10-02T09:36:45.480448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:45.480498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0
2025-10-02T09:36:45.480637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3335 sessionId: src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0 is DEAD
2025-10-02T09:36:45.480762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:45.480767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Write session will restart in 0.006510s
2025-10-02T09:36:45.480781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Write session: Do CDS request
2025-10-02T09:36:45.480785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.488098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.488201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.488210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3336
2025-10-02T09:36:45.488293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.488314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.488320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.488322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.488596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3336 sessionId:  describe result for acl check
2025-10-02T09:36:45.488622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.488627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.488628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.488631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.489019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.489437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.490557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.490775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.490920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.490928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.490935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.490971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.491008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149459846:3757]
2025-10-02T09:36:45.491532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.491718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.491752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.492015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.492055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.492060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.492061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.492061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.492063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.492063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.492064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.492065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.492066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.492067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.492068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.492069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.492073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.492069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.492079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.492081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.492085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.492089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.492092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.492081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225045637:2697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.492095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.492084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.492099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.492102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.492105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.492110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.492113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.492116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.492121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.492129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.492137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.492142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.492149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.492154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.492162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.492167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.492171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.492175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.492183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.492187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.492193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.492199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.492203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.492209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.492213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.492221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.492225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.492232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.492236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.492242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.492246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.492253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.492284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.499668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.501318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.501329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.501331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.501333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.501337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3335 [2:7556556034149459846:3757]
2025-10-02T09:36:45.501348Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.501363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.501370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.501373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.501374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.501386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.501393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.501398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.501443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.501449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.501451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.501453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.501455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.501502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.501508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.501519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.501531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.501550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.501568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045676:2697], now have 1 active actors on pipe
2025-10-02T09:36:45.501574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045501:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.501578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.501581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.501557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3335
2025-10-02T09:36:45.501558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3335
2025-10-02T09:36:45.501585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.501591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.501595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.501597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.501598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.501602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.501613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.501617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.501633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.501640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.501662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.501672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.501679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.501685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.501690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.501692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.501694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.501700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.501709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.501732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.501821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.501829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.501840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.501910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3336 partition: 0 MaxSeqNo: 36 sessionId: src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0
2025-10-02T09:36:45.502097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafa59e-244332e-4d0d8ded-ff53a123_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.504858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Write session: try to update token
2025-10-02T09:36:45.504866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.510937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.510949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.510952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.510954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.510960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.510964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.510967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149459841:3757]
2025-10-02T09:36:45.510995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.511001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.511003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.511005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.511005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.511007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.511122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.516277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId: src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.518459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.580839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225045687:8014]
2025-10-02T09:36:45.581008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3335, pipe: [1:7556556034225045687:8014]
2025-10-02T09:36:45.625197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.625507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.625517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.625529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045687:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.625660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.625707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225045687:8014]
2025-10-02T09:36:45.625714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:45.625734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.625769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3336 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0
2025-10-02T09:36:45.625900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3336 sessionId: src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0 is DEAD
2025-10-02T09:36:45.626041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:45.626050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Write session will restart in 0.006076s
2025-10-02T09:36:45.626070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Write session: Do CDS request
2025-10-02T09:36:45.626075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.633129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.633231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.633240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3337
2025-10-02T09:36:45.633318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.633338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.633345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.633347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.633606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3337 sessionId:  describe result for acl check
2025-10-02T09:36:45.633632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.633637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.633639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.633643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.633941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.634056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.635213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.635383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.635391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.635399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.635433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.635460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149460024:3747]
2025-10-02T09:36:45.635470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.635829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.635995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.636018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.636203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.636237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.636241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.636241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.636242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.636243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.636243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.636244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.636244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.636245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.636245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.636246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.636247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.636250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.636255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.636258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.636260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.636261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.636263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.636265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.636267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.636269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.636273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.636275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.636277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.636280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.636284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.636287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.636290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.636292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.636295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.636297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.636300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.636302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.636305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.636307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.636310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.636314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.636317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.636320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.636323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.636325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.636329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.636333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.636341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.636345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.636354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.636358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.636360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.636378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.640127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.640136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.640138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225045826:2711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.640141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.643722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.645282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.645293Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.645294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.645297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.645300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3336 [2:7556556034149460024:3747]
2025-10-02T09:36:45.645308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.645317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.645322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.645324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.645325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.645335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.645341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.645345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.645373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.645378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.645379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.645381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.645382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.645418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.645423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.645429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.645434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.645444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.645458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045866:2711], now have 1 active actors on pipe
2025-10-02T09:36:45.645463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045688:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.645467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.645469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.645470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.645478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.645488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.645490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.645492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.645493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.645497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.645498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.645511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.645491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3336
2025-10-02T09:36:45.645494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3336
2025-10-02T09:36:45.645516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.645517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.645525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.645527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.645552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.645559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.645561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.645562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.645567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.645573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.645582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.645658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.645662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.645670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.645710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3337 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0
2025-10-02T09:36:45.645903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c546ed7-2aa4d0d0-e04efdd4-c3dc33dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.648992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Write session: try to update token
2025-10-02T09:36:45.649004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.654857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.654868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.654869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.654870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.654876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.654879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.654881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149460019:3747]
2025-10-02T09:36:45.654900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.654905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.654906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.654911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.654922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.654925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.655027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.661425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId: src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.663575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.725732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225045875:8014]
2025-10-02T09:36:45.725897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3336, pipe: [1:7556556034225045875:8014]
2025-10-02T09:36:45.766179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.766414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.766424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.766436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045875:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.766592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225045875:8014]
2025-10-02T09:36:45.766602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.766611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:45.766613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:45.766648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3337 reason: error at write: Disconnected sessionId: src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0
2025-10-02T09:36:45.766654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.766781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3337 sessionId: src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0 is DEAD
2025-10-02T09:36:45.766900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:45.766905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Write session will restart in 0.007093s
2025-10-02T09:36:45.766919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Write session: Do CDS request
2025-10-02T09:36:45.766923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.775151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.775220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.775224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.775228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3338
2025-10-02T09:36:45.775326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.775344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.775350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.775352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.775599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3338 sessionId:  describe result for acl check
2025-10-02T09:36:45.775623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.775628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.775630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.775633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.775980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.776556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.776669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.776676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.776683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.776715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.776741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149460203:3752]
2025-10-02T09:36:45.777203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.777252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.777381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.777415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.777701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.777744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.777748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.777748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.777749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.777750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.777750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.777751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.777752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.777752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.777753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.777753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.777754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.777757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.777762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.777764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.777766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.777768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.777770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.777772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.777774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.777776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.777779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.777781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.777783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.777787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.777791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.777795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.777798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.777800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.777802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.777805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.777807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.777809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.777812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.777814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.777817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.777823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.777826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.777828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.777830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.777833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.777839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.777841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.777844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.777846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.777851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.777853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.777856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.777872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.781672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.781681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.781683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225046017:2710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.781686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.785265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.786746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.786758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.786759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.786762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.786765Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3337 [2:7556556034149460203:3752]
2025-10-02T09:36:45.786773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.786782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.786787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.786789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.786790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.786799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.786806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.786810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.786843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.786848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.786849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.786851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.786852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.786894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.786901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.786911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.786925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.786939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.786955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225046056:2710], now have 1 active actors on pipe
2025-10-02T09:36:45.786961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225045876:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.786948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3337
2025-10-02T09:36:45.786965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.786970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.786953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3337
2025-10-02T09:36:45.786971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.786985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.786989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.786991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.786992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.786993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.787002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.787007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.787020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.787026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.787044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.787052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.787061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.787061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.787067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.787070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.787071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.787076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.787085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.787169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.787263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.787268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.787276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.787339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3338 partition: 0 MaxSeqNo: 36 sessionId: src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0
2025-10-02T09:36:45.787516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b382638-4b2ce301-86e9c5d7-87d105c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.790586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Write session: try to update token
2025-10-02T09:36:45.790601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.796304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.796316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.796317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.796318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.796323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.796325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.796328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149460198:3752]
2025-10-02T09:36:45.796348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.796353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.796354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.796354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.796357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.796360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.796471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.803091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId: src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.805246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:45.866519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556034225046064:8014]
2025-10-02T09:36:45.866659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3337, pipe: [1:7556556034225046064:8014]
2025-10-02T09:36:45.906807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:45.907098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.907107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.907118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225046064:8014], now have 1 active actors on pipe
2025-10-02T09:36:45.907238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:45.907272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:45.907284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:45.907327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3338 reason: error at write: Disconnected sessionId: src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0
2025-10-02T09:36:45.907359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556034225046064:8014]
2025-10-02T09:36:45.907402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:45.907451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3338 sessionId: src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0 is DEAD
2025-10-02T09:36:45.907565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:45.907569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Write session will restart in 0.006534s
2025-10-02T09:36:45.907587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Write session: Do CDS request
2025-10-02T09:36:45.907591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:45.915128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.915291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:45.915301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3339
2025-10-02T09:36:45.915421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:45.915440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:45.915443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:45.915445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:45.915680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:45.915847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3339 sessionId:  describe result for acl check
2025-10-02T09:36:45.915887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:45.915894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:45.915896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:45.915900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:45.916357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:45.917259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:45.917466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:45.917473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:45.917480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:45.917517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:45.917543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556034149460384:3756]
2025-10-02T09:36:45.917888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:45.917972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:45.918052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:45.918075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:45.918254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:45.918283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.918287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.918288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.918289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.918289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.918290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.918291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.918291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.918292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.918292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.918293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.918293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.918296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.918302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.918304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.918307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.918311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.918313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.918315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.918317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.918319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.918321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.918323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.918327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.918330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:45.918334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.918336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:45.918339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.918341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:45.918346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.918349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:45.918353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.918355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:45.918357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.918360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:45.918363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.918370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:45.918372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.918374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:45.918377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.918379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:45.918382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.918384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.918387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.918391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.918393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.918396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.918412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:45.922246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:45.922258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:45.922260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556034225046206:2731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:45.922266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:45.925783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:45.927298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:45.927308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:45.927309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:45.927311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:45.927315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3338 [2:7556556034149460384:3756]
2025-10-02T09:36:45.927321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:45.927331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:45.927334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.927336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.927337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.927345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:45.927351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:45.927356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:45.927385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.927390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.927391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.927393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:45.927394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:45.927432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:45.927437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.927443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:45.927448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:45.927458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:45.927471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225046244:2731], now have 1 active actors on pipe
2025-10-02T09:36:45.927477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556034225046065:2446], now have 1 active actors on pipe
2025-10-02T09:36:45.927481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.927482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.927483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.927491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:45.927499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:45.927503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:45.927505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:45.927506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:45.927509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:45.927511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:45.927524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.927529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:45.927517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3338
2025-10-02T09:36:45.927517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3338
2025-10-02T09:36:45.927535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:45.927581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.927586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.927605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:45.927612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:45.927614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:45.927615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:45.927620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:45.927627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:45.927634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.927744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:45.927749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:45.927756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:45.927820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3339 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0
2025-10-02T09:36:45.928089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3887dba0-5a41aab9-7406bc4d-770c52bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:45.930819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Write session: try to update token
2025-10-02T09:36:45.930829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:45.936789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:45.936814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:45.936816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:45.936817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:45.936823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.936827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.936831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556034149460379:3756]
2025-10-02T09:36:45.936858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:45.936859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:45.936863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:45.936865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:45.936866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:45.936868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:45.937040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:45.942211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId: src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:45.944626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.007338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520013558:8014]
2025-10-02T09:36:46.007514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3338, pipe: [1:7556556038520013558:8014]
2025-10-02T09:36:46.048434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.048698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.048706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.048718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013558:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.048894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.048942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:46.048960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:46.048968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520013558:8014]
2025-10-02T09:36:46.048990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.049033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3339 reason: error at write: Disconnected sessionId: src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0
2025-10-02T09:36:46.049198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3339 sessionId: src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0 is DEAD
2025-10-02T09:36:46.049309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:46.049323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Write session will restart in 0.008465s
2025-10-02T09:36:46.049339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Write session: Do CDS request
2025-10-02T09:36:46.049343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.059170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.059245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.059256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3340
2025-10-02T09:36:46.059366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.059392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.059400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.059404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.059650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.059753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3340 sessionId:  describe result for acl check
2025-10-02T09:36:46.059787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.059793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.059794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.059799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.060219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.061186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.061308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.061315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.061320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.061351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.061376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444427860:3755]
2025-10-02T09:36:46.061682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.061755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.061912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.061936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.062118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.062150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.062154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.062155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.062155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.062156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.062156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.062157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.062157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.062158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.062158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.062159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.062159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.062162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.062168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.062170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.062173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.062175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.062177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.062179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.062180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.062182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.062185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.062187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.062189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.062193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.062197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.062200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.062203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.062205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.062207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.062210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.062212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.062215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.062217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.062220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.062222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.062225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.062229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.062232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.062237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.062241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.062249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.062253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.062258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.062262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.062271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.062275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.062279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.062298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.066130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.066141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.066144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520013703:2755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.066149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.069669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.071141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.071151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.071152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.071154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.071158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3339 [2:7556556038444427860:3755]
2025-10-02T09:36:46.071164Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.071174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.071176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.071178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.071179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.071188Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.071191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.071195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.071225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.071230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.071231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.071233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.071234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.071272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.071277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.071283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.071289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.071299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.071311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013560:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.071316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013742:2755], now have 1 active actors on pipe
2025-10-02T09:36:46.071320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.071321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.071322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.071330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.071339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.071345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.071347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.071348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.071350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.071351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.071364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.071369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.071357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3339
2025-10-02T09:36:46.071361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3339
2025-10-02T09:36:46.071386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.071408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.071413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.071427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.071434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.071435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.071436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.071441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.071447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.071458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.071584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.071588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.071596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.071657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3340 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0
2025-10-02T09:36:46.071933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d37907-ac6895ef-7d19f8de-86c7fee1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.074756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Write session: try to update token
2025-10-02T09:36:46.074766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.084387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:46.084398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.084404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.084431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:46.084437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:46.084582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:46.084703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.084845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.084963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.085123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:46.085151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:46.086264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId: src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.088728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.088765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.088777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.088778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.088780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.088783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.088786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.088788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444427854:3755]
2025-10-02T09:36:46.088819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.088823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.088823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.088824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.088829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.088831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.088957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.149169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520013749:8014]
2025-10-02T09:36:46.149390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3339, pipe: [1:7556556038520013749:8014]
2025-10-02T09:36:46.199455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.199713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.199722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.199734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013749:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.199890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.199927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520013749:8014]
2025-10-02T09:36:46.199928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.199960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:46.200046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3340 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0
2025-10-02T09:36:46.200203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3340 sessionId: src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0 is DEAD
2025-10-02T09:36:46.200326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:46.200334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Write session will restart in 0.007576s
2025-10-02T09:36:46.200351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Write session: Do CDS request
2025-10-02T09:36:46.200356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.208855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.209112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.209203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.209212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3341
2025-10-02T09:36:46.209311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.209333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.209341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.209345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.209675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3341 sessionId:  describe result for acl check
2025-10-02T09:36:46.209710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.209716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.209717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.209721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.210117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.210279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.210390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.210396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.210402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.210431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.210456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444428056:3814]
2025-10-02T09:36:46.210806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.210974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.211003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.211182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.211212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.211216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.211216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.211217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.211218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.211218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.211219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.211219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.211220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.211220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.211221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.211221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.211224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.211230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.211232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.211235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.211236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.211239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.211240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.211242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.211244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.211247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.211249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.211251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.211257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.211261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.211264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.211267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.211271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.211274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.211276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.211278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.211281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.211283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.211285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.211288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.211292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.211294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.211296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.211299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.211301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.211304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.211306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.211309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.211312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.211314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.211317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.211319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.211337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.211569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.216087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.216098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.216100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520013894:2771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.216105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.218684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.220280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.220291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.220292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.220294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.220300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3340 [2:7556556038444428056:3814]
2025-10-02T09:36:46.220307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.220317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.220319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.220320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.220321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.220330Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.220336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.220340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.220373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.220378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.220379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.220381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.220382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.220419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.220424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.220430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.220440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.220457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.220476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013751:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.220483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013934:2771], now have 1 active actors on pipe
2025-10-02T09:36:46.220488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.220490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.220492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.220501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.220513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.220515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.220517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.220518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.220524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.220525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.220505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3340
2025-10-02T09:36:46.220522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3340
2025-10-02T09:36:46.220548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.220556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.220566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.220571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.220574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.220599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.220607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.220609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.220610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.220615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.220624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.220636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.220745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.220751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.220759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.220834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3341 partition: 0 MaxSeqNo: 36 sessionId: src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0
2025-10-02T09:36:46.221084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27545c-c8ba6d16-a6e17871-54c7885f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.223872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Write session: try to update token
2025-10-02T09:36:46.223881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.229705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.229718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.229720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.229720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.229724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.229726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.229728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444428051:3814]
2025-10-02T09:36:46.229746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.229751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.229752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.229753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.229757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.229759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.229861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.235440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId: src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.237871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.300189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520013963:8014]
2025-10-02T09:36:46.300355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3340, pipe: [1:7556556038520013963:8014]
2025-10-02T09:36:46.339311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.339586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.339595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.339607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013963:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.339745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.339743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:46.339749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.339758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:46.339777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520013963:8014]
2025-10-02T09:36:46.339813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3341 reason: error at write: Disconnected sessionId: src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0
2025-10-02T09:36:46.339975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3341 sessionId: src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0 is DEAD
2025-10-02T09:36:46.340117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:46.340125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Write session will restart in 0.008740s
2025-10-02T09:36:46.340145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Write session: Do CDS request
2025-10-02T09:36:46.340149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.348832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.350149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.350274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.350297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.350312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3342
2025-10-02T09:36:46.350440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.350453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.350460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.350467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.350465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.350474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.350477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.350497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.350528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444428274:3811]
2025-10-02T09:36:46.350825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3342 sessionId:  describe result for acl check
2025-10-02T09:36:46.350851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.350857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.350858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.350862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.350891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.351094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.351121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.351291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.351324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.351356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.351360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.351361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.351361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.351362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.351362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.351363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.351363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.351364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.351364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.351365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.351365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.351369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.351375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.351377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.351379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.351381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.351383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.351385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.351387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.351390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.351393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.351395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.351397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.351400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.351404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.351408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.351411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.351413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.351415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.351418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.351420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.351422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.351425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.351427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.351430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.351435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.351439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.351445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.351453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.351459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.351467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.351471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.351477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.351480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.351485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.351493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.351497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.351516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.352921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.357022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.357032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.357034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520014123:2835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.357038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.359217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.360660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.360671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.360672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.360675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.360679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3341 [2:7556556038444428274:3811]
2025-10-02T09:36:46.360686Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.360696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.360701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.360703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.360704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.360713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.360716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.360721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.360758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.360764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.360766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.360768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.360771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.360822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.360827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.360834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.360839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.360851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.360866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014161:2835], now have 1 active actors on pipe
2025-10-02T09:36:46.360872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520013978:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.360875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.360877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.360878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.360886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.360897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.360904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.360907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.360907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.360909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.360909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.360900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3341
2025-10-02T09:36:46.360923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.360919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3341
2025-10-02T09:36:46.360928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.360929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.360943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.360945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.360963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.360970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.360972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.360973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.360979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.360984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.360997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.361119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.361127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.361137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.361207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3342 partition: 0 MaxSeqNo: 36 sessionId: src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0
2025-10-02T09:36:46.361478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53597fb-96e23dc2-ebe755e6-ea9a4ca7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.364240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Write session: try to update token
2025-10-02T09:36:46.364250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.370148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.370161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.370162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.370163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.370168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.370170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.370172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444428269:3811]
2025-10-02T09:36:46.370192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.370195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.370196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.370201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.370204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.370206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.370314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.375532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId: src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.377941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.439985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520014170:8014]
2025-10-02T09:36:46.440177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3341, pipe: [1:7556556038520014170:8014]
2025-10-02T09:36:46.480058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.480358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.480367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.480380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014170:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.480722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.480794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520014170:8014]
2025-10-02T09:36:46.480846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.480849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:46.480901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0
2025-10-02T09:36:46.481029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3342 sessionId: src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0 is DEAD
2025-10-02T09:36:46.481139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:46.481148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Write session will restart in 0.008363s
2025-10-02T09:36:46.481162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Write session: Do CDS request
2025-10-02T09:36:46.481168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.490136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.490317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.490398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.490409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3343
2025-10-02T09:36:46.490535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.490564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.490574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.490578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.490917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3343 sessionId:  describe result for acl check
2025-10-02T09:36:46.490947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.490952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.490953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.490956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.491315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.491891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.491995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.492001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.492007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.492034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.492057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444428460:3807]
2025-10-02T09:36:46.492416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.492605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.492641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.492721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.492977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.493022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.493027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.493027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.493028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.493028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.493029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.493030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.493030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.493031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.493031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.493032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.493032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.493035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.493041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.493043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.493045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.493047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.493049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.493051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.493053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.493055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.493058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.493060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.493062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.493066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.493069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.493073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.493075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.493078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.493080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.493082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.493085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.493087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.493090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.493092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.493095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.493099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.493103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.493109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.493113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.493118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.493124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.493131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.493134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.493137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.493140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.493142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.493145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.493163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.496944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.496954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.496956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520014316:2841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.496960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.500515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.502050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.502059Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.502060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.502063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.502066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3342 [2:7556556038444428460:3807]
2025-10-02T09:36:46.502072Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.502081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.502086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.502087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.502089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.502097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.502100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.502104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.502133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.502138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.502140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.502143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.502144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.502180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.502185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.502191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.502196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.502205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.502217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014171:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.502223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014355:2841], now have 1 active actors on pipe
2025-10-02T09:36:46.502226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.502227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.502228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.502235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.502245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.502249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.502252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.502254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.502256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.502257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.502246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3342
2025-10-02T09:36:46.502271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.502274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.502276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.502293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.502298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.502272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3342
2025-10-02T09:36:46.502315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fde0884-b641de09-ceeeb083-89078e22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.502322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.502324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.502325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.502330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.502335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.502342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.502469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.502474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.502481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.502546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3343 partition: 0 MaxSeqNo: 36 sessionId: src_id|8fde0884-b641de09-ceeeb083-89078e22_0
2025-10-02T09:36:46.502820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d9e15b-961902c-bcd9c761-dc4fdac5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8fde0884-b641de09-ceeeb083-89078e22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.505657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Write session: try to update token
2025-10-02T09:36:46.505668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.511390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.511402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.511406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.511407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.511412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.511415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.511417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444428455:3807]
2025-10-02T09:36:46.511437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.511444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.511446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.511448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.511453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.511456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.511571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.517212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId: src_id|8fde0884-b641de09-ceeeb083-89078e22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.519633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.580949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520014363:8014]
2025-10-02T09:36:46.581368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3342, pipe: [1:7556556038520014363:8014]
2025-10-02T09:36:46.621950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.622174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.622182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.622196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014363:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.622423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520014363:8014]
2025-10-02T09:36:46.622447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.622451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:46.622456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:46.622550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3343 reason: error at write: Disconnected sessionId: src_id|8fde0884-b641de09-ceeeb083-89078e22_0
2025-10-02T09:36:46.622722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3343 sessionId: src_id|8fde0884-b641de09-ceeeb083-89078e22_0 is DEAD
2025-10-02T09:36:46.622808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.622858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:46.622865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Write session will restart in 0.008885s
2025-10-02T09:36:46.622882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Write session: Do CDS request
2025-10-02T09:36:46.622886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.631743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.633065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.633197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.633224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.633235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3344
2025-10-02T09:36:46.633320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.633327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.633333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.633361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.633359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.633387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444428644:3824]
2025-10-02T09:36:46.633386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.633395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.633398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.633723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3344 sessionId:  describe result for acl check
2025-10-02T09:36:46.633738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.633753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.633757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.633758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.633760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.633923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.633951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.634097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.634144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.634178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.634182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.634183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.634183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.634184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.634184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.634185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.634185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.634186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.634186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.634187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.634188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.634190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.634197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.634199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.634201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.634203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.634205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.634207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.634209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.634211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.634214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.634216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.634218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.634222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.634226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.634229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.634232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.634235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.634237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.634240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.634243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.634245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.634248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.634251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.634253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.634255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.634259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.634261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.634267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.634270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.634273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.634275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.634278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.634280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.634286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.634288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.634291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.634308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.635483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.639574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.639583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.639584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520014514:2872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.639588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.641765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.643294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.643304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.643305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.643307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.643311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3343 [2:7556556038444428644:3824]
2025-10-02T09:36:46.643319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.643329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.643332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.643333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.643334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.643343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.643349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.643353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.643384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.643389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.643390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.643391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.643393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.643429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.643434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.643440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.643445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.643453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.643468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014367:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.643474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014552:2872], now have 1 active actors on pipe
2025-10-02T09:36:46.643479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.643481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.643483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.643493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.643492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3343
2025-10-02T09:36:46.643500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3343
2025-10-02T09:36:46.643506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.643507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.643509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.643511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.643517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.643519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.643542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.643547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.643555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.643563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.643574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.643578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.643583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.643585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.643586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.643590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.643596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.643609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.643710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.643715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.643722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.643766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3344 partition: 0 MaxSeqNo: 36 sessionId: src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0
2025-10-02T09:36:46.644043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fde0884-b641de09-ceeeb083-89078e22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.646817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Write session: try to update token
2025-10-02T09:36:46.646827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.652737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.652750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.652751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.652752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.652757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.652760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.652762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444428639:3824]
2025-10-02T09:36:46.652783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.652786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.652788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.652788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.652791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.652793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.652915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.659201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId: src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.661403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.722592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520014562:8014]
2025-10-02T09:36:46.722757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3343, pipe: [1:7556556038520014562:8014]
2025-10-02T09:36:46.763229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.763585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.763595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.763607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014562:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.763736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.763735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:46.763746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:46.763793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3344 reason: error at write: Disconnected sessionId: src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0
2025-10-02T09:36:46.763806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520014562:8014]
2025-10-02T09:36:46.763823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.763933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3344 sessionId: src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0 is DEAD
2025-10-02T09:36:46.764071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:46.764080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Write session will restart in 0.009380s
2025-10-02T09:36:46.764095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Write session: Do CDS request
2025-10-02T09:36:46.764100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.772491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.773930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.774048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.774054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.774060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.774087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.774111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444428830:3826]
2025-10-02T09:36:46.774142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.774210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.774220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3345
2025-10-02T09:36:46.774299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.774318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.774324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.774327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.774456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.774603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3345 sessionId:  describe result for acl check
2025-10-02T09:36:46.774616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.774627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.774632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.774633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.774635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.774637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.774843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.774946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.774951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.774951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.774952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.774952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.774953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.774953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.774954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.774954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.774955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.774956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.774956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.774959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.774965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.774958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.774967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.774969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.774971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.774973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.774975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.774977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.774979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.774989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.774991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.774993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.774997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.775001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.775005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.775008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.775011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.775013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.775016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.775018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.775020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.775023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.775025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.775028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.775031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.775033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.775035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.775038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.775040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.775042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.775044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.775046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.775049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.775051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.775053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.775055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.775072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.776148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.780252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.780260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.780262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520014713:2896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.780266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.782427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.783902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.783914Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.783915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.783917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.783921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3344 [2:7556556038444428830:3826]
2025-10-02T09:36:46.783927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.783936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.783937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.783939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.783940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.783950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.783956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.783960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.783990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.783995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.783995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.783997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.783999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.784061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.784068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.784078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.784087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.784099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.784114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014563:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.784119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014750:2896], now have 1 active actors on pipe
2025-10-02T09:36:46.784123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.784125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.784110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3344
2025-10-02T09:36:46.784118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3344
2025-10-02T09:36:46.784126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.784130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.784136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.784138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.784138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.784139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.784145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.784146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.784163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.784170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.784175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.784177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.784179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.784200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70018068-dc549491-cd9dce17-efd9e32c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.784209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.784215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.784216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.784221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.784226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.784239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.784334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.784340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.784348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.784402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3345 partition: 0 MaxSeqNo: 36 sessionId: src_id|70018068-dc549491-cd9dce17-efd9e32c_0
2025-10-02T09:36:46.784578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1317ee88-7109d2c9-fef31e6b-5d61ce81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70018068-dc549491-cd9dce17-efd9e32c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.787365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Write session: try to update token
2025-10-02T09:36:46.787376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.793304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.793317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.793318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.793319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.793323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.793326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.793328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444428825:3826]
2025-10-02T09:36:46.793349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.793351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.793354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.793354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.793355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.793358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.793465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.798815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId: src_id|70018068-dc549491-cd9dce17-efd9e32c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.800907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:46.863895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556038520014758:8014]
2025-10-02T09:36:46.864051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3344, pipe: [1:7556556038520014758:8014]
2025-10-02T09:36:46.905532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:46.905750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.905759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.905771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014758:8014], now have 1 active actors on pipe
2025-10-02T09:36:46.905909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:46.905902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556038520014758:8014]
2025-10-02T09:36:46.905921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:46.905929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:46.905931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:46.905987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3345 reason: error at write: Disconnected sessionId: src_id|70018068-dc549491-cd9dce17-efd9e32c_0
2025-10-02T09:36:46.906128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3345 sessionId: src_id|70018068-dc549491-cd9dce17-efd9e32c_0 is DEAD
2025-10-02T09:36:46.906464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:46.906473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Write session will restart in 0.007868s
2025-10-02T09:36:46.906489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Write session: Do CDS request
2025-10-02T09:36:46.906493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:46.915131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.915299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:46.915309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3346
2025-10-02T09:36:46.915424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:46.915425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:46.915445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:46.915451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:46.915454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:46.915707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3346 sessionId:  describe result for acl check
2025-10-02T09:36:46.915729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:46.915733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:46.915734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:46.915737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:46.916080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:46.917134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:46.917256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:46.917263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:46.917269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:46.917297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:46.917436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556038444429017:3840]
2025-10-02T09:36:46.917585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:46.918091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:46.918283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:46.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:46.918591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:46.918619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.918624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.918624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.918625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.918625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.918626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.918626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.918627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.918628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.918628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.918629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.918629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.918633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.918638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.918641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.918643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.918645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.918647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.918649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.918651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.918653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.918655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.918657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.918659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.918664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.918668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:46.918671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.918674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:46.918676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.918679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:46.918682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.918685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:46.918687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.918690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:46.918692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.918694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:46.918697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.918699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:46.918702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.918705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:46.918707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.918710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:46.918711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.918714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.918716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.918719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.918721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.918723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.918750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:46.922572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:46.922582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:46.922584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556038520014908:2885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:46.922587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:46.926130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:46.927672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:46.927683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:46.927684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:46.927686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:46.927689Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3345 [2:7556556038444429017:3840]
2025-10-02T09:36:46.927696Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:46.927705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:46.927711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.927712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.927713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.927722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:46.927729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:46.927733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:46.927767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.927772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.927773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.927775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:46.927777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:46.927816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:46.927821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.927827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:46.927833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:46.927841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:46.927849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.927854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.927855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.927860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:46.927868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014947:2885], now have 1 active actors on pipe
2025-10-02T09:36:46.927868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:46.927871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:46.927872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:46.927874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:46.927881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:46.927882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:46.927885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556038520014759:2446], now have 1 active actors on pipe
2025-10-02T09:36:46.927897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.927904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:46.927911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3345
2025-10-02T09:36:46.927917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3345
2025-10-02T09:36:46.927916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:46.927944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.927947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.927963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:46.927970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:46.927972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:46.927973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:46.927978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:46.927984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:46.927991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.928088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:46.928092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:46.928099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:46.928150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3346 partition: 0 MaxSeqNo: 36 sessionId: src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0
2025-10-02T09:36:46.928339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70018068-dc549491-cd9dce17-efd9e32c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:46.931185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Write session: try to update token
2025-10-02T09:36:46.931194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:46.940928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:46.940938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.940943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.940966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:46.940973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:46.941114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:46.941238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.941356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.941504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:46.941656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:46.941681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:46.943446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId: src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:46.945296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:46.945307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:46.945308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:46.945310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:46.945317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.945321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.945324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556038444429012:3840]
2025-10-02T09:36:46.945345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:46.945348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:46.945350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:46.945352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:46.945352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:46.945355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:46.945475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:46.945697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.006243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814982256:8014]
2025-10-02T09:36:47.006362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3345, pipe: [1:7556556042814982256:8014]
2025-10-02T09:36:47.054928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.055183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.055191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.055204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982256:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.055367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.055407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814982256:8014]
2025-10-02T09:36:47.055419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.055430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:47.055487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0
2025-10-02T09:36:47.055619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3346 sessionId: src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0 is DEAD
2025-10-02T09:36:47.055745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:47.055758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Write session will restart in 0.008741s
2025-10-02T09:36:47.055777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Write session: Do CDS request
2025-10-02T09:36:47.055781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.065000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.065114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.065179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.065190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3347
2025-10-02T09:36:47.065267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.065287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.065294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.065296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.065562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3347 sessionId:  describe result for acl check
2025-10-02T09:36:47.065587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.065592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.065593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.065596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.065947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.066471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.066598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.066605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.066612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.066644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.066677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739396501:3859]
2025-10-02T09:36:47.067047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.067229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.067254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.067434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.067464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.067468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.067469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.067469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.067470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.067470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.067471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.067472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.067472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.067473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.067473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.067474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.067476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.067482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.067484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.067486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.067488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.067490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.067492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.067494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.067496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.067498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.067500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.067502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.067492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.067505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.067509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.067512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.067515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.067517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.067520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.067522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.067525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.067527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.067530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.067532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.067534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.067538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.067541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.067544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.067547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.067549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.067552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.067554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.067557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.067559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.067561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.067567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.067569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.067586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.071858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.071866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.071869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814982409:2911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.071872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.075012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.076506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.076517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.076518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.076520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.076523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3346 [2:7556556042739396501:3859]
2025-10-02T09:36:47.076531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.076540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.076541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.076543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.076544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.076555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.076561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.076565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.076594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.076599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.076600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.076602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.076603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.076640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.076645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.076652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.076657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.076669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.076682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982449:2911], now have 1 active actors on pipe
2025-10-02T09:36:47.076688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982260:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.076691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.076693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.076694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.076700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.076710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.076705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3346
2025-10-02T09:36:47.076712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.076714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.076708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3346
2025-10-02T09:36:47.076716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.076721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.076722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.076736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.076741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.076742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.076752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.076757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.076782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d3a468e-a110d3fd-521f131-83fa934e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.076789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.076791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.076792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.076796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.076816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.076829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.076928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.076933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.076941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.077016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3347 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d3a468e-a110d3fd-521f131-83fa934e_0
2025-10-02T09:36:47.077209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adfa9edb-cb486fa0-3abc21b5-423afca2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d3a468e-a110d3fd-521f131-83fa934e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.079917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Write session: try to update token
2025-10-02T09:36:47.079927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.085918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.085932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.085933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.085934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.085938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.085941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.085943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739396496:3859]
2025-10-02T09:36:47.085963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.085966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.085968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.085970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.085974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.085976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.086087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.091184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId: src_id|5d3a468e-a110d3fd-521f131-83fa934e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.093216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.155749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814982456:8014]
2025-10-02T09:36:47.155921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3346, pipe: [1:7556556042814982456:8014]
2025-10-02T09:36:47.196318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.196537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.196546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.196557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982456:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.196832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814982456:8014]
2025-10-02T09:36:47.196851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.196860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:47.196863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:47.196895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.196913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3347 reason: error at write: Disconnected sessionId: src_id|5d3a468e-a110d3fd-521f131-83fa934e_0
2025-10-02T09:36:47.197043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3347 sessionId: src_id|5d3a468e-a110d3fd-521f131-83fa934e_0 is DEAD
2025-10-02T09:36:47.197201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:47.197212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Write session will restart in 0.005858s
2025-10-02T09:36:47.197227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Write session: Do CDS request
2025-10-02T09:36:47.197231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.204107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.204204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.204214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3348
2025-10-02T09:36:47.204300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.204319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.204325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.204328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.204602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3348 sessionId:  describe result for acl check
2025-10-02T09:36:47.204624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.204629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.204629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.204632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.204973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.205341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.206298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.206938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.207085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.207093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.207099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.207132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.207157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739396692:3841]
2025-10-02T09:36:47.207509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.207680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.207705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.207770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.207777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.207779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814982606:2936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.207782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.207884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.207912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.207916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.207917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.207917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.207918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.207918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.207919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.207920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.207920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.207921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.207921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.207922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.207925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.207931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.207933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.207935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.207937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.207939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.207941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.207943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.207945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.207948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.207950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.207952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.207957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.207960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.207964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.207966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.207969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.207971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.207974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.207976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.207978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.207981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.207984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.207987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.207989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.207992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.207994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.207996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.207999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.208005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.208008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.208010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.208012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.208015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.208018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.208020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.208040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.215374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.216850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.216858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.216859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.216860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.216864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3347 [2:7556556042739396692:3841]
2025-10-02T09:36:47.216870Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.216880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.216883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.216885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.216886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.216894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.216898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.216902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.216932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.216937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.216938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.216940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.216942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.216979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.216984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.216990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.216995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.217003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.217017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982458:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.217023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982645:2936], now have 1 active actors on pipe
2025-10-02T09:36:47.217026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.217028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.217029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.217037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.217047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.217049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.217051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.217052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.217055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.217056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.217048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3347
2025-10-02T09:36:47.217050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3347
2025-10-02T09:36:47.217070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.217074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.217076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.217086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.217087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.217107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.217114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.217116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.217117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.217123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.217131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.217141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.217234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.217239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.217246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.217293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3348 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0
2025-10-02T09:36:47.217483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3a468e-a110d3fd-521f131-83fa934e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.220520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Write session: try to update token
2025-10-02T09:36:47.220534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.226232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.226244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.226245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.226246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.226251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.226254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.226256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739396687:3841]
2025-10-02T09:36:47.226276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.226279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.226281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.226315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.226330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.226333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.226388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.232968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId: src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.235093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.297044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814982668:8014]
2025-10-02T09:36:47.297263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3347, pipe: [1:7556556042814982668:8014]
2025-10-02T09:36:47.337251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.337531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.337539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.337551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982668:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.337634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814982668:8014]
2025-10-02T09:36:47.337650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.337658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:47.337660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:47.337671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.337699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3348 reason: error at write: Disconnected sessionId: src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0
2025-10-02T09:36:47.337818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3348 sessionId: src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0 is DEAD
2025-10-02T09:36:47.337928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:47.337931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Write session will restart in 0.007807s
2025-10-02T09:36:47.337949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Write session: Do CDS request
2025-10-02T09:36:47.337953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.347254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.347348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.347359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3349
2025-10-02T09:36:47.347607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.347626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.347633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.347635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.347915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3349 sessionId:  describe result for acl check
2025-10-02T09:36:47.347938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.347942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.347943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.347946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.348240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.348580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.349774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.350847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.351008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.351015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.351021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.351053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.351076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739396931:3895]
2025-10-02T09:36:47.351439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.351662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.351686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.351723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.351731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.351733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814982841:2972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.351736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.351866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.351894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.351898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.351899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.351899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.351900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.351900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.351901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.351901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.351902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.351902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.351903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.351903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.351906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.351911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.351913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.351916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.351918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.351920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.351921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.351923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.351925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.351927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.351929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.351931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.351935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.351939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.351942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.351945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.351947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.351950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.351952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.351955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.351957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.351959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.351961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.351964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.351966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.351969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.351971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.351974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.351977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.351979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.351982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.351984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.351986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.351989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.351991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.351993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.352010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.359369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.360908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.360916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.360918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.360920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.360923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3348 [2:7556556042739396931:3895]
2025-10-02T09:36:47.360929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.360938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.360940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.360941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.360942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.360950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.360957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.360960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.360994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.360998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.360999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.361001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.361002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.361043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.361048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.361055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.361060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.361069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.361083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982881:2972], now have 1 active actors on pipe
2025-10-02T09:36:47.361088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982692:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.361092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.361093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.361095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.361102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.361109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.361115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.361116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.361117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.361118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.361118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.361112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3348
2025-10-02T09:36:47.361131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.361132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.361134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.361114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3348
2025-10-02T09:36:47.361144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.361149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.361174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.361181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.361183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.361184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.361189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.361196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.361205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.361297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.361302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.361312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.361355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3349 partition: 0 MaxSeqNo: 36 sessionId: src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0
2025-10-02T09:36:47.361612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4f92ed-ce5aed4-2e55f7c5-f131048c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.364172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Write session: try to update token
2025-10-02T09:36:47.364184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.370193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.370203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.370204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.370205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.370209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.370211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.370213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739396925:3895]
2025-10-02T09:36:47.370232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.370236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.370237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.370238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.370241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.370244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.370346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.376022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId: src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.378159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.437855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814982891:8014]
2025-10-02T09:36:47.437984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3348, pipe: [1:7556556042814982891:8014]
2025-10-02T09:36:47.478936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.479210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.479219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.479231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982891:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.479356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.479416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:47.479473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3349 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0
2025-10-02T09:36:47.479512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.479545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814982891:8014]
2025-10-02T09:36:47.479734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3349 sessionId: src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0 is DEAD
2025-10-02T09:36:47.479753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:47.479768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Write session will restart in 0.005990s
2025-10-02T09:36:47.479788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Write session: Do CDS request
2025-10-02T09:36:47.479794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.487247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.487348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.487358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3350
2025-10-02T09:36:47.487470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.487490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.487496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.487498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.487753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3350 sessionId:  describe result for acl check
2025-10-02T09:36:47.487776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.487781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.487782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.487784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.488143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.489047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.489331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.490824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.490927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.490933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.490939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.490965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.490996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739397122:3899]
2025-10-02T09:36:47.491007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.491017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.491018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814983021:2992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.491022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.491359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.491522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.491552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.491729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.491757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.491761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.491762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.491762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.491763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.491763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.491764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.491765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.491765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.491766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.491766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.491767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.491770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.491776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.491778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.491780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.491782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.491784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.491786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.491788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.491790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.491792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.491794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.491796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.491799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.491803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.491807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.491810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.491814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.491819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.491822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.491831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.491835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.491842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.491844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.491847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.491853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.491855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.491858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.491864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.491866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.491870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.491875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.491877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.491880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.491882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.491884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.491887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.491907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.499204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.500658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.500669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.500670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.500672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.500675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3349 [2:7556556042739397122:3899]
2025-10-02T09:36:47.500682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.500692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.500696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.500698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.500699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.500707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.500710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.500717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.500746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.500750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.500751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.500753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.500754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.500792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.500797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.500815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.500820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.500832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.500845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983079:2992], now have 1 active actors on pipe
2025-10-02T09:36:47.500851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814982892:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.500854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.500856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.500857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.500864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.500875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.500865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3349
2025-10-02T09:36:47.500878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.500881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.500865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3349
2025-10-02T09:36:47.500882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.500886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.500887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.500907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.500914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.500923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.500928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.500937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.500944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.500947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.500950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.500951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.500956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.500961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.501044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.501141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.501146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.501154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.501203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3350 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0
2025-10-02T09:36:47.501442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdcfe3a-48d853ec-ce86fada-6a5c6326_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.503863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Write session: try to update token
2025-10-02T09:36:47.503879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.509896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.509906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.509908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.509908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.509911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.509915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.509917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739397117:3899]
2025-10-02T09:36:47.509936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.509938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.509939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.509940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.509941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.509943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.510045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.516362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId: src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.518514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.579681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814983092:8014]
2025-10-02T09:36:47.579830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3349, pipe: [1:7556556042814983092:8014]
2025-10-02T09:36:47.619470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.619711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.619719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.619732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983092:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.620066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.620067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:47.620074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814983092:8014]
2025-10-02T09:36:47.620077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:47.620088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.620122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3350 reason: error at write: Disconnected sessionId: src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0
2025-10-02T09:36:47.620257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3350 sessionId: src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0 is DEAD
2025-10-02T09:36:47.620410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:47.620424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Write session will restart in 0.007613s
2025-10-02T09:36:47.620446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Write session: Do CDS request
2025-10-02T09:36:47.620451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.629171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.629285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.629294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3351
2025-10-02T09:36:47.629325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.629404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.629424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.629429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.629432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.629725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3351 sessionId:  describe result for acl check
2025-10-02T09:36:47.629749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.629754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.629755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.629758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.630097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.630875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.630975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.630981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.630993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.631020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.631046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739397314:3923]
2025-10-02T09:36:47.631253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.631401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.631566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.631594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.631784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.631814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.631818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.631818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.631819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.631820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.631820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.631821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.631821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.631822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.631822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.631823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.631823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.631826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.631832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.631834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.631836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.631838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.631840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.631842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.631844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.631847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.631851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.631854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.631858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.631862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.631869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.631877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.631880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.631883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.631885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.631889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.631892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.631895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.631897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.631899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.631902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.631909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.631912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.631914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.631918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.631920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.631922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.631925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.631928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.631930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.631933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.631935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.631938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.631953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.635667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.635676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.635677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814983247:3005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.635681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.639485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.640866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.640875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.640876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.640878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.640881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3350 [2:7556556042739397314:3923]
2025-10-02T09:36:47.640889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.640899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.640900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.640901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.640902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.640911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.640913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.640917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.641035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.641040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.641041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.641043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.641044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.641082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.641087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.641094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.641099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.641110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.641124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983093:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.641129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983286:3005], now have 1 active actors on pipe
2025-10-02T09:36:47.641132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.641133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.641134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.641142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.641152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.641154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.641156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.641157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.641162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.641164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.641168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3350
2025-10-02T09:36:47.641171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3350
2025-10-02T09:36:47.641177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.641183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.641184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.641200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.641205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.641221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.641229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.641231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.641232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.641237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.641246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.641260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.641353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.641358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.641366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.641418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3351 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0
2025-10-02T09:36:47.641656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba9064-5b1e52c0-a59d9bb8-b30884d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.644010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Write session: try to update token
2025-10-02T09:36:47.644022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.650147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.650158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.650159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.650160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.650163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.650166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.650168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739397309:3923]
2025-10-02T09:36:47.650188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.650191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.650194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.650194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.650195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.650196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.650310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.655942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId: src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.658084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.719974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814983294:8014]
2025-10-02T09:36:47.720132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3350, pipe: [1:7556556042814983294:8014]
2025-10-02T09:36:47.760111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.760324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.760332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.760344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983294:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.760470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814983294:8014]
2025-10-02T09:36:47.760478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.760492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:47.760494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:47.760536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3351 reason: error at write: Disconnected sessionId: src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0
2025-10-02T09:36:47.760555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.760660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3351 sessionId: src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0 is DEAD
2025-10-02T09:36:47.760836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:47.760852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Write session will restart in 0.007700s
2025-10-02T09:36:47.760878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Write session: Do CDS request
2025-10-02T09:36:47.760884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.769159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.769240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.769250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3352
2025-10-02T09:36:47.769370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.769391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.769397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.769400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.769675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3352 sessionId:  describe result for acl check
2025-10-02T09:36:47.769700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.769704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.769705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.769708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.769762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.770038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.771206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.771332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.771339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.771345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.771377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.771410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739397507:3905]
2025-10-02T09:36:47.771486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.771817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.771984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.772010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.772204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.772237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.772241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.772242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.772242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.772243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.772243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.772244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.772245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.772245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.772246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.772246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.772247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.772249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.772255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.772257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.772259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.772261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.772263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.772265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.772267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.772269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.772271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.772273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.772275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.772279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.772282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.772286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.772288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.772291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.772293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.772295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.772298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.772301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.772303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.772306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.772309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.772312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.772314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.772316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.772319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.772321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.772324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.772328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.772331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.772335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.772337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.772340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.772344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.772359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.776090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.776097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.776099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814983449:3026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.776103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.779680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.781264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.781273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.781274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.781276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.781279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3351 [2:7556556042739397507:3905]
2025-10-02T09:36:47.781286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.781295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.781296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.781297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.781298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.781307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.781309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.781314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.781345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.781351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.781353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.781355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.781357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.781400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.781405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.781412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.781417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.781425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.781436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983295:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.781441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983489:3026], now have 1 active actors on pipe
2025-10-02T09:36:47.781445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.781446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.781447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.781455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.781463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.781466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3351
2025-10-02T09:36:47.781467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.781470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3351
2025-10-02T09:36:47.781469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.781470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.781473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.781475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.781489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.781491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.781492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.781502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.781507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.781531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.781539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.781541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.781542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.781547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.781552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.781561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.781647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.781652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.781660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.781710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3352 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0
2025-10-02T09:36:47.781936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6b3981-86edbf37-3bde3166-f01ab196_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.784360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Write session: try to update token
2025-10-02T09:36:47.784375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.790635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.790651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.790652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.790654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.790659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.790662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.790665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739397502:3905]
2025-10-02T09:36:47.790685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.790689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.790693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.790693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.790694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.790696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.790820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.797195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId: src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.799403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.860777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814983496:8014]
2025-10-02T09:36:47.860937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3351, pipe: [1:7556556042814983496:8014]
2025-10-02T09:36:47.898628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:47.898897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.898906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.898918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983496:8014], now have 1 active actors on pipe
2025-10-02T09:36:47.899036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814983496:8014]
2025-10-02T09:36:47.899056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:47.899058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:47.899062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:47.899067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:47.899102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3352 reason: error at write: Disconnected sessionId: src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0
2025-10-02T09:36:47.899230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3352 sessionId: src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0 is DEAD
2025-10-02T09:36:47.899399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:47.899417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Write session will restart in 0.008289s
2025-10-02T09:36:47.899444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Write session: Do CDS request
2025-10-02T09:36:47.899452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:47.908066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:47.909207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.909305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:47.909314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3353
2025-10-02T09:36:47.909438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:47.909458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:47.909464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:47.909467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:47.909519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:47.909669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:47.909676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:47.909683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:47.909713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:47.909734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556042739397700:3909]
2025-10-02T09:36:47.909738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3353 sessionId:  describe result for acl check
2025-10-02T09:36:47.909762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:47.909766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:47.909768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:47.909771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:47.910070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:47.910097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:47.910236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:47.910262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:47.910432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:47.910462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.910466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.910467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.910467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.910468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.910468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.910469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.910470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.910470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.910471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.910471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.910472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.910475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.910481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.910484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.910486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.910488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.910490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.910492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.910494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.910496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.910498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.910500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.910501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.910505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.910509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:47.910512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.910515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:47.910517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.910520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:47.910522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.910525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:47.910527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.910530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:47.910532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.910535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:47.910537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.910539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:47.910541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.910544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:47.910547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.910549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:47.910551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.910554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.910560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.910562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.910564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.910567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.910584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:47.911221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:47.915314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:47.915321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:47.915323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556042814983654:3053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:47.915327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:47.917933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:47.919508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:47.919520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:47.919521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:47.919523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:47.919526Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3352 [2:7556556042739397700:3909]
2025-10-02T09:36:47.919535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:47.919546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:47.919551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.919552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.919553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.919562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:47.919564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:47.919568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:47.919601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.919605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.919606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.919608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:47.919609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:47.919647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:47.919652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.919659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:47.919664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:47.919673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:47.919688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983498:2446], now have 1 active actors on pipe
2025-10-02T09:36:47.919693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983692:3053], now have 1 active actors on pipe
2025-10-02T09:36:47.919697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.919698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.919700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.919707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:47.919717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:47.919720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:47.919722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:47.919723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:47.919720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3352
2025-10-02T09:36:47.919728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:47.919729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:47.919722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3352
2025-10-02T09:36:47.919742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.919747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:47.919748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:47.919759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.919764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.919790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:47.919796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:47.919798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:47.919799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:47.919804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:47.919808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:47.919820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.919902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:47.919907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:47.919915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:47.919962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3353 partition: 0 MaxSeqNo: 36 sessionId: src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0
2025-10-02T09:36:47.920217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ee5cab-ed0c79d2-cc294e85-8785cbac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:47.922811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Write session: try to update token
2025-10-02T09:36:47.922828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:47.928845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:47.928854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:47.928856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:47.928857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:47.928861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.928866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.928869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556042739397695:3909]
2025-10-02T09:36:47.928887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:47.928891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:47.928893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:47.928894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:47.928894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:47.928896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:47.929032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:47.936848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId: src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:47.939076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:47.999023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556042814983705:8014]
2025-10-02T09:36:47.999177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3352, pipe: [1:7556556042814983705:8014]
2025-10-02T09:36:48.038118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.038390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.038399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.038412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556042814983705:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.038542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.038585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.038590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:48.038628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556042814983705:8014]
2025-10-02T09:36:48.038649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0
2025-10-02T09:36:48.038799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3353 sessionId: src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0 is DEAD
2025-10-02T09:36:48.038993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:48.039009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Write session will restart in 0.008939s
2025-10-02T09:36:48.039034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Write session: Do CDS request
2025-10-02T09:36:48.039040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.047556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.048994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.049102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.049108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.049114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.049142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.049166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034365191:3912]
2025-10-02T09:36:48.049199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.049272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.049281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3354
2025-10-02T09:36:48.049402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.049421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.049427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.049430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.049525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.049682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3354 sessionId:  describe result for acl check
2025-10-02T09:36:48.049685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.049704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.049708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.049709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.049711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.049709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.049888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.049915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.049919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.049920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.049920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.049921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.049922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.049922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.049923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.049923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.049924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.049924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.049925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.049928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.049934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.049936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.049938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.049940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.049942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.049944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.049946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.049947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.049950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.049952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.049953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.049958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.049962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.049965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.049968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.049970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.049973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.049975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.049978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.049980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.049983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.049987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.049990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.049992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.049994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.049996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.049999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.050003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.050008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.050011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.050013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.050015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.050018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.050020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.050023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.050040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.050054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.051548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.055248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.055255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.055257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109951165:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.055260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.057412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.058899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.058910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.058911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.058913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.058917Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3353 [2:7556556047034365191:3912]
2025-10-02T09:36:48.058924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.058933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.058935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.058936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.058937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.058949Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.058957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.058964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.059005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.059010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.059011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.059013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.059014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.059052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.059057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.059063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.059068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.059078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.059093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951202:3049], now have 1 active actors on pipe
2025-10-02T09:36:48.059099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951006:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.059102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.059103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.059104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.059112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.059113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3353
2025-10-02T09:36:48.059119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3353
2025-10-02T09:36:48.059123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.059127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.059129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.059130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.059133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.059134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.059149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.059153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.059162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.059165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.059167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.059188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.059195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.059198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.059200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.059206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.059211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.059222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.059304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.059309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.059316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.059359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3354 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0
2025-10-02T09:36:48.059603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44884e43-f1b899fa-7ee7f9b1-99e76cd0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.062020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Write session: try to update token
2025-10-02T09:36:48.062037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.068104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.068116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.068117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.068118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.068123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.068125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.068126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034365186:3912]
2025-10-02T09:36:48.068145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.068149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.068151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.068151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.068155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.068158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.068265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.074197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId: src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.076413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.138791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109951209:8014]
2025-10-02T09:36:48.138950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3353, pipe: [1:7556556047109951209:8014]
2025-10-02T09:36:48.178528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.178831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.178841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.178854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951209:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.178993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:48.179004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:48.179014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.179043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109951209:8014]
2025-10-02T09:36:48.179050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3354 reason: error at write: Disconnected sessionId: src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0
2025-10-02T09:36:48.179161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.179181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3354 sessionId: src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0 is DEAD
2025-10-02T09:36:48.179348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:48.179364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Write session will restart in 0.007101s
2025-10-02T09:36:48.179386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Write session: Do CDS request
2025-10-02T09:36:48.179393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.187173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.187285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.187294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3355
2025-10-02T09:36:48.187414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.187433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.187439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.187442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.187701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3355 sessionId:  describe result for acl check
2025-10-02T09:36:48.187724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.187728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.187729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.187732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.188058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.188575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.189375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.190033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.190198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.190207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.190214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.190247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.190273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034365389:3921]
2025-10-02T09:36:48.190622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.190785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.190808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.190985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.191023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.191028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.191028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.191029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.191030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.191030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.191031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.191031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.191032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.191033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.191033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.191034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.191037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.191043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.191045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.191047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.191050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.191052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.191054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.191056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.191058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.191060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.191062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.191064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.191067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.191071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.191076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.191078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.191081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.191083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.191085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.191088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.191090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.191093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.191095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.191098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.191100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.191102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.191104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.191107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.191110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.191113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.191115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.191117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.191119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.191122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.191127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.191130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.191147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.191295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.191303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.191305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109951365:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.191309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.198550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.200001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.200013Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.200015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.200018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.200022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3354 [2:7556556047034365389:3921]
2025-10-02T09:36:48.200030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.200040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.200043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.200046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.200047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.200056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.200063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.200066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.200096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.200101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.200102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.200104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.200105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.200150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.200157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.200167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.200175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.200186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.200200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951407:3080], now have 1 active actors on pipe
2025-10-02T09:36:48.200206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951210:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.200209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.200210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.200211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.200203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3354
2025-10-02T09:36:48.200211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3354
2025-10-02T09:36:48.200216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.200225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.200230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.200234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.200235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.200236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.200241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.200257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.200262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.200271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.200279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.200291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.200294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dfe9293-1e750733-c7370510-a46e6103_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.200299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.200301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.200302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.200307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.200312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.200325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.200405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.200410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.200418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.200461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3355 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dfe9293-1e750733-c7370510-a46e6103_0
2025-10-02T09:36:48.200697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a705d7-5833aa92-ea6f1fe2-806d63c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dfe9293-1e750733-c7370510-a46e6103_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.203142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Write session: try to update token
2025-10-02T09:36:48.203158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.209390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.209401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.209402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.209403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.209407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.209409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.209411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034365384:3921]
2025-10-02T09:36:48.209430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.209436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.209435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.209437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.209438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.209440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.209558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.215530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId: src_id|8dfe9293-1e750733-c7370510-a46e6103_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.217776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.279084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109951415:8014]
2025-10-02T09:36:48.279291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3354, pipe: [1:7556556047109951415:8014]
2025-10-02T09:36:48.319600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.319813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.319822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.319834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951415:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.319953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.320000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109951415:8014]
2025-10-02T09:36:48.320024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:48.320073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8dfe9293-1e750733-c7370510-a46e6103_0
2025-10-02T09:36:48.320207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3355 sessionId: src_id|8dfe9293-1e750733-c7370510-a46e6103_0 is DEAD
2025-10-02T09:36:48.320265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.320370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:48.320385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Write session will restart in 0.009357s
2025-10-02T09:36:48.320406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Write session: Do CDS request
2025-10-02T09:36:48.320412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.329899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.331171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.331300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.331318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3356
2025-10-02T09:36:48.331336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.331447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.331452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.331458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.331464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.331473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.331482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.331486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.331491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.331517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034365627:3947]
2025-10-02T09:36:48.331795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3356 sessionId:  describe result for acl check
2025-10-02T09:36:48.331822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.331828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.331830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.331834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.331864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.332025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.332048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.332230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.332258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.332262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.332263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.332263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.332264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.332264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.332265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.332265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.332266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.332266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.332267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.332267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.332270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.332276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.332278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.332280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.332282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.332284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.332286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.332288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.332290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.332293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.332296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.332297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.332301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.332305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.332308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.332311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.332314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.332316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.332319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.332322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.332327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.332330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.332332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.332338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.332340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.332348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.332351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.332353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.332340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.332356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.332359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.332361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.332367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.332369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.332371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.332377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.332394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.333615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.337601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.337610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.337612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109951588:3125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.337616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.339686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.341249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.341259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.341260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.341262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.341265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3355 [2:7556556047034365627:3947]
2025-10-02T09:36:48.341272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.341281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.341283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.341285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.341286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.341294Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.341300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.341305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.341347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.341352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.341353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.341355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.341356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.341391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.341396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.341402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.341407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.341418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.341433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951422:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.341438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951628:3125], now have 1 active actors on pipe
2025-10-02T09:36:48.341442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.341444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.341444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.341452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.341447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3355
2025-10-02T09:36:48.341461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.341462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.341464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.341465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.341471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.341472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.341468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3355
2025-10-02T09:36:48.341490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.341499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.341506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.341511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.341510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.341531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.341538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.341540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.341541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.341545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.341553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.341563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.341803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.341811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.341821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.341868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3356 partition: 0 MaxSeqNo: 36 sessionId: src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0
2025-10-02T09:36:48.342167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dfe9293-1e750733-c7370510-a46e6103_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.344512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Write session: try to update token
2025-10-02T09:36:48.344525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.350474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.350486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.350487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.350488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.350491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.350493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.350495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034365622:3947]
2025-10-02T09:36:48.350514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.350517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.350518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.350520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.350523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.350525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.350624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.359910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId: src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.362276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.420404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109951658:8014]
2025-10-02T09:36:48.420572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3355, pipe: [1:7556556047109951658:8014]
2025-10-02T09:36:48.460180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.460464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.460472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.460484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951658:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.460629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.460638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109951658:8014]
2025-10-02T09:36:48.460660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:48.460658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.460662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:48.460708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3356 reason: error at write: Disconnected sessionId: src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0
2025-10-02T09:36:48.460859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3356 sessionId: src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0 is DEAD
2025-10-02T09:36:48.461021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:48.461037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Write session will restart in 0.005512s
2025-10-02T09:36:48.461063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Write session: Do CDS request
2025-10-02T09:36:48.461068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.467203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.467321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.467329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3357
2025-10-02T09:36:48.467454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.467473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.467479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.467481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.467756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3357 sessionId:  describe result for acl check
2025-10-02T09:36:48.467781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.467785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.467786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.467789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.468130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.470011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.472245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.472330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.472339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.472341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109951740:3143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.472345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.472484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.472666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.472674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.472680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.472714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.472740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034365836:3941]
2025-10-02T09:36:48.473087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.473258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.473280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.473453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.473483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.473487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.473488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.473488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.473489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.473489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.473490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.473490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.473491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.473491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.473492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.473493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.473495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.473501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.473504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.473506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.473508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.473510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.473512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.473514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.473516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.473518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.473520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.473521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.473526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.473530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.473533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.473536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.473538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.473541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.473543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.473546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.473548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.473551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.473553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.473556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.473558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.473561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.473563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.473565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.473568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.473571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.473573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.473575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.473577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.473581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.473583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.473586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.473606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.480925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.482279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.482291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.482292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.482294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.482298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3356 [2:7556556047034365836:3941]
2025-10-02T09:36:48.482305Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.482315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.482317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.482319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.482320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.482329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.482332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.482336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.482375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.482382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.482383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.482385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.482387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.482498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3356
2025-10-02T09:36:48.482500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3356
2025-10-02T09:36:48.482509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.482515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.482522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.482528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.482538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.482552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951853:3143], now have 1 active actors on pipe
2025-10-02T09:36:48.482558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951659:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.482567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.482572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.482584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.482588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.482589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.482597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.482606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.482610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.482612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.482613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.482617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.482619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.482627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.482631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.482633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.482633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.482639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.482646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.482662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.482669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.482675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.482678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.482766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.482770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.482778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.482822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3357 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0
2025-10-02T09:36:48.483070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b6cc5e-561eb239-6a3f26b3-8c0d8be5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.485424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Write session: try to update token
2025-10-02T09:36:48.485437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.495437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:48.495446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.495450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.495472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:48.495481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:48.495603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:48.495712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:48.495827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:48.495944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:48.496107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:48.496128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:48.499688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId: src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.499783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.499794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.499796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.499797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.499802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.499805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.499806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034365830:3941]
2025-10-02T09:36:48.499824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.499825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.499826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.499828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.499828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.499830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.499936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.502090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.560669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109951866:8014]
2025-10-02T09:36:48.560854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3356, pipe: [1:7556556047109951866:8014]
2025-10-02T09:36:48.608391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.608720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.608730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.608744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951866:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.608895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.608934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109951866:8014]
2025-10-02T09:36:48.608945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:48.608948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:48.608959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.608997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3357 reason: error at write: Disconnected sessionId: src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0
2025-10-02T09:36:48.609127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3357 sessionId: src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0 is DEAD
2025-10-02T09:36:48.609237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:48.609243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Write session will restart in 0.007490s
2025-10-02T09:36:48.609257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Write session: Do CDS request
2025-10-02T09:36:48.609261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.618147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.618317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.618326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3358
2025-10-02T09:36:48.618339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.618443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.618466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.618472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.618474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.618773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3358 sessionId:  describe result for acl check
2025-10-02T09:36:48.618800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.618804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.618805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.618808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.619151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.619885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.619983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.619989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.619995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.620021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.620043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034366034:3952]
2025-10-02T09:36:48.620382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.620490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.620551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.620573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.620747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.620774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.620778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.620779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.620779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.620780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.620780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.620781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.620781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.620782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.620782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.620783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.620783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.620786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.620791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.620794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.620796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.620798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.620811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.620813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.620815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.620817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.620819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.620821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.620823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.620826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.620830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.620833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.620836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.620838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.620841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.620843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.620845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.620848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.620850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.620854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.620856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.620859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.620865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.620867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.620870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.620872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.620875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.620877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.620880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.620882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.620885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.620887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.620889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.620906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.625665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.625673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.625675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109952027:3165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.625679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.628280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.629771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.629782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.629783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.629785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.629788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3357 [2:7556556047034366034:3952]
2025-10-02T09:36:48.629796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.629805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.629808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.629810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.629811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.629820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.629826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.629831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.629862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.629867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.629868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.629870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.629871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.629907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.629912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.629918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.629923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.629931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.629945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109951867:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.629951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952066:3165], now have 1 active actors on pipe
2025-10-02T09:36:48.629955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.629956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.629958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.629965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.629975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.629978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3357
2025-10-02T09:36:48.629982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.629980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3357
2025-10-02T09:36:48.629983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.629985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.629991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.629992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.629998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.630000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.630003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.630011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.630016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.630038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.630046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.630049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.630050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.630055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.630063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.630071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.630174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.630179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.630186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.630243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3358 partition: 0 MaxSeqNo: 36 sessionId: src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0
2025-10-02T09:36:48.630454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e45ab-81f40fd8-65e033f2-842d91a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.632861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Write session: try to update token
2025-10-02T09:36:48.632877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.639341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.639353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.639354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.639355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.639360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.639362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.639364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034366028:3952]
2025-10-02T09:36:48.639384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.639387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.639388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.639394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.639397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.639400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.639496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.646025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId: src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.648357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.709147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109952074:8014]
2025-10-02T09:36:48.709314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3357, pipe: [1:7556556047109952074:8014]
2025-10-02T09:36:48.748610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.748954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.748963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.748977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952074:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.749105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.749158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109952074:8014]
2025-10-02T09:36:48.749182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.749209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:48.749266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0
2025-10-02T09:36:48.749395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3358 sessionId: src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0 is DEAD
2025-10-02T09:36:48.749523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:48.749533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Write session will restart in 0.005254s
2025-10-02T09:36:48.749553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Write session: Do CDS request
2025-10-02T09:36:48.749557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.756130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.756264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.756275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3359
2025-10-02T09:36:48.756403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.756424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.756430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.756433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.756760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3359 sessionId:  describe result for acl check
2025-10-02T09:36:48.756786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.756790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.756791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.756795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.757172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.758638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.758651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.760155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.760244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.760252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.760254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109952177:3174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.760252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.760258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.760258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.760264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.760287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.760312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034366233:3940]
2025-10-02T09:36:48.760648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.760810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.760834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.761026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.761062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.761067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.761067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.761068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.761068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.761069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.761069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.761070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.761071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.761071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.761072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.761072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.761075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.761081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.761083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.761085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.761087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.761090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.761092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.761093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.761095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.761098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.761100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.761101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.761105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.761110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.761113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.761116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.761118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.761120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.761122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.761125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.761128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.761130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.761133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.761135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.761138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.761140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.761142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.761145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.761147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.761150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.761154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.761156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.761159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.761165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.761167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.761170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.761188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.768566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.770026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.770037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.770039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.770041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.770044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3358 [2:7556556047034366233:3940]
2025-10-02T09:36:48.770051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.770061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.770066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.770067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.770068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.770077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.770080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.770084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.770115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.770120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.770121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.770123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.770124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.770160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.770164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.770171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.770176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.770184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.770198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952271:3174], now have 1 active actors on pipe
2025-10-02T09:36:48.770203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952075:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.770207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.770208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.770209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.770217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.770228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.770230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.770232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.770233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.770238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.770240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.770241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3358
2025-10-02T09:36:48.770256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.770261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.770262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.770245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3358
2025-10-02T09:36:48.770277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.770282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.770300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.770306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.770308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.770310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.770314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.770320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.770332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.770413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.770420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.770428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.770481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3359 partition: 0 MaxSeqNo: 36 sessionId: src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0
2025-10-02T09:36:48.770679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eeffe14-da7daf8e-8cc90d54-cb90b3cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.773430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Write session: try to update token
2025-10-02T09:36:48.773441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.779447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.779461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.779463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.779464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.779468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.779471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.779474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034366228:3940]
2025-10-02T09:36:48.779494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.779498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.779499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.779533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.779552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.779558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.779660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.784791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId: src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.786876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.849442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109952283:8014]
2025-10-02T09:36:48.849591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3358, pipe: [1:7556556047109952283:8014]
2025-10-02T09:36:48.889691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:48.890021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.890030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.890043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952283:8014], now have 1 active actors on pipe
2025-10-02T09:36:48.890186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109952283:8014]
2025-10-02T09:36:48.890191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:48.890214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:48.890216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:48.890260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3359 reason: error at write: Disconnected sessionId: src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0
2025-10-02T09:36:48.890391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3359 sessionId: src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0 is DEAD
2025-10-02T09:36:48.890512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:48.890520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Write session will restart in 0.005102s
2025-10-02T09:36:48.890535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Write session: Do CDS request
2025-10-02T09:36:48.890541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:48.890680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:48.896073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.896289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:48.896297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3360
2025-10-02T09:36:48.896397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:48.896416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:48.896422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:48.896425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:48.896744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3360 sessionId:  describe result for acl check
2025-10-02T09:36:48.896768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:48.896774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:48.896775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:48.896778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:48.897149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:48.898533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:48.898749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:48.900222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:48.900338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:48.900347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:48.900354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:48.900386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:48.900416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556047034366435:3958]
2025-10-02T09:36:48.900451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:48.900458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:48.900460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556047109952394:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:48.900463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:48.900773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:48.900956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:48.900981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:48.901159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:48.901187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.901191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.901192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.901192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.901193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.901194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.901194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.901195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.901195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.901196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.901196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.901197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.901200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.901206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.901208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.901210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.901212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.901214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.901216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.901218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.901220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.901222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.901224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.901226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.901230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.901233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:48.901237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.901240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:48.901242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.901244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:48.901246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.901249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:48.901251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.901254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:48.901256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.901259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:48.901261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.901264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:48.901266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.901268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:48.901275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.901278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:48.901283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.901286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.901288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.901295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.901297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.901299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.901320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:48.908664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:48.910200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:48.910212Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:48.910213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:48.910215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:48.910218Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3359 [2:7556556047034366435:3958]
2025-10-02T09:36:48.910225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:48.910235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:48.910239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.910241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.910242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.910250Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:48.910256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:48.910260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:48.910290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.910295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.910296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.910298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:48.910299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:48.910336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:48.910340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.910347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:48.910352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:48.910362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:48.910376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952285:2446], now have 1 active actors on pipe
2025-10-02T09:36:48.910381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952491:3206], now have 1 active actors on pipe
2025-10-02T09:36:48.910385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.910386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.910387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.910395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:48.910406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:48.910407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:48.910409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:48.910411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:48.910416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:48.910417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:48.910408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3359
2025-10-02T09:36:48.910430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.910436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:48.910437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:48.910413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3359
2025-10-02T09:36:48.910445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.910450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.910476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:48.910482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:48.910484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:48.910485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:48.910490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:48.910498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:48.910510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.910614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:48.910621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:48.910629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:48.910687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3360 partition: 0 MaxSeqNo: 36 sessionId: src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0
2025-10-02T09:36:48.910888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b5682f-799c8cf3-b83d87a1-b9991cdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:48.913609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Write session: try to update token
2025-10-02T09:36:48.913620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:48.919639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:48.919655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:48.919657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:48.919659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:48.919665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.919669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.919671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556047034366430:3958]
2025-10-02T09:36:48.919693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:48.919695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:48.919696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:48.919697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:48.919698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:48.919700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:48.919871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:48.925874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId: src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:48.928074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:48.990243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556047109952507:8014]
2025-10-02T09:36:48.990405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3359, pipe: [1:7556556047109952507:8014]
2025-10-02T09:36:49.029098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.029398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.029408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.029419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556047109952507:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.029554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.029582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.029604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:49.029624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556047109952507:8014]
2025-10-02T09:36:49.029665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0
2025-10-02T09:36:49.029772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3360 sessionId: src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0 is DEAD
2025-10-02T09:36:49.029901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:49.029911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Write session will restart in 0.006674s
2025-10-02T09:36:49.029927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Write session: Do CDS request
2025-10-02T09:36:49.029931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.037097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.037188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.037199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3361
2025-10-02T09:36:49.037313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.037333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.037339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.037342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.037622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3361 sessionId:  describe result for acl check
2025-10-02T09:36:49.037641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.037646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.037648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.037650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.037987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.039249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.040626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.040945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.041044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.041050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.041057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.041081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.041104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329333932:3973]
2025-10-02T09:36:49.041279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.041288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.041290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404919930:3221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.041293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.041463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.041617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.041641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.041850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.041886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.041890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.041891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.041891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.041892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.041892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.041893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.041893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.041894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.041894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.041895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.041895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.041898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.041903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.041905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.041908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.041910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.041912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.041914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.041916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.041918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.041920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.041922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.041924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.041927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.041931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.041934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.041937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.041939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.041942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.041944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.041947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.041950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.041953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.041955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.041957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.041959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.041962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.041964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.041967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.041969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.041973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.041977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.041986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.041989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.041996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.042000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.042006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.042034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.049787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.051526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.051540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.051541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.051544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.051548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3360 [2:7556556051329333932:3973]
2025-10-02T09:36:49.051556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.051572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.051575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.051578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.051580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.051591Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.051600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.051606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.051652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.051658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.051659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.051661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.051663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.051711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.051718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.051729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.051741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.051759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.051778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404919807:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.051785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920006:3221], now have 1 active actors on pipe
2025-10-02T09:36:49.051789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.051793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.051795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.051801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3360
2025-10-02T09:36:49.051802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3360
2025-10-02T09:36:49.051807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.051818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.051820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.051822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.051822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.051833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.051836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.051867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.051874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.051884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.051894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.051905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.051921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1877c0c6-a134cf7c-22906011-5195f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.051930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.051934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.051936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.051944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.051955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.051976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.052080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.052087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.052098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.052159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3361 partition: 0 MaxSeqNo: 36 sessionId: src_id|1877c0c6-a134cf7c-22906011-5195f8c_0
2025-10-02T09:36:49.052348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63068-6ff2342c-b4ed19dd-dfdeec25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1877c0c6-a134cf7c-22906011-5195f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.055124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Write session: try to update token
2025-10-02T09:36:49.055135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.061474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.061489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.061491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.061492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.061496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.061499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.061502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329333927:3973]
2025-10-02T09:36:49.061525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.061528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.061529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.061534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.061538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.061541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.061691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.067293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId: src_id|1877c0c6-a134cf7c-22906011-5195f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.069536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.130021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404920018:8014]
2025-10-02T09:36:49.130181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3360, pipe: [1:7556556051404920018:8014]
2025-10-02T09:36:49.169495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.169717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.169726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.169738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920018:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.169867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.169887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:49.169898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:49.169934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404920018:8014]
2025-10-02T09:36:49.169942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3361 reason: error at write: Disconnected sessionId: src_id|1877c0c6-a134cf7c-22906011-5195f8c_0
2025-10-02T09:36:49.169958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.170059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3361 sessionId: src_id|1877c0c6-a134cf7c-22906011-5195f8c_0 is DEAD
2025-10-02T09:36:49.170164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:49.170169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Write session will restart in 0.007204s
2025-10-02T09:36:49.170187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Write session: Do CDS request
2025-10-02T09:36:49.170192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.178087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.178219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.178226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3362
2025-10-02T09:36:49.178332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.178352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.178358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.178360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.178622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3362 sessionId:  describe result for acl check
2025-10-02T09:36:49.178644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.178649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.178650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.178654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.179005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.179459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.180526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.180974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.181072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.181074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.181079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.181105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.181126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329334137:3978]
2025-10-02T09:36:49.181459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.181622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.181645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.181818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.181845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.181849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.181850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.181850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.181851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.181852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.181852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.181853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.181853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.181854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.181854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.181855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.181858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.181863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.181865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.181868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.181869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.181871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.181873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.181875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.181877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.181879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.181881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.181883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.181887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.181891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.181895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.181898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.181900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.181902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.181905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.181907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.181913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.181916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.181918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.181920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.181926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.181929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.181931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.181933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.181939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.181941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.181943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.181947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.181950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.181956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.181958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.181960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.181976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.185896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.185905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.185906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404920181:3238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.185910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.189621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.191114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.191125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.191127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.191129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.191132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3361 [2:7556556051329334137:3978]
2025-10-02T09:36:49.191138Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.191148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.191152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.191154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.191155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.191165Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.191170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.191175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.191208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.191212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.191213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.191215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.191217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.191251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.191256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.191262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.191267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.191278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.191292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920019:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.191297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920223:3238], now have 1 active actors on pipe
2025-10-02T09:36:49.191301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.191303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.191304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.191311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.191322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.191324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.191325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.191327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.191332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.191334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.191325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3361
2025-10-02T09:36:49.191326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3361
2025-10-02T09:36:49.191347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.191352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.191353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.191368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.191372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.191390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.191397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.191399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.191400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.191405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.191412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.191428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.191513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.191519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.191527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.191589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3362 partition: 0 MaxSeqNo: 36 sessionId: src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0
2025-10-02T09:36:49.191781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c0c6-a134cf7c-22906011-5195f8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.194554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Write session: try to update token
2025-10-02T09:36:49.194568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.200941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.200953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.200954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.200956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.200960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.200963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.200966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329334132:3978]
2025-10-02T09:36:49.200991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.200994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.200995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.200996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.200999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.201001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.201115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.205655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId: src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.207770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.270310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404920231:8014]
2025-10-02T09:36:49.270465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3361, pipe: [1:7556556051404920231:8014]
2025-10-02T09:36:49.310439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.310745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.310754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.310780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920231:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.310941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404920231:8014]
2025-10-02T09:36:49.310944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.310964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:49.310966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:49.311022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3362 reason: error at write: Disconnected sessionId: src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0
2025-10-02T09:36:49.311053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.311163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3362 sessionId: src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0 is DEAD
2025-10-02T09:36:49.311269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:49.311274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Write session will restart in 0.006387s
2025-10-02T09:36:49.311289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Write session: Do CDS request
2025-10-02T09:36:49.311293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.318163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.318229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.318236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3363
2025-10-02T09:36:49.318307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.318326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.318332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.318335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.318598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3363 sessionId:  describe result for acl check
2025-10-02T09:36:49.318622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.318627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.318628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.318632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.318972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.320241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.320436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.322622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.322722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.322729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.322731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404920353:3244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.322735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.322738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.322744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.322750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.322778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.322803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329334380:3992]
2025-10-02T09:36:49.323150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.323334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.323370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.323568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.323598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.323602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.323602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.323603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.323604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.323604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.323605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.323605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.323607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.323607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.323608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.323608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.323612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.323618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.323620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.323622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.323624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.323626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.323628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.323630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.323632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.323634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.323636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.323638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.323641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.323645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.323648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.323651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.323653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.323656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.323658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.323661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.323663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.323665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.323667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.323670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.323672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.323675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.323678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.323680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.323686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.323688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.323691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.323693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.323696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.323698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.323704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.323721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.331352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.332762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.332773Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.332774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.332776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.332779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3362 [2:7556556051329334380:3992]
2025-10-02T09:36:49.332787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.332797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.332813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.332818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.332819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.332828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.332831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.332835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.332866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.332871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.332872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.332874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.332875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.332912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.332917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.332923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.332929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.332939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.332954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920433:3244], now have 1 active actors on pipe
2025-10-02T09:36:49.332959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920232:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.332963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.332964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.332966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.332973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.332985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.332986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.332988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.332989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.332995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.332997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.332999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3362
2025-10-02T09:36:49.333004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3362
2025-10-02T09:36:49.333012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.333017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.333021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.333036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.333042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.333058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.333064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.333067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.333067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.333073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.333078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.333088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.333199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.333204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.333211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.333261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3363 partition: 0 MaxSeqNo: 36 sessionId: src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0
2025-10-02T09:36:49.333464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af42cc0d-f93342d6-43341d5f-bf94e154_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.336228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Write session: try to update token
2025-10-02T09:36:49.336237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.342671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.342686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.342687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.342688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.342692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.342695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.342697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329334360:3992]
2025-10-02T09:36:49.342718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.342721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.342722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.342723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.342727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.342730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.342851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.348109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId: src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.350179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.411121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404920481:8014]
2025-10-02T09:36:49.411285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3362, pipe: [1:7556556051404920481:8014]
2025-10-02T09:36:49.451633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.451832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.451840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.451865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920481:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.451988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.452038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404920481:8014]
2025-10-02T09:36:49.452064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:49.452136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0
2025-10-02T09:36:49.452196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.452271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3363 sessionId: src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0 is DEAD
2025-10-02T09:36:49.452413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:49.452422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Write session will restart in 0.007055s
2025-10-02T09:36:49.452442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Write session: Do CDS request
2025-10-02T09:36:49.452446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.460091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.460171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.460177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3364
2025-10-02T09:36:49.460496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.460516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.460522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.460525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.460856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3364 sessionId:  describe result for acl check
2025-10-02T09:36:49.460878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.460882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.460883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.460886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.461236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.463126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.464028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.466172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.466278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.466284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.466290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.466318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.466329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.466338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.466341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329334596:4012]
2025-10-02T09:36:49.466342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404920577:3283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.466346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.466674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.466839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.466862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.467051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.467081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.467085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.467086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.467087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.467087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.467088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.467088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.467089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.467089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.467090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.467090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.467091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.467093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.467100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.467102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.467104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.467108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.467110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.467112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.467114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.467116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.467118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.467120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.467123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.467127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.467130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.467133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.467136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.467139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.467141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.467144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.467146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.467149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.467151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.467154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.467156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.467158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.467160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.467162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.467168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.467171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.467173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.467176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.467178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.467180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.467182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.467186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.467202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.474872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.476233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.476245Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.476246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.476248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.476251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3363 [2:7556556051329334596:4012]
2025-10-02T09:36:49.476258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.476268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.476269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.476271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.476272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.476281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.476283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.476288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.476317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.476323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.476324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.476326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.476327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.476366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.476371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.476377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.476382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.476392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.476406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920482:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.476411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920684:3283], now have 1 active actors on pipe
2025-10-02T09:36:49.476414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.476416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.476417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.476424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.476434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.476436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.476438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.476439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.476444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.476446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.476435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3363
2025-10-02T09:36:49.476454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3363
2025-10-02T09:36:49.476460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.476465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.476466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.476476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.476480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.476503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.476510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.476512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.476513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.476518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.476524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.476534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.476636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.476639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.476646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.476704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3364 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0
2025-10-02T09:36:49.476900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14cb924-c01e032b-7f799109-ddf2a1cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.479671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Write session: try to update token
2025-10-02T09:36:49.479681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.486066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.486080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.486082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.486083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.486087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.486090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.486092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329334591:4012]
2025-10-02T09:36:49.486113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.486120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.486121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.486146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.486166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.486170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.486239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.491428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId: src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.493695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.552672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404920696:8014]
2025-10-02T09:36:49.552847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3363, pipe: [1:7556556051404920696:8014]
2025-10-02T09:36:49.595088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.595408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.595418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.595444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920696:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.595546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.595615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:49.595628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:49.595678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3364 reason: error at write: Disconnected sessionId: src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0
2025-10-02T09:36:49.595771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404920696:8014]
2025-10-02T09:36:49.595799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.595816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3364 sessionId: src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0 is DEAD
2025-10-02T09:36:49.595939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:49.595948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Write session will restart in 0.009004s
2025-10-02T09:36:49.595966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Write session: Do CDS request
2025-10-02T09:36:49.595971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.606121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.606208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.606214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3365
2025-10-02T09:36:49.606292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.606315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.606318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.606320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.606616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3365 sessionId:  describe result for acl check
2025-10-02T09:36:49.606642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.606647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.606649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.606653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.607010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.607507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.608567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.609498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.609596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.609601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.609606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.609633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.609655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329334802:4025]
2025-10-02T09:36:49.609992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.610124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.610132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.610134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404920862:3307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.610138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.610176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.610199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.610379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.610410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.610413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.610414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.610415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.610415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.610417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.610417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.610418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.610418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.610419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.610419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.610422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.610428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.610430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.610432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.610434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.610436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.610438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.610440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.610442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.610444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.610446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.610448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.610451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.610455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.610458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.610461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.610464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.610466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.610468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.610471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.610474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.610476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.610478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.610481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.610483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.610486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.610488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.610491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.610493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.610496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.610498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.610500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.610503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.610506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.610508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.610511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.610529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.618198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.619743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.619754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.619756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.619758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.619761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3364 [2:7556556051329334802:4025]
2025-10-02T09:36:49.619767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.619776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.619777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.619779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.619780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.619789Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.619794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.619799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.619828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.619832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.619834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.619836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.619838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.619872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.619877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.619883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.619889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.619899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.619914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920901:3307], now have 1 active actors on pipe
2025-10-02T09:36:49.619920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920697:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.619923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.619925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.619926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.619933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.619943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.619946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.619948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.619949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.619936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3364
2025-10-02T09:36:49.619954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.619955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.619942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3364
2025-10-02T09:36:49.619974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.619980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.619988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.619995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.620006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.620010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6b70d03-82da127a-22fcc183-95a9079e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.620014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.620016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.620017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.620022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.620027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.620041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.620123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.620129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.620138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.620195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3365 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6b70d03-82da127a-22fcc183-95a9079e_0
2025-10-02T09:36:49.620378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab78dba-b0666b03-d7405bd3-6de490b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6b70d03-82da127a-22fcc183-95a9079e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.623390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Write session: try to update token
2025-10-02T09:36:49.623400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.629576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.629590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.629593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.629595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.629599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.629601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.629604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329334797:4025]
2025-10-02T09:36:49.629625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.629629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.629630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.629633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.629636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.629638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.629743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.635706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId: src_id|e6b70d03-82da127a-22fcc183-95a9079e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.637839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.696061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404920912:8014]
2025-10-02T09:36:49.696227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3364, pipe: [1:7556556051404920912:8014]
2025-10-02T09:36:49.738695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.738973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.738986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.739005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920912:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.739179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404920912:8014]
2025-10-02T09:36:49.739204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:49.739206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:49.739250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3365 reason: error at write: Disconnected sessionId: src_id|e6b70d03-82da127a-22fcc183-95a9079e_0
2025-10-02T09:36:49.739385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3365 sessionId: src_id|e6b70d03-82da127a-22fcc183-95a9079e_0 is DEAD
2025-10-02T09:36:49.739418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.739485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.739722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:49.739731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Write session will restart in 0.008815s
2025-10-02T09:36:49.739745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Write session: Do CDS request
2025-10-02T09:36:49.739750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.749127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.749256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.749267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3366
2025-10-02T09:36:49.749362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.749384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.749390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.749393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.749666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3366 sessionId:  describe result for acl check
2025-10-02T09:36:49.749689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.749693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.749694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.749698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.750043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.751157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.751480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.753088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.753185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.753192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.753198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.753249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329335009:4029]
2025-10-02T09:36:49.753467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.753475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.753477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404921062:3336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.753481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.753590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.753769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.753790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.753964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.753993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.753996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.753997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.753997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.753998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.753999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.753999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.753999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.754000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.754001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.754001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.754002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.754004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.754010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.754012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.754014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.754016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.754018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.754020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.754022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.754024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.754027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.754029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.754031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.754034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.754038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.754042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.754044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.754047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.754050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.754052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.754054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.754057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.754059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.754061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.754064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.754066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.754069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.754071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.754078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.754080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.754083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.754085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.754088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.754090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.754093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.754095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.754097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.754114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.761840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.763267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.763279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.763280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.763283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.763286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3365 [2:7556556051329335009:4029]
2025-10-02T09:36:49.763293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.763303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.763308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.763310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.763311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.763321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.763327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.763333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.763364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.763370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.763371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.763373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.763375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.763414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.763418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.763425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.763430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.763438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.763453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404920915:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.763458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404921120:3336], now have 1 active actors on pipe
2025-10-02T09:36:49.763462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.763463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.763464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.763472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.763482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.763483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.763485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.763486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.763491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.763492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.763498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3365
2025-10-02T09:36:49.763509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3365
2025-10-02T09:36:49.763509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.763515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.763516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.763536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.763543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.763566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.763573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.763575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.763576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.763581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.763588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.763603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.763854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.763860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.763870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.763937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3366 partition: 0 MaxSeqNo: 36 sessionId: src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0
2025-10-02T09:36:49.764151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b70d03-82da127a-22fcc183-95a9079e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.766985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Write session: try to update token
2025-10-02T09:36:49.766996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.773188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.773202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.773204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.773205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.773210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.773213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.773215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329335003:4029]
2025-10-02T09:36:49.773236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.773240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.773241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.773280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.773300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.773307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.773348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.779567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId: src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.781779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.839135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404921133:8014]
2025-10-02T09:36:49.839302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3365, pipe: [1:7556556051404921133:8014]
2025-10-02T09:36:49.881562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:49.881778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.881787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.881799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404921133:8014], now have 1 active actors on pipe
2025-10-02T09:36:49.881916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:49.881958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:49.881967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:49.882001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404921133:8014]
2025-10-02T09:36:49.882009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3366 reason: error at write: Disconnected sessionId: src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0
2025-10-02T09:36:49.882071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:49.882134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3366 sessionId: src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0 is DEAD
2025-10-02T09:36:49.882251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:49.882259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Write session will restart in 0.006213s
2025-10-02T09:36:49.882277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Write session: Do CDS request
2025-10-02T09:36:49.882281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:49.889094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.889227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:49.889234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3367
2025-10-02T09:36:49.889322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:49.889341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:49.889347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:49.889349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:49.889655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3367 sessionId:  describe result for acl check
2025-10-02T09:36:49.889679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:49.889703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:49.889708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:49.889711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:49.890055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:49.892495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:49.894398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:49.896097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:49.896234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:49.896242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:49.896243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556051404921190:3341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:49.896247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:49.896265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:49.896273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:49.896279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:49.896312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:49.896336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556051329335217:4019]
2025-10-02T09:36:49.896672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:49.896861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:49.896884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:49.897055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:49.897084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.897088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.897089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.897090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.897090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.897091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.897091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.897092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.897092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.897093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.897093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.897094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.897097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.897103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.897105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.897107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.897109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.897112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.897114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.897116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.897118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.897120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.897122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.897124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.897128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.897132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:49.897135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.897138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:49.897140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.897143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:49.897145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.897148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:49.897150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.897153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:49.897155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.897158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:49.897160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.897163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:49.897166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.897168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:49.897170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.897173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:49.897177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.897179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.897181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.897184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.897186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.897189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.897208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:49.904876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:49.906385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:49.906396Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:49.906397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:49.906399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:49.906402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3366 [2:7556556051329335217:4019]
2025-10-02T09:36:49.906409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:49.906418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:49.906420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.906421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.906422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.906431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:49.906434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:49.906439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:49.906469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.906474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.906475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.906477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:49.906478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:49.906512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:49.906516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.906523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:49.906528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:49.906538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:49.906551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404921340:3341], now have 1 active actors on pipe
2025-10-02T09:36:49.906556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404921135:2446], now have 1 active actors on pipe
2025-10-02T09:36:49.906560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.906561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.906562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.906570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:49.906579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:49.906583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:49.906584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:49.906585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:49.906589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:49.906590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:49.906578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3366
2025-10-02T09:36:49.906578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3366
2025-10-02T09:36:49.906603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.906608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:49.906610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:49.906618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.906623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.906647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82060419-5f7318dd-2c50de79-631015a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:49.906653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:49.906655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:49.906656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:49.906661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:49.906669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:49.906678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.906769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:49.906774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:49.906781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:49.906823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3367 partition: 0 MaxSeqNo: 36 sessionId: src_id|82060419-5f7318dd-2c50de79-631015a1_0
2025-10-02T09:36:49.907032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdf199-65c2f87a-2a4764dd-391fc330_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82060419-5f7318dd-2c50de79-631015a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:49.909802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Write session: try to update token
2025-10-02T09:36:49.909812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:49.916182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:49.916196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:49.916197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:49.916198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:49.916203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.916205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.916208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556051329335212:4019]
2025-10-02T09:36:49.916231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:49.916234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:49.916234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:49.916235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:49.916237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:49.916239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:49.916341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:49.921045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId: src_id|82060419-5f7318dd-2c50de79-631015a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:49.923180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:49.981979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556051404921358:8014]
2025-10-02T09:36:49.982146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3366, pipe: [1:7556556051404921358:8014]
2025-10-02T09:36:50.025195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.025450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.025460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.025485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556051404921358:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.025659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556051404921358:8014]
2025-10-02T09:36:50.025662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.025665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.025698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.025719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3367 reason: error at write: Disconnected sessionId: src_id|82060419-5f7318dd-2c50de79-631015a1_0
2025-10-02T09:36:50.025865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3367 sessionId: src_id|82060419-5f7318dd-2c50de79-631015a1_0 is DEAD
2025-10-02T09:36:50.025996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.026002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Write session will restart in 0.007190s
2025-10-02T09:36:50.026017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Write session: Do CDS request
2025-10-02T09:36:50.025990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.026022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.034135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.034251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.034261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3368
2025-10-02T09:36:50.034340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.034359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.034364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.034366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.034774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3368 sessionId:  describe result for acl check
2025-10-02T09:36:50.034799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.034803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.034805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.034807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.035169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.037179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.038397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.040040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.040157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.040166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.040175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.040204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.040213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.040214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699888747:3357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.040217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.040219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.040250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624302722:4037]
2025-10-02T09:36:50.040678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.040881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.040917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.041137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.041168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.041172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.041172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.041173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.041174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.041174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.041175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.041176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.041176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.041177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.041177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.041178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.041181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.041187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.041189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.041191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.041193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.041195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.041197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.041199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.041201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.041203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.041205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.041207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.041210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.041214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.041218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.041221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.041223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.041225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.041227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.041230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.041233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.041235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.041237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.041240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.041242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.041245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.041249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.041251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.041254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.041260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.041262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.041265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.041270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.041273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.041275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.041277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.041295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.048962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.050382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.050393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.050394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.050396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.050399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3367 [2:7556556055624302722:4037]
2025-10-02T09:36:50.050408Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.050418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.050423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.050425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.050426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.050434Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.050440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.050444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.050473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.050478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.050479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.050481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.050483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.050519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.050524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.050530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.050535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.050546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.050560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699888865:3357], now have 1 active actors on pipe
2025-10-02T09:36:50.050566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699888658:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.050569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.050570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.050572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.050580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.050589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.050600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.050600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.050602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.050604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.050596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3367
2025-10-02T09:36:50.050597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3367
2025-10-02T09:36:50.050605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.050617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.050619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.050628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.050637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.050639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.050656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.050663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.050665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.050666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.050671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.050680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.050687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.050791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.050796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.050803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.050860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3368 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0
2025-10-02T09:36:50.051074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82060419-5f7318dd-2c50de79-631015a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.053877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Write session: try to update token
2025-10-02T09:36:50.053888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.060260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.060275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.060276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.060277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.060282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.060287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.060288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624302717:4037]
2025-10-02T09:36:50.060313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.060315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.060318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.060320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.060321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.060321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.060426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.065361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId: src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.067501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.125878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699888876:8014]
2025-10-02T09:36:50.126066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3367, pipe: [1:7556556055699888876:8014]
2025-10-02T09:36:50.170526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.170800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.170808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.170834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699888876:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.170986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699888876:8014]
2025-10-02T09:36:50.171020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.171022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.171073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3368 reason: error at write: Disconnected sessionId: src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0
2025-10-02T09:36:50.171188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.171208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3368 sessionId: src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0 is DEAD
2025-10-02T09:36:50.171221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.171330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.171337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Write session will restart in 0.009455s
2025-10-02T09:36:50.171354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Write session: Do CDS request
2025-10-02T09:36:50.171359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.182103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.182186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.182194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3369
2025-10-02T09:36:50.182274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.182295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.182302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.182305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.182578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3369 sessionId:  describe result for acl check
2025-10-02T09:36:50.182603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.182607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.182608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.182611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.182966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.183123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.184859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.185077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.185176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.185183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.185189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.185216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.185240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624302934:4045]
2025-10-02T09:36:50.185598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.185806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.185827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.186005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.186035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.186039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.186039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.186040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.186040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.186041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.186041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.186042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.186042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.186043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.186044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.186044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.186047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.186052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.186055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.186057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.186058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.186060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.186062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.186064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.186067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.186069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.186071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.186073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.186076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.186080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.186083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.186086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.186088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.186090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.186093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.186095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.186098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.186100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.186102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.186105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.186108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.186111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.186113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.186116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.186118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.186121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.186122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.186126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.186132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.186134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.186136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.186139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.186156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.186639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.186647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.186649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699889046:3380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.186652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.193698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.195190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.195201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.195202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.195204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.195207Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3368 [2:7556556055624302934:4045]
2025-10-02T09:36:50.195215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.195227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.195228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.195230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.195231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.195239Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.195242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.195246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.195276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.195281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.195282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.195284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.195285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.195320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.195324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.195331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.195339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.195350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.195364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699888877:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.195370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889088:3380], now have 1 active actors on pipe
2025-10-02T09:36:50.195374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.195375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.195376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.195383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.195394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.195403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.195404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.195406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.195395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3368
2025-10-02T09:36:50.195411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.195397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3368
2025-10-02T09:36:50.195412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.195418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.195420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.195422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.195438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.195440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.195457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.195464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.195466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.195467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.195472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.195481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.195489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.195600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.195606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.195613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.195676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3369 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0
2025-10-02T09:36:50.195864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4134bf-46aac324-97f294e4-f7033ce4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.198874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Write session: try to update token
2025-10-02T09:36:50.198883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.205021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.205033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.205034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.205035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.205040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.205042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.205045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624302929:4045]
2025-10-02T09:36:50.205065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.205068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.205069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.205104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.205119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.205122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.205194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.211896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId: src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.214008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.271265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699889096:8014]
2025-10-02T09:36:50.271404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3368, pipe: [1:7556556055699889096:8014]
2025-10-02T09:36:50.314196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.314524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.314539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.314551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889096:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.314718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.314729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.314749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699889096:8014]
2025-10-02T09:36:50.314766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.314800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3369 reason: error at write: Disconnected sessionId: src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0
2025-10-02T09:36:50.314854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.314929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3369 sessionId: src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0 is DEAD
2025-10-02T09:36:50.315064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.315072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Write session will restart in 0.007833s
2025-10-02T09:36:50.315087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Write session: Do CDS request
2025-10-02T09:36:50.315091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.324151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.324275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.324284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3370
2025-10-02T09:36:50.324385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.324407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.324413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.324415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.324692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3370 sessionId:  describe result for acl check
2025-10-02T09:36:50.324718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.324722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.324723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.324726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.325026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.326877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.327797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.330091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.330238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.330245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.330251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.330289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.330312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624303169:4053]
2025-10-02T09:36:50.330320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.330330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.330333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699889207:3382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.330338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.330670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.330871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.330894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.331083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.331113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.331117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.331118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.331118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.331119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.331120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.331121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.331122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.331122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.331123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.331123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.331127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.331130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.331136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.331138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.331140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.331142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.331144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.331146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.331148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.331150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.331152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.331154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.331156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.331159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.331164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.331167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.331170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.331172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.331175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.331181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.331184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.331186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.331190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.331192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.331194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.331196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.331200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.331202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.331205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.331207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.331209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.331211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.331214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.331216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.331219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.331221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.331223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.331243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.338802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.340333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.340345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.340347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.340349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.340352Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3369 [2:7556556055624303169:4053]
2025-10-02T09:36:50.340358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.340368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.340374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.340376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.340377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.340385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.340387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.340391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.340419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.340424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.340425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.340429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.340431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.340465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.340470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.340477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.340482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.340492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.340506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889097:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.340511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889305:3382], now have 1 active actors on pipe
2025-10-02T09:36:50.340515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.340516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.340517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.340524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.340535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.340538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.340539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.340541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.340545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.340547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.340535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3369
2025-10-02T09:36:50.340560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.340565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.340566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.340568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3369
2025-10-02T09:36:50.340585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.340590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.340605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.340611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.340614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.340616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.340621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.340627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.340636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.340753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.340760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.340767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.340829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3370 partition: 0 MaxSeqNo: 36 sessionId: src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0
2025-10-02T09:36:50.341067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa8fe7f-33c9e9bc-34447bf9-e7884716_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.344065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Write session: try to update token
2025-10-02T09:36:50.344079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.350123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.350138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.350139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.350140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.350144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.350146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.350148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624303164:4053]
2025-10-02T09:36:50.350168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.350170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.350171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.350178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.350182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.350185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.350276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.356573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId: src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.358638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.415130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699889355:8014]
2025-10-02T09:36:50.415254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3369, pipe: [1:7556556055699889355:8014]
2025-10-02T09:36:50.461408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.461683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.461692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.461705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889355:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.461831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.461846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.461855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.461884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699889355:8014]
2025-10-02T09:36:50.461904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3370 reason: error at write: Disconnected sessionId: src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0
2025-10-02T09:36:50.461908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.462052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3370 sessionId: src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0 is DEAD
2025-10-02T09:36:50.462177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.462185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Write session will restart in 0.009793s
2025-10-02T09:36:50.462200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Write session: Do CDS request
2025-10-02T09:36:50.462203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.473101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.473208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.473221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3371
2025-10-02T09:36:50.473298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.473318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.473324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.473327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.473590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3371 sessionId:  describe result for acl check
2025-10-02T09:36:50.473609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.473613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.473614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.473617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.473954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.474408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.475859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.476390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.476488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.476495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.476501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.476526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.476551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624303406:4107]
2025-10-02T09:36:50.476905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.477108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.477131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.477305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.477334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.477338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.477339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.477339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.477340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.477340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.477341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.477342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.477342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.477343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.477343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.477344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.477347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.477353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.477355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.477357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.477359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.477361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.477363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.477364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.477366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.477368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.477370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.477372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.477376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.477380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.477383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.477386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.477388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.477390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.477393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.477395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.477397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.477400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.477402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.477405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.477408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.477410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.477412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.477415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.477417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.477424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.477426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.477430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.477432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.477435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.477437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.477440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.477457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.480431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.480438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.480440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699889528:3430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.480443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.485199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.486711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.486725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.486726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.486728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.486731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3370 [2:7556556055624303406:4107]
2025-10-02T09:36:50.486738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.486746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.486751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.486752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.486753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.486762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.486764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.486768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.486798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.486802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.486803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.486805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.486806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.486853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.486859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.486867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.486875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.486885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.486899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889569:3430], now have 1 active actors on pipe
2025-10-02T09:36:50.486904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889356:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.486908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.486910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.486911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.486918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.486926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.486925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3370
2025-10-02T09:36:50.486931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.486927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3370
2025-10-02T09:36:50.486934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.486935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.486939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.486941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.486948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.486949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.486959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.486967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.486969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.486987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.486994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.486997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.486998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.487011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.487020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.487028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.487143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.487149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.487156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.487208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3371 partition: 0 MaxSeqNo: 36 sessionId: src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0
2025-10-02T09:36:50.487409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cccab8d-2665d8f5-e09626de-6393ff14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.490158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Write session: try to update token
2025-10-02T09:36:50.490168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.496582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.496600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.496602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.496603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.496608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.496611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.496613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624303401:4107]
2025-10-02T09:36:50.496636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.496640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.496641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.496642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.496647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.496649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.496750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.501812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId: src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.504040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.562092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699889577:8014]
2025-10-02T09:36:50.562265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3370, pipe: [1:7556556055699889577:8014]
2025-10-02T09:36:50.606596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.606911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.606921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.606946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889577:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.607129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.607185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699889577:8014]
2025-10-02T09:36:50.607227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.607237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.607279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3371 reason: error at write: Disconnected sessionId: src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0
2025-10-02T09:36:50.607422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.607420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3371 sessionId: src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0 is DEAD
2025-10-02T09:36:50.607537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.607546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Write session will restart in 0.008962s
2025-10-02T09:36:50.607565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Write session: Do CDS request
2025-10-02T09:36:50.607569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.617120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.617236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.617244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3372
2025-10-02T09:36:50.617347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.617368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.617374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.617378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.617666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3372 sessionId:  describe result for acl check
2025-10-02T09:36:50.617689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.617693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.617695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.617698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.618047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.619601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.619934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.621276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.621411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.621418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.621424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.621455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.621480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624303619:4084]
2025-10-02T09:36:50.621817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.621850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.621857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.621859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699889717:3452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.621863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.621996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.622019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.622207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.622240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.622244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.622244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.622245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.622245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.622246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.622246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.622247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.622247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.622248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.622248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.622249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.622252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.622258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.622260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.622262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.622264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.622266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.622268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.622270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.622272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.622274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.622276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.622278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.622282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.622287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.622290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.622293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.622295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.622298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.622300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.622303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.622305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.622308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.622310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.622313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.622317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.622320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.622322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.622325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.622327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.622330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.622332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.622336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.622339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.622342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.622344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.622346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.622363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.629805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.631308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.631319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.631320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.631322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.631326Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3371 [2:7556556055624303619:4084]
2025-10-02T09:36:50.631332Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.631342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.631346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.631347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.631348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.631357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.631359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.631363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.631393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.631398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.631399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.631401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.631402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.631438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.631443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.631449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.631454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.631462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.631477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889578:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.631482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889790:3452], now have 1 active actors on pipe
2025-10-02T09:36:50.631485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.631486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.631487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.631495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.631502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.631508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.631510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.631511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.631511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.631512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.631525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.631533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.631535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.631520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3371
2025-10-02T09:36:50.631525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3371
2025-10-02T09:36:50.631551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.631555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.631573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4b948-782c7b87-4a4345-2649fa03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.631579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.631581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.631582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.631587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.631592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.631603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.631778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.631790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.631805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.631872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3372 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d4b948-782c7b87-4a4345-2649fa03_0
2025-10-02T09:36:50.632080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e2f0d1-4a7329c7-c5f3b423-f670329f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d4b948-782c7b87-4a4345-2649fa03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.635109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Write session: try to update token
2025-10-02T09:36:50.635119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.640770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.640784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.640785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.640786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.640791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.640794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.640796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624303614:4084]
2025-10-02T09:36:50.640825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.640828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.640830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.640835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.640838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.640840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.640945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.647567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId: src_id|7d4b948-782c7b87-4a4345-2649fa03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.649746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.707483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699889800:8014]
2025-10-02T09:36:50.707671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3371, pipe: [1:7556556055699889800:8014]
2025-10-02T09:36:50.751361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.751686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.751695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.751707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889800:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.751842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.751845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.751879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.751880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699889800:8014]
2025-10-02T09:36:50.751889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.751931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3372 reason: error at write: Disconnected sessionId: src_id|7d4b948-782c7b87-4a4345-2649fa03_0
2025-10-02T09:36:50.752059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3372 sessionId: src_id|7d4b948-782c7b87-4a4345-2649fa03_0 is DEAD
2025-10-02T09:36:50.752176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.752186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Write session will restart in 0.009450s
2025-10-02T09:36:50.752201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Write session: Do CDS request
2025-10-02T09:36:50.752204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.762119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.762192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.762201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3373
2025-10-02T09:36:50.762278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.762298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.762304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.762307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.762593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3373 sessionId:  describe result for acl check
2025-10-02T09:36:50.762612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.762617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.762618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.762621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.762956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.763867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.764158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.765665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.765768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.765774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.765780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.765807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.765833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624303833:4072]
2025-10-02T09:36:50.765871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.765879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.765881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699889964:3466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.765884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.766264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.766469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.766681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.766713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.766717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.766718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.766719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.766719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.766720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.766721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.766721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.766722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.766722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.766723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.766723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.766726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.766732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.766734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.766736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.766738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.766740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.766742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.766744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.766746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.766748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.766751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.766753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.766756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.766760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.766763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.766766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.766768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.766771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.766774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.766777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.766779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.766782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.766784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.766787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.766789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.766792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.766798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.766801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.766803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.766806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.766808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.766811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.766814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.766821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.766823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.766825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.766843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.774416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.775856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.775868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.775869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.775871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.775874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3372 [2:7556556055624303833:4072]
2025-10-02T09:36:50.775882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.775891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.775896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.775898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.775899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.775909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.775913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.775920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.775951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.775955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.775956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.775958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.775959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.775995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.775999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.776005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.776011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.776018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.776032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699890011:3466], now have 1 active actors on pipe
2025-10-02T09:36:50.776037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699889801:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.776041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.776042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.776043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.776050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.776061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.776064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.776066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.776067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.776071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.776073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.776071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3372
2025-10-02T09:36:50.776074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3372
2025-10-02T09:36:50.776086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.776091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.776093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.776106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.776112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.776134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6679b5bd-9a697cc-abaae827-365ff354_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.776143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.776150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.776152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.776157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.776167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.776185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.776273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.776278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.776285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.776341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3373 partition: 0 MaxSeqNo: 36 sessionId: src_id|6679b5bd-9a697cc-abaae827-365ff354_0
2025-10-02T09:36:50.776521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4b948-782c7b87-4a4345-2649fa03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6679b5bd-9a697cc-abaae827-365ff354_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.779307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Write session: try to update token
2025-10-02T09:36:50.779318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.785852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.785868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.785869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.785870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.785874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.785877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.785880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624303828:4072]
2025-10-02T09:36:50.785901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.785906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.785907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.785909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.785912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.785915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.786034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.790744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId: src_id|6679b5bd-9a697cc-abaae827-365ff354_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.792702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.851861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699890023:8014]
2025-10-02T09:36:50.852011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3372, pipe: [1:7556556055699890023:8014]
2025-10-02T09:36:50.896231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:50.896453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.896462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.896488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699890023:8014], now have 1 active actors on pipe
2025-10-02T09:36:50.896634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:50.896661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:50.896673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:50.896685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699890023:8014]
2025-10-02T09:36:50.896698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:50.896720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3373 reason: error at write: Disconnected sessionId: src_id|6679b5bd-9a697cc-abaae827-365ff354_0
2025-10-02T09:36:50.896870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3373 sessionId: src_id|6679b5bd-9a697cc-abaae827-365ff354_0 is DEAD
2025-10-02T09:36:50.896993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:50.897002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Write session will restart in 0.005212s
2025-10-02T09:36:50.897021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Write session: Do CDS request
2025-10-02T09:36:50.897025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:50.903113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.903244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:50.903261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3374
2025-10-02T09:36:50.903352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:50.903372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:50.903377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:50.903380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:50.903687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3374 sessionId:  describe result for acl check
2025-10-02T09:36:50.903705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:50.903709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:50.903710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:50.903713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:50.904036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:50.906127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:50.908640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:50.908648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:50.908649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556055699890070:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:50.908653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:50.909371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:50.911060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:50.911156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:50.911163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:50.911168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:50.911192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:50.911215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556055624304048:4086]
2025-10-02T09:36:50.911550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:50.911734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:50.911755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:50.911926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:50.911953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.911957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.911957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.911958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.911959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.911959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.911960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.911960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.911961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.911962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.911962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.911963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.911965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.911971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.911974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.911976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.911978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.911979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.911981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.911984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.911986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.911988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.911990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.911992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.911995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.911999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:50.912002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.912005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:50.912007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.912009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:50.912012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.912014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:50.912016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.912019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:50.912021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.912024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:50.912026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.912029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:50.912031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.912034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:50.912036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.912039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:50.912041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.912043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.912047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.912050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.912052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.912054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.912071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:50.919782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:50.921258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:50.921270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:50.921271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:50.921273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:50.921277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3373 [2:7556556055624304048:4086]
2025-10-02T09:36:50.921284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:50.921295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:50.921300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.921302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.921303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.921313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:50.921319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:50.921324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:50.921356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.921361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.921362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.921363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:50.921365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:50.921400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:50.921405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.921411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:50.921416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:50.921424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:50.921438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699890233:3507], now have 1 active actors on pipe
2025-10-02T09:36:50.921444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699890024:2446], now have 1 active actors on pipe
2025-10-02T09:36:50.921447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.921448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.921449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.921457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:50.921465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:50.921470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:50.921472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:50.921473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:50.921476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:50.921477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:50.921491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.921500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:50.921495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3373
2025-10-02T09:36:50.921509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:50.921499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3373
2025-10-02T09:36:50.921647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.921653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.921676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:50.921685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:50.921688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:50.921690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:50.921694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:50.921700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:50.921709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.921822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:50.921827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:50.921836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:50.921891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3374 partition: 0 MaxSeqNo: 36 sessionId: src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0
2025-10-02T09:36:50.922125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6679b5bd-9a697cc-abaae827-365ff354_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:50.925183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Write session: try to update token
2025-10-02T09:36:50.925194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:50.930753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:50.930767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:50.930768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:50.930769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:50.930773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.930775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.930778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556055624304043:4086]
2025-10-02T09:36:50.930788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:50.930792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:50.930794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:50.930794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:50.930796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:50.930798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:50.930912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:50.938300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId: src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:50.940299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:50.996774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556055699890254:8014]
2025-10-02T09:36:50.996963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3373, pipe: [1:7556556055699890254:8014]
2025-10-02T09:36:51.041534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.041763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.041772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.041784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556055699890254:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.041928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.041935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556055699890254:8014]
2025-10-02T09:36:51.041946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.041960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:51.042020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0
2025-10-02T09:36:51.042144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3374 sessionId: src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0 is DEAD
2025-10-02T09:36:51.042501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:51.042511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Write session will restart in 0.006487s
2025-10-02T09:36:51.042525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Write session: Do CDS request
2025-10-02T09:36:51.042530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.050147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.050208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.050217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3375
2025-10-02T09:36:51.050282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.050300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.050306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.050308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.050715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3375 sessionId:  describe result for acl check
2025-10-02T09:36:51.050741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.050746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.050747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.050749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.051109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.052929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.054106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.056008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.056107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.056114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.056121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.056147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.056172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919271559:4103]
2025-10-02T09:36:51.056230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.056238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.056239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994857650:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.056243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.056520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.056700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.056723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.056911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.056940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.056944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.056945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.056945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.056946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.056946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.056947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.056947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.056948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.056948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.056949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.056949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.056952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.056958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.056960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.056962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.056964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.056966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.056968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.056970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.056972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.056974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.056976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.056978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.056983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.056986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.056990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.056992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.056995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.056997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.056999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.057002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.057005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.057008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.057010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.057012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.057015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.057017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.057020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.057022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.057028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.057032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.057034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.057037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.057042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.057045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.057047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.057050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.057071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.064735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.066260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.066261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.066263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.066267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3374 [2:7556556059919271559:4103]
2025-10-02T09:36:51.066274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.066283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.066284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.066286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.066287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.066295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.066298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.066302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.066332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.066338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.066340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.066341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.066343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.066378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.066384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.066391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.066396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.066406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.066420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994857768:3517], now have 1 active actors on pipe
2025-10-02T09:36:51.066425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994857555:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.066429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.066430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.066431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.066439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.066449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.066455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.066457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.066459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.066459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.066461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.066456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3374
2025-10-02T09:36:51.066466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3374
2025-10-02T09:36:51.066474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.066479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.066481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.066493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.066498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.066517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c0cf457-c358e05-756f56c5-6008079f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.066523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.066527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.066528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.066533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.066539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.066552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.066653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.066659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.066667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.066732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3375 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c0cf457-c358e05-756f56c5-6008079f_0
2025-10-02T09:36:51.066937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9408f6a9-c42fbc0a-a2366ff3-5401e20e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c0cf457-c358e05-756f56c5-6008079f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.069701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Write session: try to update token
2025-10-02T09:36:51.069712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.076071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.076089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.076090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.076092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.076096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.076098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.076101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919271554:4103]
2025-10-02T09:36:51.076121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.076124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.076125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.076133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.076136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.076139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.076232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.081210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId: src_id|7c0cf457-c358e05-756f56c5-6008079f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.083216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.142189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994857779:8014]
2025-10-02T09:36:51.142366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3374, pipe: [1:7556556059994857779:8014]
2025-10-02T09:36:51.187493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.187721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.187731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.187757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994857779:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.187884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.187933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994857779:8014]
2025-10-02T09:36:51.187951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.187971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:51.188072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3375 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c0cf457-c358e05-756f56c5-6008079f_0
2025-10-02T09:36:51.188213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3375 sessionId: src_id|7c0cf457-c358e05-756f56c5-6008079f_0 is DEAD
2025-10-02T09:36:51.188346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:51.188355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Write session will restart in 0.007852s
2025-10-02T09:36:51.188374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Write session: Do CDS request
2025-10-02T09:36:51.188378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.197229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.197299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.197309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3376
2025-10-02T09:36:51.197394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.197413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.197419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.197421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.197701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3376 sessionId:  describe result for acl check
2025-10-02T09:36:51.197724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.197729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.197730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.197733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.198104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.199753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.200481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.202122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.202220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.202227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.202233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.202259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.202291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919271778:4096]
2025-10-02T09:36:51.202343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.202351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.202355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994857896:3530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.202358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.202635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.202809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.202832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.203004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.203041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.203045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.203045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.203046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.203046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.203047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.203048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.203048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.203049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.203049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.203050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.203050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.203053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.203059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.203061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.203063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.203065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.203067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.203069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.203071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.203073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.203075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.203077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.203079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.203082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.203086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.203089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.203092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.203095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.203098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.203100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.203103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.203105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.203107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.203109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.203112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.203114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.203117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.203119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.203122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.203124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.203127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.203131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.203133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.203137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.203140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.203143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.203146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.203173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.210892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.212402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.212415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.212416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.212418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.212421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3375 [2:7556556059919271778:4096]
2025-10-02T09:36:51.212427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.212437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.212440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.212442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.212443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.212451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.212457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.212462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.212492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.212497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.212498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.212500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.212501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.212535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.212540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.212546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.212553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.212563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.212577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994857781:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.212583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994857995:3530], now have 1 active actors on pipe
2025-10-02T09:36:51.212586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.212587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.212588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.212596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.212607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.212609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.212611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.212612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.212606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3375
2025-10-02T09:36:51.212618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.212610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3375
2025-10-02T09:36:51.212619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.212632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.212636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.212637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.212645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.212648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.212674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.212681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.212684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.212687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.212693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.212699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.212714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.212822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.212826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.212834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.212886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3376 partition: 0 MaxSeqNo: 36 sessionId: src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0
2025-10-02T09:36:51.213116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cf457-c358e05-756f56c5-6008079f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.215655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Write session: try to update token
2025-10-02T09:36:51.215668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.222061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.222074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.222075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.222076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.222079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.222082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.222084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919271773:4096]
2025-10-02T09:36:51.222102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.222104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.222106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.222107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.222108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.222109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.222212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.227971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId: src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.229991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.288099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994858006:8014]
2025-10-02T09:36:51.288288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3375, pipe: [1:7556556059994858006:8014]
2025-10-02T09:36:51.332124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.332510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.332520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.332532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858006:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.332698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.332739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:51.332750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:51.332769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.332794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3376 reason: error at write: Disconnected sessionId: src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0
2025-10-02T09:36:51.332815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994858006:8014]
2025-10-02T09:36:51.332944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3376 sessionId: src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0 is DEAD
2025-10-02T09:36:51.333099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:51.333113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Write session will restart in 0.005268s
2025-10-02T09:36:51.333133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Write session: Do CDS request
2025-10-02T09:36:51.333139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.339163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.339262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.339270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3377
2025-10-02T09:36:51.339354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.339372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.339379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.339381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.339655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3377 sessionId:  describe result for acl check
2025-10-02T09:36:51.339677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.339681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.339683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.339686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.340026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.341723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.344477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.344486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.344489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994858044:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.344494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.346307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.347891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.348027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.348035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.348042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.348072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.348099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919272009:4112]
2025-10-02T09:36:51.348439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.348636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.348662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.348866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.348900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.348905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.348905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.348906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.348907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.348907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.348908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.348909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.348909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.348910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.348910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.348911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.348914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.348919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.348921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.348923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.348925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.348928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.348929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.348931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.348933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.348935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.348937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.348939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.348943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.348947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.348952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.348955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.348957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.348959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.348966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.348969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.348971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.348974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.348976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.348978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.348981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.348983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.348985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.348988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.348994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.348996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.348998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.349001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.349007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.349010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.349015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.349018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.349035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.357026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.358908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.358950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.358959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.358963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.358969Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3376 [2:7556556059919272009:4112]
2025-10-02T09:36:51.358982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.359003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.359020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.359023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.359025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.359041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.359053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.359059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.359121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.359128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.359130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.359133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.359135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.359199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.359208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.359220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.359239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.359253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3376
2025-10-02T09:36:51.359262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.359259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3376
2025-10-02T09:36:51.359286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858007:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.359296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858208:3557], now have 1 active actors on pipe
2025-10-02T09:36:51.359304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.359312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.359315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.359328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.359341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.359350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.359351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.359361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.359371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.359386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.359406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.359415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.359456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.359470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.359480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.359482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.359491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.359506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.359517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.359526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.359536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.359552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.359667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.359676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.359692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.359760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3377 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0
2025-10-02T09:36:51.360090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e752eb06-fbfb5781-c689141f-6e5a9f25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.362463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Write session: try to update token
2025-10-02T09:36:51.362477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.369516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.369532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.369534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.369537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.369544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.369548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.369552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919272004:4112]
2025-10-02T09:36:51.369583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.369584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.369590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.369592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.369594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.369596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.370342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.375097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId: src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.377285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.432984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994858270:8014]
2025-10-02T09:36:51.433101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3376, pipe: [1:7556556059994858270:8014]
2025-10-02T09:36:51.493010Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.493277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.493287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.493299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858270:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.493454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.493478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.493512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994858270:8014]
2025-10-02T09:36:51.493513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:51.493566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0
2025-10-02T09:36:51.493707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3377 sessionId: src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0 is DEAD
2025-10-02T09:36:51.493846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:51.493859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Write session will restart in 0.006670s
2025-10-02T09:36:51.493889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Write session: Do CDS request
2025-10-02T09:36:51.493896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.501149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.501240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.501249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3378
2025-10-02T09:36:51.501356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.501376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.501382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.501385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.501655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3378 sessionId:  describe result for acl check
2025-10-02T09:36:51.501679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.501684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.501685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.501687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.502024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.504288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.506062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.506069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.506071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994858337:3609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.506075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.506568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.508283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.508476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.508484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.508491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.508525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.508549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919272266:4162]
2025-10-02T09:36:51.508899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.509117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.509141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.509315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.509344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.509348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.509350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.509350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.509351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.509351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.509352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.509352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.509353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.509354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.509354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.509357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.509363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.509365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.509367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.509369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.509371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.509373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.509375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.509377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.509379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.509381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.509383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.509387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.509391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.509394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.509396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.509399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.509401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.509404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.509407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.509410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.509412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.509414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.509417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.509420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.509423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.509425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.509427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.509429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.509432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.509434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.509437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.509442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.509445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.509447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.509450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.509466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.517035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.518527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.518542Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.518543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.518545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.518548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3377 [2:7556556059919272266:4162]
2025-10-02T09:36:51.518556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.518566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.518567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.518569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.518570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.518579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.518582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.518586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.518615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.518621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.518622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.518624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.518625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.518662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.518667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.518673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.518679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.518688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.518702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858484:3609], now have 1 active actors on pipe
2025-10-02T09:36:51.518708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858271:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.518712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.518713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.518714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.518722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.518732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.518736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.518738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.518726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3377
2025-10-02T09:36:51.518739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.518742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.518736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3377
2025-10-02T09:36:51.518744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.518758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.518763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.518765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.518773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.518777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.518802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.518809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.518812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.518813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.518818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.518823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.518836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.518937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.518944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.518951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.519004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3378 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0
2025-10-02T09:36:51.519256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7e749d-a25a9e67-a7f25874-6b90d94e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.521601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Write session: try to update token
2025-10-02T09:36:51.521615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.528229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.528241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.528242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.528243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.528248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.528250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.528252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919272261:4162]
2025-10-02T09:36:51.528270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.528272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.528272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.528274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.528275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.528277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.528380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.535125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId: src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.537348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.593748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994858502:8014]
2025-10-02T09:36:51.593923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3377, pipe: [1:7556556059994858502:8014]
2025-10-02T09:36:51.638336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.638847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.638857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.638871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858502:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.639017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.639035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.639069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:51.639123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0
2025-10-02T09:36:51.639130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994858502:8014]
2025-10-02T09:36:51.639251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3378 sessionId: src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0 is DEAD
2025-10-02T09:36:51.639382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:51.639396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Write session will restart in 0.009422s
2025-10-02T09:36:51.639418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Write session: Do CDS request
2025-10-02T09:36:51.639424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.650175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.650293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.650301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3379
2025-10-02T09:36:51.650414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.650434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.650440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.650443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.650757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3379 sessionId:  describe result for acl check
2025-10-02T09:36:51.650777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.650781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.650782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.650785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.651125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.651992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.652592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.653869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.653963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.653970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.653977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.654001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.654024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919272485:4164]
2025-10-02T09:36:51.654359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.654531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.654555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.654555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.654562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.654564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994858674:3638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.654567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.654731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.654764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.654765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.654765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.654766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.654766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.654767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.654767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.654768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.654768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.654769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.654770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.654772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.654786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.654789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.654791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.654793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.654795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.654797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.654799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.654801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.654803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.654805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.654807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.654810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.654814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.654818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.654820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.654823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.654826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.654831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.654833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.654836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.654838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.654841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.654843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.654846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.654849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.654853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.654856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.654860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.654862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.654864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.654867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.654869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.654872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.654874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.654880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.654897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.662577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.664206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.664218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.664220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.664221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.664224Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3378 [2:7556556059919272485:4164]
2025-10-02T09:36:51.664231Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.664239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.664241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.664242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.664243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.664252Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.664255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.664259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.664289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.664294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.664295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.664296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.664298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.664331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.664335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.664342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.664348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.664356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.664368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.664372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.664373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.664378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.664385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858723:3638], now have 1 active actors on pipe
2025-10-02T09:36:51.664385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.664387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.664388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.664391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858504:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.664395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.664402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.664404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.664418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.664427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.664418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3378
2025-10-02T09:36:51.664423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3378
2025-10-02T09:36:51.664442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.664471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.664477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.664490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.664496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.664498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.664500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.664506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.664511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.664520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.664617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.664622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.664630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.664683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3379 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0
2025-10-02T09:36:51.664916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3372f4-5fcc1900-b2a181c8-801a1c12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.667248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Write session: try to update token
2025-10-02T09:36:51.667264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.673846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.673858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.673859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.673860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.673864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.673867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.673869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919272480:4164]
2025-10-02T09:36:51.673888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.673891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.673892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.673893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.673895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.673897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.674004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.679376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId: src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.681503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.739174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994858733:8014]
2025-10-02T09:36:51.739335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3378, pipe: [1:7556556059994858733:8014]
2025-10-02T09:36:51.782097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.782431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.782440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.782453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858733:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.782570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.782606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.782616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:51.782638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994858733:8014]
2025-10-02T09:36:51.782666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3379 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0
2025-10-02T09:36:51.782811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3379 sessionId: src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0 is DEAD
2025-10-02T09:36:51.782964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:51.782978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Write session will restart in 0.008984s
2025-10-02T09:36:51.782998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Write session: Do CDS request
2025-10-02T09:36:51.783003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.793158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.793237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.793245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3380
2025-10-02T09:36:51.793377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.793398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.793403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.793406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.793687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3380 sessionId:  describe result for acl check
2025-10-02T09:36:51.793709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.793715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.793716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.793718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.794065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.795428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.795771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.797392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.797535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.797543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.797550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.797579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.797606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919272706:4168]
2025-10-02T09:36:51.797611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.797618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.797620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994858875:3654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.797623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.797947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.798150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.798181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.798362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.798391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.798394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.798395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.798396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.798396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.798397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.798397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.798398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.798398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.798399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.798399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.798400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.798403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.798409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.798411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.798413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.798415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.798417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.798419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.798421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.798423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.798425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.798427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.798429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.798433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.798438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.798442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.798445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.798447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.798450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.798452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.798455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.798459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.798461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.798463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.798465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.798468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.798470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.798472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.798475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.798477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.798480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.798484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.798486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.798489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.798493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.798496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.798499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.798516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.806188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.807702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.807714Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.807715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.807717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.807720Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3379 [2:7556556059919272706:4168]
2025-10-02T09:36:51.807727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.807736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.807738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.807739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.807740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.807750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.807752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.807757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.807784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.807789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.807790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.807792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.807793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.807827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.807832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.807838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.807843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.807852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.807866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858734:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.807872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858952:3654], now have 1 active actors on pipe
2025-10-02T09:36:51.807875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.807876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.807878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.807884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.807893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.807898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.807900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.807892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3379
2025-10-02T09:36:51.807901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.807897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3379
2025-10-02T09:36:51.807904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.807905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.807918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.807923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.807924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.807940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.807945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.807962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.807968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.807971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.807972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.807977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.807985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.807998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.808098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.808103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.808110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.808165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3380 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0
2025-10-02T09:36:51.808411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9930c15-ec556d3-d80a093f-4a5be2a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.810704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Write session: try to update token
2025-10-02T09:36:51.810718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.817355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.817368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.817369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.817370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.817373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.817376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.817377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919272701:4168]
2025-10-02T09:36:51.817396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.817399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.817400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.817401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.817403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.817404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.817508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.822590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId: src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.824712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:51.882523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556059994858964:8014]
2025-10-02T09:36:51.882675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3379, pipe: [1:7556556059994858964:8014]
2025-10-02T09:36:51.926112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:51.926395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.926404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.926429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858964:8014], now have 1 active actors on pipe
2025-10-02T09:36:51.926550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:51.926569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:51.926606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:51.926611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:51.926634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556059994858964:8014]
2025-10-02T09:36:51.926711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3380 reason: error at write: Disconnected sessionId: src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0
2025-10-02T09:36:51.926841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3380 sessionId: src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0 is DEAD
2025-10-02T09:36:51.926995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:51.927008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Write session will restart in 0.005036s
2025-10-02T09:36:51.927054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Write session: Do CDS request
2025-10-02T09:36:51.927059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:51.933117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.933231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:51.933240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3381
2025-10-02T09:36:51.933347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:51.933366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:51.933370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:51.933372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:51.933729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3381 sessionId:  describe result for acl check
2025-10-02T09:36:51.933751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:51.933756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:51.933758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:51.933760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:51.934109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:51.936503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:51.938965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:51.938972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:51.938974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556059994859012:3656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:51.938977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:51.939722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:51.941379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:51.941478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:51.941484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:51.941490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:51.941515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:51.941539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556059919272929:4189]
2025-10-02T09:36:51.941876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:51.942054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:51.942076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:51.942247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:51.942277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.942281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.942281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.942282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.942282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.942283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.942283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.942284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.942284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.942285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.942285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.942286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.942289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.942295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.942297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.942299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.942301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.942303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.942305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.942307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.942309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.942311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.942313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.942315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.942319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.942322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:51.942325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.942328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:51.942330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.942333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:51.942335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.942338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:51.942344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.942348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:51.942350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.942353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:51.942355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.942357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:51.942360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.942362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:51.942364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.942367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:51.942369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.942372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.942375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.942378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.942380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.942382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.942399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:51.949909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:51.951407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:51.951421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:51.951422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:51.951424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:51.951427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3380 [2:7556556059919272929:4189]
2025-10-02T09:36:51.951434Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:51.951444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:51.951446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.951447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.951448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.951457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:51.951460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:51.951464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:51.951494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.951499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.951500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.951502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:51.951504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:51.951538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:51.951543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.951549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:51.951554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:51.951564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:51.951578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994859184:3656], now have 1 active actors on pipe
2025-10-02T09:36:51.951583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556059994858968:2446], now have 1 active actors on pipe
2025-10-02T09:36:51.951587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.951589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.951590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.951599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:51.951614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:51.951615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:51.951617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:51.951619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:51.951629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:51.951631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:51.951631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3380
2025-10-02T09:36:51.951636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3380
2025-10-02T09:36:51.951649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.951655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:51.951658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:51.951669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.951671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.951810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0e9425-881989cc-f5809ae8-b646617d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:51.951819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:51.951821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:51.951822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:51.951827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:51.951833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:51.951849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.951955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:51.951960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:51.951968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:51.952019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3381 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f0e9425-881989cc-f5809ae8-b646617d_0
2025-10-02T09:36:51.952240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2676bdb-d8eccc7e-9e6d76fd-927d229e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f0e9425-881989cc-f5809ae8-b646617d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:51.954515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Write session: try to update token
2025-10-02T09:36:51.954528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:51.960865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:51.960877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:51.960879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:51.960881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:51.960885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.960889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.960891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556059919272924:4189]
2025-10-02T09:36:51.960911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:51.960914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:51.960915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:51.960917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:51.960920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:51.960922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:51.961029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:51.967015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId: src_id|3f0e9425-881989cc-f5809ae8-b646617d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:51.969275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.026915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289826502:8014]
2025-10-02T09:36:52.027088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3380, pipe: [1:7556556064289826502:8014]
2025-10-02T09:36:52.070023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.070382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.070391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.070404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826502:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.070542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:52.070579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289826502:8014]
2025-10-02T09:36:52.070667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:52.070673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:52.070689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.070716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3381 reason: error at write: Disconnected sessionId: src_id|3f0e9425-881989cc-f5809ae8-b646617d_0
2025-10-02T09:36:52.070857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3381 sessionId: src_id|3f0e9425-881989cc-f5809ae8-b646617d_0 is DEAD
2025-10-02T09:36:52.071029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:52.071044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Write session will restart in 0.009438s
2025-10-02T09:36:52.071064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Write session: Do CDS request
2025-10-02T09:36:52.071069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.081161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.081247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.081255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3382
2025-10-02T09:36:52.081363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.081383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.081389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.081392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.081724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3382 sessionId:  describe result for acl check
2025-10-02T09:36:52.081748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.081752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.081753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.081756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.082106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.083593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.083725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.085371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.085483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.085490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.085495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.085524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.085546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214240446:4179]
2025-10-02T09:36:52.085647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.085655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.085657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289826652:3683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.085660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.085897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.086086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.086108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.086403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.086444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.086448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.086449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.086450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.086450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.086451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.086451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.086452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.086452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.086453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.086453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.086454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.086456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.086462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.086464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.086466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.086468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.086471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.086472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.086474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.086476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.086480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.086481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.086483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.086489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.086493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.086496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.086499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.086501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.086504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.086506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.086509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.086511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.086514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.086516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.086519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.086521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.086523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.086525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.086528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.086529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.086532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.086534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.086536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.086539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.086541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.086543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.086550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.086567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.094239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.095596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.095609Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.095610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.095612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.095615Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3381 [2:7556556064214240446:4179]
2025-10-02T09:36:52.095622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.095632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.095635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.095637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.095638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.095646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.095653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.095657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.095688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.095692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.095693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.095695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.095696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.095733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.095737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.095744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.095749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.095757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.095771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826723:3683], now have 1 active actors on pipe
2025-10-02T09:36:52.095776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826503:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.095780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.095785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.095786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.095794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.095804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.095806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.095809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.095810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.095816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.095817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.095815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3381
2025-10-02T09:36:52.095824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3381
2025-10-02T09:36:52.095831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.095836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.095837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.095850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.095855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.095875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.095882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.095885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.095889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.095894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.095900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.095916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.096045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.096050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.096057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.096119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3382 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0
2025-10-02T09:36:52.096337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e9425-881989cc-f5809ae8-b646617d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.098666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Write session: try to update token
2025-10-02T09:36:52.098680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.105221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.105234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.105235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.105237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.105240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.105242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.105245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214240441:4179]
2025-10-02T09:36:52.105264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.105267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.105268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.105269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.105271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.105273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.105378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.110529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId: src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.112826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.170994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289826734:8014]
2025-10-02T09:36:52.171169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3381, pipe: [1:7556556064289826734:8014]
2025-10-02T09:36:52.214365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.214762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.214772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.214797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826734:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.214918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:52.214964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:52.214976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289826734:8014]
2025-10-02T09:36:52.214991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.215035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3382 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0
2025-10-02T09:36:52.215170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3382 sessionId: src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0 is DEAD
2025-10-02T09:36:52.215327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:52.215342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Write session will restart in 0.006491s
2025-10-02T09:36:52.215366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Write session: Do CDS request
2025-10-02T09:36:52.215372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.223145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.223224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.223232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3383
2025-10-02T09:36:52.223377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.223399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.223404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.223407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.223728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3383 sessionId:  describe result for acl check
2025-10-02T09:36:52.223753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.223757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.223759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.223762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.224110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.226163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.227964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.227979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.227986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.227988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289826822:3686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.227992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.229771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.229876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.229883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.229888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.229916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.229937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214240673:4183]
2025-10-02T09:36:52.230280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.230464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.230486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.230664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.230693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.230696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.230697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.230697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.230698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.230699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.230699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.230700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.230700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.230701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.230701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.230702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.230705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.230710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.230713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.230715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.230717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.230720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.230722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.230724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.230726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.230728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.230730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.230734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.230738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.230741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.230743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.230746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.230749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.230751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.230753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.230756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.230758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.230760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.230763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.230765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.230768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.230771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.230774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.230776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.230779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.230781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.230787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.230789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.230792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.230794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.230796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.230812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.238490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.239946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.239958Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.239959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.239961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.239964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3382 [2:7556556064214240673:4183]
2025-10-02T09:36:52.239970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.239979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.239981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.239982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.239983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.239992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.239995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.239999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.240026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.240031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.240032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.240034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.240036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.240069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.240074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.240080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.240085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.240093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.240107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826736:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.240112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826956:3686], now have 1 active actors on pipe
2025-10-02T09:36:52.240116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.240117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.240118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.240125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.240136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.240139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.240141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.240142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.240146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.240148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.240132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3382
2025-10-02T09:36:52.240141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3382
2025-10-02T09:36:52.240167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.240172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.240181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.240188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.240197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.240206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.240210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.240212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.240213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.240218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.240226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.240237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.240344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.240348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.240356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.240412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3383 partition: 0 MaxSeqNo: 36 sessionId: src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0
2025-10-02T09:36:52.240614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7f6dc6-80600cd-2205c9e8-d18f15d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.243429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Write session: try to update token
2025-10-02T09:36:52.243440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.249805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.249816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.249818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.249819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.249823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.249826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.249828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214240667:4183]
2025-10-02T09:36:52.249849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.249851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.249852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.249853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.249853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.249856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.249997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.256364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId: src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.258688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.315162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289826968:8014]
2025-10-02T09:36:52.315336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3382, pipe: [1:7556556064289826968:8014]
2025-10-02T09:36:52.360731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.361020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.361028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.361042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826968:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.361166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:52.361293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289826968:8014]
2025-10-02T09:36:52.361314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.361318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:52.361365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0
2025-10-02T09:36:52.361487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3383 sessionId: src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0 is DEAD
2025-10-02T09:36:52.361594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:52.361603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Write session will restart in 0.009255s
2025-10-02T09:36:52.361618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Write session: Do CDS request
2025-10-02T09:36:52.361622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.372244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.372304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.372311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3384
2025-10-02T09:36:52.372458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.372478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.372484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.372486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.372829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3384 sessionId:  describe result for acl check
2025-10-02T09:36:52.372846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.372849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.372850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.372853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.373160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.374693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.374967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.376514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.376631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.376637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.376643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.376670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.376695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214240909:4185]
2025-10-02T09:36:52.377010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.377018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.377022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289827132:3732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.377025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.377056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.377237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.377260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.377435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.377464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.377468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.377469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.377469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.377470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.377470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.377471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.377471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.377472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.377473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.377473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.377474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.377477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.377483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.377485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.377487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.377489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.377491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.377493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.377495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.377497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.377499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.377501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.377503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.377507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.377511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.377514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.377516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.377519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.377521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.377523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.377526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.377529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.377531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.377533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.377536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.377539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.377541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.377543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.377546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.377552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.377555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.377557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.377561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.377565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.377568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.377574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.377576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.377594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.385451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.386854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.386864Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.386865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.386868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.386871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3383 [2:7556556064214240909:4185]
2025-10-02T09:36:52.386878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.386888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.386894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.386895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.386897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.386905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.386908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.386912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.386942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.386947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.386948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.386949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.386951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.386986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.386991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.386997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.387004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.387021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.387036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.387040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.387042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.387046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.387053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827206:3732], now have 1 active actors on pipe
2025-10-02T09:36:52.387053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.387055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.387057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.387059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289826984:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.387064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.387071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.387073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.387086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.387094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.387104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.387100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3383
2025-10-02T09:36:52.387107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3383
2025-10-02T09:36:52.387137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.387143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.387159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.387166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.387168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.387169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.387174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.387181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.387188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.387296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.387301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.387308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.387364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3384 partition: 0 MaxSeqNo: 36 sessionId: src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0
2025-10-02T09:36:52.387583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51edd0be-e1a170d8-c05a78c4-2ff3fd46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.390393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Write session: try to update token
2025-10-02T09:36:52.390403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.396591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:52.396603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.396608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.396632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:52.396636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:52.396765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:52.396904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.397023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.397135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.397291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:52.397317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:52.402613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId: src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.404775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.405436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.405453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.405464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.405465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.405466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.405467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.405471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.405473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.405475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214240904:4185]
2025-10-02T09:36:52.405497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.405503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.405504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.405506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.405506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.405507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.405615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.461762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289827239:8014]
2025-10-02T09:36:52.461906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3383, pipe: [1:7556556064289827239:8014]
2025-10-02T09:36:52.513863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.514273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:52.514294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827239:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.514346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:52.514417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:52.514423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:52.514423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289827239:8014]
2025-10-02T09:36:52.514441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.514471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3384 reason: error at write: Disconnected sessionId: src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0
2025-10-02T09:36:52.514595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3384 sessionId: src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0 is DEAD
2025-10-02T09:36:52.514715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:52.514729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Write session will restart in 0.006919s
2025-10-02T09:36:52.514749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Write session: Do CDS request
2025-10-02T09:36:52.514757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.523155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.523202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.523210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3385
2025-10-02T09:36:52.523375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.523394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.523400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.523402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.523668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3385 sessionId:  describe result for acl check
2025-10-02T09:36:52.523695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.523699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.523700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.523704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.524041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.526028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.527106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.529052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.529150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.529156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.529162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.529187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.529208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214241173:4215]
2025-10-02T09:36:52.529285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.529292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.529294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289827347:3759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.529297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.529548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.529729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.529750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.529923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.529952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.529955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.529956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.529956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.529957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.529958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.529958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.529959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.529959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.529960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.529960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.529961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.529964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.529969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.529971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.529974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.529975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.529977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.529979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.529981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.529983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.529985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.529987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.529989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.529993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.529997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.530000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.530003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.530005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.530008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.530010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.530012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.530015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.530018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.530020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.530022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.530024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.530027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.530029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.530032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.530034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.530037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.530039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.530041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.530044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.530046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.530048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.530051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.530068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.537801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.539501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.539511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.539513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.539515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.539517Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3384 [2:7556556064214241173:4215]
2025-10-02T09:36:52.539523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.539534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.539538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.539540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.539541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.539549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.539555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.539559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.539589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.539594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.539595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.539598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.539599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.539633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.539637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.539643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.539648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.539656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.539669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827464:3759], now have 1 active actors on pipe
2025-10-02T09:36:52.539674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827241:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.539678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.539679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.539680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.539688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.539698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.539701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.539705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.539707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.539707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.539708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.539720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.539725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.539726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.539728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3384
2025-10-02T09:36:52.539747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3384
2025-10-02T09:36:52.539756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.539761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.539776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.539783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.539786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.539787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.539793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.539801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.539810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.539911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.539916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.539922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.540005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3385 partition: 0 MaxSeqNo: 36 sessionId: src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0
2025-10-02T09:36:52.540234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23aa5386-4fc9cb6-3fed270-e23fd56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.542850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Write session: try to update token
2025-10-02T09:36:52.542866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.553222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:52.553230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.553234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.553253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:52.553260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:52.553388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:52.553506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.553619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.553746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.553976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:52.554000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:52.557640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.557650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.557651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.557653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.557656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.557658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.557660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214241168:4215]
2025-10-02T09:36:52.557677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.557678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.557680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.557680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.557681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.557682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.557798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.558968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId: src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.561291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.614697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289827475:8014]
2025-10-02T09:36:52.614856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3384, pipe: [1:7556556064289827475:8014]
2025-10-02T09:36:52.666011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.666404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.666417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.666429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827475:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.666595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:52.666606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:52.666616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289827475:8014]
2025-10-02T09:36:52.666632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.666649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3385 reason: error at write: Disconnected sessionId: src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0
2025-10-02T09:36:52.666786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3385 sessionId: src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0 is DEAD
2025-10-02T09:36:52.666933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:52.666948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:52.666963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Write session will restart in 0.007238s
2025-10-02T09:36:52.666984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Write session: Do CDS request
2025-10-02T09:36:52.666990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.675170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.675229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.675236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3386
2025-10-02T09:36:52.675349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.675370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.675375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.675378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.675691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3386 sessionId:  describe result for acl check
2025-10-02T09:36:52.675715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.675720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.675721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.675724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.676089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.678209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.679922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.680178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.680186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.680188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289827565:3785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.680192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.681721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.681816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.681823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.681828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.681854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.681876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214241401:4219]
2025-10-02T09:36:52.682218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.682416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.682441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.682611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.682734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.682738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.682739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.682740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.682740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.682741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.682741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.682742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.682742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.682743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.682743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.682744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.682747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.682753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.682755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.682757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.682759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.682761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.682763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.682765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.682767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.682769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.682771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.682773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.682777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.682781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.682785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.682788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.682790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.682793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.682795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.682797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.682800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.682802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.682804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.682807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.682809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.682811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.682813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.682816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.682818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.682821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.682822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.682825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.682827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.682829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.682831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.682833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.682850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.690268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.691662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.691674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.691675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.691677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.691680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3385 [2:7556556064214241401:4219]
2025-10-02T09:36:52.691687Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.691697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.691699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.691700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.691702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.691710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.691714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.691719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.691749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.691754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.691755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.691757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.691759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.691791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.691796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.691802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.691807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.691815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.691829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827476:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.691834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827701:3785], now have 1 active actors on pipe
2025-10-02T09:36:52.691838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.691839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.691840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.691847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.691857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.691864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.691866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.691868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.691867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.691869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.691881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.691884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.691867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3385
2025-10-02T09:36:52.691886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.691868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3385
2025-10-02T09:36:52.691903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.691908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.691922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.691925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.691927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.691928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.691933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.691938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.691947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.692050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.692057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.692064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.692118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3386 partition: 0 MaxSeqNo: 36 sessionId: src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0
2025-10-02T09:36:52.692333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c866499b-9e7f1da9-161e2dd7-9f709af2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.694714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Write session: try to update token
2025-10-02T09:36:52.694727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.701263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.701274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.701275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.701276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.701280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.701283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.701285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214241395:4219]
2025-10-02T09:36:52.701303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.701306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.701309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.701311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.701314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.701316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.701434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.707634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId: src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.709775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.766750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289827712:8014]
2025-10-02T09:36:52.766912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3385, pipe: [1:7556556064289827712:8014]
2025-10-02T09:36:52.810043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.810435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.810450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.810463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827712:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.810623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289827712:8014]
2025-10-02T09:36:52.810643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.810651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:52.810660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:52.810701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3386 reason: error at write: Disconnected sessionId: src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0
2025-10-02T09:36:52.810838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3386 sessionId: src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0 is DEAD
2025-10-02T09:36:52.810864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:52.810991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:52.811004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Write session will restart in 0.005845s
2025-10-02T09:36:52.811033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Write session: Do CDS request
2025-10-02T09:36:52.811038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.818157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.818248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.818258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3387
2025-10-02T09:36:52.818394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.818414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.818420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.818423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.818679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3387 sessionId:  describe result for acl check
2025-10-02T09:36:52.818699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.818703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.818704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.818707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.819044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.821113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.823425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.823433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.823435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289827762:3814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.823438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.825104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.826772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.826867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.826874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.826879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.826903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.826925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214241628:4222]
2025-10-02T09:36:52.827282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.827477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.827502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.827679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.827709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.827713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.827714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.827714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.827715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.827715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.827716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.827716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.827717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.827718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.827718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.827719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.827722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.827728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.827730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.827732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.827734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.827736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.827738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.827740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.827742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.827745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.827747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.827749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.827752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.827756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.827760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.827762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.827765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.827768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.827772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.827774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.827777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.827783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.827785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.827788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.827790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.827793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.827796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.827799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.827801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.827804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.827809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.827811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.827814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.827816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.827818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.827821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.827839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.835315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.837001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.837010Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.837011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.837013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.837016Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3386 [2:7556556064214241628:4222]
2025-10-02T09:36:52.837024Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.837033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.837035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.837036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.837037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.837046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.837049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.837053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.837086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.837091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.837092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.837095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.837097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.837139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.837144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.837150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.837155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.837163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.837177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827914:3814], now have 1 active actors on pipe
2025-10-02T09:36:52.837182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827713:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.837186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.837187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.837188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.837193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.837199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.837200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.837205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.837207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.837207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.837208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.837222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.837228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.837230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.837231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3386
2025-10-02T09:36:52.837254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3386
2025-10-02T09:36:52.837265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.837270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.837285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.837292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.837294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.837296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.837301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.837309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.837317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.837412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.837417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.837424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.837505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3387 partition: 0 MaxSeqNo: 36 sessionId: src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0
2025-10-02T09:36:52.837763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1671eef6-5e7af664-a4aba3ed-be63a664_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.840199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Write session: try to update token
2025-10-02T09:36:52.840215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:52.846474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:52.846484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.846488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.846510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:52.846513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:52.846649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:52.846768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.846891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.847030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:52.847339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:52.847362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:52.852449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId: src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:52.854755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:52.855592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.855603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.855613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:52.855614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:52.855616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:52.855617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:52.855622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.855624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.855626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214241623:4222]
2025-10-02T09:36:52.855647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:52.855649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:52.855649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:52.855651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:52.855652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.855653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:52.855757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:52.910629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556064289827950:8014]
2025-10-02T09:36:52.910841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3386, pipe: [1:7556556064289827950:8014]
2025-10-02T09:36:52.964739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:52.965007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:52.965031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827950:8014], now have 1 active actors on pipe
2025-10-02T09:36:52.965096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:52.965183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556064289827950:8014]
2025-10-02T09:36:52.965205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:52.973610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:52.973624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:52.973640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3387 reason: error at write: Disconnected sessionId: src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0
2025-10-02T09:36:52.973738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3387 sessionId: src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0 is DEAD
2025-10-02T09:36:52.973892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:52.973907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Write session will restart in 0.005266s
2025-10-02T09:36:52.973929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Write session: Do CDS request
2025-10-02T09:36:52.973934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:52.980157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.980221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:52.980230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3388
2025-10-02T09:36:52.980365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:52.980386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:52.980392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:52.980395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:52.980653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3388 sessionId:  describe result for acl check
2025-10-02T09:36:52.980670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:52.980675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:52.980675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:52.980678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:52.981030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:52.981416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:52.982994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:52.983058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:52.983139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:52.983146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:52.983152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:52.983182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:52.983207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556064214241856:4233]
2025-10-02T09:36:52.983545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:52.983714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:52.983736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:52.983908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:52.983937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.983941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.983942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.983942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.983942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.983943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.983943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.983944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.983944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.983945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.983945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.983946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.983948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.983954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.983956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.983958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.983960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.983962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.983964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.983966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.983968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.983970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.983972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.983974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.983978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.983982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:52.983985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.983988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:52.983990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.983993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:52.983995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.983998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:52.984001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.984003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:52.984005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.984007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:52.984011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.984014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:52.984015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.984018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:52.984020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.984022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:52.984024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.984027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.984029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.984032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.984035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.984038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.984054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:52.988069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:52.988078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:52.988080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556064289828148:3838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:52.988083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:52.991792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:52.993236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:52.993247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:52.993249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:52.993252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:52.993256Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3387 [2:7556556064214241856:4233]
2025-10-02T09:36:52.993264Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:52.993274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:52.993279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.993280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.993281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.993289Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:52.993292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:52.993296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:52.993327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.993331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.993332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.993334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:52.993336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:52.993369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:52.993374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:52.993381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:52.993389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:52.993400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:52.993414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289827959:2446], now have 1 active actors on pipe
2025-10-02T09:36:52.993419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556064289828186:3838], now have 1 active actors on pipe
2025-10-02T09:36:52.993423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:52.993424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:52.993425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:52.993433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:52.993443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:52.993446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:52.993449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:52.993450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:52.993454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:52.993456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:52.993449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3387
2025-10-02T09:36:52.993469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:52.993474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:52.993477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:52.993485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.993490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.993499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3387
2025-10-02T09:36:52.993513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:52.993519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:52.993521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:52.993522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:52.993527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:52.993536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:52.993550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.993654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:52.993659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:52.993666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:52.993727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3388 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0
2025-10-02T09:36:52.993951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622e20c8-c5c9edf4-24622edc-ab8479b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:52.996661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Write session: try to update token
2025-10-02T09:36:52.996671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.003139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.003151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.003152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.003153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.003158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:53.003161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:53.003163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556064214241851:4233]
2025-10-02T09:36:53.003186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.003187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.003189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.003190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.003190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.003192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.003412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.008509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId: src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.010795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.065248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584795493:8014]
2025-10-02T09:36:53.065433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3387, pipe: [1:7556556068584795493:8014]
2025-10-02T09:36:53.113658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.113931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.113941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.113966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795493:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.114121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.114123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.114130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584795493:8014]
2025-10-02T09:36:53.114149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:53.114151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:53.114194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3388 reason: error at write: Disconnected sessionId: src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0
2025-10-02T09:36:53.114326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3388 sessionId: src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0 is DEAD
2025-10-02T09:36:53.114465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:53.114478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Write session will restart in 0.009533s
2025-10-02T09:36:53.114502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Write session: Do CDS request
2025-10-02T09:36:53.114507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.125225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.125326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.125336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3389
2025-10-02T09:36:53.125457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.125480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.125487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.125490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.125785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3389 sessionId:  describe result for acl check
2025-10-02T09:36:53.125813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.125819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.125820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.125825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.126173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.127666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.127968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.129639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.129779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.129786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.129793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.129822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.129828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.129837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.129845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509209382:4224]
2025-10-02T09:36:53.129841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584795642:3842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.129844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.130186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.130368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.130393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.130574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.130602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.130606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.130607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.130607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.130608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.130609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.130609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.130609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.130610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.130611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.130611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.130612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.130614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.130620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.130622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.130624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.130626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.130628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.130630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.130632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.130634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.130636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.130638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.130640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.130643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.130647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.130654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.130656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.130659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.130661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.130664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.130667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.130670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.130672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.130675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.130679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.130682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.130684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.130687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.130689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.130694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.130696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.130698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.130700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.130702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.130718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.138452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.139918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.139928Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.139929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.139931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.139934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3388 [2:7556556068509209382:4224]
2025-10-02T09:36:53.139945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.139958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.139962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.139963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.139964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.139974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.139978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.139982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.140016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.140022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.140023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.140024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.140026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.140060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.140065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.140071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.140076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.140084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.140099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795494:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.140105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795722:3842], now have 1 active actors on pipe
2025-10-02T09:36:53.140109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.140110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.140111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.140118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.140129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.140135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.140137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.140139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.140140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.140141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.140156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.140161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.140162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.140132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3388
2025-10-02T09:36:53.140142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3388
2025-10-02T09:36:53.140178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.140184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.140201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76969506-c5c32d91-8e7a816e-a21d5608_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.140207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.140210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.140211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.140215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.140222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.140233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.140352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.140358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.140367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.140430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3389 partition: 0 MaxSeqNo: 36 sessionId: src_id|76969506-c5c32d91-8e7a816e-a21d5608_0
2025-10-02T09:36:53.140665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd45f6d4-4161a293-cfab3dd2-17c9bb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76969506-c5c32d91-8e7a816e-a21d5608_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.143450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Write session: try to update token
2025-10-02T09:36:53.143465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.149839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.149851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.149853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.149854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.149857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.149860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.149863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509209377:4224]
2025-10-02T09:36:53.149883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.149886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.149888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.149888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.149891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.149895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.150002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.155587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId: src_id|76969506-c5c32d91-8e7a816e-a21d5608_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.157879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.214248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584795734:8014]
2025-10-02T09:36:53.214423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3388, pipe: [1:7556556068584795734:8014]
2025-10-02T09:36:53.260617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.261079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.261101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.261119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795734:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.261309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:53.261317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:53.261327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584795734:8014]
2025-10-02T09:36:53.261343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.261365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3389 reason: error at write: Disconnected sessionId: src_id|76969506-c5c32d91-8e7a816e-a21d5608_0
2025-10-02T09:36:53.261443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.261506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3389 sessionId: src_id|76969506-c5c32d91-8e7a816e-a21d5608_0 is DEAD
2025-10-02T09:36:53.261626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:53.261635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Write session will restart in 0.007067s
2025-10-02T09:36:53.261649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Write session: Do CDS request
2025-10-02T09:36:53.261654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.270085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.270231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.270240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3390
2025-10-02T09:36:53.270341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.270362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.270368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.270370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.270653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3390 sessionId:  describe result for acl check
2025-10-02T09:36:53.270686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.270690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.270692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.270695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.271040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.272951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.275148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.275156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.275158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584795818:3875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.275161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.275269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.277050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.277169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.277176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.277182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.277210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.277235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509209628:4236]
2025-10-02T09:36:53.277569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.277741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.277763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.277936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.277964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.277968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.277968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.277969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.277970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.277970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.277971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.277971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.277972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.277973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.277973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.277974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.277976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.277982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.277984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.277986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.277988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.277990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.277992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.277994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.277996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.277999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.278001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.278003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.278007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.278013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.278018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.278022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.278025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.278030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.278033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.278037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.278041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.278045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.278047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.278049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.278052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.278055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.278057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.278059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.278062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.278064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.278071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.278074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.278076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.278079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.278081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.278084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.278103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.285805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.287297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.287307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.287308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.287310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.287313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3389 [2:7556556068509209628:4236]
2025-10-02T09:36:53.287320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.287330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.287335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.287337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.287338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.287347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.287350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.287354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.287390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.287396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.287396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.287398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.287399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.287433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.287438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.287444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.287449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.287457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.287468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.287473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.287474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.287479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.287486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.287488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.287490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.287491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.287496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.287498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.287505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795962:3875], now have 1 active actors on pipe
2025-10-02T09:36:53.287509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795735:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.287520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.287528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.287532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.287530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3389
2025-10-02T09:36:53.287533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3389
2025-10-02T09:36:53.287569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.287575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.287590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.287597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.287600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.287601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.287606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.287614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.287623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.287744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.287750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.287758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.287809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3390 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0
2025-10-02T09:36:53.288016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76969506-c5c32d91-8e7a816e-a21d5608_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.290761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Write session: try to update token
2025-10-02T09:36:53.290770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.297174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.297186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.297187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.297188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.297193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.297196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.297198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509209622:4236]
2025-10-02T09:36:53.297220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.297223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.297224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.297227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.297231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.297233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.297381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.302226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId: src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.304356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.361860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584795989:8014]
2025-10-02T09:36:53.362010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3389, pipe: [1:7556556068584795989:8014]
2025-10-02T09:36:53.406660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.406907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.406916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.406940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795989:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.407084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.407134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:53.407206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0
2025-10-02T09:36:53.407303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584795989:8014]
2025-10-02T09:36:53.407330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3390 sessionId: src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0 is DEAD
2025-10-02T09:36:53.407334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.407458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:53.407467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Write session will restart in 0.007384s
2025-10-02T09:36:53.407483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Write session: Do CDS request
2025-10-02T09:36:53.407488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.416164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.416264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.416270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3391
2025-10-02T09:36:53.416385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.416406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.416414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.416416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.416702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3391 sessionId:  describe result for acl check
2025-10-02T09:36:53.416724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.416729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.416730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.416733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.417080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.419788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.421487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.421497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.421499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584796080:3913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.421507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.423607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.423962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.424094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.424104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.424112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.424141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.424172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509209874:4279]
2025-10-02T09:36:53.424618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.424833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.424872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.425129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.425169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.425175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.425176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.425176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.425177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.425178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.425178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.425179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.425180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.425181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.425181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.425182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.425185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.425193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.425196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.425198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.425201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.425203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.425206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.425209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.425211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.425214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.425216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.425219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.425224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.425229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.425233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.425237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.425240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.425243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.425246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.425251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.425253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.425268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.425271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.425274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.425277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.425280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.425283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.425286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.425296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.425300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.425308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.425311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.425314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.425317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.425320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.425323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.425342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.433318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.434772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.434784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.434785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.434787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.434791Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3390 [2:7556556068509209874:4279]
2025-10-02T09:36:53.434798Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.434809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.434812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.434814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.434815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.434824Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.434827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.434831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.434866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.434872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.434873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.434875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.434876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.434916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.434921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.434927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.434933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.434941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.434966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3390
2025-10-02T09:36:53.434958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584795990:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.434984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3390
2025-10-02T09:36:53.434965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796217:3913], now have 1 active actors on pipe
2025-10-02T09:36:53.434969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.434971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.434972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.434981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.434987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.434988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.434989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.434991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.434996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.434997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.435031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.435036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.435041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.435045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.435046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.435245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61d99361-6039bde2-7db19781-20a0bf33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.435260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.435263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.435264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.435272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.435285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.435307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.435416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.435421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.435431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.435484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3391 partition: 0 MaxSeqNo: 36 sessionId: src_id|61d99361-6039bde2-7db19781-20a0bf33_0
2025-10-02T09:36:53.435754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b790e9-3d34baaf-33a722cf-dfd065c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61d99361-6039bde2-7db19781-20a0bf33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.438353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Write session: try to update token
2025-10-02T09:36:53.438367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.444531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.444542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.444543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.444544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.444548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.444550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.444552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509209869:4279]
2025-10-02T09:36:53.444571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.444573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.444574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.444576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.444580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.444582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.444689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.450418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId: src_id|61d99361-6039bde2-7db19781-20a0bf33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.452796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.507734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584796252:8014]
2025-10-02T09:36:53.507917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3390, pipe: [1:7556556068584796252:8014]
2025-10-02T09:36:53.554813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.555216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.555226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.555238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796252:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.555362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.555423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.555470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584796252:8014]
2025-10-02T09:36:53.555490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:53.555552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61d99361-6039bde2-7db19781-20a0bf33_0
2025-10-02T09:36:53.555694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3391 sessionId: src_id|61d99361-6039bde2-7db19781-20a0bf33_0 is DEAD
2025-10-02T09:36:53.555850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:53.555865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Write session will restart in 0.006501s
2025-10-02T09:36:53.555893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Write session: Do CDS request
2025-10-02T09:36:53.555898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.563161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.563263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.563274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3392
2025-10-02T09:36:53.563389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.563410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.563416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.563418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.563721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3392 sessionId:  describe result for acl check
2025-10-02T09:36:53.563748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.563752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.563753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.563757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.564106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.566344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.568771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.568779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.568781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584796311:3957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.568784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.569630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.571346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.571457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.571463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.571470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.571497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.571523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509210130:4267]
2025-10-02T09:36:53.571871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.572065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.572087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.572262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.572292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.572296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.572297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.572297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.572298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.572298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.572299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.572300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.572300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.572301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.572301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.572302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.572304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.572310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.572312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.572314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.572316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.572318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.572320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.572322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.572324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.572327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.572329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.572331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.572334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.572338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.572342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.572345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.572348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.572350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.572352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.572355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.572357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.572360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.572362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.572364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.572367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.572369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.572371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.572373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.572375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.572378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.572380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.572383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.572385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.572391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.572393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.572395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.572411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.580138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.581633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.581645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.581646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.581648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.581652Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3391 [2:7556556068509210130:4267]
2025-10-02T09:36:53.581659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.581670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.581675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.581676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.581677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.581686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.581689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.581693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.581723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.581728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.581729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.581732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.581733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.581772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.581777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.581783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.581788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.581796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.581811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796254:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.581817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796481:3957], now have 1 active actors on pipe
2025-10-02T09:36:53.581821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.581822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.581823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.581830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.581840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.581844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.581846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.581848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.581851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.581852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.581866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.581872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.581873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.581849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3391
2025-10-02T09:36:53.581855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3391
2025-10-02T09:36:53.581889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.581897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.581914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|848f48b1-55b66ce7-6cce70fd-33228772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.581918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.581921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.581922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.581926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.581931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.581940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.582043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.582049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.582056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.582110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3392 partition: 0 MaxSeqNo: 36 sessionId: src_id|848f48b1-55b66ce7-6cce70fd-33228772_0
2025-10-02T09:36:53.582337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d99361-6039bde2-7db19781-20a0bf33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|848f48b1-55b66ce7-6cce70fd-33228772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.584693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Write session: try to update token
2025-10-02T09:36:53.584707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.591088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.591100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.591102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.591103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.591109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.591112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.591114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509210125:4267]
2025-10-02T09:36:53.591138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.591139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.591140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.591142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.591142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.591144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.591265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.597095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId: src_id|848f48b1-55b66ce7-6cce70fd-33228772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.599384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.655593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584796495:8014]
2025-10-02T09:36:53.655779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3391, pipe: [1:7556556068584796495:8014]
2025-10-02T09:36:53.699559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.699932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.699941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.699953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796495:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.700119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:53.700127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.700129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:53.700157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584796495:8014]
2025-10-02T09:36:53.700178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3392 reason: error at write: Disconnected sessionId: src_id|848f48b1-55b66ce7-6cce70fd-33228772_0
2025-10-02T09:36:53.700091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.700316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3392 sessionId: src_id|848f48b1-55b66ce7-6cce70fd-33228772_0 is DEAD
2025-10-02T09:36:53.700457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:53.700472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Write session will restart in 0.008480s
2025-10-02T09:36:53.700494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Write session: Do CDS request
2025-10-02T09:36:53.700499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.710151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.710279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.710291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3393
2025-10-02T09:36:53.710525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.710547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.710554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.710557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.710874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3393 sessionId:  describe result for acl check
2025-10-02T09:36:53.710899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.710903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.710904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.710907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.711254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.713437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.714490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.716187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.716290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.716297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.716304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.716332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.716354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509210363:4273]
2025-10-02T09:36:53.716411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.716417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.716419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584796608:3975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.716423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.716732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.716934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.716960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.717148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.717178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.717182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.717182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.717183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.717183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.717184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.717184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.717185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.717186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.717186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.717187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.717187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.717190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.717195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.717198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.717200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.717202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.717204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.717206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.717208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.717210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.717212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.717214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.717216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.717221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.717227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.717232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.717236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.717240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.717245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.717248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.717250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.717252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.717255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.717261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.717263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.717266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.717268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.717270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.717273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.717275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.717279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.717283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.717285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.717287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.717290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.717292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.717296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.717313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.724739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.726429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.726441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.726443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.726445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.726450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3392 [2:7556556068509210363:4273]
2025-10-02T09:36:53.726460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.726478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.726484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.726486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.726487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.726496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.726499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.726504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.726536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.726541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.726542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.726544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.726545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.726581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.726586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.726593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.726598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.726606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.726621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796497:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.726627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796728:3975], now have 1 active actors on pipe
2025-10-02T09:36:53.726630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.726631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.726633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.726641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.726651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.726654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.726656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.726657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.726662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.726663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.726678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.726666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3392
2025-10-02T09:36:53.726683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.726671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3392
2025-10-02T09:36:53.726690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.726701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.726708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.726730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|101b84ed-f8281be9-1c02fe35-181702b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.726737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.726739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.726741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.726745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.726750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.726764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.726886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.726892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.726899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.726957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3393 partition: 0 MaxSeqNo: 36 sessionId: src_id|101b84ed-f8281be9-1c02fe35-181702b4_0
2025-10-02T09:36:53.727201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848f48b1-55b66ce7-6cce70fd-33228772_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|101b84ed-f8281be9-1c02fe35-181702b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.729479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Write session: try to update token
2025-10-02T09:36:53.729496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.735848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.735859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.735860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.735861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.735864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.735866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.735867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509210358:4273]
2025-10-02T09:36:53.735887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.735890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.735890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.735891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.735893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.735895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.736007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.742351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId: src_id|101b84ed-f8281be9-1c02fe35-181702b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.744640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.800471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584796739:8014]
2025-10-02T09:36:53.800608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3392, pipe: [1:7556556068584796739:8014]
2025-10-02T09:36:53.845905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.846134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.846143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.846156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796739:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.846274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584796739:8014]
2025-10-02T09:36:53.846294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:53.846296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:53.846311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.846298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.846339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3393 reason: error at write: Disconnected sessionId: src_id|101b84ed-f8281be9-1c02fe35-181702b4_0
2025-10-02T09:36:53.846456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3393 sessionId: src_id|101b84ed-f8281be9-1c02fe35-181702b4_0 is DEAD
2025-10-02T09:36:53.846555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:53.846568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Write session will restart in 0.007336s
2025-10-02T09:36:53.846592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Write session: Do CDS request
2025-10-02T09:36:53.846597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:53.855170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.855265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:53.855273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3394
2025-10-02T09:36:53.855374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:53.855392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:53.855397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:53.855399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:53.855726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3394 sessionId:  describe result for acl check
2025-10-02T09:36:53.855751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:53.855752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:53.855753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:53.855756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:53.856112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:53.858170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:53.860254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:53.860262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:53.860264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556068584796829:3988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:53.860268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:53.860422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:53.862134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:53.862233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:53.862239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:53.862245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:53.862270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:53.862293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556068509210599:4280]
2025-10-02T09:36:53.862653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:53.862838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:53.862861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:53.863049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:53.863083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.863089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.863089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.863090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.863091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.863091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.863092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.863092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.863093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.863093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.863094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.863094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.863097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.863102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.863104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.863106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.863108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.863110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.863112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.863114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.863118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.863120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.863122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.863126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.863129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:53.863132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.863135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:53.863137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.863140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:53.863144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.863148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:53.863152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.863157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:53.863160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.863164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:53.863168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.863173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:53.863177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.863181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:53.863183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.863186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:53.863188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.863191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.863194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.863197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.863199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.863202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.863220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:53.870887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:53.872249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:53.872261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:53.872263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:53.872265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:53.872267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3393 [2:7556556068509210599:4280]
2025-10-02T09:36:53.872273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:53.872283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:53.872288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.872289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.872290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.872298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:53.872301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:53.872305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:53.872336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.872340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.872341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.872343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:53.872344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:53.872389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:53.872396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.872405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:53.872414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:53.872425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:53.872440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796972:3988], now have 1 active actors on pipe
2025-10-02T09:36:53.872445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796741:2446], now have 1 active actors on pipe
2025-10-02T09:36:53.872448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.872449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.872450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.872445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3393
2025-10-02T09:36:53.872444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3393
2025-10-02T09:36:53.872459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:53.872464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:53.872466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:53.872467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:53.872469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:53.872476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:53.872480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:53.872502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.872507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.872514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.872521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:53.872530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:53.872540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:53.872547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:53.872549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:53.872550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:53.872555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:53.872563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:53.872577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.872667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.872674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.872683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:53.872730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3394 partition: 0 MaxSeqNo: 36 sessionId: src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0
2025-10-02T09:36:53.872975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|101b84ed-f8281be9-1c02fe35-181702b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:53.875385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Write session: try to update token
2025-10-02T09:36:53.875399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:53.881994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:53.882004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:53.882005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:53.882006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:53.882010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.882011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.882014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556068509210594:4280]
2025-10-02T09:36:53.882032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:53.882035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:53.882036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:53.882036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:53.882038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:53.882040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:53.882147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:53.887476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId: src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:53.889739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:53.946386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556068584796989:8014]
2025-10-02T09:36:53.946527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3393, pipe: [1:7556556068584796989:8014]
2025-10-02T09:36:53.993826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:53.994392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:53.994401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:53.994426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796989:8014], now have 1 active actors on pipe
2025-10-02T09:36:53.994593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:53.994639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556068584796989:8014]
2025-10-02T09:36:53.994646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:53.994667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:53.994723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0
2025-10-02T09:36:53.994848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3394 sessionId: src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0 is DEAD
2025-10-02T09:36:53.995004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:53.995018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Write session will restart in 0.007933s
2025-10-02T09:36:53.995046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Write session: Do CDS request
2025-10-02T09:36:53.995052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.004192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.004279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.004287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3395
2025-10-02T09:36:54.004411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.004431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.004438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.004440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.004896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3395 sessionId:  describe result for acl check
2025-10-02T09:36:54.004921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.004926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.004926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.004929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.005267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.007539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.009386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.011267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.011360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.011362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.011367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.011369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.011375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.011371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879764385:4014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.011375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.011407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.011432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804178129:4283]
2025-10-02T09:36:54.011779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.011965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.011992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.012189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.012221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.012225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.012226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.012226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.012227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.012227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.012228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.012228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.012229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.012229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.012230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.012230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.012233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.012239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.012241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.012243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.012245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.012247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.012249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.012251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.012253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.012255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.012257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.012259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.012263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.012267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.012270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.012273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.012275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.012278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.012279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.012282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.012286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.012288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.012290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.012293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.012295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.012297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.012299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.012302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.012304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.012306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.012308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.012311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.012313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.012315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.012317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.012320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.012337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.019742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.021304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.021316Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.021317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.021319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.021322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3394 [2:7556556072804178129:4283]
2025-10-02T09:36:54.021328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.021338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.021339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.021340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.021341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.021349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.021354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.021364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.021403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.021408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.021409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.021411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.021412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.021450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.021454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.021461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.021466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.021474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.021485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556068584796990:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.021490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764522:4014], now have 1 active actors on pipe
2025-10-02T09:36:54.021494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.021495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.021497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.021504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.021514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.021518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.021520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.021521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.021524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.021525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.021516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3394
2025-10-02T09:36:54.021521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3394
2025-10-02T09:36:54.021539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.021544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.021546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.021555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.021560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.021585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.021592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.021594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.021595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.021600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.021606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.021621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.021745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.021754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.021763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.021823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3395 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0
2025-10-02T09:36:54.022047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|362bfe89-a4ce8567-3abe43f-5e98839e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.024337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Write session: try to update token
2025-10-02T09:36:54.024351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.030773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.030785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.030787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.030788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.030792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.030794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.030797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804178124:4283]
2025-10-02T09:36:54.030815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.030821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.030823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.030822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.030825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.030827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.030942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.036395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId: src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.038564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.094881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879764534:8014]
2025-10-02T09:36:54.095087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3394, pipe: [1:7556556072879764534:8014]
2025-10-02T09:36:54.140334Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.140823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.140833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.140846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764534:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.140993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.141002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.141026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879764534:8014]
2025-10-02T09:36:54.141028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:54.141030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:54.141071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3395 reason: error at write: Disconnected sessionId: src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0
2025-10-02T09:36:54.141193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3395 sessionId: src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0 is DEAD
2025-10-02T09:36:54.141291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:54.141305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Write session will restart in 0.007765s
2025-10-02T09:36:54.141331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Write session: Do CDS request
2025-10-02T09:36:54.141336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.150173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.150265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.150272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3396
2025-10-02T09:36:54.150376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.150395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.150401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.150404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.150665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3396 sessionId:  describe result for acl check
2025-10-02T09:36:54.150689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.150693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.150694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.150696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.151051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.153276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.155196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.155251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.155259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.155261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879764627:4024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.155264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.156768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.156880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.156886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.156892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.156919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.156941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804178369:4275]
2025-10-02T09:36:54.157295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.157502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.157528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.157720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.157752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.157756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.157757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.157758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.157758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.157759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.157760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.157760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.157761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.157761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.157762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.157762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.157765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.157771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.157773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.157775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.157777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.157779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.157781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.157783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.157785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.157787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.157789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.157791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.157795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.157801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.157806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.157810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.157814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.157823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.157830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.157833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.157835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.157839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.157842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.157844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.157850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.157853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.157856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.157858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.157860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.157864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.157871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.157873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.157876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.157881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.157884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.157901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.165591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.167255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.167266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.167267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.167269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.167272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3395 [2:7556556072804178369:4275]
2025-10-02T09:36:54.167284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.167300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.167306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.167308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.167309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.167317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.167320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.167324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.167355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.167360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.167361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.167363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.167364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.167400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.167404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.167411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.167416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.167427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.167441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764535:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.167447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764769:4024], now have 1 active actors on pipe
2025-10-02T09:36:54.167450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.167452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.167453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.167461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.167471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.167474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.167476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.167477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.167478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.167480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.167474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3395
2025-10-02T09:36:54.167484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3395
2025-10-02T09:36:54.167494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.167500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.167501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.167511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.167515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.167546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.167555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.167558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.167561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.167566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.167571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.167584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.167681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.167688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.167697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.167751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3396 partition: 0 MaxSeqNo: 36 sessionId: src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0
2025-10-02T09:36:54.168004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d7c863-307a9107-4d494116-fdd8ff4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.170384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Write session: try to update token
2025-10-02T09:36:54.170398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.176605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.176615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.176617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.176618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.176621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.176623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.176625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804178363:4275]
2025-10-02T09:36:54.176646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.176647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.176648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.176648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.176649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.176650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.176841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.182504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId: src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.184654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.241320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879764781:8014]
2025-10-02T09:36:54.241497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3395, pipe: [1:7556556072879764781:8014]
2025-10-02T09:36:54.287012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.287368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.287377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.287390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764781:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.287531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.287550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879764781:8014]
2025-10-02T09:36:54.287569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:54.287575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.287620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0
2025-10-02T09:36:54.287750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3396 sessionId: src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0 is DEAD
2025-10-02T09:36:54.287886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:54.287902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Write session will restart in 0.009956s
2025-10-02T09:36:54.287922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Write session: Do CDS request
2025-10-02T09:36:54.287927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.299163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.299313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.299323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3397
2025-10-02T09:36:54.299441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.299460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.299466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.299468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.299771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3397 sessionId:  describe result for acl check
2025-10-02T09:36:54.299795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.299799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.299800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.299804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.300146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.301448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.301642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.303403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.303508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.303514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.303521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.303548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.303572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804178618:4314]
2025-10-02T09:36:54.303610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.303617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.303619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879764953:4051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.303621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.303918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.304105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.304127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.304313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.304345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.304349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.304350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.304350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.304351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.304351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.304352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.304352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.304353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.304353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.304354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.304354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.304357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.304363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.304365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.304367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.304369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.304371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.304373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.304374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.304376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.304378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.304380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.304382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.304385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.304389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.304395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.304399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.304401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.304403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.304406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.304409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.304411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.304413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.304417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.304419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.304421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.304423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.304425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.304427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.304430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.304432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.304434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.304437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.304439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.304441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.304443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.304459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.311850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.313345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.313357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.313358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.313360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.313364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3396 [2:7556556072804178618:4314]
2025-10-02T09:36:54.313371Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.313381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.313384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.313385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.313386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.313394Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.313399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.313403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.313430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.313434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.313436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.313437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.313439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.313482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.313487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.313493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.313499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.313511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.313522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765017:4051], now have 1 active actors on pipe
2025-10-02T09:36:54.313527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879764782:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.313530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.313531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.313532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.313539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.313550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.313553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.313555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.313547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3396
2025-10-02T09:36:54.313556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3396
2025-10-02T09:36:54.313556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.313561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.313562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.313574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.313578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.313579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.313591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.313595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.313614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.313621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.313623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.313624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.313630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.313637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.313648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.313745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.313752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.313761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.313821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3397 partition: 0 MaxSeqNo: 36 sessionId: src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0
2025-10-02T09:36:54.314078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a8fe1-b1bdfd26-e71d9ecc-6e5319c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.316326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Write session: try to update token
2025-10-02T09:36:54.316339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.322720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.322733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.322734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.322735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.322738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.322740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.322742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804178613:4314]
2025-10-02T09:36:54.322762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.322764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.322765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.322766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.322769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.322771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.322868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.328535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId: src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.330674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.387739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879765043:8014]
2025-10-02T09:36:54.387909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3396, pipe: [1:7556556072879765043:8014]
2025-10-02T09:36:54.433506Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.434026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.434039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.434054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765043:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.434200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.434216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:54.434225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:54.434239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.434268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879765043:8014]
2025-10-02T09:36:54.434270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3397 reason: error at write: Disconnected sessionId: src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0
2025-10-02T09:36:54.434400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3397 sessionId: src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0 is DEAD
2025-10-02T09:36:54.434532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:54.434541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Write session will restart in 0.009171s
2025-10-02T09:36:54.434561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Write session: Do CDS request
2025-10-02T09:36:54.434566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.445252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.445346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.445354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3398
2025-10-02T09:36:54.445474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.445492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.445498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.445501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.445757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3398 sessionId:  describe result for acl check
2025-10-02T09:36:54.445780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.445785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.445786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.445789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.446106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.447900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.450576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.450705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.450713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.450714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879765183:4079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.450718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.450877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.451149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.451159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.451167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.451203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.451235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804178873:4309]
2025-10-02T09:36:54.451668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.451863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.451890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.452116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.452153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.452160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.452160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.452161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.452162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.452162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.452163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.452164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.452164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.452165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.452165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.452166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.452169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.452177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.452180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.452182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.452185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.452188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.452190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.452192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.452195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.452198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.452200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.452202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.452207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.452212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.452217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.452222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.452224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.452228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.452231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.452234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.452237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.452240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.452243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.452247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.452251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.452255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.452257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.452261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.452264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.452269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.452283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.452292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.452295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.452298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.452301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.452305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.452324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.460119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.461854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.461868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.461869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.461872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.461877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3397 [2:7556556072804178873:4309]
2025-10-02T09:36:54.461886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.461898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.461901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.461903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.461904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.461915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.461925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.461930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.461970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.461977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.461978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.461980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.461982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.462029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.462036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.462044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.462050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.462061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.462081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765280:4079], now have 1 active actors on pipe
2025-10-02T09:36:54.462089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765044:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.462094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.462095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.462099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.462112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.462109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3397
2025-10-02T09:36:54.462125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.462110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3397
2025-10-02T09:36:54.462126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.462129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.462130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.462139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.462141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.462177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.462185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.462196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.462207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.462219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.462233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.462243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.462245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.462247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.462254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.462265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.462279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.462410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.462421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.462440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.462518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3398 partition: 0 MaxSeqNo: 36 sessionId: src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0
2025-10-02T09:36:54.462742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e5a6b3-ca9ef116-38857bf-1a2b20c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.465041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Write session: try to update token
2025-10-02T09:36:54.465056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.471314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.471326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.471327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.471328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.471332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.471334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.471336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804178867:4309]
2025-10-02T09:36:54.471360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.471360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.471363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.471364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.471364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.471365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.471480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.477720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId: src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.479906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.534169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879765314:8014]
2025-10-02T09:36:54.534346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3397, pipe: [1:7556556072879765314:8014]
2025-10-02T09:36:54.581499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.582023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.582032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.582044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765314:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.582179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.582238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:54.582249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:54.582254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.582287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879765314:8014]
2025-10-02T09:36:54.582293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3398 reason: error at write: Disconnected sessionId: src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0
2025-10-02T09:36:54.582430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3398 sessionId: src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0 is DEAD
2025-10-02T09:36:54.582591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:54.582605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Write session will restart in 0.008167s
2025-10-02T09:36:54.582625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Write session: Do CDS request
2025-10-02T09:36:54.582630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.592159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.592202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.592211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3399
2025-10-02T09:36:54.592302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.592323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.592329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.592332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.592620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3399 sessionId:  describe result for acl check
2025-10-02T09:36:54.592654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.592659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.592660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.592663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.593009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.595178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.597032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.597041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.597043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879765408:4101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.597047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.597144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.598824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.598929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.598935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.598942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.598972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.598995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804179135:4340]
2025-10-02T09:36:54.599357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.599559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.599586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.599784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.599815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.599819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.599820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.599820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.599821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.599821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.599822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.599822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.599823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.599823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.599824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.599825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.599828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.599834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.599836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.599838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.599840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.599842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.599844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.599846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.599848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.599850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.599852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.599854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.599859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.599863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.599866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.599869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.599871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.599874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.599875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.599878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.599880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.599883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.599885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.599887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.599889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.599894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.599897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.599906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.599909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.599916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.599921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.599923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.599926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.599929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.599931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.599933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.599953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.607358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.608835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.608844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.608845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.608847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.608851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3398 [2:7556556072804179135:4340]
2025-10-02T09:36:54.608858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.608868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.608869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.608871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.608872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.608883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.608891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.608897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.608929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.608934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.608935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.608937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.608938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.608975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.608979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.608986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.608991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.609002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.609016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765315:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.609022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765551:4101], now have 1 active actors on pipe
2025-10-02T09:36:54.609025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.609027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.609027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.609035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.609044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.609047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.609049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.609051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.609055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.609056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.609069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.609077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.609085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.609074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3398
2025-10-02T09:36:54.609110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.609116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.609112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3398
2025-10-02T09:36:54.609134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.609143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.609149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.609150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.609157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.609165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.609177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.609279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.609286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.609295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.609352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3399 partition: 0 MaxSeqNo: 36 sessionId: src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0
2025-10-02T09:36:54.609569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af110cc-908daf85-ecdbfbab-a03007a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.611841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Write session: try to update token
2025-10-02T09:36:54.611857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.618104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.618113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.618114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.618116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.618118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.618120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.618122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804179129:4340]
2025-10-02T09:36:54.618141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.618144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.618145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.618145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.618147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.618149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.618261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.624053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId: src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.626175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.682645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879765564:8014]
2025-10-02T09:36:54.682773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3398, pipe: [1:7556556072879765564:8014]
2025-10-02T09:36:54.727627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.727834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.727843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.727856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765564:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.727982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.728006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879765564:8014]
2025-10-02T09:36:54.728027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.728119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:54.728176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0
2025-10-02T09:36:54.728312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3399 sessionId: src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0 is DEAD
2025-10-02T09:36:54.728472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:54.728486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Write session will restart in 0.006485s
2025-10-02T09:36:54.728526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Write session: Do CDS request
2025-10-02T09:36:54.728531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.736130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.736206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.736214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3400
2025-10-02T09:36:54.736289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.736308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.736314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.736316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.736563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3400 sessionId:  describe result for acl check
2025-10-02T09:36:54.736585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.736589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.736590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.736593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.736942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.738916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.741213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.741221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.741223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879765637:4125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.741226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.742145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.743972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.744079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.744086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.744092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.744118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.744140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804179376:4343]
2025-10-02T09:36:54.744481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.744667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.744691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.744877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.744909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.744913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.744914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.744914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.744915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.744915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.744916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.744916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.744918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.744918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.744921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.744928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.744930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.744932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.744934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.744936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.744938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.744940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.744942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.744944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.744946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.744948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.744952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.744956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.744959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.744962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.744964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.744966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.744968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.744971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.744975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.744978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.744980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.744982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.744985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.744987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.744989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.744992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.744998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.745001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.745003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.745005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.745008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.745010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.745012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.745015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.745034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.752523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.754208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.754218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.754219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.754221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.754226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3399 [2:7556556072804179376:4343]
2025-10-02T09:36:54.754233Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.754244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.754245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.754247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.754248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.754258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.754264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.754269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.754299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.754303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.754304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.754306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.754308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.754347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.754352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.754361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.754370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.754388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.754407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765565:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.754414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765800:4125], now have 1 active actors on pipe
2025-10-02T09:36:54.754420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.754422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.754423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.754435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.754447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.754449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.754426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3399
2025-10-02T09:36:54.754454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.754441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3399
2025-10-02T09:36:54.754455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.754457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.754458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.754478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.754481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.754492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.754493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.754495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.754517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|908253bc-e34175bc-83970f06-17f51532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.754524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.754526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.754528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.754533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.754538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.754551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.754650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.754654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.754662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.754729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3400 partition: 0 MaxSeqNo: 36 sessionId: src_id|908253bc-e34175bc-83970f06-17f51532_0
2025-10-02T09:36:54.754992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e4c753-4a9ebcb5-1f272daf-9981f521_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|908253bc-e34175bc-83970f06-17f51532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.757807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Write session: try to update token
2025-10-02T09:36:54.757819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.763917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.763929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.763931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.763932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.763936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.763939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.763942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804179371:4343]
2025-10-02T09:36:54.763964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.763967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.763969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.763976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.763983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.763984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.764153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.769506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId: src_id|908253bc-e34175bc-83970f06-17f51532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.771683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.828072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879765814:8014]
2025-10-02T09:36:54.828239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3399, pipe: [1:7556556072879765814:8014]
2025-10-02T09:36:54.873746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:54.874123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.874133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.874145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765814:8014], now have 1 active actors on pipe
2025-10-02T09:36:54.874291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:54.874301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:54.874335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:54.874335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879765814:8014]
2025-10-02T09:36:54.874389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3400 reason: status is not ok: tablet will be restarted right now sessionId: src_id|908253bc-e34175bc-83970f06-17f51532_0
2025-10-02T09:36:54.874511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3400 sessionId: src_id|908253bc-e34175bc-83970f06-17f51532_0 is DEAD
2025-10-02T09:36:54.874642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:54.874649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Write session will restart in 0.008304s
2025-10-02T09:36:54.874683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Write session: Do CDS request
2025-10-02T09:36:54.874687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:54.884162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.884219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:54.884229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3401
2025-10-02T09:36:54.884309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:54.884329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:54.884335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:54.884338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:54.884623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3401 sessionId:  describe result for acl check
2025-10-02T09:36:54.884649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:54.884653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:54.884655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:54.884659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:54.885035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:54.886751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:54.888477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:54.890995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:54.891087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:54.891103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:54.891095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:54.891110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:54.891097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556072879765927:4144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:54.891115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:54.891100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:54.891143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:54.891164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556072804179617:4361]
2025-10-02T09:36:54.891523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:54.891720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:54.891753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:54.891935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:54.891963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.891967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.891968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.891968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.891969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.891969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.891971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.891971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.891971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.891972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.891972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.891973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.891976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.891981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.891984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.891986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.891989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.891993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.891997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.892000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.892003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.892007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.892010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.892014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.892021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.892024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:54.892029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.892032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:54.892034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.892037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:54.892039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.892041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:54.892043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.892046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:54.892048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.892050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:54.892054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.892057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:54.892060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.892063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:54.892065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.892069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:54.892071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.892074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.892076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.892079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.892081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.892087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.892103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:54.899466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:54.901058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:54.901067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:54.901068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:54.901070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:54.901073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3400 [2:7556556072804179617:4361]
2025-10-02T09:36:54.901081Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:54.901089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:54.901094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.901096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.901097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.901105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:54.901109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:54.901113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:54.901143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.901147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.901148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.901150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:54.901151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:54.901186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:54.901191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.901197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:54.901203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:54.901220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:54.901237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879765816:2446], now have 1 active actors on pipe
2025-10-02T09:36:54.901243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879766055:4144], now have 1 active actors on pipe
2025-10-02T09:36:54.901246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.901247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.901248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.901257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:54.901268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:54.901258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3400
2025-10-02T09:36:54.901270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:54.901264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3400
2025-10-02T09:36:54.901274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:54.901276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:54.901277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:54.901279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:54.901289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.901291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:54.901292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:54.901343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.901354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.901371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:54.901379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:54.901381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:54.901385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:54.901391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:54.901396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:54.901405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.901536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:54.901543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:54.901552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:54.901611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3401 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0
2025-10-02T09:36:54.901798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908253bc-e34175bc-83970f06-17f51532_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:54.904554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Write session: try to update token
2025-10-02T09:36:54.904563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:54.910413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:54.910424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:54.910425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:54.910427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:54.910432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.910436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.910439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556072804179612:4361]
2025-10-02T09:36:54.910465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:54.910468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:54.910470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:54.910473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:54.910476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:54.910479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:54.910586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:54.916049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId: src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:54.918044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:54.974490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556072879766071:8014]
2025-10-02T09:36:54.974646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3400, pipe: [1:7556556072879766071:8014]
2025-10-02T09:36:55.019200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.019541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.019549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.019561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556072879766071:8014], now have 1 active actors on pipe
2025-10-02T09:36:55.019675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.019683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.019707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.019712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.019713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556072879766071:8014]
2025-10-02T09:36:55.019723Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:36:55.019755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3401 reason: error at write: Disconnected sessionId: src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0
2025-10-02T09:36:55.019803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3401 sessionId: src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0 is DEAD
2025-10-02T09:36:55.019874Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 34 consumer shared/user session shared/user_1_34_8835201686720473460_v1 is DEAD
2025-10-02T09:36:55.019955Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556012750203147:7996] disconnected; active server actors: 1
2025-10-02T09:36:55.019962Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556012750203147:7996] client user disconnected session shared/user_1_34_8835201686720473460_v1
2025-10-02T09:36:55.019989Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:36:55.020074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.020080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Write session will restart in 0.007635s
2025-10-02T09:36:55.020095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Write session: Do CDS request
2025-10-02T09:36:55.020099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.020102Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:55.020106Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:36:55.020112Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006396s
2025-10-02T09:36:55.027065Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:36:55.027216Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:36:55.027222Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 35
2025-10-02T09:36:55.027334Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 35 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:55.027366Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:36:55.027429Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 auth for : user
2025-10-02T09:36:55.027591Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 Handle describe topics response
2025-10-02T09:36:55.027609Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 auth is DEAD
2025-10-02T09:36:55.027611Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:36:55.027756Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:36:55.027818Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_35_15119197923035340636_v1
2025-10-02T09:36:55.027905Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556077174733429:4160] connected; active server actors: 1
2025-10-02T09:36:55.027915Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556077174733429:4160] session shared/user_1_35_15119197923035340636_v1
2025-10-02T09:36:55.027924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:36:55.027932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:36:55.027939Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_35_15119197923035340636_v1" (Sender=[1:7556556077174733417:4160], Pipe=[1:7556556077174733429:4160], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:55.027941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:36:55.027948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:36:55.027956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_35_15119197923035340636_v1" (Sender=[1:7556556077174733417:4160], Pipe=[1:7556556077174733429:4160], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:36:55.027963Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_35_15119197923035340636_v1" sender [1:7556556077174733417:4160] lock partition 0 for ReadingSession "shared/user_1_35_15119197923035340636_v1" (Sender=[1:7556556077174733417:4160], Pipe=[1:7556556077174733429:4160], Partitions=[], ActiveFamilyCount=1) generation 1 step 35
2025-10-02T09:36:55.027971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:36:55.027977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000024s
2025-10-02T09:36:55.028164Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 35 Session: "shared/user_1_35_15119197923035340636_v1" ClientId: "user" PipeClient { RawX1: 7556556077174733429 RawX2: 4503603922341952 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:36:55.028181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:36:55.029198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.029266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.029271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3402
2025-10-02T09:36:55.029337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.029354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.029360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.029362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.029617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3402 sessionId:  describe result for acl check
2025-10-02T09:36:55.029634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.029638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.029639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.029642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.029976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.031788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.033742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.033750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.033752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174733473:4193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.033755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.034512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.036383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.036486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.036492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.036603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.036644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.036667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099147158:4348]
2025-10-02T09:36:55.037036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.037233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.037258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.037443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.037486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.037491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.037492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.037493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.037494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.037494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.037495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.037496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.037497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.037498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.037498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.037499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.037503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.037512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.037515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.037518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.037521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.037524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.037528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.037531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.037537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.037540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.037545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.037549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.037554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.037564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.037572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.037578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.037581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.037583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.037587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.037589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.037593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.037596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.037599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.037602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.037605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.037607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.037609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.037612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.037614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.037616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.037618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.037621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.037623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.037625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.037627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.037632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.037648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.045068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.046471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.046482Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.046484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.046486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.046490Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3401 [2:7556556077099147158:4348]
2025-10-02T09:36:55.046498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.046508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.046513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.046514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.046515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.046525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.046529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.046533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.046562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.046568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.046569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.046570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.046572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.046610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.046614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.046620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.046625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.046637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.046652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733616:4193], now have 1 active actors on pipe
2025-10-02T09:36:55.046657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733372:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.046659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733440:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.046663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.046664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.046665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.046673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.046685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.046687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.046689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.046690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.046697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.046698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.046712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.046717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.046719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.046698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3401
2025-10-02T09:36:55.046711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3401
2025-10-02T09:36:55.046733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.046738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.046721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3401, pipe: [1:7556556077174733440:4174]
2025-10-02T09:36:55.046835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.046840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.046843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_35_15119197923035340636_v1 on pipe: [1:7556556077174733440:4174]
2025-10-02T09:36:55.046859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba644bd8-cf28cdd2-9b585594-10025060_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.046866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.046868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.046869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.046873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.046882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.046885Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_35_15119197923035340636_v1:1 with generation 3401
2025-10-02T09:36:55.046893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.046896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.046897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.046904Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_35_15119197923035340636_v1
2025-10-02T09:36:55.046906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.046918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.046927Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:36:55.047001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.047006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.047014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.047074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3402 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba644bd8-cf28cdd2-9b585594-10025060_0
2025-10-02T09:36:55.047274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2ad8a-8a87458-12a4d1bd-226bfba3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba644bd8-cf28cdd2-9b585594-10025060_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.050046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Write session: try to update token
2025-10-02T09:36:55.050057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.050175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:36:55.050193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:36:55.050196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.050197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.050198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.050201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:36:55.050204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:36:55.050274Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397815046 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:36:55.050284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:36:55.050303Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 sending to client partition status
2025-10-02T09:36:55.055817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.055828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.055830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.055831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.055836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.055838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.055840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099147153:4348]
2025-10-02T09:36:55.055860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.055863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.055863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.055864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.055866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.055867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.056035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.061616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId: src_id|ba644bd8-cf28cdd2-9b585594-10025060_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.063633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.165605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.165923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.165933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.166082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_35_15119197923035340636_v1
2025-10-02T09:36:55.166098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.166100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.166109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.166114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.166141Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_35_15119197923035340636_v1
2025-10-02T09:36:55.166142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174733440:4174]
2025-10-02T09:36:55.166159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3402 reason: error at write: Disconnected sessionId: src_id|ba644bd8-cf28cdd2-9b585594-10025060_0
2025-10-02T09:36:55.166281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3402 sessionId: src_id|ba644bd8-cf28cdd2-9b585594-10025060_0 is DEAD
2025-10-02T09:36:55.166406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.166418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Write session will restart in 0.006427s
2025-10-02T09:36:55.166433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Write session: Do CDS request
2025-10-02T09:36:55.166437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.174202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.174320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.174328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3403
2025-10-02T09:36:55.174414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.174434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.174440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.174442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.174709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3403 sessionId:  describe result for acl check
2025-10-02T09:36:55.174732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.174737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.174738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.174740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.175086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.177352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.179971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.179981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.179983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174733693:4197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.179987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.181569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.183115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.183212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.183219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.183225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.183249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.183271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099147406:4356]
2025-10-02T09:36:55.183608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.183793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.183815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.184031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.184064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.184068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.184069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.184069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.184070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.184070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.184071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.184072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.184072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.184072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.184073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.184073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.184076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.184082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.184084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.184086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.184088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.184090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.184092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.184093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.184095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.184097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.184099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.184101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.184105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.184109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.184112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.184115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.184117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.184120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.184122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.184125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.184127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.184130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.184132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.184134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.184139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.184141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.184144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.184147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.184149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.184152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.184154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.184156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.184158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.184161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.184163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.184165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.184181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.191609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.193072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.193082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.193084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.193086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.193089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3402 [2:7556556077099147406:4356]
2025-10-02T09:36:55.193096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.193106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.193111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.193113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.193114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.193122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.193125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.193130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.193159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.193164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.193166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.193167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.193170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.193206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.193211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.193217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.193222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.193233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.193246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.193250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.193251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.193256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.193263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.193265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733631:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.193268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733863:4197], now have 1 active actors on pipe
2025-10-02T09:36:55.193270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.193271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.193271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.193278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.193280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.193292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.193302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.193300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3402
2025-10-02T09:36:55.193311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3402
2025-10-02T09:36:55.193322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.193349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.193354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.193368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.193375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.193377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.193378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.193384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.193392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.193402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.193536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.193540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.193547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.193609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3403 partition: 0 MaxSeqNo: 36 sessionId: src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0
2025-10-02T09:36:55.193840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba644bd8-cf28cdd2-9b585594-10025060_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.196482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Write session: try to update token
2025-10-02T09:36:55.196498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.202314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.202325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.202326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.202327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.202333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.202335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.202337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099147400:4356]
2025-10-02T09:36:55.202355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.202358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.202359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.202361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.202364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.202366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.202472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.209859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId: src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.211860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.266342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174733884:4174]
2025-10-02T09:36:55.266547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3402, pipe: [1:7556556077174733884:4174]
2025-10-02T09:36:55.311773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.312055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.312063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.312076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733884:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.312244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.312275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.312275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174733884:4174]
2025-10-02T09:36:55.312277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.312318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3403 reason: error at write: Disconnected sessionId: src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0
2025-10-02T09:36:55.312449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3403 sessionId: src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0 is DEAD
2025-10-02T09:36:55.312615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.312631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Write session will restart in 0.008178s
2025-10-02T09:36:55.312657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Write session: Do CDS request
2025-10-02T09:36:55.312664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.312652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.322174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.322289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.322298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3404
2025-10-02T09:36:55.322450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.322497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.322508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.322513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.322825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3404 sessionId:  describe result for acl check
2025-10-02T09:36:55.322852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.322856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.322857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.322860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.323242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.325437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.327040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.329449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.329555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.329562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.329568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.329596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.329619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099147661:4357]
2025-10-02T09:36:55.329725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.329734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.329736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174733995:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.329740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.329962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.330139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.330163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.330469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.330507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.330511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.330512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.330513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.330513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.330514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.330514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.330515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.330515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.330516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.330516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.330516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.330519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.330525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.330527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.330530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.330531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.330534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.330536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.330538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.330540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.330542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.330543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.330545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.330549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.330553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.330557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.330559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.330563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.330565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.330567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.330570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.330572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.330575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.330577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.330579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.330582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.330585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.330587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.330589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.330591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.330594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.330596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.330598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.330601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.330603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.330605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.330608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.330624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.337941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.339402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.339412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.339414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.339416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.339420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3403 [2:7556556077099147661:4357]
2025-10-02T09:36:55.339427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.339436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.339439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.339441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.339443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.339451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.339459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.339463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.339492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.339497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.339498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.339500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.339502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.339547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.339553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.339563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.339571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.339588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.339608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174733885:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.339614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734125:4218], now have 1 active actors on pipe
2025-10-02T09:36:55.339620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.339624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.339625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.339635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.339649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.339648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.339650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.339652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.339665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.339671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.339668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3403
2025-10-02T09:36:55.339688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.339674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3403
2025-10-02T09:36:55.339694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.339696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.339715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.339722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.339746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5468671-7b035bf4-c61c8636-2313c56c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.339755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.339759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.339760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.339765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.339771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.339788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.339933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.339938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.339945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.340028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3404 partition: 0 MaxSeqNo: 36 sessionId: src_id|5468671-7b035bf4-c61c8636-2313c56c_0
2025-10-02T09:36:55.340288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19dbad9e-4b60451d-bf90f3ff-8cab59c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5468671-7b035bf4-c61c8636-2313c56c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.343176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Write session: try to update token
2025-10-02T09:36:55.343188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.349021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.349033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.349034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.349035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.349040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.349042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.349044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099147656:4357]
2025-10-02T09:36:55.349064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.349067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.349069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.349076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.349082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.349084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.349184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.355615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId: src_id|5468671-7b035bf4-c61c8636-2313c56c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.357974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.412269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174734152:4174]
2025-10-02T09:36:55.412489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3403, pipe: [1:7556556077174734152:4174]
2025-10-02T09:36:55.457772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.458073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.458081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.458094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734152:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.458284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.458288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174734152:4174]
2025-10-02T09:36:55.458313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.458316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.458382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3404 reason: error at write: Disconnected sessionId: src_id|5468671-7b035bf4-c61c8636-2313c56c_0
2025-10-02T09:36:55.458538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3404 sessionId: src_id|5468671-7b035bf4-c61c8636-2313c56c_0 is DEAD
2025-10-02T09:36:55.458671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.458680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Write session will restart in 0.008289s
2025-10-02T09:36:55.458696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Write session: Do CDS request
2025-10-02T09:36:55.458720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.458695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.468189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.468352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.468364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3405
2025-10-02T09:36:55.468483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.468509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.468518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.468521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.468904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3405 sessionId:  describe result for acl check
2025-10-02T09:36:55.468940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.468946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.468948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.468953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.469373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.471798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.473547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.473557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.473560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174734256:4230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.473565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.475611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.475908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.476068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.476079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.476090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.476134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.476175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099147923:4354]
2025-10-02T09:36:55.476840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.477059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.477097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.477414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.477463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.477470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.477472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.477473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.477474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.477476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.477477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.477478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.477479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.477480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.477482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.477483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.477488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.477499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.477504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.477508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.477512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.477517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.477521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.477525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.477529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.477534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.477545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.477549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.477555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.477563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.477575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.477582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.477589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.477594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.477599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.477605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.477612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.477623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.477628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.477639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.477644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.477650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.477660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.477665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.477670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.477680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.477687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.477698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.477703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.477713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.477718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.477723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.477764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.485393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.487378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.487394Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.487396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.487399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.487405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3404 [2:7556556077099147923:4354]
2025-10-02T09:36:55.487420Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.487435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.487444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.487448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.487451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.487466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.487477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.487483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.487539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.487550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.487552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.487556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.487558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.487622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.487632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.487644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.487657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.487679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.487703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734394:4230], now have 1 active actors on pipe
2025-10-02T09:36:55.487713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734153:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.487692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3404
2025-10-02T09:36:55.487694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3404
2025-10-02T09:36:55.487721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.487728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.487730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.487740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.487746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.487748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.487750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.487761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.487781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.487788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.487805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.487814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.487854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.487868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.487880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.487888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|123d6281-b9357cc-aab0ffee-7d820c21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.487900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.487904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.487912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.487921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.487932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.487971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.488130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.488143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.488165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.488248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3405 partition: 0 MaxSeqNo: 36 sessionId: src_id|123d6281-b9357cc-aab0ffee-7d820c21_0
2025-10-02T09:36:55.488532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5468671-7b035bf4-c61c8636-2313c56c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|123d6281-b9357cc-aab0ffee-7d820c21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.491099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Write session: try to update token
2025-10-02T09:36:55.491113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.497174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.497188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.497189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.497190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.497193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.497196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.497198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099147918:4354]
2025-10-02T09:36:55.497222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.497227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.497227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.497228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.497230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.497232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.497357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.503218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId: src_id|123d6281-b9357cc-aab0ffee-7d820c21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.505449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.558705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174734430:4174]
2025-10-02T09:36:55.558929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3404, pipe: [1:7556556077174734430:4174]
2025-10-02T09:36:55.606630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.607055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.607065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.607079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734430:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.607240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174734430:4174]
2025-10-02T09:36:55.607247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.607252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.607269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.607323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3405 reason: error at write: Disconnected sessionId: src_id|123d6281-b9357cc-aab0ffee-7d820c21_0
2025-10-02T09:36:55.607446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.607472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3405 sessionId: src_id|123d6281-b9357cc-aab0ffee-7d820c21_0 is DEAD
2025-10-02T09:36:55.607635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.607650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Write session will restart in 0.005575s
2025-10-02T09:36:55.607675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Write session: Do CDS request
2025-10-02T09:36:55.607681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.614183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.614292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.614307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3406
2025-10-02T09:36:55.614412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.614437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.614446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.614450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.614853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3406 sessionId:  describe result for acl check
2025-10-02T09:36:55.614885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.614891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.614892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.614896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.615317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.617700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.620585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.620596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.620598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174734481:4279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.620603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.622105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.624094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.624213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.624220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.624226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.624254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.624277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099148193:4391]
2025-10-02T09:36:55.624649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.624856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.624887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.625079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.625110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.625114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.625115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.625115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.625116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.625116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.625117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.625118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.625118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.625118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.625119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.625120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.625122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.625132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.625135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.625139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.625142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.625146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.625149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.625153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.625156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.625159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.625161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.625162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.625166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.625170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.625177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.625180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.625182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.625185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.625188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.625191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.625193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.625196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.625198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.625200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.625203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.625205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.625207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.625210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.625212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.625215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.625218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.625222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.625224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.625226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.625228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.625231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.625248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.632664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.634364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.634378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.634379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.634381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.634385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3405 [2:7556556077099148193:4391]
2025-10-02T09:36:55.634392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.634402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.634403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.634404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.634405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.634413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.634416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.634420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.634450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.634455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.634456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.634458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.634459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.634496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.634501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.634507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.634513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.634521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.634536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734659:4279], now have 1 active actors on pipe
2025-10-02T09:36:55.634541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734431:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.634547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.634551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.634552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.634559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.634570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.634573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.634575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.634576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.634581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.634583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.634595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.634605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.634608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.634593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3405
2025-10-02T09:36:55.634596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3405
2025-10-02T09:36:55.634632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.634638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.634658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.634664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.634666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.634668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.634673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.634681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.634692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.634834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.634839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.634846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.634913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3406 partition: 0 MaxSeqNo: 36 sessionId: src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0
2025-10-02T09:36:55.635189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123d6281-b9357cc-aab0ffee-7d820c21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.637643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Write session: try to update token
2025-10-02T09:36:55.637659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.643629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.643640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.643642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.643643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.643646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.643649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.643651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099148188:4391]
2025-10-02T09:36:55.643670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.643673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.643674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.643675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.643675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.643677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.643793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.651390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId: src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.653584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.707179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174734687:4174]
2025-10-02T09:36:55.707416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3405, pipe: [1:7556556077174734687:4174]
2025-10-02T09:36:55.754186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.754526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.754534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.754548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734687:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.754674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.754926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174734687:4174]
2025-10-02T09:36:55.754926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:55.754956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.755008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3406 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0
2025-10-02T09:36:55.755168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3406 sessionId: src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0 is DEAD
2025-10-02T09:36:55.755297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:55.755305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Write session will restart in 0.005203s
2025-10-02T09:36:55.755323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Write session: Do CDS request
2025-10-02T09:36:55.755327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.761173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.761308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.761321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3407
2025-10-02T09:36:55.761431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.761456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.761466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.761470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.761822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3407 sessionId:  describe result for acl check
2025-10-02T09:36:55.761855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.761861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.761863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.761867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.762295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.764768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.767505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.767519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.767522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174734723:4284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.767528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.770227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.771915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.772023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.772030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.772037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.772064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.772183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099148441:4390]
2025-10-02T09:36:55.772530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.772719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.772746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.772944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.772974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.772978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.772978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.772979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.772979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.772980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.772981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.772981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.772982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.772982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.772983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.772983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.772986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.772993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.772995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.772997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.772999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.773001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.773003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.773005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.773007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.773009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.773011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.773013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.773017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.773021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.773024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.773027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.773029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.773032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.773034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.773037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.773039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.773042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.773044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.773047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.773049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.773052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.773055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.773057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.773060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.773063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.773066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.773069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.773073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.773075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.773079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.773082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.773098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.780472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.781930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.781940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.781941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.781944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.781947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3406 [2:7556556077099148441:4390]
2025-10-02T09:36:55.781954Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.781964Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.781969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.781971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.781972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.781981Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.781987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.781991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.782020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.782025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.782026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.782028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.782029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.782165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.782171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.782178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.782151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3406
2025-10-02T09:36:55.782157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3406
2025-10-02T09:36:55.782183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.782195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.782211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734881:4284], now have 1 active actors on pipe
2025-10-02T09:36:55.782216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734688:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.782226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.782231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.782243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.782248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.782249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.782256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.782264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.782269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.782271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.782272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.782274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.782276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.782284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.782291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.782294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.782297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.782302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.782311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.782328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.782336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.782341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.782345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.782539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.782543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.782552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.782619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3407 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0
2025-10-02T09:36:55.782928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f38a-cf668e1e-a8e6ad5c-2b858ad5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.785376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Write session: try to update token
2025-10-02T09:36:55.785392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.791294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.791305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.791306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.791307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.791311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.791314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.791316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099148435:4390]
2025-10-02T09:36:55.791334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.791336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.791337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.791338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.791339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.791341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.791449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.798021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId: src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.800185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:55.855124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174734945:4174]
2025-10-02T09:36:55.855295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3406, pipe: [1:7556556077174734945:4174]
2025-10-02T09:36:55.899494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:55.899817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.899826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.899838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734945:4174], now have 1 active actors on pipe
2025-10-02T09:36:55.900052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174734945:4174]
2025-10-02T09:36:55.900056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:55.900060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:55.900092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:55.900160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3407 reason: error at write: Disconnected sessionId: src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0
2025-10-02T09:36:55.900203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:55.900322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3407 sessionId: src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0 is DEAD
2025-10-02T09:36:55.900460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:55.900473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Write session will restart in 0.009726s
2025-10-02T09:36:55.900499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Write session: Do CDS request
2025-10-02T09:36:55.900506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:55.911191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.911282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:55.911298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3408
2025-10-02T09:36:55.911379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:55.911406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:55.911416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:55.911419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:55.911804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3408 sessionId:  describe result for acl check
2025-10-02T09:36:55.911832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:55.911839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:55.911841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:55.911845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:55.912263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:55.914376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:55.914795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:55.917424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:55.917591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:55.917598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:55.917604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:55.917635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:55.917655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:55.917664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:55.917667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556077174735089:4322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:55.917673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:55.917659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556077099148688:4394]
2025-10-02T09:36:55.918014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:55.918192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:55.918214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:55.918393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:55.918425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.918429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.918429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.918430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.918431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.918431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.918432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.918432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.918433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.918433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.918434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.918434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.918437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.918443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.918445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.918447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.918449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.918451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.918453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.918455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.918457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.918459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.918461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.918463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.918466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.918470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:55.918473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.918476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:55.918478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.918481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:55.918483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.918486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:55.918488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.918491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:55.918493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.918495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:55.918497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.918500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:55.918503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.918505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:55.918508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.918510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:55.918512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.918515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.918517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.918521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.918523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.918525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.918542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:55.925891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:55.927552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:55.927564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:55.927565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:55.927567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:55.927570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3407 [2:7556556077099148688:4394]
2025-10-02T09:36:55.927577Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:55.927586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:55.927591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.927592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.927593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.927602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:55.927606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:55.927610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:55.927642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.927647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.927649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.927651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:55.927652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:55.927688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:55.927692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.927700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:55.927705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:55.927716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:55.927729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174734946:2446], now have 1 active actors on pipe
2025-10-02T09:36:55.927734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174735191:4322], now have 1 active actors on pipe
2025-10-02T09:36:55.927738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.927739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.927741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.927748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:55.927755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:55.927763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:55.927764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:55.927766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:55.927766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:55.927768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:55.927782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.927787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:55.927774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3407
2025-10-02T09:36:55.927795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:55.927790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3407
2025-10-02T09:36:55.927808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.927812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.927829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:55.927835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:55.927837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:55.927839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:55.927846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:55.927853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:55.927861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.927969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:55.927974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:55.927982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:55.928051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3408 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0
2025-10-02T09:36:55.928330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc883cb7-37df9e8f-1caf2d9d-738c450b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:55.930717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Write session: try to update token
2025-10-02T09:36:55.930732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:55.936847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:55.936856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:55.936857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:55.936858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:55.936862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.936865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.936867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556077099148683:4394]
2025-10-02T09:36:55.936885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:55.936888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:55.936890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:55.936893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:55.936895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:55.936897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:55.936999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:55.943408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId: src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:55.945589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.000057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556077174735209:4174]
2025-10-02T09:36:56.000304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3407, pipe: [1:7556556077174735209:4174]
2025-10-02T09:36:56.046886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.047125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.047134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.047147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556077174735209:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.047362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.047359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.047391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556077174735209:4174]
2025-10-02T09:36:56.047414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:56.047420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:56.047482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3408 reason: error at write: Disconnected sessionId: src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0
2025-10-02T09:36:56.047628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3408 sessionId: src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0 is DEAD
2025-10-02T09:36:56.047777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:56.047790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Write session will restart in 0.006721s
2025-10-02T09:36:56.047816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Write session: Do CDS request
2025-10-02T09:36:56.047822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.055108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.055251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.055265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3409
2025-10-02T09:36:56.055370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.055395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.055404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.055407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.055734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3409 sessionId:  describe result for acl check
2025-10-02T09:36:56.055766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.055774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.055775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.055779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.056205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.058751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.061246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.061258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.061260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469702563:4330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.061266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.062972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.064789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.064945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.064953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.064964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.065003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.065027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394116235:4400]
2025-10-02T09:36:56.065377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.065630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.065693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.066052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.066098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.066104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.066105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.066106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.066107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.066108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.066109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.066109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.066111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.066111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.066113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.066113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.066118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.066126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.066129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.066132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.066135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.066138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.066141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.066144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.066147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.066164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.066167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.066169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.066174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.066180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.066185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.066193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.066196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.066200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.066203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.066206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.066214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.066217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.066220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.066224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.066227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.066231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.066233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.066237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.066245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.066251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.066254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.066259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.066266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.066269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.066272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.066293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.073745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.075357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.075367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.075368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.075370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.075374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3408 [2:7556556081394116235:4400]
2025-10-02T09:36:56.075383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.075393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.075395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.075396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.075398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.075408Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.075414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.075418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.075453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.075460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.075462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.075464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.075466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.075507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.075512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.075520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.075525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.075537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.075552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469702510:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.075557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469702730:4330], now have 1 active actors on pipe
2025-10-02T09:36:56.075561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.075562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.075563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.075571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.075579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.075584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.075586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.075588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.075590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.075592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.075611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.075581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3408
2025-10-02T09:36:56.075616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.075604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3408
2025-10-02T09:36:56.075618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.075630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.075631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.075659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.075666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.075668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.075669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.075674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.075681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.075691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.075809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.075814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.075822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.075877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3409 partition: 0 MaxSeqNo: 36 sessionId: src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0
2025-10-02T09:36:56.076247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5752f4a-c454f9eb-8797eebc-ecb11554_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.078640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Write session: try to update token
2025-10-02T09:36:56.078660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.084684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.084695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.084699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.084700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.084704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.084706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.084708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394116230:4400]
2025-10-02T09:36:56.084728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.084731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.084732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.084732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.084735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.084737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.084858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.091393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId: src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.093662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.147507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469702768:4174]
2025-10-02T09:36:56.147697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3408, pipe: [1:7556556081469702768:4174]
2025-10-02T09:36:56.194285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.194626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.194635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.194648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469702768:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.194776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:56.194792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:56.194888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3409 reason: error at write: Disconnected sessionId: src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0
2025-10-02T09:36:56.194893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469702768:4174]
2025-10-02T09:36:56.194908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.195401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.195403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3409 sessionId: src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0 is DEAD
2025-10-02T09:36:56.195597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:56.195606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Write session will restart in 0.008534s
2025-10-02T09:36:56.195626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Write session: Do CDS request
2025-10-02T09:36:56.195630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.205194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.205286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.205300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3410
2025-10-02T09:36:56.205421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.205446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.205456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.205459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.205788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3410 sessionId:  describe result for acl check
2025-10-02T09:36:56.205820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.205825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.205827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.205831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.206211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.206348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.207934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.207949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.208039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.208045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.208051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.208074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.208096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394116487:4412]
2025-10-02T09:36:56.208438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.208614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.208636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.208827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.208856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.208860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.208861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.208861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.208862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.208862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.208863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.208863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.208864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.208864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.208865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.208865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.208868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.208874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.208876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.208878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.208880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.208882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.208884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.208886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.208888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.208890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.208892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.208894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.208898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.208901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.208905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.208908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.208910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.208913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.208915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.208918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.208920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.208922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.208924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.208927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.208928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.208931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.208933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.208936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.208938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.208940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.208943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.208946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.208948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.208951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.208953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.208955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.208974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.212874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.212887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.212890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469702981:4351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.212898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.216361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.217873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.217885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.217887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.217888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.217891Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3409 [2:7556556081394116487:4412]
2025-10-02T09:36:56.217899Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.217908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.217910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.217911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.217912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.217921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.217928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.217932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.217959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.217964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.217965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.217966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.217968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.218002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.218006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.218013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.218020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.218028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.218043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469702770:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.218048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703022:4351], now have 1 active actors on pipe
2025-10-02T09:36:56.218052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.218053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.218054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.218063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.218071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.218076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.218078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.218079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.218082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.218083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.218088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3409
2025-10-02T09:36:56.218098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.218100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3409
2025-10-02T09:36:56.218104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.218112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.218130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.218135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.218148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.218155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.218157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.218158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.218163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.218170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.218179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.218301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.218306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.218313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.218374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3410 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0
2025-10-02T09:36:56.218628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363fceb0-cb21d0ab-dfa145ff-273e0307_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.221519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Write session: try to update token
2025-10-02T09:36:56.221530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.231080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:56.231095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.231102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.231131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:56.231137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:56.231258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:56.231382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.231506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.231627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.231802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:56.231829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:56.233239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId: src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.235552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.235609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.235621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.235622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.235623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.235628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.235630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.235632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394116481:4412]
2025-10-02T09:36:56.235642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.235644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.235646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.235651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.235654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.235656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.235778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.294949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469703029:4174]
2025-10-02T09:36:56.295137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3409, pipe: [1:7556556081469703029:4174]
2025-10-02T09:36:56.346338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.346618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.346627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.346641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703029:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.346803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.346836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.346849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469703029:4174]
2025-10-02T09:36:56.346867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:56.346923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3410 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0
2025-10-02T09:36:56.347054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3410 sessionId: src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0 is DEAD
2025-10-02T09:36:56.347158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:56.347166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Write session will restart in 0.005746s
2025-10-02T09:36:56.347180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Write session: Do CDS request
2025-10-02T09:36:56.347184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.354148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.354260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.354272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3411
2025-10-02T09:36:56.354402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.354427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.354431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.354437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.354797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3411 sessionId:  describe result for acl check
2025-10-02T09:36:56.354824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.354830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.354832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.354836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.355200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.357205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.358917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.360585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.360719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.360726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.360733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.360761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.360752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.360762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.360766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469703131:4377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.360770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.360785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394116752:4416]
2025-10-02T09:36:56.361150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.361330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.361354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.361532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.361562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.361566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.361567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.361567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.361568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.361568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.361569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.361569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.361570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.361570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.361571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.361572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.361575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.361582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.361584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.361586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.361588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.361590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.361592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.361594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.361596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.361598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.361600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.361602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.361606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.361610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.361613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.361616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.361619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.361621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.361624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.361626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.361629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.361632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.361634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.361640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.361643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.361646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.361648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.361650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.361652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.361655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.361657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.361660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.361662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.361665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.361667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.361669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.361687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.369106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.370662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.370673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.370674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.370676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.370679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3410 [2:7556556081394116752:4416]
2025-10-02T09:36:56.370688Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.370697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.370700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.370702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.370703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.370712Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.370714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.370718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.370748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.370754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.370756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.370757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.370759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.370795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.370799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.370805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.370810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.370818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.370833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703032:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.370838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703294:4377], now have 1 active actors on pipe
2025-10-02T09:36:56.370842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.370843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.370844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.370851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.370861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.370866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.370868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.370870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.370875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.370877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.370882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.370884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.370885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.370880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3410
2025-10-02T09:36:56.370892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3410
2025-10-02T09:36:56.370923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.370929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.370941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.370948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.370950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.370951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.370956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.370961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.370971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.371106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.371111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.371118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.371186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3411 partition: 0 MaxSeqNo: 36 sessionId: src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0
2025-10-02T09:36:56.371524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd96ae0-66788cd5-1a8ee332-3f9e4478_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.374367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Write session: try to update token
2025-10-02T09:36:56.374377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.379948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:56.379963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.379968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.379990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:56.380028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:56.380129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:56.380245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.380363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.380479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.380638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:56.380662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:56.385970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId: src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.388287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.388634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.388648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.388659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.388660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.388662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.388663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.388667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.388670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.388672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394116747:4416]
2025-10-02T09:36:56.388694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.388697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.388699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.388699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.388702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.388706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.388892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.447027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469703305:4174]
2025-10-02T09:36:56.447219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3410, pipe: [1:7556556081469703305:4174]
2025-10-02T09:36:56.498121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.498472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:56.498495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703305:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.498573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:56.498605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469703305:4174]
2025-10-02T09:36:56.498631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.498692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:56.498701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:56.498760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3411 reason: error at write: Disconnected sessionId: src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0
2025-10-02T09:36:56.498893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3411 sessionId: src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0 is DEAD
2025-10-02T09:36:56.499054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:56.499067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Write session will restart in 0.006561s
2025-10-02T09:36:56.499087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Write session: Do CDS request
2025-10-02T09:36:56.499095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.506191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.506292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.506306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3412
2025-10-02T09:36:56.506410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.506435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.506444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.506447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.506773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3412 sessionId:  describe result for acl check
2025-10-02T09:36:56.506798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.506805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.506807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.506811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.507243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.509419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.510984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.512683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.512780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.512787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.512793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.512830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.512854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394117019:4463]
2025-10-02T09:36:56.512854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.512863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.512865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469703392:4394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.512870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.513198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.513360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.513383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.513557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.513585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.513589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.513589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.513590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.513590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.513591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.513591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.513592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.513592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.513593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.513593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.513594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.513596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.513603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.513605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.513607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.513609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.513611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.513613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.513615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.513617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.513619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.513621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.513623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.513626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.513629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.513633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.513636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.513638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.513640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.513642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.513645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.513648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.513650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.513652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.513654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.513657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.513659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.513661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.513665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.513667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.513672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.513674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.513676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.513678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.513681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.513683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.513685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.513711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.521070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.522417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.522429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.522430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.522432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.522435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3411 [2:7556556081394117019:4463]
2025-10-02T09:36:56.522441Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.522451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.522456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.522457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.522458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.522467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.522470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.522474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.522501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.522506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.522507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.522509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.522510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.522547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.522552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.522558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.522564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.522575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.522588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703556:4394], now have 1 active actors on pipe
2025-10-02T09:36:56.522593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703306:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.522597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.522598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.522599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.522605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.522617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.522617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.522619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.522620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.522627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.522629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.522644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.522649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.522641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3411
2025-10-02T09:36:56.522663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.522650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3411
2025-10-02T09:36:56.522750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.522756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.522777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.522784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.522786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.522787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.522794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.522802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.522813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.522934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.522938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.522946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.523009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3412 partition: 0 MaxSeqNo: 36 sessionId: src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0
2025-10-02T09:36:56.523266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53fe4a-8a049e8f-58b3a9eb-1e7f084d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.525872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Write session: try to update token
2025-10-02T09:36:56.525889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.531655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.531667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.531669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.531669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.531673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.531675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.531677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394117014:4463]
2025-10-02T09:36:56.531696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.531698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.531698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.531699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.531700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.531702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.531822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
E1002 09:36:56.531862440 3223120 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:13253: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:36:56.538104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId: src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.540431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.598570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469703593:4174]
2025-10-02T09:36:56.598812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3411, pipe: [1:7556556081469703593:4174]
2025-10-02T09:36:56.640941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.641258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.641267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.641280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703593:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.641444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.641468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:56.641484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469703593:4174]
2025-10-02T09:36:56.641557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0
2025-10-02T09:36:56.641411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.641726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3412 sessionId: src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0 is DEAD
2025-10-02T09:36:56.641882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:56.641895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Write session will restart in 0.008932s
2025-10-02T09:36:56.641916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Write session: Do CDS request
2025-10-02T09:36:56.641921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.652190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.652297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.652313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3413
2025-10-02T09:36:56.652422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.652450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.652460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.652463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.652796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3413 sessionId:  describe result for acl check
2025-10-02T09:36:56.652837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.652841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.652842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.652845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.653209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.653581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.654982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.655203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.655357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.655365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.655372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.655402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.655426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394117296:4457]
2025-10-02T09:36:56.655782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.655955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.655977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.656157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.656184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.656188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.656189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.656189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.656190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.656190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.656190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.656191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.656192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.656192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.656193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.656193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.656196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.656202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.656204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.656206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.656208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.656210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.656212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.656214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.656216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.656218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.656220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.656222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.656225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.656229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.656232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.656235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.656237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.656240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.656242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.656246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.656248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.656251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.656253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.656256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.656258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.656265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.656267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.656270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.656272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.656274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.656276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.656279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.656281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.656283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.656286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.656289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.656305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.660169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.660181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.660184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469703807:4453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.660193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.663709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.665242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.665254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.665255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.665257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.665261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3412 [2:7556556081394117296:4457]
2025-10-02T09:36:56.665268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.665277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.665282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.665284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.665285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.665295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.665300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.665305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.665337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.665342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.665343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.665345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.665346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.665383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.665388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.665394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.665403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.665414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.665428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703849:4453], now have 1 active actors on pipe
2025-10-02T09:36:56.665433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703594:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.665437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.665439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.665440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.665448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.665458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.665462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.665464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.665465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.665468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.665470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.665484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.665489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.665478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3412
2025-10-02T09:36:56.665486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3412
2025-10-02T09:36:56.665504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.665507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.665509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.665528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.665535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.665536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.665537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.665542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.665551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.665561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.665675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.665681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.665689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.665755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3413 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0
2025-10-02T09:36:56.666021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22815ea-6f4b64d6-cc284cfb-1317a777_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.668372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Write session: try to update token
2025-10-02T09:36:56.668383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.674511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.674523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.674524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.674525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.674528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.674530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.674531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394117291:4457]
2025-10-02T09:36:56.674550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.674552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.674553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.674554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.674556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.674558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.674668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.681135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId: src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.683305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.741410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469703858:4174]
2025-10-02T09:36:56.741630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3412, pipe: [1:7556556081469703858:4174]
2025-10-02T09:36:56.785001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.785263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.785273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.785286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703858:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.785424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.785447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:56.785457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:56.785473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469703858:4174]
2025-10-02T09:36:56.785496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.785508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3413 reason: error at write: Disconnected sessionId: src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0
2025-10-02T09:36:56.785629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3413 sessionId: src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0 is DEAD
2025-10-02T09:36:56.785770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:56.785783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Write session will restart in 0.006906s
2025-10-02T09:36:56.785809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Write session: Do CDS request
2025-10-02T09:36:56.785814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.794171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.794284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.794302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3414
2025-10-02T09:36:56.794400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.794426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.794433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.794437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.794773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3414 sessionId:  describe result for acl check
2025-10-02T09:36:56.794800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.794802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.794803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.794807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.795176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.797013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.797732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.799425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.799521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.799528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.799535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.799560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.799582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394117551:4474]
2025-10-02T09:36:56.799640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.799649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.799651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469703987:4459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.799685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.799925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.800089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.800113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.800373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.800409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.800413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.800414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.800414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.800415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.800415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.800416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.800416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.800416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.800417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.800418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.800418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.800421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.800427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.800429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.800431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.800433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.800435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.800436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.800438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.800440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.800442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.800444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.800446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.800450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.800454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.800457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.800460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.800462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.800465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.800467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.800470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.800472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.800474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.800476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.800479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.800481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.800484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.800486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.800488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.800490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.800494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.800496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.800498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.800500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.800502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.800504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.800506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.800522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.807879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.809456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.809467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.809468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.809470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.809474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3413 [2:7556556081394117551:4474]
2025-10-02T09:36:56.809480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.809490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.809495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.809497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.809498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.809507Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.809510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.809519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.809546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.809551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.809551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.809554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.809555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.809588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.809593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.809600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.809605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.809613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.809626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469703859:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.809632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469704111:4459], now have 1 active actors on pipe
2025-10-02T09:36:56.809635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.809637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.809638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.809645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.809653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.809663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.809664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.809665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.809671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.809672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.809678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.809680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.809691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.809670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3413
2025-10-02T09:36:56.809701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.809679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3413
2025-10-02T09:36:56.809707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.809723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f13344f-575433f9-21343456-1bd2f0c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.809729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.809731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.809732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.809737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.809745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.809753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.809879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.809884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.809891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.809955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3414 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f13344f-575433f9-21343456-1bd2f0c5_0
2025-10-02T09:36:56.810187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d30f38a-8c0bcb0a-d9d7e83f-8bbc66b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f13344f-575433f9-21343456-1bd2f0c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.812490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Write session: try to update token
2025-10-02T09:36:56.812504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.818608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.818618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.818619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.818620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.818623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.818625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.818629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394117546:4474]
2025-10-02T09:36:56.818648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.818650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.818651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.818651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.818654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.818656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.818756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.824280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId: src_id|6f13344f-575433f9-21343456-1bd2f0c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.826408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:56.885796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556081469704123:4174]
2025-10-02T09:36:56.886016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3413, pipe: [1:7556556081469704123:4174]
2025-10-02T09:36:56.928221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:56.928495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.928505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.928518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469704123:4174], now have 1 active actors on pipe
2025-10-02T09:36:56.928654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:56.928699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:56.928702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556081469704123:4174]
2025-10-02T09:36:56.928726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:56.928771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3414 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f13344f-575433f9-21343456-1bd2f0c5_0
2025-10-02T09:36:56.928927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3414 sessionId: src_id|6f13344f-575433f9-21343456-1bd2f0c5_0 is DEAD
2025-10-02T09:36:56.929154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:56.929171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Write session will restart in 0.009763s
2025-10-02T09:36:56.929192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Write session: Do CDS request
2025-10-02T09:36:56.929197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:56.940165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.940297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:56.940310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3415
2025-10-02T09:36:56.940407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:56.940428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:56.940433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:56.940436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:56.940988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3415 sessionId:  describe result for acl check
2025-10-02T09:36:56.941004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:56.941040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:56.941048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:56.941050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:56.941054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:56.941498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:56.942549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:56.942651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:56.942658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:56.942664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:56.942690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:56.942713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556081394117807:4476]
2025-10-02T09:36:56.943090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:56.943167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:56.943259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:56.943282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:56.943460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:56.943488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.943492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.943493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.943494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.943494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.943495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.943495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.943496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.943496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.943497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.943497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.943498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.943500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.943507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.943509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.943511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.943513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.943515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.943517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.943519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.943521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.943523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.943525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.943527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.943532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.943536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:56.943539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.943542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:56.943545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.943547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:56.943549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.943552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:56.943555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.943557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:56.943560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.943564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:56.943567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.943569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:56.943572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.943574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:56.943577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.943579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:56.943582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.943584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.943586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.943589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.943593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.943595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.943612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:56.947579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:56.947590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:56.947593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556081469704345:4481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:56.947600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:56.950965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:56.952485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:56.952498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:56.952500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:56.952502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:56.952507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3414 [2:7556556081394117807:4476]
2025-10-02T09:36:56.952517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:56.952528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:56.952534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.952535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.952537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.952546Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:56.952549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:56.952558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:56.952590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.952594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.952595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.952597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:56.952598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:56.952635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:56.952639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.952646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:56.952651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:56.952659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:56.952672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469704127:2446], now have 1 active actors on pipe
2025-10-02T09:36:56.952678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556081469704388:4481], now have 1 active actors on pipe
2025-10-02T09:36:56.952681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.952682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.952683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.952692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:56.952702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:56.952703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:56.952705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:56.952708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:56.952711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:56.952712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:56.952726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.952730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:56.952732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:56.952739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3414
2025-10-02T09:36:56.952765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3414
2025-10-02T09:36:56.952812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.952818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.952833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:56.952839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:56.952841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:56.952843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:56.952847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:56.952854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:56.952864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.953001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:56.953007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:56.953016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:56.953088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3415 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0
2025-10-02T09:36:56.953338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f13344f-575433f9-21343456-1bd2f0c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:56.955648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Write session: try to update token
2025-10-02T09:36:56.955661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:56.961601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:56.961613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.961617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.961636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:56.961636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:56.961773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:56.961887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.962001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.962117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:56.962275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:56.962298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:56.968240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId: src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:56.970190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:56.970202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:56.970203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:56.970204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:56.970208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.970210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.970212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556081394117802:4476]
2025-10-02T09:36:56.970231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:56.970236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:56.970236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:56.970238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:56.970240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:56.970243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:56.970336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:56.970704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.028663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764671695:4174]
2025-10-02T09:36:57.028868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3414, pipe: [1:7556556085764671695:4174]
2025-10-02T09:36:57.078600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.078975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.078984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.078997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764671695:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.079137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.079170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764671695:4174]
2025-10-02T09:36:57.079173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.079199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:57.079258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3415 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0
2025-10-02T09:36:57.079396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3415 sessionId: src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0 is DEAD
2025-10-02T09:36:57.079546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:57.079556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Write session will restart in 0.006702s
2025-10-02T09:36:57.079577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Write session: Do CDS request
2025-10-02T09:36:57.079582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.087154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.087251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.087263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3416
2025-10-02T09:36:57.087380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.087407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.087415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.087418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.087784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3416 sessionId:  describe result for acl check
2025-10-02T09:36:57.087813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.087819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.087820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.087823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.088169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.090426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.091166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.092816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.092913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.092920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.092925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.092952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.092944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.092954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.092956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764671807:4499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.092974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689085359:4485]
2025-10-02T09:36:57.092993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.093312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.093474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.093496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.093684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.093718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.093722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.093723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.093724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.093724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.093725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.093725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.093726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.093727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.093727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.093727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.093728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.093730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.093736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.093738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.093741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.093742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.093745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.093747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.093749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.093751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.093753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.093755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.093757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.093760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.093764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.093767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.093770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.093772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.093775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.093777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.093779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.093782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.093784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.093786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.093790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.093796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.093799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.093801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.093803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.093805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.093808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.093810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.093813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.093815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.093817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.093819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.093822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.093841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.101174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.102688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.102703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.102705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.102706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.102710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3415 [2:7556556085689085359:4485]
2025-10-02T09:36:57.102716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.102726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.102731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.102733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.102734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.102743Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.102750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.102754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.102783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.102788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.102789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.102791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.102792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.102830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.102835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.102842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.102847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.102858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.102873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764671950:4499], now have 1 active actors on pipe
2025-10-02T09:36:57.102879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764671696:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.102882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.102884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.102885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.102892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.102903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.102906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.102908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.102909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.102916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.102917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.102930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.102935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.102947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.102929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3415
2025-10-02T09:36:57.102944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3415
2025-10-02T09:36:57.102957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.102962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.102977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.102984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.102986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.102987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.102992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.102997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.103005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.103108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.103113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.103121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.103189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3416 partition: 0 MaxSeqNo: 36 sessionId: src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0
2025-10-02T09:36:57.103441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3371de-d3fd8782-bd2aebda-663a44b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.105790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Write session: try to update token
2025-10-02T09:36:57.105802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.112054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.112066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.112067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.112068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.112072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.112074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.112076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689085354:4485]
2025-10-02T09:36:57.112094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.112097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.112100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.112100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.112101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.112101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.112207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.118009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId: src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.120213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.179204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764671961:4174]
2025-10-02T09:36:57.179408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3415, pipe: [1:7556556085764671961:4174]
2025-10-02T09:36:57.220517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.221019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.221028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.221040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764671961:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.221173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.221242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764671961:4174]
2025-10-02T09:36:57.221264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.221273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:57.221340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3416 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0
2025-10-02T09:36:57.221470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3416 sessionId: src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0 is DEAD
2025-10-02T09:36:57.221694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:57.221707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Write session will restart in 0.007128s
2025-10-02T09:36:57.221727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Write session: Do CDS request
2025-10-02T09:36:57.221733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.230179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.230275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.230292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3417
2025-10-02T09:36:57.230408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.230432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.230441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.230444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.230788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3417 sessionId:  describe result for acl check
2025-10-02T09:36:57.230817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.230822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.230824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.230829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.231281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.233052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.233185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.234733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.234836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.234843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.234849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.234878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.234904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689085619:4497]
2025-10-02T09:36:57.235006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.235018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.235019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764672110:4510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.235024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.235259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.235428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.235451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.235627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.235657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.235661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.235661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.235662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.235663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.235663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.235664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.235664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.235665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.235665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.235666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.235666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.235669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.235676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.235678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.235680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.235682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.235684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.235686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.235688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.235690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.235692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.235694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.235696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.235700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.235704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.235707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.235710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.235713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.235716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.235719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.235722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.235725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.235731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.235733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.235736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.235738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.235741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.235744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.235747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.235749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.235754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.235756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.235758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.235764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.235767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.235769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.235771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.235792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.243157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.244598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.244612Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.244614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.244616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.244619Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3416 [2:7556556085689085619:4497]
2025-10-02T09:36:57.244626Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.244635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.244640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.244642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.244643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.244652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.244654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.244659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.244689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.244694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.244695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.244697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.244698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.244733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.244738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.244744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.244749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.244757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.244772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764671963:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.244777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672218:4510], now have 1 active actors on pipe
2025-10-02T09:36:57.244781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.244782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.244783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.244791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.244813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.244815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.244817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.244819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.244824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.244825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.244839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.244844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.244824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3416
2025-10-02T09:36:57.244839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3416
2025-10-02T09:36:57.244848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.244858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.244859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.244879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.244886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.244888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.244889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.244894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.244899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.244912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.245017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.245022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.245029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.245096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3417 partition: 0 MaxSeqNo: 36 sessionId: src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0
2025-10-02T09:36:57.245351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bab251-f312dcc9-aea04cbb-e1dc8085_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.247626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Write session: try to update token
2025-10-02T09:36:57.247640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.253818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.253829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.253831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.253832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.253835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.253838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.253839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689085614:4497]
2025-10-02T09:36:57.253859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.253862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.253864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.253864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.253866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.253866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.253979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.259853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId: src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.262132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.321512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764672229:4174]
2025-10-02T09:36:57.321701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3416, pipe: [1:7556556085764672229:4174]
2025-10-02T09:36:57.363607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.364162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.364172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.364185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672229:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.364306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.364318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:57.364323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764672229:4174]
2025-10-02T09:36:57.364333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:57.364336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.364400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3417 reason: error at write: Disconnected sessionId: src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0
2025-10-02T09:36:57.364543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3417 sessionId: src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0 is DEAD
2025-10-02T09:36:57.364706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:57.364718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Write session will restart in 0.007424s
2025-10-02T09:36:57.364738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Write session: Do CDS request
2025-10-02T09:36:57.364743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.373122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.373214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.373227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3418
2025-10-02T09:36:57.373313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.373336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.373344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.373347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.373643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3418 sessionId:  describe result for acl check
2025-10-02T09:36:57.373685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.373692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.373693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.373698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.374035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.375915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.376482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.378104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.378209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.378216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.378222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.378252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.378276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689085890:4510]
2025-10-02T09:36:57.378330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.378340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.378342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764672378:4541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.378347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.378629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.378793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.378817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.378991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.379020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.379024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.379024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.379025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.379026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.379026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.379027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.379027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.379028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.379028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.379029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.379029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.379032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.379038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.379048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.379050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.379052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.379054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.379056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.379058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.379060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.379062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.379064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.379066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.379071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.379075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.379078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.379081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.379083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.379085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.379088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.379090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.379094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.379096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.379098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.379100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.379103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.379105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.379109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.379112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.379114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.379117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.379120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.379123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.379125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.379129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.379131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.379138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.379155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.386460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.387849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.387861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.387862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.387864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.387867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3417 [2:7556556085689085890:4510]
2025-10-02T09:36:57.387874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.387884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.387886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.387888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.387889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.387897Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.387900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.387904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.387935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.387940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.387941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.387943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.387945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.387981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.387986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.387992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.387997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.388005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.388019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672501:4541], now have 1 active actors on pipe
2025-10-02T09:36:57.388025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672245:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.388028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.388030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.388032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.388039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.388049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.388055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.388057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.388057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.388059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.388059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.388074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.388084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.388087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.388071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3417
2025-10-02T09:36:57.388095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3417
2025-10-02T09:36:57.388108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.388114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.388131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.388137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.388139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.388140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.388145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.388154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.388162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.388301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.388306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.388313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.388382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3418 partition: 0 MaxSeqNo: 36 sessionId: src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0
2025-10-02T09:36:57.388795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3144775f-766572c9-ab1c7e6a-13c4a08d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.391123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Write session: try to update token
2025-10-02T09:36:57.391137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.397028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.397039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.397040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.397041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.397045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.397047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.397049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689085885:4510]
2025-10-02T09:36:57.397067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.397070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.397071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.397071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.397073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.397075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.397182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.403821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId: src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.406109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.464378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764672512:4174]
2025-10-02T09:36:57.464555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3417, pipe: [1:7556556085764672512:4174]
2025-10-02T09:36:57.505786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.506455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.506465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.506478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672512:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.506631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.506664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:57.506678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:57.506687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764672512:4174]
2025-10-02T09:36:57.506714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.506727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3418 reason: error at write: Disconnected sessionId: src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0
2025-10-02T09:36:57.506861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3418 sessionId: src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0 is DEAD
2025-10-02T09:36:57.507026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:57.507038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Write session will restart in 0.007843s
2025-10-02T09:36:57.507074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Write session: Do CDS request
2025-10-02T09:36:57.507080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.516126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.516255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.516268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3419
2025-10-02T09:36:57.516371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.516394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.516401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.516404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.516746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3419 sessionId:  describe result for acl check
2025-10-02T09:36:57.516776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.516782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.516783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.516787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.517186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.518686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.520600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.520831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.520851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.520841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.520843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764672679:4556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.520847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.521005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.521013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.521020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.521050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.521071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689086166:4512]
2025-10-02T09:36:57.521426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.521588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.521611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.521791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.521821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.521825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.521827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.521828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.521828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.521829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.521829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.521830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.521831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.521831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.521834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.521841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.521843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.521845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.521847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.521849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.521852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.521855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.521857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.521859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.521861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.521863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.521867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.521870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.521874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.521877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.521879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.521881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.521884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.521887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.521889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.521892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.521894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.521896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.521899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.521902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.521904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.521907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.521911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.521914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.521916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.521919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.521923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.521927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.521929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.521932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.521953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.529344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.530928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.530938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.530939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.530941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.530945Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3418 [2:7556556085689086166:4512]
2025-10-02T09:36:57.530953Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.530962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.530967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.530968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.530969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.530978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.530980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.530985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.531016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.531020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.531021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.531023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.531024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.531065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.531070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.531075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.531081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.531093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.531107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672513:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.531112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672770:4556], now have 1 active actors on pipe
2025-10-02T09:36:57.531115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.531116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.531117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.531124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.531135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.531138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.531140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.531141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.531145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.531147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.531161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.531166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.531173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.531157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3418
2025-10-02T09:36:57.531162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3418
2025-10-02T09:36:57.531196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.531201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.531217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|335685c5-c5a6891d-db9541b-8859ca84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.531224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.531226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.531230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.531234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.531242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.531253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.531381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.531386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.531393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.531463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3419 partition: 0 MaxSeqNo: 36 sessionId: src_id|335685c5-c5a6891d-db9541b-8859ca84_0
2025-10-02T09:36:57.531723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ff15dd-45ec6b23-b2e7aa24-41221e53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|335685c5-c5a6891d-db9541b-8859ca84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.534080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Write session: try to update token
2025-10-02T09:36:57.534101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.543880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:57.543892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.543898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.543909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:57.543920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:57.544056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:57.544179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.544295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.544418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.544578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:57.544602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:57.546597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId: src_id|335685c5-c5a6891d-db9541b-8859ca84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.548234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.548247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.548248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.548249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.548253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.548255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.548256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689086160:4512]
2025-10-02T09:36:57.548276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.548278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.548282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.548282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.548283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.548285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.548401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.548935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.606695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764672804:4174]
2025-10-02T09:36:57.606888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3418, pipe: [1:7556556085764672804:4174]
2025-10-02T09:36:57.658199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.658397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.658407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.658420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672804:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.658550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.658577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:57.658592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:57.658633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764672804:4174]
2025-10-02T09:36:57.658638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3419 reason: error at write: Disconnected sessionId: src_id|335685c5-c5a6891d-db9541b-8859ca84_0
2025-10-02T09:36:57.658664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.658774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3419 sessionId: src_id|335685c5-c5a6891d-db9541b-8859ca84_0 is DEAD
2025-10-02T09:36:57.658929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:57.658942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Write session will restart in 0.007165s
2025-10-02T09:36:57.658964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Write session: Do CDS request
2025-10-02T09:36:57.658968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.667189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.667334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.667345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3420
2025-10-02T09:36:57.667455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.667481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.667489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.667492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.667902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3420 sessionId:  describe result for acl check
2025-10-02T09:36:57.667937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.667944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.667945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.667948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.668314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.670198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.672127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.673867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.673962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.673969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.673975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.674000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.674026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689086448:4548]
2025-10-02T09:36:57.674308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.674319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.674321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764672899:4598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.674325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.674366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.674530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.674553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.674726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.674755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.674758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.674759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.674760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.674760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.674761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.674761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.674762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.674762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.674763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.674763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.674764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.674766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.674772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.674775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.674777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.674779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.674781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.674783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.674784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.674786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.674788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.674790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.674792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.674796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.674801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.674804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.674807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.674809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.674811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.674814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.674816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.674819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.674821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.674823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.674826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.674828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.674830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.674832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.674835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.674837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.674841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.674843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.674845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.674848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.674850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.674855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.674857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.674874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.682189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.683641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.683651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.683653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.683654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.683658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3419 [2:7556556085689086448:4548]
2025-10-02T09:36:57.683665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.683674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.683679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.683681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.683682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.683690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.683697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.683701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.683730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.683734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.683735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.683737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.683739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.683774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.683779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.683785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.683790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.683803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.683817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764672806:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.683822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673070:4598], now have 1 active actors on pipe
2025-10-02T09:36:57.683826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.683827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.683828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.683836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.683844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.683849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.683851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.683852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.683854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.683855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.683869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.683877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.683879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.683870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3419
2025-10-02T09:36:57.683903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.683908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.683922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.683929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.683931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.683933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.683939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.683947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.683916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3419
2025-10-02T09:36:57.683957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.684065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.684070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.684078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.684144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3420 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0
2025-10-02T09:36:57.684403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|335685c5-c5a6891d-db9541b-8859ca84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.686773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Write session: try to update token
2025-10-02T09:36:57.686789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.692646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:57.692659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.692665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.692687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:57.692690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:57.692839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:57.692960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.693078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.693204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:57.693369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:57.693390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:57.699477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId: src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.701167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.701178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.701180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.701180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.701184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.701186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.701189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689086443:4548]
2025-10-02T09:36:57.701208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.701208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.701211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.701211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.701212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.701213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.701316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.701806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.758805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764673082:4174]
2025-10-02T09:36:57.759076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3419, pipe: [1:7556556085764673082:4174]
2025-10-02T09:36:57.811008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.811341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.811350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.811364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673082:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.811522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.811755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764673082:4174]
2025-10-02T09:36:57.811792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.811833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:57.811916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0
2025-10-02T09:36:57.812075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3420 sessionId: src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0 is DEAD
2025-10-02T09:36:57.812251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:57.812265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Write session will restart in 0.008036s
2025-10-02T09:36:57.812293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Write session: Do CDS request
2025-10-02T09:36:57.812298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.821119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.821227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.821241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3421
2025-10-02T09:36:57.821338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.821361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.821369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.821371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.821728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3421 sessionId:  describe result for acl check
2025-10-02T09:36:57.821764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.821771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.821772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.821775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.822119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.823796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.825345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.825614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.825719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.825730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.825732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764673250:4629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.825736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.825761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.825767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.825774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.825811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.825836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689086710:4556]
2025-10-02T09:36:57.826182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.826350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.826378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.826577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.826608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.826612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.826613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.826613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.826614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.826614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.826615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.826616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.826616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.826617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.826617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.826618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.826621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.826627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.826629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.826631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.826633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.826635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.826637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.826639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.826641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.826643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.826645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.826647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.826651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.826654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.826658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.826661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.826663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.826666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.826668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.826673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.826675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.826678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.826680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.826682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.826684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.826687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.826689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.826692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.826695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.826698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.826700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.826703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.826705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.826708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.826713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.826716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.826734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.834255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.835893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.835909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.835910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.835913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.835918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3420 [2:7556556085689086710:4556]
2025-10-02T09:36:57.835928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.835945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.835951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.835953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.835955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.835968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.835976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.835982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.836031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.836038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.836039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.836042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.836044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.836097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.836105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.836114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.836120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.836130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.836150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673342:4629], now have 1 active actors on pipe
2025-10-02T09:36:57.836158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673083:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.836162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.836163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.836165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.836175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.836190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.836190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.836198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.836199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.836199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.836202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.836183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3420
2025-10-02T09:36:57.836189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3420
2025-10-02T09:36:57.836230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.836241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.836248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.836255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.836258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.836297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.836308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.836310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.836313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.836319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.836331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.836344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.836459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.836471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.836489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.836565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3421 partition: 0 MaxSeqNo: 36 sessionId: src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0
2025-10-02T09:36:57.836834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae0e8bd2-46b9c599-ece61062-f83c88be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.839157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Write session: try to update token
2025-10-02T09:36:57.839171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.845347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.845358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.845359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.845360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.845364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.845367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.845369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689086705:4556]
2025-10-02T09:36:57.845390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.845395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.845396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.845396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.845400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.845402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.845507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.851445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId: src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.853738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:57.911868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556085764673354:4174]
2025-10-02T09:36:57.912074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3420, pipe: [1:7556556085764673354:4174]
2025-10-02T09:36:57.957321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:57.957647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.957657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.957671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673354:4174], now have 1 active actors on pipe
2025-10-02T09:36:57.957780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:57.957814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:57.957822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:57.957863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556085764673354:4174]
2025-10-02T09:36:57.957876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3421 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0
2025-10-02T09:36:57.958017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3421 sessionId: src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0 is DEAD
2025-10-02T09:36:57.958199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:57.958216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Write session will restart in 0.008584s
2025-10-02T09:36:57.958237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Write session: Do CDS request
2025-10-02T09:36:57.958242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:57.968302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.968344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:57.968356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3422
2025-10-02T09:36:57.968525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:57.968550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:57.968559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:57.968562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:57.968876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3422 sessionId:  describe result for acl check
2025-10-02T09:36:57.968908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:57.968912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:57.968913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:57.968916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:57.969286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:57.969708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:57.970827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:57.971395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:57.971492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:57.971499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:57.971505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:57.971530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:57.971552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556085689086974:4567]
2025-10-02T09:36:57.971903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:57.972066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:57.972089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:57.972287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:57.972321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.972325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.972326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.972326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.972327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.972327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.972328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.972329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.972329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.972330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.972330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.972331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.972333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.972339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.972341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.972343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.972345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.972347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.972349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.972351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.972353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.972355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.972357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.972359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.972362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.972366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:57.972369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.972372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:57.972374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.972376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:57.972378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.972381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:57.972383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.972386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:57.972388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.972394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:57.972397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.972399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:57.972401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.972404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:57.972406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.972409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:57.972411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.972414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.972418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.972422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.972425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.972431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.972447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:57.972698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:57.972710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:57.972712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556085764673588:4632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:57.972718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:57.979817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:57.981433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:57.981447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:57.981449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:57.981451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:57.981455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3421 [2:7556556085689086974:4567]
2025-10-02T09:36:57.981462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:57.981471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:57.981476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.981477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.981478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.981488Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:57.981490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:57.981494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:57.981522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.981527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.981528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.981530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:57.981531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:57.981566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:57.981571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.981577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:57.981582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:57.981594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:57.981608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673625:4632], now have 1 active actors on pipe
2025-10-02T09:36:57.981614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556085764673366:2446], now have 1 active actors on pipe
2025-10-02T09:36:57.981617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.981619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.981620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.981627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:57.981637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:57.981645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:57.981647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:57.981648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:57.981653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:57.981654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:57.981662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.981664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:57.981657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3421
2025-10-02T09:36:57.981668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3421
2025-10-02T09:36:57.981682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:57.981697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.981702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.981714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:57.981721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:57.981723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:57.981725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:57.981729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:57.981737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:57.981746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.981870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:57.981878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:57.981887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:57.981956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3422 partition: 0 MaxSeqNo: 36 sessionId: src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0
2025-10-02T09:36:57.982216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67dfcf7-cd8f5a34-d5d731ce-714ac43_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:57.984457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Write session: try to update token
2025-10-02T09:36:57.984470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:57.990681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:57.990691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:57.990692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:57.990694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:57.990697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.990699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.990701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556085689086968:4567]
2025-10-02T09:36:57.990719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:57.990724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:57.990725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:57.990726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:57.990727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:57.990728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:57.990832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:57.996399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId: src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:57.998744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.058279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059640932:4174]
2025-10-02T09:36:58.058465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3421, pipe: [1:7556556090059640932:4174]
2025-10-02T09:36:58.101385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.101816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.101830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.101845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059640932:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.101982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.102069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059640932:4174]
2025-10-02T09:36:58.102069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.102098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:58.102152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3422 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0
2025-10-02T09:36:58.102295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3422 sessionId: src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0 is DEAD
2025-10-02T09:36:58.102464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:58.102475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Write session will restart in 0.007878s
2025-10-02T09:36:58.102498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Write session: Do CDS request
2025-10-02T09:36:58.102504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.111178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.111287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.111299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3423
2025-10-02T09:36:58.111422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.111453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.111460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.111463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.111830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3423 sessionId:  describe result for acl check
2025-10-02T09:36:58.111860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.111866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.111867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.111870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.112219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.114357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.116274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.116481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.116490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.116493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059641076:4643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.116497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.116502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.116619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.116626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.116632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.116661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.116683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984054535:4587]
2025-10-02T09:36:58.117063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.117234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.117257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.117450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.117484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.117487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.117488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.117489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.117489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.117490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.117490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.117491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.117491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.117492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.117492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.117493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.117496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.117502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.117504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.117506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.117508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.117510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.117512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.117514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.117516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.117518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.117520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.117522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.117526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.117530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.117533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.117536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.117539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.117541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.117545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.117550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.117553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.117557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.117561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.117565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.117568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.117575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.117579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.117586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.117588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.117591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.117594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.117598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.117600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.117603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.117607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.117610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.117641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.125036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.126626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.126638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.126639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.126641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.126644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3422 [2:7556556089984054535:4587]
2025-10-02T09:36:58.126650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.126659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.126660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.126662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.126663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.126671Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.126674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.126679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.126708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.126713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.126714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.126716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.126717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.126869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.126876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.126883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.126852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3422
2025-10-02T09:36:58.126861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3422
2025-10-02T09:36:58.126889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.126902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.126916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641194:4643], now have 1 active actors on pipe
2025-10-02T09:36:58.126922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059640933:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.126931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.126935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.126947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.126951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.126952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.126960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.126971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.126973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.126975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.126977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.126981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.126983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.126992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e76247a2-8008d28a-af0b1030-51ae9537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.126998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.127000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.127001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.127005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.127011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.127030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.127040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.127055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.127058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.127179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.127186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.127195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.127267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3423 partition: 0 MaxSeqNo: 36 sessionId: src_id|e76247a2-8008d28a-af0b1030-51ae9537_0
2025-10-02T09:36:58.127546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aad57b7-11946e73-bdf7fa03-2c11d1bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e76247a2-8008d28a-af0b1030-51ae9537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.129838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Write session: try to update token
2025-10-02T09:36:58.129855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.140093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:58.140105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.140109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.140130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:58.140134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:58.140269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:58.140395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:58.140513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:58.140651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:58.140822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:58.140848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:58.142167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId: src_id|e76247a2-8008d28a-af0b1030-51ae9537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.144375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.144386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.144388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.144389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.144392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.144394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.144396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984054529:4587]
2025-10-02T09:36:58.144414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.144415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.144416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.144418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.144419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.144420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.144511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.144527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.202156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059641206:4174]
2025-10-02T09:36:58.202321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3422, pipe: [1:7556556090059641206:4174]
2025-10-02T09:36:58.256664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.256962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.256972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.256985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641206:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.257159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.257181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.257187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:58.257190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:58.257228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059641206:4174]
2025-10-02T09:36:58.257265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3423 reason: error at write: Disconnected sessionId: src_id|e76247a2-8008d28a-af0b1030-51ae9537_0
2025-10-02T09:36:58.257443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3423 sessionId: src_id|e76247a2-8008d28a-af0b1030-51ae9537_0 is DEAD
2025-10-02T09:36:58.257609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:58.257622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Write session will restart in 0.005732s
2025-10-02T09:36:58.257642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Write session: Do CDS request
2025-10-02T09:36:58.257648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.264197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.264287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.264300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3424
2025-10-02T09:36:58.264405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.264428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.264439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.264445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.264762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3424 sessionId:  describe result for acl check
2025-10-02T09:36:58.264818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.264824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.264825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.264828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.265182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.267129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.269118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.269128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.269129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059641285:4657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.269133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.269679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.271533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.271645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.271652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.271658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.271683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.271707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984054801:4571]
2025-10-02T09:36:58.272060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.272231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.272255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.272428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.272455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.272459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.272459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.272460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.272460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.272461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.272461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.272462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.272462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.272463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.272463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.272464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.272466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.272472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.272474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.272477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.272478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.272480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.272482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.272484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.272486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.272488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.272490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.272492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.272495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.272499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.272503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.272505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.272507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.272510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.272512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.272514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.272517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.272519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.272521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.272524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.272526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.272529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.272530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.272533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.272536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.272539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.272541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.272543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.272546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.272551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.272553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.272555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.272571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.279951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.281632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.281643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.281644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.281646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.281649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3423 [2:7556556089984054801:4571]
2025-10-02T09:36:58.281656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.281664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.281669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.281670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.281671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.281680Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.281683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.281687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.281716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.281721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.281722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.281724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.281726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.281759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.281763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.281770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.281775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.281787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.281800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641467:4657], now have 1 active actors on pipe
2025-10-02T09:36:58.281806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641207:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.281809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.281810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.281811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.281818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.281825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.281828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.281829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.281830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.281835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.281836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.281849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.281857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.281859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.281851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3423
2025-10-02T09:36:58.281879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.281884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.281897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.281905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.281906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.281908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.281913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.281920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.281913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3423
2025-10-02T09:36:58.281930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.282050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.282056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.282064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.282135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3424 partition: 0 MaxSeqNo: 36 sessionId: src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0
2025-10-02T09:36:58.282389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76247a2-8008d28a-af0b1030-51ae9537_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.284730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Write session: try to update token
2025-10-02T09:36:58.284745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.290890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.290901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.290902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.290903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.290906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.290908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.290910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984054796:4571]
2025-10-02T09:36:58.290928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.290930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.290931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.290932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.290933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.290935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.291069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.297018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId: src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.299255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.357282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059641495:4174]
2025-10-02T09:36:58.357421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3423, pipe: [1:7556556090059641495:4174]
2025-10-02T09:36:58.401502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.401880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.401894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.401907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641495:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.402075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.402080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:58.402096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:58.402100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059641495:4174]
2025-10-02T09:36:58.402125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.402145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3424 reason: error at write: Disconnected sessionId: src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0
2025-10-02T09:36:58.402292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3424 sessionId: src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0 is DEAD
2025-10-02T09:36:58.402444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:58.402456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Write session will restart in 0.005095s
2025-10-02T09:36:58.402479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Write session: Do CDS request
2025-10-02T09:36:58.402484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.408138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.408328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.408341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3425
2025-10-02T09:36:58.408439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.408465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.408472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.408476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.408847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3425 sessionId:  describe result for acl check
2025-10-02T09:36:58.408881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.408887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.408889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.408893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.409323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.411594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.414119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.414130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.414132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059641549:4688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.414137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.414704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.416398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.416505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.416511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.416517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.416542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.416569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984055081:4573]
2025-10-02T09:36:58.416949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.417134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.417168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.417372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.417405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.417409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.417409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.417410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.417410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.417411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.417411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.417412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.417412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.417413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.417413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.417414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.417416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.417423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.417425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.417427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.417429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.417431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.417433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.417435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.417437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.417439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.417441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.417443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.417447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.417450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.417453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.417456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.417459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.417461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.417464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.417466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.417469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.417471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.417473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.417476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.417479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.417481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.417483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.417486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.417488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.417495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.417498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.417500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.417503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.417505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.417508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.417511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.424907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.426549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.426563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.426565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.426567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.426572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3424 [2:7556556089984055081:4573]
2025-10-02T09:36:58.426583Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.426594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.426600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.426602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.426604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.426614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.426618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.426624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.426664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.426670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.426671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.426673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.426675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.426722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.426728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.426734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.426739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.426751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.426764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641757:4688], now have 1 active actors on pipe
2025-10-02T09:36:58.426769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641496:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.426772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.426774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.426775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.426782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.426791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.426799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.426801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.426802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.426806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.426811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.426826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.426831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.426836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.426816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3424
2025-10-02T09:36:58.426825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3424
2025-10-02T09:36:58.426848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.426853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.426874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.426883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.426886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.426892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.426896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.426902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.426912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.427074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.427082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.427094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.427164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3425 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0
2025-10-02T09:36:58.427442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3c54a62-7c9adc38-824cb89a-6fa81fc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.430279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Write session: try to update token
2025-10-02T09:36:58.430291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.436015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.436033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.436035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.436036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.436041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.436044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.436046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984055076:4573]
2025-10-02T09:36:58.436068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.436072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.436074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.436078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.436082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.436085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.436189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.441861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId: src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.444256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.502220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059641770:4174]
2025-10-02T09:36:58.502420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3424, pipe: [1:7556556090059641770:4174]
2025-10-02T09:36:58.545011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.545231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.545241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.545253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641770:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.545418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.545449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059641770:4174]
2025-10-02T09:36:58.545485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:58.545565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0
2025-10-02T09:36:58.545606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.545736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3425 sessionId: src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0 is DEAD
2025-10-02T09:36:58.545903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:58.545914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Write session will restart in 0.008718s
2025-10-02T09:36:58.545929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Write session: Do CDS request
2025-10-02T09:36:58.545934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.555266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.555350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.555367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3426
2025-10-02T09:36:58.555471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.555495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.555504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.555507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.555814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3426 sessionId:  describe result for acl check
2025-10-02T09:36:58.555843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.555849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.555852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.555855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.556179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.558129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.558329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.560070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.560175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.560182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.560188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.560214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.560240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984055360:4579]
2025-10-02T09:36:58.560294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.560304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.560305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059641931:4704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.560308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.560590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.560778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.560814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.560991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.561019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.561023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.561023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.561024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.561025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.561025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.561026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.561026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.561028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.561029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.561031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.561038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.561040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.561042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.561044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.561046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.561048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.561051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.561053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.561055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.561057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.561059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.561062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.561066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.561069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.561072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.561076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.561079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.561083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.561085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.561087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.561090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.561096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.561099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.561101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.561104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.561110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.561113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.561115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.561117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.561123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.561126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.561128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.561131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.561136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.561138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.561155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.568523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.570161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.570173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.570174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.570176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.570180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3425 [2:7556556089984055360:4579]
2025-10-02T09:36:58.570187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.570196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.570197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.570199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.570200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.570208Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.570215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.570219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.570256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.570260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.570261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.570263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.570264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.570298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.570303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.570311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.570316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.570324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.570338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059641772:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.570345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.570346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.570347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.570352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.570358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642035:4704], now have 1 active actors on pipe
2025-10-02T09:36:58.570362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.570364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.570366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.570368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.570370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.570371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.570383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.570387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.570391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.570397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3425
2025-10-02T09:36:58.570408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3425
2025-10-02T09:36:58.570477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.570483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.570496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.570503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.570505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.570507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.570511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.570520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.570529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.570675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.570680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.570688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.570754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3426 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0
2025-10-02T09:36:58.570985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d916b6b-842ba9ed-d3b582f9-ed87b627_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.573474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Write session: try to update token
2025-10-02T09:36:58.573487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.579523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.579536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.579537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.579538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.579541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.579543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.579545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984055355:4579]
2025-10-02T09:36:58.579565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.579568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.579569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.579575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.579578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.579581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.579677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.585229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId: src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.587453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.645535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059642068:4174]
2025-10-02T09:36:58.645690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3425, pipe: [1:7556556090059642068:4174]
2025-10-02T09:36:58.690331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.690914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.690923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.690935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642068:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.691057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:58.691071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:58.691091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059642068:4174]
2025-10-02T09:36:58.691105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.691114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3426 reason: error at write: Disconnected sessionId: src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0
2025-10-02T09:36:58.691258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3426 sessionId: src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0 is DEAD
2025-10-02T09:36:58.691412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:58.691420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Write session will restart in 0.007023s
2025-10-02T09:36:58.691436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.691517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Write session: Do CDS request
2025-10-02T09:36:58.691523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.699162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.699247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.699259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3427
2025-10-02T09:36:58.699390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.699411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.699418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.699421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.699688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3427 sessionId:  describe result for acl check
2025-10-02T09:36:58.699715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.699720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.699722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.699727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.700057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.702381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.704282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.704292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.704294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059642150:4749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.704297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.704888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.706867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.707085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.707094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.707103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.707146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.707169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984055652:4621]
2025-10-02T09:36:58.707518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.707900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.707925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.708111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.708142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.708146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.708147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.708147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.708148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.708149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.708149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.708150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.708151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.708151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.708152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.708152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.708155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.708165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.708168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.708172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.708174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.708178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.708181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.708185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.708188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.708191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.708193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.708195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.708199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.708203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.708206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.708209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.708211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.708213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.708215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.708218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.708220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.708223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.708225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.708227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.708229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.708232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.708234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.708237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.708240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.708243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.708245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.708248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.708250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.708253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.708255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.708258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.708274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.715690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.717260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.717271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.717273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.717275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.717278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3426 [2:7556556089984055652:4621]
2025-10-02T09:36:58.717287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.717296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.717301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.717303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.717304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.717313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.717315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.717319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.717349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.717354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.717355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.717357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.717358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.717394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.717399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.717405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.717410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.717418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.717431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.717435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.717437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.717442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.717448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642332:4749], now have 1 active actors on pipe
2025-10-02T09:36:58.717449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.717452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.717453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.717454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642070:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.717458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.717465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.717467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.717479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.717486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.717508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.717495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3426
2025-10-02T09:36:58.717497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3426
2025-10-02T09:36:58.717566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.717572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.717587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be960b77-704363bd-93920d6f-d5ffadf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.717595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.717597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.717598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.717603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.717610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.717620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.717751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.717756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.717763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.717815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3427 partition: 0 MaxSeqNo: 36 sessionId: src_id|be960b77-704363bd-93920d6f-d5ffadf8_0
2025-10-02T09:36:58.718092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef625a4-e28b366-3f9eb6f-c32f9c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be960b77-704363bd-93920d6f-d5ffadf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.720419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Write session: try to update token
2025-10-02T09:36:58.720432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.726544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.726557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.726558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.726559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.726562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.726564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.726566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984055647:4621]
2025-10-02T09:36:58.726585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.726587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.726588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.726594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.726598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.726601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.726699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.732625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId: src_id|be960b77-704363bd-93920d6f-d5ffadf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.734796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.791451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059642346:4174]
2025-10-02T09:36:58.791612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3426, pipe: [1:7556556090059642346:4174]
2025-10-02T09:36:58.835460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.835684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.835693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.835706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642346:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.835870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.835903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059642346:4174]
2025-10-02T09:36:58.835921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.835996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:58.836052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3427 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be960b77-704363bd-93920d6f-d5ffadf8_0
2025-10-02T09:36:58.836190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3427 sessionId: src_id|be960b77-704363bd-93920d6f-d5ffadf8_0 is DEAD
2025-10-02T09:36:58.836351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:58.836364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Write session will restart in 0.009147s
2025-10-02T09:36:58.836385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Write session: Do CDS request
2025-10-02T09:36:58.836391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.846150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.846267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.846278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3428
2025-10-02T09:36:58.846396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.846418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.846425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.846429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.846809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3428 sessionId:  describe result for acl check
2025-10-02T09:36:58.846849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.846855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.846860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.846864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.847323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.849154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.849947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.851866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.851965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.851972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.851978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.852004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.852028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984055919:4606]
2025-10-02T09:36:58.852067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.852077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.852079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059642499:4771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.852084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.852372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.852535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.852559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.852761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.852764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.852765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.852765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.852766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.852766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.852767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.852767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.852768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.852768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.852769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.852769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.852772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.852778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.852780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.852782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.852784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.852786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.852789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.852790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.852792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.852795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.852796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.852798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.852813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.852817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.852820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.852823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.852825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.852828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.852830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.852832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.852835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.852837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.852839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.852842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.852845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.852847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.852849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.852852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.852854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.852856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.852859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.852862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.852864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.852867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.852869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.852871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.852888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:58.860222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:58.861762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:58.861773Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:58.861774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:58.861776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:58.861780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3427 [2:7556556089984055919:4606]
2025-10-02T09:36:58.861787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:58.861797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:58.861802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.861804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.861805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.861814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:58.861820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:58.861825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:58.861853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.861858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.861859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.861861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:58.861862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:58.861898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:58.861903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.861909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.861916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.861925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:58.861939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642347:2446], now have 1 active actors on pipe
2025-10-02T09:36:58.861945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642613:4771], now have 1 active actors on pipe
2025-10-02T09:36:58.861949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.861950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.861951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.861958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:58.861968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:58.861973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:58.861977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:58.861978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:58.861982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:58.861984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:58.861991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.861993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:58.861994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:58.862006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3427
2025-10-02T09:36:58.862025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3427
2025-10-02T09:36:58.862039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.862045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.862059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d932e183-541d879b-a2686629-ff8c3b64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:58.862066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:58.862068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:58.862069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:58.862074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:58.862086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:58.862095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.862212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.862219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.862230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:58.862296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3428 partition: 0 MaxSeqNo: 36 sessionId: src_id|d932e183-541d879b-a2686629-ff8c3b64_0
2025-10-02T09:36:58.862523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be960b77-704363bd-93920d6f-d5ffadf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d932e183-541d879b-a2686629-ff8c3b64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:58.864846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Write session: try to update token
2025-10-02T09:36:58.864861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:58.870983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:58.870993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:58.870995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:58.870996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:58.871000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.871002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.871003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984055914:4606]
2025-10-02T09:36:58.871022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:58.871025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.871025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:58.871027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:58.871028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:58.871030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:58.871152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:58.876918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId: src_id|d932e183-541d879b-a2686629-ff8c3b64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:58.879148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:58.935865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556090059642628:4174]
2025-10-02T09:36:58.936059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3427, pipe: [1:7556556090059642628:4174]
2025-10-02T09:36:58.979890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:58.980082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:58.980090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:58.980102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642628:4174], now have 1 active actors on pipe
2025-10-02T09:36:58.980229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:58.980288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:58.980309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:58.980336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556090059642628:4174]
2025-10-02T09:36:58.980399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d932e183-541d879b-a2686629-ff8c3b64_0
2025-10-02T09:36:58.980570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3428 sessionId: src_id|d932e183-541d879b-a2686629-ff8c3b64_0 is DEAD
2025-10-02T09:36:58.980731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:58.980740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Write session will restart in 0.005510s
2025-10-02T09:36:58.980759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Write session: Do CDS request
2025-10-02T09:36:58.980765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:58.987104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.987183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:58.987194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3429
2025-10-02T09:36:58.987281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:58.987305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:58.987313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:58.987316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:58.987710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3429 sessionId:  describe result for acl check
2025-10-02T09:36:58.987743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:58.987749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:58.987750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:58.987753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:58.988116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:58.990447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:58.992934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:58.992945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:58.992947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556090059642671:4783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:58.992951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:58.994859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:58.996978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:58.997077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:58.997084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:58.997090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:58.997116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:58.997139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556089984056190:4615]
2025-10-02T09:36:58.997477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:58.997657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:58.997678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:58.997851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:58.997883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.997889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.997890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.997891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.997892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.997893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.997893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.997894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.997895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.997896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.997897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.997898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.997902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.997909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.997911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.997913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.997915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.997917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.997918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.997920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.997922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.997924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.997926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.997928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.997932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.997936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:58.997939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.997942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:58.997944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.997947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:58.997949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.997952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:58.997954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.997956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:58.997958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.997961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:58.997963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.997965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:58.997967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.997970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:58.997972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.997975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:58.997977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.997980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:58.997982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.997985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:58.997989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.997991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:58.998009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.005395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.006783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.006796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.006797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.006799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.006802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3428 [2:7556556089984056190:4615]
2025-10-02T09:36:59.006809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.006819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.006824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.006825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.006826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.006835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.006839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.006843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.007022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.007028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.007029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.007031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.007032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.007078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.007083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.007090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.007095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.007105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.007119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642849:4783], now have 1 active actors on pipe
2025-10-02T09:36:59.007124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556090059642631:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.007128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.007129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.007130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.007138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.007148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.007150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.007153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.007154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.007160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.007161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.007174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.007182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.007184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.007182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3428
2025-10-02T09:36:59.007208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.007213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.007207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3428
2025-10-02T09:36:59.007227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7779634e-c394ef6d-ca404196-e99a127c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.007235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.007237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.007239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.007243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.007250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.007259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.007376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.007382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.007392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.007466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3429 partition: 0 MaxSeqNo: 36 sessionId: src_id|7779634e-c394ef6d-ca404196-e99a127c_0
2025-10-02T09:36:59.007699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d932e183-541d879b-a2686629-ff8c3b64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7779634e-c394ef6d-ca404196-e99a127c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.009941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Write session: try to update token
2025-10-02T09:36:59.009957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.015951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:59.015962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.015966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.015985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:59.015986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:59.016114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:59.016258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.016374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.016488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.016653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:59.016676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:59.022058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId: src_id|7779634e-c394ef6d-ca404196-e99a127c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.024214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.024226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.024227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.024227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.024230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.024232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.024235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556089984056185:4615]
2025-10-02T09:36:59.024254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.024254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.024256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.024256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.024257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.024258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.024292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.024361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.080744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354610209:4174]
2025-10-02T09:36:59.081010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3428, pipe: [1:7556556094354610209:4174]
2025-10-02T09:36:59.133714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.134022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.134033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.134046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610209:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.134181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:59.134220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.134256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:59.134276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354610209:4174]
2025-10-02T09:36:59.134344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3429 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7779634e-c394ef6d-ca404196-e99a127c_0
2025-10-02T09:36:59.134493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3429 sessionId: src_id|7779634e-c394ef6d-ca404196-e99a127c_0 is DEAD
2025-10-02T09:36:59.134657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:59.134665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Write session will restart in 0.008176s
2025-10-02T09:36:59.134689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Write session: Do CDS request
2025-10-02T09:36:59.134694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.144184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.144302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.144320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3430
2025-10-02T09:36:59.144426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.144452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.144461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.144465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.144835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3430 sessionId:  describe result for acl check
2025-10-02T09:36:59.144870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.144877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.144878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.144881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.145231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.147159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.148110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.149736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.149835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.149842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.149847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.149848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.149859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.149860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354610349:4799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.149864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.149873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.149896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279023756:4617]
2025-10-02T09:36:59.150236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.150390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.150601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.150631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.150635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.150635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.150636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.150637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.150637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.150638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.150639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.150639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.150640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.150640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.150641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.150643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.150650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.150652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.150654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.150656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.150658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.150660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.150662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.150664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.150666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.150668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.150670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.150673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.150677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.150680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.150683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.150691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.150693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.150699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.150701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.150703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.150706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.150708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.150712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.150714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.150717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.150721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.150724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.150729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.150736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.150738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.150740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.150746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.150748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.150751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.150767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.158145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.159635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.159647Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.159648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.159650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.159654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3429 [2:7556556094279023756:4617]
2025-10-02T09:36:59.159663Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.159671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.159673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.159674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.159675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.159684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.159686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.159691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.159726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.159731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.159732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.159734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.159736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.159772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.159777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.159784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.159789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.159800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.159814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610210:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.159819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610477:4799], now have 1 active actors on pipe
2025-10-02T09:36:59.159823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.159824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.159825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.159833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.159840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.159846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.159847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.159848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.159849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.159849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.159862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.159865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.159866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.159872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3429
2025-10-02T09:36:59.159886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3429
2025-10-02T09:36:59.159924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.159929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.159944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13962ed0-d2fe7222-1e89860b-1c210737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.159951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.159953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.159954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.159959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.159967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.159977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.160118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.160123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.160130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.160206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3430 partition: 0 MaxSeqNo: 36 sessionId: src_id|13962ed0-d2fe7222-1e89860b-1c210737_0
2025-10-02T09:36:59.160446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7779634e-c394ef6d-ca404196-e99a127c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13962ed0-d2fe7222-1e89860b-1c210737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.162759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Write session: try to update token
2025-10-02T09:36:59.162775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.168842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.168855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.168856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.168857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.168861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.168864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.168865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279023751:4617]
2025-10-02T09:36:59.168884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.168886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.168886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.168887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.168889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.168891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.168991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.174902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId: src_id|13962ed0-d2fe7222-1e89860b-1c210737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.177147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.234357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354610490:4174]
2025-10-02T09:36:59.234566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3429, pipe: [1:7556556094354610490:4174]
2025-10-02T09:36:59.277892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.278285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.278295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.278307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610490:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.278420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:59.278473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.278495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:59.278515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354610490:4174]
2025-10-02T09:36:59.278586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13962ed0-d2fe7222-1e89860b-1c210737_0
2025-10-02T09:36:59.278745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3430 sessionId: src_id|13962ed0-d2fe7222-1e89860b-1c210737_0 is DEAD
2025-10-02T09:36:59.278917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:59.278930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Write session will restart in 0.007318s
2025-10-02T09:36:59.278951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Write session: Do CDS request
2025-10-02T09:36:59.278957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.287156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.287246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.287259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3431
2025-10-02T09:36:59.287370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.287394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.287402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.287405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.287732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3431 sessionId:  describe result for acl check
2025-10-02T09:36:59.287765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.287766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.287767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.287770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.288068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.290236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.292485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.294255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.294361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.294369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.294374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.294384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.294395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.294401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.294397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354610591:4825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.294401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.294425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279024042:4616]
2025-10-02T09:36:59.294761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.294928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.294949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.295134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.295165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.295169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.295170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.295171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.295171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.295172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.295172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.295173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.295173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.295174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.295174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.295175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.295178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.295184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.295186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.295188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.295190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.295192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.295194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.295196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.295198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.295200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.295202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.295204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.295207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.295211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.295214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.295217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.295219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.295222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.295224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.295226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.295228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.295231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.295233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.295235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.295237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.295240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.295243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.295246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.295248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.295251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.295253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.295256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.295259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.295261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.295263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.295266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.295281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.302694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.304109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.304122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.304123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.304125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.304128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3430 [2:7556556094279024042:4616]
2025-10-02T09:36:59.304136Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.304145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.304150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.304151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.304152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.304162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.304167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.304172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.304201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.304205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.304206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.304208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.304209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.304246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.304251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.304258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.304263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.304275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.304288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610760:4825], now have 1 active actors on pipe
2025-10-02T09:36:59.304293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610491:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.304297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.304298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.304300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.304307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.304318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.304320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.304322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.304323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.304328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.304330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.304315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3430
2025-10-02T09:36:59.304344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.304349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.304350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.304347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3430
2025-10-02T09:36:59.304358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.304361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.304385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.304392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.304394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.304395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.304399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.304404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.304414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.304524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.304531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.304540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.304624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3431 partition: 0 MaxSeqNo: 36 sessionId: src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0
2025-10-02T09:36:59.304891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13962ed0-d2fe7222-1e89860b-1c210737_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.307698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Write session: try to update token
2025-10-02T09:36:59.307710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.313501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.313514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.313516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.313517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.313521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.313524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.313526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279024037:4616]
2025-10-02T09:36:59.313546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.313549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.313551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.313555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.313558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.313560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.313654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.319116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId: src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.321542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.378725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354610786:4174]
2025-10-02T09:36:59.378996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3430, pipe: [1:7556556094354610786:4174]
2025-10-02T09:36:59.423081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.423308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.423317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.423330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610786:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.423472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:59.423557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.423616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:59.423625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354610786:4174]
2025-10-02T09:36:59.423686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0
2025-10-02T09:36:59.423835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3431 sessionId: src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0 is DEAD
2025-10-02T09:36:59.423966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:59.423977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Write session will restart in 0.008181s
2025-10-02T09:36:59.423996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Write session: Do CDS request
2025-10-02T09:36:59.424000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.433220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.433384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.433401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3432
2025-10-02T09:36:59.433545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.433571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.433579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.433583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.434011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3432 sessionId:  describe result for acl check
2025-10-02T09:36:59.434034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.434040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.434041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.434044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.434392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.436445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.437359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.439205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.439305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.439311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.439317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.439344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.439335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.439347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.439349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354610924:4852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.439353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.439367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279024316:4627]
2025-10-02T09:36:59.439711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.439887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.439909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.440081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.440110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.440114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.440115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.440115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.440116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.440116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.440117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.440117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.440118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.440118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.440119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.440119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.440122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.440128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.440131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.440133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.440135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.440137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.440139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.440141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.440142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.440145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.440147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.440149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.440152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.440156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.440160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.440163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.440165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.440168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.440170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.440172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.440175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.440181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.440184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.440186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.440189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.440191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.440193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.440196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.440198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.440201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.440203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.440206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.440208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.440210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.440214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.440217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.440235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.447555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.449148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.449160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.449161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.449163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.449166Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3431 [2:7556556094279024316:4627]
2025-10-02T09:36:59.449172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.449181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.449182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.449184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.449185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.449194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.449201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.449206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.449236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.449241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.449242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.449244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.449245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.449281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.449285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.449292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.449296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.449306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.449320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354610787:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.449325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611056:4852], now have 1 active actors on pipe
2025-10-02T09:36:59.449329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.449330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.449331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.449338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.449348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.449350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.449352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.449353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.449358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.449359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.449372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.449378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.449383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.449371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3431
2025-10-02T09:36:59.449382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3431
2025-10-02T09:36:59.449427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.449432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.449448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11383eef-c02c2474-19368370-9fd1b910_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.449456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.449459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.449460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.449465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.449470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.449481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.449619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.449624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.449632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.449700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3432 partition: 0 MaxSeqNo: 36 sessionId: src_id|11383eef-c02c2474-19368370-9fd1b910_0
2025-10-02T09:36:59.449943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ab2757-ef5edbf6-5397281f-96bb5835_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11383eef-c02c2474-19368370-9fd1b910_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.452817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Write session: try to update token
2025-10-02T09:36:59.452826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.458256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:59.458269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.458274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.458294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:59.458295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:59.458425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:59.458544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.458656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.458775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.458937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:59.458960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:59.464143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId: src_id|11383eef-c02c2474-19368370-9fd1b910_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.466467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.466642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.466656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.466668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.466669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.466670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.466671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.466676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.466678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.466680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279024311:4627]
2025-10-02T09:36:59.466700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.466703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.466703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.466705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.466707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.466708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.466815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.523618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354611069:4174]
2025-10-02T09:36:59.523804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3431, pipe: [1:7556556094354611069:4174]
2025-10-02T09:36:59.575203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.575435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:36:59.575453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611069:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.575521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:59.575576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354611069:4174]
2025-10-02T09:36:59.575609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.575623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:59.575626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:59.575687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3432 reason: error at write: Disconnected sessionId: src_id|11383eef-c02c2474-19368370-9fd1b910_0
2025-10-02T09:36:59.575822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3432 sessionId: src_id|11383eef-c02c2474-19368370-9fd1b910_0 is DEAD
2025-10-02T09:36:59.576028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:59.576038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Write session will restart in 0.008206s
2025-10-02T09:36:59.576054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Write session: Do CDS request
2025-10-02T09:36:59.576058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.585215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.585296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.585308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3433
2025-10-02T09:36:59.585405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.585430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.585439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.585443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.585744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3433 sessionId:  describe result for acl check
2025-10-02T09:36:59.585776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.585780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.585781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.585784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.586118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.588079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.589346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.591236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.591331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.591338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.591344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.591342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.591352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.591353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354611204:4858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.591357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.591370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.591395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279024603:4671]
2025-10-02T09:36:59.591736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.591913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.591936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.592111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.592141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.592145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.592145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.592146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.592147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.592147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.592148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.592148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.592149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.592149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.592150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.592150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.592153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.592158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.592160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.592163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.592165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.592167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.592169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.592170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.592172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.592174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.592176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.592179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.592182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.592186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.592189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.592192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.592194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.592197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.592199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.592202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.592204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.592207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.592209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.592211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.592213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.592216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.592218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.592220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.592223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.592226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.592228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.592230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.592233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.592236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.592238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.592240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.592256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.599698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.601294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.601308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.601309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.601311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.601314Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3432 [2:7556556094279024603:4671]
2025-10-02T09:36:59.601320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.601330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.601335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.601336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.601337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.601345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.601348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.601353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.601385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.601391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.601392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.601394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.601396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.601440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.601445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.601453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.601459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.601470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.601485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611070:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.601491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611340:4858], now have 1 active actors on pipe
2025-10-02T09:36:59.601495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.601499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.601500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.601509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.601520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.601521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.601523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.601524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.601529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.601531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.601545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.601550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.601536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3432
2025-10-02T09:36:59.601556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.601552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3432
2025-10-02T09:36:59.601568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.601572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.601590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93575812-26a3346f-444aaa20-91442dd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.601597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.601600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.601602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.601608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.601616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.601625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.601757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.601769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.601787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.601872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3433 partition: 0 MaxSeqNo: 36 sessionId: src_id|93575812-26a3346f-444aaa20-91442dd9_0
2025-10-02T09:36:59.602142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11383eef-c02c2474-19368370-9fd1b910_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93575812-26a3346f-444aaa20-91442dd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.604971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Write session: try to update token
2025-10-02T09:36:59.604982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.610658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.610672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.610674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.610675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.610679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.610682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.610684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279024598:4671]
2025-10-02T09:36:59.610706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.610707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.610709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.610710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.610711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.610712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.610818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.617337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId: src_id|93575812-26a3346f-444aaa20-91442dd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.619604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.675698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354611374:4174]
2025-10-02T09:36:59.675912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3432, pipe: [1:7556556094354611374:4174]
2025-10-02T09:36:59.720309Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.720677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.720687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.720700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611374:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.720830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:59.720877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.720887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:36:59.720891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:36:59.720932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354611374:4174]
2025-10-02T09:36:59.720933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3433 reason: error at write: Disconnected sessionId: src_id|93575812-26a3346f-444aaa20-91442dd9_0
2025-10-02T09:36:59.721061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3433 sessionId: src_id|93575812-26a3346f-444aaa20-91442dd9_0 is DEAD
2025-10-02T09:36:59.721225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:36:59.721237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Write session will restart in 0.007028s
2025-10-02T09:36:59.721261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Write session: Do CDS request
2025-10-02T09:36:59.721267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.729169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.729249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.729261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3434
2025-10-02T09:36:59.729793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.729821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.729830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.729834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.730184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3434 sessionId:  describe result for acl check
2025-10-02T09:36:59.730212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.730218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.730220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.730224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.730645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.732818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.735117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.735128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.735130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354611469:4894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.735135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.735542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.737369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.737466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.737472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.737478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.737504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.737531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279024903:4670]
2025-10-02T09:36:59.737870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.738054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.738077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.738254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.738283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.738287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.738287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.738288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.738288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.738289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.738289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.738290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.738290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.738291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.738291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.738292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.738295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.738302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.738304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.738307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.738308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.738310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.738312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.738314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.738316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.738318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.738320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.738322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.738326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.738329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.738333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.738336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.738338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.738340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.738342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.738345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.738347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.738349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.738351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.738353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.738355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.738358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.738360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.738362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.738364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.738367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.738369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.738372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.738374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.738376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.738378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.738383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.738398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.745746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.747274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.747285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.747286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.747288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.747291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3433 [2:7556556094279024903:4670]
2025-10-02T09:36:59.747300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.747309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.747310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.747312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.747313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.747322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.747328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.747332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.747363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.747367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.747368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.747370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.747372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.747409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.747414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.747420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.747425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.747433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.747448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611378:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.747454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611649:4894], now have 1 active actors on pipe
2025-10-02T09:36:59.747457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.747458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.747459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.747466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.747476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.747479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.747481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.747482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.747485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.747486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.747499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.747502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.747503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.747509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3433
2025-10-02T09:36:59.747651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3433
2025-10-02T09:36:59.747685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.747690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.747704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.747711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.747713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.747714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.747719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.747724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.747731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.747856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.747861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.747867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.747919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3434 partition: 0 MaxSeqNo: 36 sessionId: src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0
2025-10-02T09:36:59.748188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93575812-26a3346f-444aaa20-91442dd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.750722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Write session: try to update token
2025-10-02T09:36:59.750738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.756341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:36:59.756351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.756355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.756374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:36:59.756374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:36:59.756504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:36:59.756618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.756728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.756859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:36:59.757006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:36:59.757028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:36:59.763190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId: src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.764760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.764772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.764773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.764774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.764779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.764782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.764784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279024898:4670]
2025-10-02T09:36:59.764814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.764817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.764818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.764823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.764826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.764828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.764924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.765478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.821097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354611666:4174]
2025-10-02T09:36:59.821286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3433, pipe: [1:7556556094354611666:4174]
2025-10-02T09:36:59.872870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:36:59.873328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.873338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.873351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611666:4174], now have 1 active actors on pipe
2025-10-02T09:36:59.873470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:36:59.873500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354611666:4174]
2025-10-02T09:36:59.873524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:36:59.873531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:36:59.873581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3434 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0
2025-10-02T09:36:59.873726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3434 sessionId: src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0 is DEAD
2025-10-02T09:36:59.873916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:36:59.873930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Write session will restart in 0.007611s
2025-10-02T09:36:59.873951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Write session: Do CDS request
2025-10-02T09:36:59.873956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:36:59.882160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.882250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:36:59.882263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3435
2025-10-02T09:36:59.882389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:36:59.882415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:36:59.882423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:36:59.882427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:36:59.882768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3435 sessionId:  describe result for acl check
2025-10-02T09:36:59.882796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:36:59.882803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:36:59.882804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:36:59.882809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:36:59.883258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:36:59.885476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:36:59.887566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:36:59.887575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:36:59.887577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556094354611762:4907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:36:59.887582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:36:59.887838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:36:59.889406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:36:59.889505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:36:59.889512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:36:59.889520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:36:59.889555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:36:59.889582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556094279025179:4661]
2025-10-02T09:36:59.889926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:36:59.890090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:36:59.890113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:36:59.890291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:36:59.890320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.890324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.890325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.890325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.890326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.890326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.890327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.890327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.890328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.890328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.890329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.890330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.890333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.890339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.890341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.890343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.890345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.890349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.890351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.890353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.890355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.890357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.890359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.890362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.890366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:36:59.890369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.890372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:36:59.890375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.890377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:36:59.890380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.890382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:36:59.890385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.890388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:36:59.890390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.890392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:36:59.890394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.890397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:36:59.890399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.890402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:36:59.890404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.890407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:36:59.890409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.890411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.890415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.890418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.890420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.890422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.890439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:36:59.897810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:36:59.899301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:36:59.899314Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:36:59.899315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:36:59.899317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:36:59.899321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3434 [2:7556556094279025179:4661]
2025-10-02T09:36:59.899328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:36:59.899337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:36:59.899339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.899340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.899342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.899350Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:36:59.899353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:36:59.899357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:36:59.899388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.899392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.899394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.899396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:36:59.899397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:36:59.899434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:36:59.899438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.899444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:36:59.899450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:36:59.899457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:36:59.899473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611939:4907], now have 1 active actors on pipe
2025-10-02T09:36:59.899478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611668:2446], now have 1 active actors on pipe
2025-10-02T09:36:59.899482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.899484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.899485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.899493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:36:59.899503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:36:59.899503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:36:59.899505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:36:59.899506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:36:59.899513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:36:59.899514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:36:59.899527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.899532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:36:59.899533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:36:59.899515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3434
2025-10-02T09:36:59.899547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.899535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3434
2025-10-02T09:36:59.899552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.899570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:36:59.899577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:36:59.899579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:36:59.899580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:36:59.899584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:36:59.899589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:36:59.899603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.899722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:36:59.899729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:36:59.899738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:36:59.899816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3435 partition: 0 MaxSeqNo: 36 sessionId: src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0
2025-10-02T09:36:59.900099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaa330b-1ff86feb-52f8142e-d5ac995a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:36:59.902447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Write session: try to update token
2025-10-02T09:36:59.902464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:36:59.908452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:36:59.908464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:36:59.908465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:36:59.908466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:36:59.908470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.908472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.908474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556094279025174:4661]
2025-10-02T09:36:59.908493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:36:59.908494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:36:59.908496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:36:59.908496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:36:59.908497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:36:59.908498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:36:59.908604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:36:59.914482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId: src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:36:59.916566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:36:59.973684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556094354611957:4174]
2025-10-02T09:36:59.973883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3434, pipe: [1:7556556094354611957:4174]
2025-10-02T09:37:00.017987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.018206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.018215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.018228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556094354611957:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.018359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.018432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:00.018445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:00.018445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556094354611957:4174]
2025-10-02T09:37:00.018465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.018499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3435 reason: error at write: Disconnected sessionId: src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0
2025-10-02T09:37:00.018652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3435 sessionId: src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0 is DEAD
2025-10-02T09:37:00.018825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:00.018840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Write session will restart in 0.007721s
2025-10-02T09:37:00.018864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Write session: Do CDS request
2025-10-02T09:37:00.018869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.027196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.027300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.027318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3436
2025-10-02T09:37:00.027436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.027463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.027473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.027477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.027969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3436 sessionId:  describe result for acl check
2025-10-02T09:37:00.028008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.028015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.028017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.028021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.028544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.030787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.032988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.033001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.033007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649579359:4927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.033014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.033100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.034969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.035082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.035089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.035095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.035124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.035150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573992752:4663]
2025-10-02T09:37:00.035510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.035692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.035715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.035898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.035927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.035932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.035932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.035933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.035934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.035934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.035936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.035936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.035937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.035939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.035947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.035949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.035951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.035953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.035955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.035957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.035959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.035961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.035964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.035966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.035968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.035972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.035975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.035979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.035982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.035984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.035986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.035988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.035991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.035993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.035996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.035998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.036001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.036003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.036006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.036008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.036011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.036016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.036020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.036026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.036029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.036031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.036037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.036039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.036042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.036064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.043675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.045126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.045139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.045140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.045142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.045147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3435 [2:7556556098573992752:4663]
2025-10-02T09:37:00.045155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.045167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.045169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.045170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.045171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.045180Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.045187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.045192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.045225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.045230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.045231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.045233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.045235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.045344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.045350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.045357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.045362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.045376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.045391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579531:4927], now have 1 active actors on pipe
2025-10-02T09:37:00.045397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579257:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.045400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.045401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.045403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.045412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.045424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.045426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.045429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.045430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.045401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3435
2025-10-02T09:37:00.045435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.045437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.045401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3435
2025-10-02T09:37:00.045464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.045469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.045478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.045485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.045497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.045508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c963349-3691c41b-eac04432-902fabc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.045515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.045517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.045521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.045526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.045531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.045546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.045670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.045676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.045684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.045745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3436 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c963349-3691c41b-eac04432-902fabc2_0
2025-10-02T09:37:00.046028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982cd28d-722dbb94-1c6f829b-473b93e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c963349-3691c41b-eac04432-902fabc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.048317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Write session: try to update token
2025-10-02T09:37:00.048330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.054688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.054700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.054702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.054703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.054707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.054709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.054713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573992746:4663]
2025-10-02T09:37:00.054732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.054735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.054736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.054736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.054739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.054740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.055106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.060895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId: src_id|1c963349-3691c41b-eac04432-902fabc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.063272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.118603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649579543:4174]
2025-10-02T09:37:00.118804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3435, pipe: [1:7556556098649579543:4174]
2025-10-02T09:37:00.167883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.168247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.168256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.168269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579543:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.168381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.168449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649579543:4174]
2025-10-02T09:37:00.168449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.168492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:00.168579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c963349-3691c41b-eac04432-902fabc2_0
2025-10-02T09:37:00.168736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3436 sessionId: src_id|1c963349-3691c41b-eac04432-902fabc2_0 is DEAD
2025-10-02T09:37:00.168892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:00.168909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Write session will restart in 0.008301s
2025-10-02T09:37:00.168929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Write session: Do CDS request
2025-10-02T09:37:00.168935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.178176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.178277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.178293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3437
2025-10-02T09:37:00.178404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.178432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.178441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.178445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.178778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3437 sessionId:  describe result for acl check
2025-10-02T09:37:00.178806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.178813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.178815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.178819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.179265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.181249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.182432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.184255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.184362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.184369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.184375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.184400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.184430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573993030:4676]
2025-10-02T09:37:00.184537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.184548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.184550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649579676:4945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.184556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.184780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.184945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.184969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.185148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.185177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.185181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.185182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.185182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.185183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.185183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.185184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.185184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.185185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.185185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.185186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.185186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.185189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.185196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.185198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.185200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.185202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.185204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.185206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.185208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.185210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.185212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.185213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.185215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.185219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.185223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.185226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.185229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.185231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.185234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.185237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.185240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.185242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.185244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.185246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.185249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.185251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.185254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.185256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.185259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.185261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.185264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.185267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.185273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.185275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.185277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.185281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.185285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.185316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.192769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.194287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.194300Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.194301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.194303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.194306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3436 [2:7556556098573993030:4676]
2025-10-02T09:37:00.194314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.194324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.194327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.194328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.194329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.194338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.194341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.194347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.194378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.194383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.194384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.194386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.194387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.194430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.194435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.194441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.194446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.194456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.194470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579544:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.194475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579819:4945], now have 1 active actors on pipe
2025-10-02T09:37:00.194479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.194480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.194482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.194491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.194501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.194503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.194505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.194506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.194509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.194510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.194523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.194528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.194529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.194557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3436
2025-10-02T09:37:00.194563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3436
2025-10-02T09:37:00.194602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.194607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.194622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.194629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.194631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.194632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.194637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.194643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.194653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.194788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.194792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.194799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.194869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3437 partition: 0 MaxSeqNo: 36 sessionId: src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0
2025-10-02T09:37:00.195244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963349-3691c41b-eac04432-902fabc2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.198133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Write session: try to update token
2025-10-02T09:37:00.198144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.207646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:00.207665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.207672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.207704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:00.207706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:00.207837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:00.207955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:00.208083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:00.208207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:00.208374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:00.208402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:00.209609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId: src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.212086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.212097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.212099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.212100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.212104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.212107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.212086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.212110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573993025:4676]
2025-10-02T09:37:00.212127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.212128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.212131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.212131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.212132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.212133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.212246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.268611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649579831:4174]
2025-10-02T09:37:00.268866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3436, pipe: [1:7556556098649579831:4174]
2025-10-02T09:37:00.326758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.327055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.327073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.327086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579831:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.327221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.327326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.327346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649579831:4174]
2025-10-02T09:37:00.327377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:00.327460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0
2025-10-02T09:37:00.327618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3437 sessionId: src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0 is DEAD
2025-10-02T09:37:00.327748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:00.327762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Write session will restart in 0.009036s
2025-10-02T09:37:00.327784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Write session: Do CDS request
2025-10-02T09:37:00.327789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.338211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.338279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.338292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3438
2025-10-02T09:37:00.338396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.338417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.338423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.338427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.338806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3438 sessionId:  describe result for acl check
2025-10-02T09:37:00.338851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.338858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.338860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.338864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.339337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.340900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.341198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.342838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.342952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.342959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.342965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.342993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.343016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573993321:4680]
2025-10-02T09:37:00.343069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.343079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.343081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649580015:4958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.343086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.343389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.343560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.343583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.343868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.343906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.343910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.343911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.343911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.343912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.343913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.343913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.343914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.343914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.343915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.343915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.343916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.343918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.343924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.343926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.343928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.343930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.343932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.343934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.343936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.343938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.343940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.343941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.343943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.343947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.343951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.343955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.343958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.343960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.343962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.343964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.343967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.343969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.343972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.343974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.343976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.343978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.343981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.343983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.343986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.343988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.343991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.343993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.343995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.343998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.344001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.344005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.344011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.344028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.351404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.352786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.352812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.352817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.352820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.352823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3437 [2:7556556098573993321:4680]
2025-10-02T09:37:00.352830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.352840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.352842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.352843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.352844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.352854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.352858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.352866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.352898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.352903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.352904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.352906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.352908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.352945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.352950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.352957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.352962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.352970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.352984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580109:4958], now have 1 active actors on pipe
2025-10-02T09:37:00.352990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649579832:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.352994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.352995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.352996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.353004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.353014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.353016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.353018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.353019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.353024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.353026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.353039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.353044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.353046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.353058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.353064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.353033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3437
2025-10-02T09:37:00.353063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3437
2025-10-02T09:37:00.353085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.353092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.353094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.353095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.353100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.353105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.353118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.353206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.353212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.353221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.353286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3438 partition: 0 MaxSeqNo: 36 sessionId: src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0
2025-10-02T09:37:00.353489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27889ac9-5bea26c3-cfab708c-fd95fb6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.356194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Write session: try to update token
2025-10-02T09:37:00.356205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.362225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.362241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.362242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.362243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.362248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.362251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.362254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573993316:4680]
2025-10-02T09:37:00.362277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.362280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.362280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.362281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.362284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.362286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.362393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.367610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId: src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.369685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.427311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649580133:4174]
2025-10-02T09:37:00.427492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3437, pipe: [1:7556556098649580133:4174]
2025-10-02T09:37:00.473454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.473808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.473817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.473829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580133:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.473972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.473996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649580133:4174]
2025-10-02T09:37:00.474032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.474048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:00.474153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3438 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0
2025-10-02T09:37:00.474317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3438 sessionId: src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0 is DEAD
2025-10-02T09:37:00.474470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:00.474478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Write session will restart in 0.008520s
2025-10-02T09:37:00.474493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Write session: Do CDS request
2025-10-02T09:37:00.474498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.484189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.484279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.484292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3439
2025-10-02T09:37:00.484378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.484399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.484405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.484409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.484793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3439 sessionId:  describe result for acl check
2025-10-02T09:37:00.484841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.484848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.484849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.484854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.485294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.487590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.488021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.489898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.490004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.490011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.490016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.490043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.490067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573993603:4689]
2025-10-02T09:37:00.490114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.490124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.490127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649580291:4987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.490132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.490436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.490607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.490631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.490807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.490837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.490841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.490841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.490842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.490843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.490843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.490844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.490844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.490845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.490845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.490846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.490846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.490849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.490856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.490858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.490860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.490862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.490864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.490866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.490868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.490870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.490872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.490874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.490876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.490880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.490884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.490888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.490891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.490893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.490895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.490898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.490900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.490904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.490907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.490909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.490911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.490914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.490916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.490918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.490921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.490923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.490926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.490928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.490932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.490934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.490937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.490939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.490942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.490961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.498332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.499753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.499766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.499767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.499769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.499773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3438 [2:7556556098573993603:4689]
2025-10-02T09:37:00.499780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.499790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.499791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.499793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.499794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.499803Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.499809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.499813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.499845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.499850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.499851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.499853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.499855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.499891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.499895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.499903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.499916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.499933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.499950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580134:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.499955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580411:4987], now have 1 active actors on pipe
2025-10-02T09:37:00.499959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.499960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.499962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.499969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.499981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.499981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.499983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.499984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.499991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.499993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.500006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.500013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.500013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.499996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3438
2025-10-02T09:37:00.499999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3438
2025-10-02T09:37:00.500036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.500043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.500063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f74858d8-b4155e44-3b6aff18-f5924669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.500070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.500072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.500074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.500078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.500086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.500102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.500234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.500240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.500248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.500326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3439 partition: 0 MaxSeqNo: 36 sessionId: src_id|f74858d8-b4155e44-3b6aff18-f5924669_0
2025-10-02T09:37:00.500588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a204c5a9-fb13ba04-3471e2aa-63c629e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f74858d8-b4155e44-3b6aff18-f5924669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.503274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Write session: try to update token
2025-10-02T09:37:00.503284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.509321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.509336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.509338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.509339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.509344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.509347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.509350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573993598:4689]
2025-10-02T09:37:00.509371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.509374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.509375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.509377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.509380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.509384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.509483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.514838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId: src_id|f74858d8-b4155e44-3b6aff18-f5924669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.517161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.574263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649580423:4174]
2025-10-02T09:37:00.574509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3438, pipe: [1:7556556098649580423:4174]
2025-10-02T09:37:00.622432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.623018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.623029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.623040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580423:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.623158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.623180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649580423:4174]
2025-10-02T09:37:00.623211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:00.623215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:00.623282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3439 reason: error at write: Disconnected sessionId: src_id|f74858d8-b4155e44-3b6aff18-f5924669_0
2025-10-02T09:37:00.623440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3439 sessionId: src_id|f74858d8-b4155e44-3b6aff18-f5924669_0 is DEAD
2025-10-02T09:37:00.623533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.623574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:00.623582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Write session will restart in 0.008401s
2025-10-02T09:37:00.623601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Write session: Do CDS request
2025-10-02T09:37:00.623605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.633184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.633267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.633285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3440
2025-10-02T09:37:00.633412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.633438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.633447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.633450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.633792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3440 sessionId:  describe result for acl check
2025-10-02T09:37:00.633826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.633833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.633834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.633838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.634252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.636228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.637538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.639763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.639865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.639872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.639878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.639902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.639914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.639915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.639917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649580560:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.639922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.639940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573993913:4708]
2025-10-02T09:37:00.640294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.640472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.640496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.640673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.640702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.640706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.640707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.640707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.640708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.640709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.640709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.640710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.640710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.640711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.640711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.640712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.640715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.640720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.640722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.640725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.640726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.640729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.640730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.640733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.640735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.640737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.640739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.640741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.640745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.640749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.640752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.640755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.640758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.640760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.640762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.640765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.640767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.640770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.640772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.640774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.640776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.640779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.640781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.640783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.640785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.640788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.640792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.640794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.640797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.640810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.640812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.640815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.640832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.648226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.649699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.649712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.649713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.649716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.649719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3439 [2:7556556098573993913:4708]
2025-10-02T09:37:00.649726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.649736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.649737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.649739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.649740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.649748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.649755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.649759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.649789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.649794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.649795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.649796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.649798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.649835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.649841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.649847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.649852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.649863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.649877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580702:5012], now have 1 active actors on pipe
2025-10-02T09:37:00.649882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580424:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.649886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.649887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.649888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.649896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.649906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.649908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.649910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.649911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.649917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.649918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.649931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.649938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.649942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.649937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3439
2025-10-02T09:37:00.649968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3439
2025-10-02T09:37:00.649971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.649978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.649993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f41c8904-b6a86e65-603332af-aa3292cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.649996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.649998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.649999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.650004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.650010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.650016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.650123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.650129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.650138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.650213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3440 partition: 0 MaxSeqNo: 36 sessionId: src_id|f41c8904-b6a86e65-603332af-aa3292cc_0
2025-10-02T09:37:00.650444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74858d8-b4155e44-3b6aff18-f5924669_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f41c8904-b6a86e65-603332af-aa3292cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.652968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Write session: try to update token
2025-10-02T09:37:00.652980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.658986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.658998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.658999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.658999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.659003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.659005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.659007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573993908:4708]
2025-10-02T09:37:00.659026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.659028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.659029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.659030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.659030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.659033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.659145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.665075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId: src_id|f41c8904-b6a86e65-603332af-aa3292cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.667435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.723261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649580736:4174]
2025-10-02T09:37:00.723506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3439, pipe: [1:7556556098649580736:4174]
2025-10-02T09:37:00.769944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.770179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.770189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.770201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580736:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.770405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:00.770414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649580736:4174]
2025-10-02T09:37:00.770426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:00.770445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.770509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3440 reason: error at write: Disconnected sessionId: src_id|f41c8904-b6a86e65-603332af-aa3292cc_0
2025-10-02T09:37:00.770691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3440 sessionId: src_id|f41c8904-b6a86e65-603332af-aa3292cc_0 is DEAD
2025-10-02T09:37:00.770854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:00.770867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Write session will restart in 0.007138s
2025-10-02T09:37:00.770887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Write session: Do CDS request
2025-10-02T09:37:00.770893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.771261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.779239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.779299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.779316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3441
2025-10-02T09:37:00.779431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.779459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.779469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.779472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.779886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3441 sessionId:  describe result for acl check
2025-10-02T09:37:00.779922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.779927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.779928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.779932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.780296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.782563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.784228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.786065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.786168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.786176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.786182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.786208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.786234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573994201:4726]
2025-10-02T09:37:00.786337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.786346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.786348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649580847:5047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.786352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.786581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.786752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.786775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.786954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.786983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.786987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.786987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.786989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.786989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.786990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.786990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.786991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.786992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.786992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.786995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.787001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.787003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.787005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.787007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.787009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.787011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.787013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.787015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.787017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.787019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.787021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.787025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.787029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.787032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.787036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.787038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.787041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.787043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.787046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.787048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.787051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.787053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.787057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.787070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.787076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.787078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.787081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.787085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.787088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.787094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.787096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.787099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.787102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.787104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.787107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.787126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.794566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.796103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.796115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.796116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.796118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.796122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3440 [2:7556556098573994201:4726]
2025-10-02T09:37:00.796128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.796138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.796139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.796141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.796142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.796151Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.796155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.796159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.796187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.796192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.796193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.796195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.796196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.796232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.796237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.796243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.796248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.796257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.796270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649581015:5047], now have 1 active actors on pipe
2025-10-02T09:37:00.796276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649580737:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.796279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.796281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.796282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.796289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.796300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.796302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.796304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.796305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.796310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.796312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.796325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.796330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.796309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3440
2025-10-02T09:37:00.796338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.796344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3440
2025-10-02T09:37:00.796352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.796357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.796373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1037fb-63bb20f-a64aeefb-920df016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.796380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.796382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.796383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.796387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.796393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.796403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.796524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.796529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.796536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.796605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3441 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd1037fb-63bb20f-a64aeefb-920df016_0
2025-10-02T09:37:00.796910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41c8904-b6a86e65-603332af-aa3292cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd1037fb-63bb20f-a64aeefb-920df016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.799172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Write session: try to update token
2025-10-02T09:37:00.799189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.805554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.805565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.805566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.805567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.805571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.805573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.805576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573994196:4726]
2025-10-02T09:37:00.805594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.805597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.805597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.805598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.805599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.805601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.805717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.811708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId: src_id|dd1037fb-63bb20f-a64aeefb-920df016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.814017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:00.870694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556098649581028:4174]
2025-10-02T09:37:00.870888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3440, pipe: [1:7556556098649581028:4174]
2025-10-02T09:37:00.916865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:00.917073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.917083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.917096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649581028:4174], now have 1 active actors on pipe
2025-10-02T09:37:00.917236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:00.917279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:00.917299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:00.917318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556098649581028:4174]
2025-10-02T09:37:00.917334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:00.917377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3441 reason: error at write: Disconnected sessionId: src_id|dd1037fb-63bb20f-a64aeefb-920df016_0
2025-10-02T09:37:00.917515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3441 sessionId: src_id|dd1037fb-63bb20f-a64aeefb-920df016_0 is DEAD
2025-10-02T09:37:00.917777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:00.917791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Write session will restart in 0.008927s
2025-10-02T09:37:00.917815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Write session: Do CDS request
2025-10-02T09:37:00.917820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:00.928201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.928332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:00.928351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3442
2025-10-02T09:37:00.928464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:00.928491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:00.928501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:00.928505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:00.928958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3442 sessionId:  describe result for acl check
2025-10-02T09:37:00.928999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:00.929005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:00.929007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:00.929012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:00.929455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:00.931129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:00.931246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:00.933069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:00.933171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:00.933178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:00.933184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:00.933210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:00.933234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556098573994484:4718]
2025-10-02T09:37:00.933281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:00.933292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:00.933294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556098649581208:5062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:00.933300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:00.933587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:00.933747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:00.933769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:00.933946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:00.933976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.933980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.933981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.933981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.933982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.933982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.933983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.933984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.933984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.933984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.933985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.933985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.933989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.933996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.933998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.934000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.934002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.934004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.934006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.934008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.934010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.934013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.934015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.934017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.934021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.934024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:00.934028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.934031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:00.934033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.934036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:00.934038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.934041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:00.934043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.934045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:00.934049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.934051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:00.934054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.934056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:00.934059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.934062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:00.934066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.934068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:00.934071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.934073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.934076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.934080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.934082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.934085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.934101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:00.941442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:00.942918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:00.942929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:00.942930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:00.942932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:00.942935Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3441 [2:7556556098573994484:4718]
2025-10-02T09:37:00.942943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:00.942953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:00.942954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.942956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.942957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.942966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:00.942969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:00.942974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:00.943003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.943013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.943015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.943017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:00.943019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:00.943056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:00.943070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.943076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:00.943084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:00.943094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:00.943108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649581312:5062], now have 1 active actors on pipe
2025-10-02T09:37:00.943113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556098649581029:2446], now have 1 active actors on pipe
2025-10-02T09:37:00.943117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.943118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.943119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.943126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:00.943135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:00.943138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:00.943140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:00.943141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:00.943146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:00.943148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:00.943161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.943167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:00.943171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:00.943173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3441
2025-10-02T09:37:00.943177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3441
2025-10-02T09:37:00.943360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.943369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.943388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa990732-1804cf51-13f447c5-4ad8d283_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:00.943398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:00.943401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:00.943402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:00.943410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:00.943416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:00.943426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.943553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:00.943558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:00.943565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:00.943630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3442 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa990732-1804cf51-13f447c5-4ad8d283_0
2025-10-02T09:37:00.943936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1037fb-63bb20f-a64aeefb-920df016_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa990732-1804cf51-13f447c5-4ad8d283_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:00.946777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Write session: try to update token
2025-10-02T09:37:00.946789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:00.952320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:00.952334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:00.952336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:00.952337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:00.952342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.952344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.952346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556098573994479:4718]
2025-10-02T09:37:00.952367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:00.952370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:00.952372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:00.952372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:00.952375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:00.952377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:00.952487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:00.960731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId: src_id|aa990732-1804cf51-13f447c5-4ad8d283_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:00.963215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.017648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944548624:4174]
2025-10-02T09:37:01.017867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3441, pipe: [1:7556556102944548624:4174]
2025-10-02T09:37:01.064039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.064266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.064275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.064288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944548624:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.064453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.064493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:01.064494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944548624:4174]
2025-10-02T09:37:01.064514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:01.064519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.064615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3442 reason: error at write: Disconnected sessionId: src_id|aa990732-1804cf51-13f447c5-4ad8d283_0
2025-10-02T09:37:01.064775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3442 sessionId: src_id|aa990732-1804cf51-13f447c5-4ad8d283_0 is DEAD
2025-10-02T09:37:01.064939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:01.064955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Write session will restart in 0.008724s
2025-10-02T09:37:01.064976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Write session: Do CDS request
2025-10-02T09:37:01.064981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.075236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.075310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.075327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3443
2025-10-02T09:37:01.075446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.075471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.075479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.075482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.075832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3443 sessionId:  describe result for acl check
2025-10-02T09:37:01.075862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.075869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.075871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.075874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.076295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.078161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.079641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.079868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.079916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.079927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.079929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944548814:5087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.079935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.079984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.079992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.079999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.080028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.080056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868962064:4730]
2025-10-02T09:37:01.080403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.080564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.080587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.080762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.080792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.080796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.080797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.080798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.080798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.080799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.080814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.080814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.080815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.080815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.080816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.080816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.080819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.080826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.080828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.080830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.080832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.080834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.080836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.080838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.080840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.080842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.080844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.080846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.080850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.080854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.080857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.080860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.080863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.080865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.080871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.080874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.080876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.080879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.080882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.080884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.080887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.080893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.080895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.080898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.080903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.080908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.080910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.080912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.080914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.080917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.080919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.080921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.080940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.088276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.089934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.089946Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.089947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.089949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.089953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3442 [2:7556556102868962064:4730]
2025-10-02T09:37:01.089960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.089969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.089972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.089974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.089975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.089985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.089988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.089999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.090035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.090040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.090041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.090043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.090044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.090079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.090084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.090090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.090095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.090105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.090118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944548907:5087], now have 1 active actors on pipe
2025-10-02T09:37:01.090124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944548626:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.090128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.090132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.090133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.090140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.090150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.090153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.090155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.090156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.090161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.090162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.090176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.090178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.090179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.090179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3442
2025-10-02T09:37:01.090296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3442
2025-10-02T09:37:01.090332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.090339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.090360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acefea54-b214ba33-11322dc9-95cae679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.090370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.090374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.090380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.090386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.090393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.090404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.090523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.090528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.090535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.090598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3443 partition: 0 MaxSeqNo: 36 sessionId: src_id|acefea54-b214ba33-11322dc9-95cae679_0
2025-10-02T09:37:01.090859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa990732-1804cf51-13f447c5-4ad8d283_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|acefea54-b214ba33-11322dc9-95cae679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.093478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Write session: try to update token
2025-10-02T09:37:01.093493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.099356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.099370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.099371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.099372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.099376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.099379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.099381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868962059:4730]
2025-10-02T09:37:01.099401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.099404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.099405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.099405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.099408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.099412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.099519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.105476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId: src_id|acefea54-b214ba33-11322dc9-95cae679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.107861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.164601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944548918:4174]
2025-10-02T09:37:01.164830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3442, pipe: [1:7556556102944548918:4174]
2025-10-02T09:37:01.208780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.209017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.209027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.209039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944548918:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.209213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944548918:4174]
2025-10-02T09:37:01.209240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:01.209245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:01.209256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.209320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3443 reason: error at write: Disconnected sessionId: src_id|acefea54-b214ba33-11322dc9-95cae679_0
2025-10-02T09:37:01.209337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.209494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3443 sessionId: src_id|acefea54-b214ba33-11322dc9-95cae679_0 is DEAD
2025-10-02T09:37:01.209636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:01.209645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Write session will restart in 0.007357s
2025-10-02T09:37:01.209661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Write session: Do CDS request
2025-10-02T09:37:01.209666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.218160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.218277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.218297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3444
2025-10-02T09:37:01.218417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.218444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.218454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.218457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.218809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3444 sessionId:  describe result for acl check
2025-10-02T09:37:01.218840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.218847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.218849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.218853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.219349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.221284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.223265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.223277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.223279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944549024:5101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.223284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.223462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.225299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.225416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.225423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.225429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.225456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.225481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868962352:4741]
2025-10-02T09:37:01.225827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.225989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.226012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.226188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.226217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.226221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.226221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.226222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.226222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.226223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.226224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.226224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.226225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.226225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.226226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.226226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.226229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.226236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.226238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.226241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.226242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.226245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.226247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.226249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.226250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.226253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.226255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.226257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.226260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.226264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.226268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.226271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.226274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.226277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.226279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.226282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.226284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.226287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.226289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.226291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.226294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.226296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.226298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.226301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.226304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.226306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.226312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.226315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.226317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.226319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.226321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.226324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.226340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.233698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.235251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.235262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.235263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.235265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.235269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3443 [2:7556556102868962352:4741]
2025-10-02T09:37:01.235277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.235287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.235288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.235290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.235290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.235300Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.235306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.235311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.235340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.235345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.235346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.235348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.235349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.235384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.235388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.235395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.235400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.235410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.235424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944548920:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.235430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549201:5101], now have 1 active actors on pipe
2025-10-02T09:37:01.235433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.235434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.235436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.235444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.235453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.235456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.235458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.235459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.235463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.235465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.235479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.235484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.235483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3443
2025-10-02T09:37:01.235504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.235489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3443
2025-10-02T09:37:01.235517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.235519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.235536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d8aa66a-779ef217-e2aec105-2046a969_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.235543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.235545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.235546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.235551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.235556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.235566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.235698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.235704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.235713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.235788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3444 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d8aa66a-779ef217-e2aec105-2046a969_0
2025-10-02T09:37:01.236098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acefea54-b214ba33-11322dc9-95cae679_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d8aa66a-779ef217-e2aec105-2046a969_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.238862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Write session: try to update token
2025-10-02T09:37:01.238871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.244697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.244711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.244712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.244713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.244717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.244721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.244723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868962347:4741]
2025-10-02T09:37:01.244745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.244747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.244748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.244749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.244749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.244752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.244875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.250171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId: src_id|8d8aa66a-779ef217-e2aec105-2046a969_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.252585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.309516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944549213:4174]
2025-10-02T09:37:01.309702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3443, pipe: [1:7556556102944549213:4174]
2025-10-02T09:37:01.354804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.355236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.355246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.355258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549213:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.355395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.355459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.355480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944549213:4174]
2025-10-02T09:37:01.355504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:01.355585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3444 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d8aa66a-779ef217-e2aec105-2046a969_0
2025-10-02T09:37:01.355760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3444 sessionId: src_id|8d8aa66a-779ef217-e2aec105-2046a969_0 is DEAD
2025-10-02T09:37:01.355909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:01.355918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Write session will restart in 0.007089s
2025-10-02T09:37:01.355936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Write session: Do CDS request
2025-10-02T09:37:01.355941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.364137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.364248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.364261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3445
2025-10-02T09:37:01.364393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.364416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.364423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.364426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.364773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3445 sessionId:  describe result for acl check
2025-10-02T09:37:01.364813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.364818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.364819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.364823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.365110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.366940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.368711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.368722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.368725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944549334:5120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.368729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.369410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.371219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.371320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.371326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.371332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.371358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.371381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868962650:4748]
2025-10-02T09:37:01.371740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.371901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.371925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.372108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.372140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.372144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.372144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.372145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.372145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.372146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.372146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.372147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.372147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.372148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.372148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.372149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.372152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.372158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.372160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.372162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.372164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.372166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.372168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.372170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.372172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.372174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.372176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.372178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.372182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.372186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.372189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.372191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.372194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.372196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.372199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.372201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.372203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.372206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.372208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.372211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.372213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.372219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.372221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.372224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.372226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.372229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.372231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.372233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.372235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.372238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.372242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.372244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.372262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.379616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.381177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.381188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.381189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.381191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.381195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3444 [2:7556556102868962650:4748]
2025-10-02T09:37:01.381201Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.381212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.381213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.381215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.381216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.381225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.381231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.381235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.381267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.381272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.381273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.381275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.381276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.381310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.381315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.381321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.381330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.381341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.381356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549509:5120], now have 1 active actors on pipe
2025-10-02T09:37:01.381361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549216:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.381365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.381366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.381367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.381375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.381386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.381388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.381390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.381391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.381396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.381397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.381412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.381420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.381411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3444
2025-10-02T09:37:01.381434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.381439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.381413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3444
2025-10-02T09:37:01.381440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.381459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.381464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.381470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.381471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.381476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.381481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.381491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.381621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.381627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.381635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.381698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3445 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0
2025-10-02T09:37:01.381963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8aa66a-779ef217-e2aec105-2046a969_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.384699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Write session: try to update token
2025-10-02T09:37:01.384711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.390690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.390704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.390706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.390707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.390711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.390714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.390716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868962645:4748]
2025-10-02T09:37:01.390737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.390740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.390742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.390744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.390748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.390750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.390853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.396230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId: src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.398651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.455410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944549524:4174]
2025-10-02T09:37:01.455646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3444, pipe: [1:7556556102944549524:4174]
2025-10-02T09:37:01.504281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.504509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.504519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.504531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549524:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.504678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.504756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:01.504767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944549524:4174]
2025-10-02T09:37:01.504792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.504873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0
2025-10-02T09:37:01.505014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3445 sessionId: src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0 is DEAD
2025-10-02T09:37:01.505192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:01.505205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Write session will restart in 0.006603s
2025-10-02T09:37:01.505221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Write session: Do CDS request
2025-10-02T09:37:01.505225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.513269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.513297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.513310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3446
2025-10-02T09:37:01.513470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.513494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.513498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.513502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.513855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3446 sessionId:  describe result for acl check
2025-10-02T09:37:01.513890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.513892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.513894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.513898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.514348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.516262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.518234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.518244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.518246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944549628:5139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.518250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.520400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.520646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.520750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.520758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.520764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.520789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.520826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868962938:4754]
2025-10-02T09:37:01.521192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.521354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.521385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.521585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.521619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.521624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.521625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.521626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.521627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.521628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.521629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.521629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.521630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.521631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.521632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.521633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.521638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.521647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.521651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.521655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.521658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.521661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.521664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.521665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.521668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.521670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.521672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.521674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.521678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.521682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.521685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.521688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.521691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.521693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.521696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.521700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.521703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.521705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.521707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.521714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.521716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.521719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.521721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.521726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.521728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.521731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.521736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.521739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.521741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.521744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.521746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.521748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.521765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.529146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.530743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.530755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.530756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.530758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.530762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3445 [2:7556556102868962938:4754]
2025-10-02T09:37:01.530769Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.530779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.530781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.530783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.530784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.530793Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.530799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.530803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.530834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.530839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.530840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.530842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.530844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.530882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.530887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.530893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.530899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.530910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.530925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549807:5139], now have 1 active actors on pipe
2025-10-02T09:37:01.530931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549525:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.530936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.530942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.530944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.530954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.530966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.530970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.530973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.530974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.530978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.530979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.530992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.530998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.531003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.531018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.531024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.530993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3445
2025-10-02T09:37:01.531039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec358037-f160b466-b4090c72-67ebf08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.531030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3445
2025-10-02T09:37:01.531046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.531048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.531049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.531054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.531059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.531077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.531185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.531190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.531198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.531267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3446 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec358037-f160b466-b4090c72-67ebf08_0
2025-10-02T09:37:01.531569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d9d75f3-5dfceea2-6701596a-ea05e8bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec358037-f160b466-b4090c72-67ebf08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.534351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Write session: try to update token
2025-10-02T09:37:01.534363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.540149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.540163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.540164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.540166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.540170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.540174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.540176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868962933:4754]
2025-10-02T09:37:01.540197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.540201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.540202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.540203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.540207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.540209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.540313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.545864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId: src_id|ec358037-f160b466-b4090c72-67ebf08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.548170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.604904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944549824:4174]
2025-10-02T09:37:01.605123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3445, pipe: [1:7556556102944549824:4174]
2025-10-02T09:37:01.655330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.655511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.655520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.655532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549824:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.655707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:01.655715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944549824:4174]
2025-10-02T09:37:01.655721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:01.655736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.655790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3446 reason: error at write: Disconnected sessionId: src_id|ec358037-f160b466-b4090c72-67ebf08_0
2025-10-02T09:37:01.655811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.656094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:01.656106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Write session will restart in 0.007541s
2025-10-02T09:37:01.656125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Write session: Do CDS request
2025-10-02T09:37:01.655936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3446 sessionId: src_id|ec358037-f160b466-b4090c72-67ebf08_0 is DEAD
2025-10-02T09:37:01.656136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.665144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.665552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.665563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3447
2025-10-02T09:37:01.665678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.665702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.665709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.665713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.666040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3447 sessionId:  describe result for acl check
2025-10-02T09:37:01.666070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.666075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.666076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.666080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.666500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.667969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.669209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.670822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.670962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.670969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.670975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.671010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.671034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868963254:4777]
2025-10-02T09:37:01.671096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.671110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.671112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944549977:5173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.671118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.671389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.671550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.671572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.671749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.671778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.671782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.671783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.671783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.671784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.671784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.671785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.671785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.671786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.671786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.671787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.671787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.671790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.671796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.671798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.671800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.671802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.671804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.671806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.671808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.671810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.671812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.671814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.671816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.671819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.671823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.671826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.671829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.671831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.671835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.671837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.671840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.671842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.671845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.671847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.671850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.671852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.671855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.671857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.671863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.671865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.671868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.671870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.671872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.671877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.671880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.671882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.671885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.671903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.679321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.680891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.680901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.680903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.680905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.680908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3446 [2:7556556102868963254:4777]
2025-10-02T09:37:01.680917Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.680925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.680927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.680928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.680929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.680938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.680942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.680946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.680977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.680982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.680983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.680985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.680987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.681028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.681032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.681039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.681046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.681054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.681068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550110:5173], now have 1 active actors on pipe
2025-10-02T09:37:01.681075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944549825:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.681078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.681079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.681080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.681087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.681096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.681102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.681105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.681107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.681109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.681111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.681120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.681122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.681124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.681161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.681167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.681131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3446
2025-10-02T09:37:01.681171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3446
2025-10-02T09:37:01.681181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.681188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.681190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.681191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.681196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.681203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.681225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.681337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.681343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.681353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.681428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3447 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0
2025-10-02T09:37:01.681724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec358037-f160b466-b4090c72-67ebf08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.684209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Write session: try to update token
2025-10-02T09:37:01.684221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.690179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.690191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.690193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.690194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.690198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.690201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.690203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868963249:4777]
2025-10-02T09:37:01.690222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.690225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.690226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.690228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.690230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.690232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.690342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.696081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3447 sessionId: src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.698451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.755982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944550144:4174]
2025-10-02T09:37:01.756217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3446, pipe: [1:7556556102944550144:4174]
2025-10-02T09:37:01.803241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.803623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.803632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.803645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550144:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.803765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.803810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:01.803824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.803827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:01.803872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944550144:4174]
2025-10-02T09:37:01.803904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3447 reason: error at write: Disconnected sessionId: src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0
2025-10-02T09:37:01.804123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3447 sessionId: src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0 is DEAD
2025-10-02T09:37:01.804228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:01.804238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Write session will restart in 0.008218s
2025-10-02T09:37:01.804257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Write session: Do CDS request
2025-10-02T09:37:01.804263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.813209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.813264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.813273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3448
2025-10-02T09:37:01.813385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.813407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.813410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.813413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.813784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3448 sessionId:  describe result for acl check
2025-10-02T09:37:01.813815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.813821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.813822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.813826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.814257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.816862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.817510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.819414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.819521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.819528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.819534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.819562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.819591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868963550:4789]
2025-10-02T09:37:01.819689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.819699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.819702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944550277:5200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.819709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.819958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.820127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.820151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.820334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.820365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.820369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.820370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.820370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.820371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.820371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.820372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.820373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.820373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.820374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.820374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.820375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.820377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.820384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.820387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.820389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.820391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.820393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.820396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.820399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.820402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.820406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.820409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.820412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.820419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.820425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.820430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.820435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.820437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.820440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.820441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.820444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.820446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.820449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.820451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.820453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.820456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.820458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.820460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.820463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.820468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.820471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.820474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.820477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.820479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.820481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.820483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.820486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.820505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.827942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.829720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.829732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.829733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.829736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.829739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3447 [2:7556556102868963550:4789]
2025-10-02T09:37:01.829748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.829759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.829764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.829766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.829767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.829776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.829779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.829784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.829819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.829824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.829825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.829827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.829829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.829870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.829875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.829882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.829887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.829895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.829911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550430:5200], now have 1 active actors on pipe
2025-10-02T09:37:01.829916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550145:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.829920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.829922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.829923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.829930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.829938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.829944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.829946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.829948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.829949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.829951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.829967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.829973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.829978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.830000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3447
2025-10-02T09:37:01.830008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3447
2025-10-02T09:37:01.830058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.830064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.830080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6b0cf59-129b4cae-48209c65-415827d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.830087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.830089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.830091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.830096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.830104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.830116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.830239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.830244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.830252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.830316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3448 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6b0cf59-129b4cae-48209c65-415827d7_0
2025-10-02T09:37:01.830601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d022b3-ef013fb1-e54c942-dad210a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6b0cf59-129b4cae-48209c65-415827d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.833491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Write session: try to update token
2025-10-02T09:37:01.833504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.838955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:01.838971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.838976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.839001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:01.839007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:01.839175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:01.839304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.839430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.839552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.839706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:01.839732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:01.845553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3448 sessionId: src_id|b6b0cf59-129b4cae-48209c65-415827d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:01.847491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:01.847505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.847507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:01.847508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:01.847514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.847516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.847518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868963545:4789]
2025-10-02T09:37:01.847539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:01.847541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:01.847542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.847543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:01.847544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:01.847546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:01.847657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:01.847924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:01.903943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556102944550443:4174]
2025-10-02T09:37:01.904140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3447, pipe: [1:7556556102944550443:4174]
2025-10-02T09:37:01.959155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:01.959561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.959574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.959588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550443:4174], now have 1 active actors on pipe
2025-10-02T09:37:01.959742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:01.959795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:01.959801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:01.959807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556102944550443:4174]
2025-10-02T09:37:01.959867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3448 reason: error at write: Disconnected sessionId: src_id|b6b0cf59-129b4cae-48209c65-415827d7_0
2025-10-02T09:37:01.960022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3448 sessionId: src_id|b6b0cf59-129b4cae-48209c65-415827d7_0 is DEAD
2025-10-02T09:37:01.960153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:01.960163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Write session will restart in 0.007200s
2025-10-02T09:37:01.960178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Write session: Do CDS request
2025-10-02T09:37:01.960187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:01.960210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:01.968180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.968279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:01.968293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3449
2025-10-02T09:37:01.968398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:01.968430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:01.968439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:01.968443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:01.968793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3449 sessionId:  describe result for acl check
2025-10-02T09:37:01.968836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:01.968842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:01.968844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:01.968847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:01.969326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:01.971240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:01.973315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:01.973393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:01.973403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:01.973405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556102944550560:5231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:01.973409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:01.975263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:01.975367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:01.975373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:01.975380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:01.975405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:01.975427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556102868963842:4792]
2025-10-02T09:37:01.975781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:01.975946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:01.975969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:01.976144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:01.976173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.976176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.976177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.976178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.976178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.976179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.976179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.976180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.976180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.976181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.976181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.976182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.976184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.976191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.976193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.976195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.976197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.976199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.976201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.976203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.976205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.976207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.976209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.976211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.976215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.976219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:01.976222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.976225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:01.976227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.976229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:01.976231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.976234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:01.976236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.976239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:01.976241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.976244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:01.976246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.976249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:01.976251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.976253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:01.976255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.976258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:01.976260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.976262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.976265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.976271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.976272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.976275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.976294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:01.983724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:01.985215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:01.985228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:01.985229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:01.985231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:01.985234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3448 [2:7556556102868963842:4792]
2025-10-02T09:37:01.985241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:01.985252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:01.985254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.985255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.985256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.985265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:01.985271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:01.985276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:01.985311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.985315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.985316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.985318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:01.985320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:01.985356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:01.985361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:01.985368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:01.985375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:01.985384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:01.985398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550736:5231], now have 1 active actors on pipe
2025-10-02T09:37:01.985403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556102944550454:2446], now have 1 active actors on pipe
2025-10-02T09:37:01.985407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:01.985408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:01.985409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:01.985419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:01.985429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:01.985431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:01.985433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:01.985434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:01.985439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:01.985441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:01.985453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:01.985459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:01.985464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:01.985458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3448
2025-10-02T09:37:01.985458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3448
2025-10-02T09:37:01.985503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.985509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.985525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|624884a5-72275143-268d0dce-e8793a35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:01.985532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:01.985535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:01.985536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:01.985542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:01.985550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:01.985558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.985681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:01.985686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:01.985693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:01.985753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3449 partition: 0 MaxSeqNo: 36 sessionId: src_id|624884a5-72275143-268d0dce-e8793a35_0
2025-10-02T09:37:01.985995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6b0cf59-129b4cae-48209c65-415827d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|624884a5-72275143-268d0dce-e8793a35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:01.988505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Write session: try to update token
2025-10-02T09:37:01.988519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:01.994431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:01.994443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:01.994447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:01.994467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:01.994467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:01.994657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:01.994773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.994882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.994992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:01.995155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:01.995178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:02.000696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3449 sessionId: src_id|624884a5-72275143-268d0dce-e8793a35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.002929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.003450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.003463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.003473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.003475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.003476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.003477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.003481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:02.003483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:02.003485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556102868963836:4792]
2025-10-02T09:37:02.003506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.003509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.003511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.003513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.003514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.003514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.003620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.060095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239518048:4174]
2025-10-02T09:37:02.060297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3448, pipe: [1:7556556107239518048:4174]
2025-10-02T09:37:02.114997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.115402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:02.115433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518048:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.115548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.115575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239518048:4174]
2025-10-02T09:37:02.115607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.115662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:02.115669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:02.115735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3449 reason: error at write: Disconnected sessionId: src_id|624884a5-72275143-268d0dce-e8793a35_0
2025-10-02T09:37:02.115854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3449 sessionId: src_id|624884a5-72275143-268d0dce-e8793a35_0 is DEAD
2025-10-02T09:37:02.116014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:02.116025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Write session will restart in 0.008737s
2025-10-02T09:37:02.116044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Write session: Do CDS request
2025-10-02T09:37:02.116050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.126230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.126349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.126369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3450
2025-10-02T09:37:02.126497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.126523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.126527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.126531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.126935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3450 sessionId:  describe result for acl check
2025-10-02T09:37:02.126970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.126976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.126977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.126981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.127422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.129398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.131786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.131985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.131996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.131998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239518224:5246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.132005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.132039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.132150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.132157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.132164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.132192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.132222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163931429:4798]
2025-10-02T09:37:02.132617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.132788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.132825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.133010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.133040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.133044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.133046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.133047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.133047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.133049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.133049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.133050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.133053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.133060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.133063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.133065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.133067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.133069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.133071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.133073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.133075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.133078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.133080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.133081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.133086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.133089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.133093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.133096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.133099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.133102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.133104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.133107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.133110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.133113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.133115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.133118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.133122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.133125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.133127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.133130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.133132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.133135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.133138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.133141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.133143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.133147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.133149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.133151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.133178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.140537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.142134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.142147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.142149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.142151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.142155Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3449 [2:7556556107163931429:4798]
2025-10-02T09:37:02.142162Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.142171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.142173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.142174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.142175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.142184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.142187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.142191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.142222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.142227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.142228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.142230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.142232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.142268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.142272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.142279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.142284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.142295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.142309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518338:5246], now have 1 active actors on pipe
2025-10-02T09:37:02.142314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518049:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.142318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.142319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.142320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.142328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.142339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.142341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.142343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.142344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.142349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.142351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.142365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.142372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.142377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.142384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3449
2025-10-02T09:37:02.142413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.142420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.142386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3449
2025-10-02T09:37:02.142440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.142447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.142449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.142450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.142456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.142463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.142473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.142594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.142599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.142606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.142669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3450 partition: 0 MaxSeqNo: 36 sessionId: src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0
2025-10-02T09:37:02.143026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624884a5-72275143-268d0dce-e8793a35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.145329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Write session: try to update token
2025-10-02T09:37:02.145342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.151393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.151406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.151408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.151409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.151413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.151415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.151418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163931423:4798]
2025-10-02T09:37:02.151437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.151440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.151440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.151442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.151442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.151444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.151549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.157487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3450 sessionId: src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.159589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.215738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239518350:4174]
2025-10-02T09:37:02.215925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3449, pipe: [1:7556556107239518350:4174]
2025-10-02T09:37:02.262843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.263093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.263103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.263115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518350:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.263258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:02.263327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.263327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.263373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239518350:4174]
2025-10-02T09:37:02.263422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3450 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0
2025-10-02T09:37:02.263578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3450 sessionId: src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0 is DEAD
2025-10-02T09:37:02.263801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:02.263810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Write session will restart in 0.005198s
2025-10-02T09:37:02.263830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Write session: Do CDS request
2025-10-02T09:37:02.263835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.270138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.270230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.270238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3451
2025-10-02T09:37:02.270334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.270357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.270364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.270367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.270676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3451 sessionId:  describe result for acl check
2025-10-02T09:37:02.270706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.270711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.270712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.270716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.271133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.273725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.276196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.276207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.276209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239518396:5265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.276213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.277701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.279501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.279604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.279610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.279615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.279641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.279665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163931722:4804]
2025-10-02T09:37:02.280013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.280177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.280199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.280372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.280400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.280404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.280404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.280405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.280405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.280406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.280406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.280407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.280407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.280408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.280408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.280409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.280411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.280418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.280420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.280422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.280424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.280426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.280428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.280430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.280432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.280434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.280436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.280438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.280442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.280445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.280449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.280451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.280453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.280456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.280458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.280461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.280463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.280465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.280469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.280473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.280478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.280482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.280486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.280490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.280493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.280498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.280501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.280508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.280511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.280516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.280518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.280521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.280539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.287849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.289421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.289434Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.289435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.289437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.289441Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3450 [2:7556556107163931722:4804]
2025-10-02T09:37:02.289449Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.289458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.289459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.289461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.289462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.289471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.289473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.289478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.289510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.289516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.289517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.289519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.289520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.289556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.289561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.289570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.289584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.289601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.289618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518351:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.289625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518606:5265], now have 1 active actors on pipe
2025-10-02T09:37:02.289630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.289635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.289638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.289649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.289659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.289666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.289667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.289703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.289689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3450
2025-10-02T09:37:02.289720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.289695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3450
2025-10-02T09:37:02.289726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.289757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.289764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.289774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.289782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.289790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.289803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.289812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.289817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.289818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.289824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.289834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.289854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.289968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.289980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.289997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.290073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3451 partition: 0 MaxSeqNo: 36 sessionId: src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0
2025-10-02T09:37:02.290348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58452fd-11dcdb0c-45d79f99-beed4551_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.293147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Write session: try to update token
2025-10-02T09:37:02.293159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.298871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.298885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.298886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.298887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.298891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.298894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.298897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163931717:4804]
2025-10-02T09:37:02.298919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.298921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.298923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.298924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.298924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.298927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.299040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.304181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3451 sessionId: src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.306428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.363683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239518665:4174]
2025-10-02T09:37:02.363852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3450, pipe: [1:7556556107239518665:4174]
2025-10-02T09:37:02.411386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.411952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.411963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.411977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518665:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.412099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:02.412170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.412172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239518665:4174]
2025-10-02T09:37:02.412193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.412267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0
2025-10-02T09:37:02.412423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3451 sessionId: src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0 is DEAD
2025-10-02T09:37:02.412586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:02.412597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Write session will restart in 0.008787s
2025-10-02T09:37:02.412613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Write session: Do CDS request
2025-10-02T09:37:02.412618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.422199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.422312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.422328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3452
2025-10-02T09:37:02.422424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.422447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.422455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.422459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.422899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3452 sessionId:  describe result for acl check
2025-10-02T09:37:02.422932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.422937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.422943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.422947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.423386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.425482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.426756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.428658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.428784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.428791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.428797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.428838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.428867Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163932028:4803]
2025-10-02T09:37:02.428934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.428945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.428947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239518805:10228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.428953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.429236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.429421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.429444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.429626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.429657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.429661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.429661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.429662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.429662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.429663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.429663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.429664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.429664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.429665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.429665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.429666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.429668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.429677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.429680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.429683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.429687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.429690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.429693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.429697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.429700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.429704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.429707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.429709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.429713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.429717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.429724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.429727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.429729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.429733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.429735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.429738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.429740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.429742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.429745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.429747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.429750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.429752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.429756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.429758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.429761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.429763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.429769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.429772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.429774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.429776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.429778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.429781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.429803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.437246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.439044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.439056Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.439057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.439060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.439064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3451 [2:7556556107163932028:4803]
2025-10-02T09:37:02.439084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.439097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.439102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.439104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.439105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.439114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.439117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.439125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.439162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.439167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.439168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.439170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.439172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.439212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.439217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.439224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.439229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.439237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.439252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518957:10228], now have 1 active actors on pipe
2025-10-02T09:37:02.439261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.439264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.439265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.439273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.439281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518667:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.439285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.439288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.439289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.439289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.439297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.439299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.439313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.439321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.439325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.439354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3451
2025-10-02T09:37:02.439358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3451
2025-10-02T09:37:02.439424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.439432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.439450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.439458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.439460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.439461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.439466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.439475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.439486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.439608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.439613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.439621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.439688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3452 partition: 0 MaxSeqNo: 36 sessionId: src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0
2025-10-02T09:37:02.439990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2258bb6-878fcc6b-4f49fbac-c5360e8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.442508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Write session: try to update token
2025-10-02T09:37:02.442523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.448244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:02.448255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.448259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.448280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:02.448283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:02.448421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:02.448535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.448647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.448773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.448941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:02.448967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:02.454707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3452 sessionId: src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.456972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.456985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.456986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.456987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.456992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.456995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.456997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163932023:4803]
2025-10-02T09:37:02.457017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.457018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.457020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.457021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.457021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.457023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.457072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.457187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.512195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239518968:4174]
2025-10-02T09:37:02.512405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3451, pipe: [1:7556556107239518968:4174]
2025-10-02T09:37:02.566994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.567329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.567339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.567353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518968:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.567498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:02.567561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.567590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.567609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239518968:4174]
2025-10-02T09:37:02.567676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0
2025-10-02T09:37:02.567849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3452 sessionId: src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0 is DEAD
2025-10-02T09:37:02.568014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:02.568026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Write session will restart in 0.005561s
2025-10-02T09:37:02.568051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Write session: Do CDS request
2025-10-02T09:37:02.568058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.574110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.574235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.574244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3453
2025-10-02T09:37:02.574348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.574370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.574378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.574381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.574683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3453 sessionId:  describe result for acl check
2025-10-02T09:37:02.574712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.574717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.574718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.574722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.575154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.577126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.579444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.579452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.579454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239519017:10206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.579458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.581925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.583854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.583958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.583964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.583970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.583995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.584018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163932323:4815]
2025-10-02T09:37:02.584383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.584554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.584577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.584752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.584781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.584785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.584785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.584786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.584786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.584787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.584787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.584788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.584788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.584789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.584789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.584790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.584793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.584813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.584816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.584818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.584820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.584822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.584824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.584825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.584827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.584829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.584831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.584833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.584837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.584841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.584844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.584847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.584849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.584852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.584854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.584857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.584859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.584861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.584864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.584866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.584868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.584871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.584873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.584876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.584878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.584880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.584885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.584888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.584891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.584894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.584899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.584902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.584919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.592245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.593953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.593965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.593966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.593968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.593972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3452 [2:7556556107163932323:4815]
2025-10-02T09:37:02.593981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.593991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.593997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.593998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.593999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.594009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.594016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.594020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.594054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.594059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.594060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.594061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.594063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.594098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.594103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.594109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.594114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.594122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.594137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239518970:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.594143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519183:10206], now have 1 active actors on pipe
2025-10-02T09:37:02.594147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.594149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.594150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.594158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.594168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.594171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.594173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.594174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.594178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.594180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.594193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.594198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.594199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.594201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3452
2025-10-02T09:37:02.594210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3452
2025-10-02T09:37:02.594241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.594246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.594261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.594268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.594270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.594271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.594276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.594284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.594295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.594414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.594420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.594430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.594496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3453 partition: 0 MaxSeqNo: 36 sessionId: src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0
2025-10-02T09:37:02.594737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68a679e-8c54cc7e-8bf3830d-d49941fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.597505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Write session: try to update token
2025-10-02T09:37:02.597516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.603387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.603402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.603404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.603405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.603409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.603412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.603415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163932318:4815]
2025-10-02T09:37:02.603431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.603434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.603435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.603436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.603438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.603439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.603543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.608723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3453 sessionId: src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.610970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.667833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239519272:4174]
2025-10-02T09:37:02.668021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3452, pipe: [1:7556556107239519272:4174]
2025-10-02T09:37:02.715247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.715491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.715501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.715514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519272:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.715673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:02.715736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239519272:4174]
2025-10-02T09:37:02.715766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.715796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.715865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3453 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0
2025-10-02T09:37:02.716011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3453 sessionId: src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0 is DEAD
2025-10-02T09:37:02.716160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:02.716172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Write session will restart in 0.007629s
2025-10-02T09:37:02.716187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Write session: Do CDS request
2025-10-02T09:37:02.716192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.725172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.725289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.725304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3454
2025-10-02T09:37:02.725432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.725456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.725465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.725469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.725779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3454 sessionId:  describe result for acl check
2025-10-02T09:37:02.725806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.725813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.725815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.725819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.726216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.728055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.730159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.730170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.730172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239519404:10172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.730179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.730214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.732069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.732187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.732195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.732202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.732232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.732259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163932647:4842]
2025-10-02T09:37:02.732610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.732782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.732814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.732993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.733022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.733026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.733027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.733027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.733028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.733029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.733029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.733029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.733030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.733030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.733031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.733031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.733034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.733041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.733043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.733045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.733047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.733049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.733051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.733053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.733055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.733057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.733059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.733061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.733065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.733069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.733073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.733075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.733078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.733080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.733082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.733085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.733087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.733090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.733092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.733095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.733097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.733100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.733102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.733105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.733107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.733110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.733112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.733114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.733117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.733120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.733124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.733126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.733145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.740549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.742094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.742106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.742107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.742109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.742112Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3453 [2:7556556107163932647:4842]
2025-10-02T09:37:02.742120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.742130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.742135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.742136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.742138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.742147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.742151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.742156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.742196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.742201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.742202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.742204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.742205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.742244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.742250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.742256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.742261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.742268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.742282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519287:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.742287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519577:10172], now have 1 active actors on pipe
2025-10-02T09:37:02.742291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.742292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.742293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.742300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.742311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.742313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.742315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.742316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.742326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.742332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.742349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.742354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.742341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3453
2025-10-02T09:37:02.742361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.742375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3453
2025-10-02T09:37:02.742399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.742405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.742419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac22a630-aad02942-15742d3c-30d9128f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.742426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.742429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.742430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.742435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.742443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.742451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.742576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.742582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.742592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.742659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3454 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac22a630-aad02942-15742d3c-30d9128f_0
2025-10-02T09:37:02.742920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e257f17c-7ced2e4e-b9fd7d28-f6636aa3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac22a630-aad02942-15742d3c-30d9128f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.745837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Write session: try to update token
2025-10-02T09:37:02.745848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.751320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:02.751334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.751339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.751360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:02.751361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:02.751488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:02.751606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.751718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.751838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:02.751993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:02.752018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:02.758432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3454 sessionId: src_id|ac22a630-aad02942-15742d3c-30d9128f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.759853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.759866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.759868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.759869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.759875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.759878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.759881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163932641:4842]
2025-10-02T09:37:02.759901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.759901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.759904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.759905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.759906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.759906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.760024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.760724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.815809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239519599:4174]
2025-10-02T09:37:02.816042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3453, pipe: [1:7556556107239519599:4174]
2025-10-02T09:37:02.872329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:02.872677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.872687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.872701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519599:4174], now have 1 active actors on pipe
2025-10-02T09:37:02.872907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:02.872953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239519599:4174]
2025-10-02T09:37:02.872987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:02.873096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:02.873215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac22a630-aad02942-15742d3c-30d9128f_0
2025-10-02T09:37:02.873378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3454 sessionId: src_id|ac22a630-aad02942-15742d3c-30d9128f_0 is DEAD
2025-10-02T09:37:02.873510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:02.873523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Write session will restart in 0.008861s
2025-10-02T09:37:02.873545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Write session: Do CDS request
2025-10-02T09:37:02.873550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:02.883111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.883618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:02.883629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3455
2025-10-02T09:37:02.883764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:02.883788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:02.883794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:02.883797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:02.884128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3455 sessionId:  describe result for acl check
2025-10-02T09:37:02.884158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:02.884163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:02.884164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:02.884168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:02.884585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:02.886749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:02.887283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:02.889135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:02.889243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:02.889250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:02.889258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:02.889291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:02.889317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556107163932949:4851]
2025-10-02T09:37:02.889391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:02.889402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:02.889406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556107239519761:10165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:02.889412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:02.889767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:02.889940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:02.889964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:02.890162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:02.890196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.890200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.890200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.890201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.890201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.890202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.890202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.890203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.890203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.890203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.890204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.890205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.890207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.890213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.890215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.890217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.890219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.890221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.890223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.890225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.890227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.890229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.890231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.890233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.890237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.890241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:02.890244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.890247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:02.890249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.890251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:02.890253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.890256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:02.890258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.890261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:02.890263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.890265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:02.890267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.890270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:02.890273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.890277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:02.890281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.890286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:02.890295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.890299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.890307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.890312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.890314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.890316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.890333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:02.897742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:02.899306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:02.899317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:02.899318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:02.899320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:02.899324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3454 [2:7556556107163932949:4851]
2025-10-02T09:37:02.899331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:02.899340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:02.899341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.899343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.899344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.899352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:02.899355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:02.899360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:02.899391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.899395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.899397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.899398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:02.899400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:02.899436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:02.899443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.899450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:02.899455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:02.899463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:02.899473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519601:2446], now have 1 active actors on pipe
2025-10-02T09:37:02.899475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519894:10165], now have 1 active actors on pipe
2025-10-02T09:37:02.899479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.899480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.899481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.899488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:02.899496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:02.899503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:02.899505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:02.899506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:02.899511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:02.899513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:02.899529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.899538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:02.899543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:02.899531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3454
2025-10-02T09:37:02.899534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3454
2025-10-02T09:37:02.899579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.899584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.899598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:02.899605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:02.899608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:02.899609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:02.899613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:02.899619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:02.899627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.899753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:02.899764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:02.899775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:02.899846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3455 partition: 0 MaxSeqNo: 36 sessionId: src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0
2025-10-02T09:37:02.900111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac22a630-aad02942-15742d3c-30d9128f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:02.902978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Write session: try to update token
2025-10-02T09:37:02.902989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:02.908625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:02.908639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:02.908641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:02.908641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:02.908647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.908649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.908652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556107163932944:4851]
2025-10-02T09:37:02.908674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:02.908677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:02.908678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:02.908677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:02.908680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:02.908683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:02.908814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:02.915168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3455 sessionId: src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:02.917449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:02.972972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556107239519912:4174]
2025-10-02T09:37:02.973141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3454, pipe: [1:7556556107239519912:4174]
2025-10-02T09:37:03.019893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.020121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.020132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.020145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556107239519912:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.020296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.020352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.020367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556107239519912:4174]
2025-10-02T09:37:03.020392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:03.020395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:03.020468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3455 reason: error at write: Disconnected sessionId: src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0
2025-10-02T09:37:03.020637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3455 sessionId: src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0 is DEAD
2025-10-02T09:37:03.020770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:03.020780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Write session will restart in 0.009233s
2025-10-02T09:37:03.020795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Write session: Do CDS request
2025-10-02T09:37:03.020811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.031136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.031264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.031285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3456
2025-10-02T09:37:03.031419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.031443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.031451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.031454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.031823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3456 sessionId:  describe result for acl check
2025-10-02T09:37:03.031855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.031860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.031862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.031866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.032314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.034013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.034498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.036423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.036541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.036548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.036555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.036584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.036609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458900542:4847]
2025-10-02T09:37:03.036634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.036644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.036646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534487392:10150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.036650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.036995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.037180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.037207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.037397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.037431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.037435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.037436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.037436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.037437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.037437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.037438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.037438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.037439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.037439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.037440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.037441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.037443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.037450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.037452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.037454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.037456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.037458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.037460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.037462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.037464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.037467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.037469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.037471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.037475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.037481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.037486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.037495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.037502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.037505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.037507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.037511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.037514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.037516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.037518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.037524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.037527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.037529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.037531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.037534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.037539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.037542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.037543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.037547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.037552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.037555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.037557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.037560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.037575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.045153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.046827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.046839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.046840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.046842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.046846Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3455 [2:7556556111458900542:4847]
2025-10-02T09:37:03.046855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.046865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.046866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.046868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.046868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.046878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.046881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.046885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.046919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.046924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.046925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.046927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.046929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.046963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.046968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.046974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.046980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.046989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.047004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487507:10150], now have 1 active actors on pipe
2025-10-02T09:37:03.047009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487212:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.047013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.047014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.047015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.047022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.047032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.047034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.047036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.047037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.047040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.047042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.047055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.047060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.047064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.047047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3455
2025-10-02T09:37:03.047052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3455
2025-10-02T09:37:03.047089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.047095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.047114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19b18405-93d34c48-a0369097-f2278b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.047120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.047122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.047123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.047128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.047135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.047145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.047263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.047268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.047275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.047336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3456 partition: 0 MaxSeqNo: 36 sessionId: src_id|19b18405-93d34c48-a0369097-f2278b9_0
2025-10-02T09:37:03.047577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e936f0-6ff9f9b4-9637205b-11a6eb36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19b18405-93d34c48-a0369097-f2278b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.050414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Write session: try to update token
2025-10-02T09:37:03.050424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.056123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.056139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.056140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.056141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.056146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.056148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.056150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458900537:4847]
2025-10-02T09:37:03.056171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.056173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.056174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.056176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.056176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.056178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.056280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.063194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3456 sessionId: src_id|19b18405-93d34c48-a0369097-f2278b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.065360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.120446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534487518:4174]
2025-10-02T09:37:03.120662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3455, pipe: [1:7556556111534487518:4174]
2025-10-02T09:37:03.166020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.166230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.166238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.166251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487518:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.166399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.166431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.166454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534487518:4174]
2025-10-02T09:37:03.166478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:03.166556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3456 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19b18405-93d34c48-a0369097-f2278b9_0
2025-10-02T09:37:03.166699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3456 sessionId: src_id|19b18405-93d34c48-a0369097-f2278b9_0 is DEAD
2025-10-02T09:37:03.166835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:03.166845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Write session will restart in 0.008682s
2025-10-02T09:37:03.166864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Write session: Do CDS request
2025-10-02T09:37:03.166868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.176134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.176264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.176277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3457
2025-10-02T09:37:03.176396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.176417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.176424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.176428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.176774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3457 sessionId:  describe result for acl check
2025-10-02T09:37:03.176817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.176823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.176824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.176828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.177235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.179234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.181215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.181224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.181227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534487628:10153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.181231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.181653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.183467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.183571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.183579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.183584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.183610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.183631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458900842:4859]
2025-10-02T09:37:03.183992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.184156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.184186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.184370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.184399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.184403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.184403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.184404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.184404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.184405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.184406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.184406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.184407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.184407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.184408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.184408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.184411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.184417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.184420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.184423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.184427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.184430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.184434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.184437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.184439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.184443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.184446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.184449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.184459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.184466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.184470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.184476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.184478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.184481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.184486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.184489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.184491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.184493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.184495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.184498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.184500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.184503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.184505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.184508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.184510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.184516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.184518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.184520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.184524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.184530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.184533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.184535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.184555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.191887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.193254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.193265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.193267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.193269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.193273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3456 [2:7556556111458900842:4859]
2025-10-02T09:37:03.193280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.193289Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.193294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.193296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.193297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.193305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.193312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.193316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.193351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.193357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.193359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.193362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.193364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.193407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.193412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.193419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.193424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.193436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.193450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487812:10153], now have 1 active actors on pipe
2025-10-02T09:37:03.193456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487519:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.193459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.193460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.193462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.193469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.193479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.193482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.193483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.193484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.193490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.193491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.193481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3456
2025-10-02T09:37:03.193488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3456
2025-10-02T09:37:03.193505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.193510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.193511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.193520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.193525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.193712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee9bab9b-bc181afe-5a053614-e473d775_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.193723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.193725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.193726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.193731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.193737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.193752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.193869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.193874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.193882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.193942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3457 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee9bab9b-bc181afe-5a053614-e473d775_0
2025-10-02T09:37:03.194186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b18405-93d34c48-a0369097-f2278b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee9bab9b-bc181afe-5a053614-e473d775_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.197058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Write session: try to update token
2025-10-02T09:37:03.197069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.202737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.202753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.202754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.202755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.202760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.202762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.202764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458900837:4859]
2025-10-02T09:37:03.202785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.202789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.202790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.202790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.202793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.202795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.202915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.209593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3457 sessionId: src_id|ee9bab9b-bc181afe-5a053614-e473d775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.211751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.266877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534487826:4174]
2025-10-02T09:37:03.267124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3456, pipe: [1:7556556111534487826:4174]
2025-10-02T09:37:03.313833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.314263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.314278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.314290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487826:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.314441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.314486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:03.314487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534487826:4174]
2025-10-02T09:37:03.314503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:03.314510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.314574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3457 reason: error at write: Disconnected sessionId: src_id|ee9bab9b-bc181afe-5a053614-e473d775_0
2025-10-02T09:37:03.314740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3457 sessionId: src_id|ee9bab9b-bc181afe-5a053614-e473d775_0 is DEAD
2025-10-02T09:37:03.314892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:03.314902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Write session will restart in 0.005772s
2025-10-02T09:37:03.314919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Write session: Do CDS request
2025-10-02T09:37:03.314923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.322113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.322271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.322285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3458
2025-10-02T09:37:03.322421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.322444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.322452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.322455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.322824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3458 sessionId:  describe result for acl check
2025-10-02T09:37:03.322856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.322860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.322862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.322866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.323315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.325653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.327867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.327882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.327884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534487898:10140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.327889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.329451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.331273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.331391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.331398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.331404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.331431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.331453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458901153:4855]
2025-10-02T09:37:03.331801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.331966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.331989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.332165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.332193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.332197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.332198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.332198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.332199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.332199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.332200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.332200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.332201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.332201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.332202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.332202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.332205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.332212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.332214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.332216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.332218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.332220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.332222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.332224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.332226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.332228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.332230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.332232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.332235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.332239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.332243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.332246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.332248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.332250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.332252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.332255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.332258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.332261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.332263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.332266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.332270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.332273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.332275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.332278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.332280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.332283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.332286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.332288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.332292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.332294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.332296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.332299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.332314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.339679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.341280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.341292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.341293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.341295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.341299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3457 [2:7556556111458901153:4855]
2025-10-02T09:37:03.341306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.341315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.341318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.341319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.341320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.341328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.341332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.341336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.341373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.341379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.341380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.341383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.341385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.341421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.341426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.341432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.341437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.341445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.341460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534487827:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.341466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488096:10140], now have 1 active actors on pipe
2025-10-02T09:37:03.341470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.341471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.341472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.341481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.341491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.341496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.341498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.341499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.341501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.341503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.341514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.341519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.341521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.341525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3457
2025-10-02T09:37:03.341534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3457
2025-10-02T09:37:03.341554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.341559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.341573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.341580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.341582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.341583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.341588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.341597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.341606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.341735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.341740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.341748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.341814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3458 partition: 0 MaxSeqNo: 36 sessionId: src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0
2025-10-02T09:37:03.342111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9bab9b-bc181afe-5a053614-e473d775_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.344891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Write session: try to update token
2025-10-02T09:37:03.344901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.350627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.350639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.350641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.350642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.350646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.350649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.350651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458901148:4855]
2025-10-02T09:37:03.350672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.350675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.350677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.350677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.350678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.350679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.350792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.356578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3458 sessionId: src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.358869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.414839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534488149:4174]
2025-10-02T09:37:03.415045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3457, pipe: [1:7556556111534488149:4174]
2025-10-02T09:37:03.462064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.462371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.462380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.462393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488149:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.462571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.462624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:03.462626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:03.462631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534488149:4174]
2025-10-02T09:37:03.462719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3458 reason: error at write: Disconnected sessionId: src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0
2025-10-02T09:37:03.462869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3458 sessionId: src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0 is DEAD
2025-10-02T09:37:03.462989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:03.463000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Write session will restart in 0.006555s
2025-10-02T09:37:03.463018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Write session: Do CDS request
2025-10-02T09:37:03.463025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.463031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.470144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.470215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.470226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3459
2025-10-02T09:37:03.470337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.470360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.470368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.470371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.470732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3459 sessionId:  describe result for acl check
2025-10-02T09:37:03.470766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.470771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.470772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.470777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.471207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.473516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.475551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.475562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.475565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534488216:10122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.475569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.477748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.479698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.479804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.479811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.479817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.479842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.479879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458901455:4871]
2025-10-02T09:37:03.480232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.480409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.480434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.480623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.480660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.480664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.480665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.480665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.480666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.480666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.480667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.480667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.480668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.480668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.480669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.480670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.480672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.480679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.480681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.480683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.480685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.480687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.480689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.480691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.480693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.480695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.480697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.480699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.480703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.480707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.480711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.480714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.480716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.480718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.480722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.480724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.480726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.480729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.480731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.480734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.480736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.480739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.480741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.480743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.480746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.480748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.480750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.480753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.480755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.480759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.480764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.480767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.480784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.488155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.489774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.489787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.489788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.489790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.489794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3458 [2:7556556111458901455:4871]
2025-10-02T09:37:03.489801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.489812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.489817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.489819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.489820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.489829Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.489832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.489836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.489867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.489871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.489872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.489874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.489876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.489911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.489915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.489922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.489927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.489936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.489949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.489953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.489954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.489959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.489967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488394:10122], now have 1 active actors on pipe
2025-10-02T09:37:03.489968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.489970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.489971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.489973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488150:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.489977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.489984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.489986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.489999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.490006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.490030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.490053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3458
2025-10-02T09:37:03.490088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.490093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.490055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3458
2025-10-02T09:37:03.490110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.490116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.490118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.490119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.490124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.490130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.490141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.490265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.490270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.490277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.490343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3459 partition: 0 MaxSeqNo: 36 sessionId: src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0
2025-10-02T09:37:03.490641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3688029b-39fcf3a-ec0a7677-2ea4c043_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.493166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Write session: try to update token
2025-10-02T09:37:03.493181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.499007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.499018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.499019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.499020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.499023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.499026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.499028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458901450:4871]
2025-10-02T09:37:03.499046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.499049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.499052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.499053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.499054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.499055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.499210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.505137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3459 sessionId: src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.507292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.562794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534488467:4174]
2025-10-02T09:37:03.562989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3458, pipe: [1:7556556111534488467:4174]
2025-10-02T09:37:03.610138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.610375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.610384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.610396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488467:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.610524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.610647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534488467:4174]
2025-10-02T09:37:03.610649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:03.610691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.610754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0
2025-10-02T09:37:03.610912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3459 sessionId: src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0 is DEAD
2025-10-02T09:37:03.611066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:03.611086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Write session will restart in 0.008588s
2025-10-02T09:37:03.611103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Write session: Do CDS request
2025-10-02T09:37:03.611106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.621200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.621289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.621304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3460
2025-10-02T09:37:03.621391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.621412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.621420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.621423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.621832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3460 sessionId:  describe result for acl check
2025-10-02T09:37:03.621864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.621869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.621871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.621875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.622281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.624064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.627703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.627730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.627741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.627744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534488619:10112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.627749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.627954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.628094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.628101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.628110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.628147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.628178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458901756:4916]
2025-10-02T09:37:03.628717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.628912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.628944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.629210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.629251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.629257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.629258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.629259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.629259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.629260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.629261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.629262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.629263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.629264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.629265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.629266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.629270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.629280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.629283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.629287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.629291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.629294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.629298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.629301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.629307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.629310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.629313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.629318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.629324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.629332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.629340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.629345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.629353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.629357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.629365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.629370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.629378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.629382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.629387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.629392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.629400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.629404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.629411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.629416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.629423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.629429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.629436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.629441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.629448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.629453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.629458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.629462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.629495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.636886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.638500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.638511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.638513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.638516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.638521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3459 [2:7556556111458901756:4916]
2025-10-02T09:37:03.638530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.638542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.638548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.638550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.638551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.638562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.638570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.638575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.638618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.638624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.638626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.638628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.638630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.638676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.638682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.638692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.638703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.638721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.638738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488766:10112], now have 1 active actors on pipe
2025-10-02T09:37:03.638745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488468:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.638750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.638755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.638757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.638767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.638779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.638780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.638785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.638786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.638793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.638795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.638776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3459
2025-10-02T09:37:03.638777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3459
2025-10-02T09:37:03.638810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.638816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.638817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.638828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.638835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.638868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48967c07-f00691b8-73b248ba-d472a1dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.638876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.638879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.638880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.638887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.638897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.638912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.639022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.639030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.639042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.639104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3460 partition: 0 MaxSeqNo: 36 sessionId: src_id|48967c07-f00691b8-73b248ba-d472a1dc_0
2025-10-02T09:37:03.639382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50aad3f-e25610aa-88b2e5f3-ccebaa39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48967c07-f00691b8-73b248ba-d472a1dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.641707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Write session: try to update token
2025-10-02T09:37:03.641722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.647922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.647936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.647938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.647939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.647943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.647946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.647950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458901750:4916]
2025-10-02T09:37:03.647971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.647974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.647978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.647978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.647979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.647980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.648104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.653424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3460 sessionId: src_id|48967c07-f00691b8-73b248ba-d472a1dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.655464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.710788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534488778:4174]
2025-10-02T09:37:03.710937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3459, pipe: [1:7556556111534488778:4174]
2025-10-02T09:37:03.774439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.774732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.774744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.774757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488778:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.774902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.774919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.774925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534488778:4174]
2025-10-02T09:37:03.774945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:03.775010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48967c07-f00691b8-73b248ba-d472a1dc_0
2025-10-02T09:37:03.775178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3460 sessionId: src_id|48967c07-f00691b8-73b248ba-d472a1dc_0 is DEAD
2025-10-02T09:37:03.775325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:03.775337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Write session will restart in 0.007361s
2025-10-02T09:37:03.775357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Write session: Do CDS request
2025-10-02T09:37:03.775361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.784159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.784250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.784265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3461
2025-10-02T09:37:03.784957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.784985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.784993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.784996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.785377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3461 sessionId:  describe result for acl check
2025-10-02T09:37:03.785413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.785418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.785419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.785423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.785811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.787734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.789775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.789950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.789959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.789964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534488931:10080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.789968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.791574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.791733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.791740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.791746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.791778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.791804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458902093:4918]
2025-10-02T09:37:03.792156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.792330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.792357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.792549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.792580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.792584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.792585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.792585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.792586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.792587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.792587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.792588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.792588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.792589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.792589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.792590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.792592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.792599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.792601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.792603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.792605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.792607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.792610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.792611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.792613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.792615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.792617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.792619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.792623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.792627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.792630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.792633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.792635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.792638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.792640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.792643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.792645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.792647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.792649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.792652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.792654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.792657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.792659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.792662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.792665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.792667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.792669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.792672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.792674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.792677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.792681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.792689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.792711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.800033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.801683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.801693Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.801694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.801696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.801699Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3460 [2:7556556111458902093:4918]
2025-10-02T09:37:03.801705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.801714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.801715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.801717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.801718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.801726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.801731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.801735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.801764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.801769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.801770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.801772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.801774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.801809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.801814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.801820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.801825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.801835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.801849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534488804:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.801854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534489100:10080], now have 1 active actors on pipe
2025-10-02T09:37:03.801858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.801859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.801860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.801868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.801875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.801879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.801881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.801882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.801885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.801887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.801900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.801911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.801912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.801905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3460
2025-10-02T09:37:03.801911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3460
2025-10-02T09:37:03.801938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.801943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.801959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d02889ea-7802f819-42f51c03-704b722b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.801965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.801967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.801968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.801973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.801978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.801984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.802094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.802100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.802109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.802171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3461 partition: 0 MaxSeqNo: 36 sessionId: src_id|d02889ea-7802f819-42f51c03-704b722b_0
2025-10-02T09:37:03.802404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48967c07-f00691b8-73b248ba-d472a1dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d02889ea-7802f819-42f51c03-704b722b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.804687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Write session: try to update token
2025-10-02T09:37:03.804701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.811129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.811142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.811144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.811145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.811150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.811155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.811158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458902087:4918]
2025-10-02T09:37:03.811177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.811180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.811183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.811185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.811185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.811186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.811352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.817040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3461 sessionId: src_id|d02889ea-7802f819-42f51c03-704b722b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.819371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:03.875125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556111534489112:4174]
2025-10-02T09:37:03.875351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3460, pipe: [1:7556556111534489112:4174]
2025-10-02T09:37:03.925480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:03.925916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.925929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.925943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534489112:4174], now have 1 active actors on pipe
2025-10-02T09:37:03.926137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:03.926151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556111534489112:4174]
2025-10-02T09:37:03.926189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:03.926191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:03.926191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:03.926265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3461 reason: error at write: Disconnected sessionId: src_id|d02889ea-7802f819-42f51c03-704b722b_0
2025-10-02T09:37:03.926454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3461 sessionId: src_id|d02889ea-7802f819-42f51c03-704b722b_0 is DEAD
2025-10-02T09:37:03.926607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:03.926620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Write session will restart in 0.009619s
2025-10-02T09:37:03.926642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Write session: Do CDS request
2025-10-02T09:37:03.926647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:03.937177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.937290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:03.937306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3462
2025-10-02T09:37:03.937415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:03.937439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:03.937448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:03.937451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:03.937860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3462 sessionId:  describe result for acl check
2025-10-02T09:37:03.937891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:03.937896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:03.937898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:03.937902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:03.938321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:03.940257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:03.940559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:03.942406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:03.942517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:03.942524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:03.942531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:03.942560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:03.942584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556111458902395:4919]
2025-10-02T09:37:03.942606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:03.942615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:03.942618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556111534489300:9523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:03.942622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:03.942936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:03.943108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:03.943132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:03.943320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:03.943469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.943475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.943476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.943477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.943478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.943479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.943479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.943480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.943481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.943482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.943483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.943484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.943488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.943495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.943497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.943499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.943501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.943503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.943504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.943506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.943508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.943511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.943513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.943515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.943520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.943524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:03.943527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.943530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:03.943532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.943534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:03.943537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.943539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:03.943541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.943544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:03.943546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.943549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:03.943551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.943553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:03.943557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.943559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:03.943562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.943564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:03.943566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.943569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.943572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.943574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.943576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.943578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.943596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:03.950958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:03.952524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:03.952535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:03.952537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:03.952538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:03.952542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3461 [2:7556556111458902395:4919]
2025-10-02T09:37:03.952549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:03.952559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:03.952560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.952562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.952563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.952571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:03.952574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:03.952578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:03.952611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.952617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.952619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.952621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:03.952623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:03.952665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:03.952672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.952678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:03.952684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:03.952698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:03.952712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534489417:9523], now have 1 active actors on pipe
2025-10-02T09:37:03.952715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556111534489113:2446], now have 1 active actors on pipe
2025-10-02T09:37:03.952721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.952728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.952729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.952737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:03.952745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:03.952756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:03.952758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:03.952759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:03.952741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3461
2025-10-02T09:37:03.952742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3461
2025-10-02T09:37:03.952761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:03.952762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:03.952781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.952783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.952792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.952797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:03.952813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:03.952825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:03.952830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:03.952833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:03.952834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:03.952838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:03.952845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:03.952903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.953020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:03.953026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:03.953034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:03.953099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3462 partition: 0 MaxSeqNo: 36 sessionId: src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0
2025-10-02T09:37:03.953368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02889ea-7802f819-42f51c03-704b722b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:03.955767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Write session: try to update token
2025-10-02T09:37:03.955781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:03.961807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:03.961819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:03.961820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:03.961821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:03.961824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.961829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.961831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556111458902390:4919]
2025-10-02T09:37:03.961850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:03.961854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:03.961857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:03.961857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:03.961859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:03.961859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:03.961986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:03.968123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3462 sessionId: src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:03.970355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.026166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829456732:4174]
2025-10-02T09:37:04.026406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3461, pipe: [1:7556556115829456732:4174]
2025-10-02T09:37:04.073964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.074215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.074226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.074243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829456732:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.074371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.074389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.074415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829456732:4174]
2025-10-02T09:37:04.074435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:04.074515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3462 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0
2025-10-02T09:37:04.074669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3462 sessionId: src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0 is DEAD
2025-10-02T09:37:04.074791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:04.074801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Write session will restart in 0.007474s
2025-10-02T09:37:04.074820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Write session: Do CDS request
2025-10-02T09:37:04.074824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.083186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.083260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.083271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3463
2025-10-02T09:37:04.083357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.083379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.083387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.083390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.083728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3463 sessionId:  describe result for acl check
2025-10-02T09:37:04.083763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.083770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.083771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.083775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.084240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.086724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.088622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.088631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.088634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829456828:10070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.088639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.091700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.091999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.092129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.092136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.092143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.092178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.092210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753869996:4910]
2025-10-02T09:37:04.092744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.092935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.092969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.093239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.093277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.093282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.093283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.093284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.093285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.093286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.093287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.093287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.093288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.093289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.093290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.093291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.093295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.093304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.093307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.093311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.093314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.093317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.093321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.093324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.093327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.093331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.093334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.093337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.093344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.093350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.093358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.093363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.093371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.093376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.093383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.093388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.093395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.093400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.093405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.093409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.093414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.093419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.093424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.093429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.093438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.093444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.093448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.093453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.093457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.093465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.093469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.093475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.093507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.100867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.102479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.102491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.102492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.102495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.102500Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3462 [2:7556556115753869996:4910]
2025-10-02T09:37:04.102509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.102524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.102530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.102532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.102534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.102544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.102552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.102558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.102600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.102605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.102607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.102609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.102611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.102662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.102668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.102679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.102689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.102706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.102726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829456733:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.102732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457031:10070], now have 1 active actors on pipe
2025-10-02T09:37:04.102737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.102739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.102741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.102751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.102761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.102764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.102767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.102768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.102776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.102749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3462
2025-10-02T09:37:04.102757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3462
2025-10-02T09:37:04.102779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.102799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.102808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.102812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.102821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.102827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.102862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.102870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.102874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.102877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.102883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.102890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.102905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.103010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.103015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.103024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.103106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3463 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0
2025-10-02T09:37:04.103411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da90d1b0-d46e3332-6c7a4626-ab85c943_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.105735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Write session: try to update token
2025-10-02T09:37:04.105751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.111844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.111856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.111858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.111859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.111864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.111869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.111872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753869991:4910]
2025-10-02T09:37:04.111893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.111895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.111898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.111899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.111900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.111901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.112014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.117778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3463 sessionId: src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.120019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.174640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457046:4174]
2025-10-02T09:37:04.174845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3462, pipe: [1:7556556115829457046:4174]
2025-10-02T09:37:04.242365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.242801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.242813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.242827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457046:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.243029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.243040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:04.243044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:04.243101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457046:4174]
2025-10-02T09:37:04.243123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3463 reason: error at write: Disconnected sessionId: src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0
2025-10-02T09:37:04.243141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.243299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3463 sessionId: src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0 is DEAD
2025-10-02T09:37:04.243431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:04.243437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Write session will restart in 0.007471s
2025-10-02T09:37:04.243456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Write session: Do CDS request
2025-10-02T09:37:04.243461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.252143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.252221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.252232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3464
2025-10-02T09:37:04.252329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.252361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.252365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.252372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.252855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3464 sessionId:  describe result for acl check
2025-10-02T09:37:04.252886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.252887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.252888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.252892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.253306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.255664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.257943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.257952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.257955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829457149:10061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.257959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.260586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.260902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.261041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.261051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.261060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.261113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.261144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753870308:4940]
2025-10-02T09:37:04.261535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.262218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.262256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.262452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.262481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.262482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.262483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.262483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.262484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.262484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.262485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.262486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.262487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.262487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.262488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.262488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.262491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.262498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.262501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.262502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.262504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.262506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.262508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.262510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.262512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.262514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.262516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.262518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.262522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.262526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.262529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.262532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.262535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.262538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.262540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.262543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.262545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.262548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.262550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.262553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.262555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.262558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.262561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.262564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.262566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.262568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.262570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.262574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.262580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.262583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.262585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.262587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.262603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.269963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.271384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.271393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.271395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.271397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.271401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3463 [2:7556556115753870308:4940]
2025-10-02T09:37:04.271407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.271418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.271424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.271425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.271426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.271435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.271438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.271442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.271475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.271480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.271481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.271483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.271484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.271522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.271528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.271534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.271539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.271547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.271558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457047:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.271564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457348:10061], now have 1 active actors on pipe
2025-10-02T09:37:04.271568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.271569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.271570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.271577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.271587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.271592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.271597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.271598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.271599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.271600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.271614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.271616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.271617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.271635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3463
2025-10-02T09:37:04.271643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3463
2025-10-02T09:37:04.271697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.271702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.271720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.271727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.271729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.271730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.271734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.271741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.271748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.271885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.271890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.271897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.271961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3464 partition: 0 MaxSeqNo: 36 sessionId: src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0
2025-10-02T09:37:04.272211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9614b85-1923a81-da11ba4-6b89b9c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.275130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Write session: try to update token
2025-10-02T09:37:04.275141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.285435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:04.285446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.285452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.285479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:04.285481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:04.285632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:04.285760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:04.285885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:04.286010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:04.286184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:04.286213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:04.287892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3464 sessionId: src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.289198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.289209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.289210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.289212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.289217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.289220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.289224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753870298:4940]
2025-10-02T09:37:04.289244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.289246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.289250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.289251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.289252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.289253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.289385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.290084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.343076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457367:4174]
2025-10-02T09:37:04.343292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3463, pipe: [1:7556556115829457367:4174]
2025-10-02T09:37:04.410999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.411332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.411342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.411356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457367:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.411524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.411566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.411577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457367:4174]
2025-10-02T09:37:04.411608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:04.411686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3464 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0
2025-10-02T09:37:04.411835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3464 sessionId: src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0 is DEAD
2025-10-02T09:37:04.411986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:04.411999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Write session will restart in 0.007625s
2025-10-02T09:37:04.412019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Write session: Do CDS request
2025-10-02T09:37:04.412023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.416613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.417700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.417803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.417810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.417816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.417843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.417869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753870383:4953]
2025-10-02T09:37:04.418214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.418382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.418581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.418611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.418615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.418616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.418618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.418619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.418619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.418620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.418621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.418621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.418622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.418622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.418623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.418626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.418633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.418635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.418637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.418639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.418641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.418643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.418645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.418647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.418649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.418651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.418653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.418657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.418661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.418664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.418667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.418670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.418672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.418674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.418677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.418680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.418683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.418686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.418689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.418691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.418694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.418696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.418699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.418701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.418703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.418705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.418708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.418710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.418713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.418715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.418718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.418734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.420191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.420284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.420295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3465
2025-10-02T09:37:04.420385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.420408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.420412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.420414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.420749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3465 sessionId:  describe result for acl check
2025-10-02T09:37:04.420785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.420791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.420793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.420809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.421239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.423023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.425604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.425614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.425617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829457404:10038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.425623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.426134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.427525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.427537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.427538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.427541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.427544Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3464 [2:7556556115753870383:4953]
2025-10-02T09:37:04.427599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.427613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.427615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.427617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.427618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.427628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.427631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.427635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.427668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.427673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.427674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.427676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.427678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.427716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.427721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.427727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.427732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.427740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.427756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457440:10038], now have 1 active actors on pipe
2025-10-02T09:37:04.427761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457380:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.427764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.427766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.427768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.427776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.427786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.427790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.427792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.427793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.427795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.427796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.427799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3464
2025-10-02T09:37:04.427805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3464
2025-10-02T09:37:04.427811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.427816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.427837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.427841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.427843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.427860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.427866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.427868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.427869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.427876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.427884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.427894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.428006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.428011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.428018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.428080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3465 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0
2025-10-02T09:37:04.428326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64cf7d06-bab46ad5-af57425f-b3696f07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.431225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Write session: try to update token
2025-10-02T09:37:04.431238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.437084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.437096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.437097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.437099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.437104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.437107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.437109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753870378:4953]
2025-10-02T09:37:04.437130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.437133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.437134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.437135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.437138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.437140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.437259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.443156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3465 sessionId: src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.445446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.511560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457448:4174]
2025-10-02T09:37:04.511804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3464, pipe: [1:7556556115829457448:4174]
2025-10-02T09:37:04.557313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.557604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.557616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.557632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457448:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.557862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:04.557863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457448:4174]
2025-10-02T09:37:04.557877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:04.557893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.557949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3465 reason: error at write: Disconnected sessionId: src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0
2025-10-02T09:37:04.557985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.558102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3465 sessionId: src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0 is DEAD
2025-10-02T09:37:04.558254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:04.558265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Write session will restart in 0.005922s
2025-10-02T09:37:04.558280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Write session: Do CDS request
2025-10-02T09:37:04.558285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.563288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.564329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.564483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.564490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.564497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.564532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.564566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753870441:4970]
2025-10-02T09:37:04.565112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.565148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.565223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.565231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3466
2025-10-02T09:37:04.565305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.565325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.565338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.565346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.565353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.565356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.565609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.565655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.565661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.565664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.565665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.565665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.565666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.565667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.565668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.565669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.565670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.565671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.565672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.565673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3466 sessionId:  describe result for acl check
2025-10-02T09:37:04.565676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.565686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.565689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.565693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.565696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.565700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.565703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.565706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.565710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.565704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.565714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.565709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.565717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.565711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.565721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.565715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.565726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.565731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.565741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.565750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.565758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.565765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.565772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.565778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.565785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.565791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.565798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.565803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.565811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.565815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.565819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.565827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.565840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.565845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.565849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.565853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.565857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.565861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.565865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.565869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.565900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.566130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.567778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.571601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.571610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.571614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829457471:10022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.571618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.573352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.574897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.574910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.574914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.574917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.574922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3465 [2:7556556115753870441:4970]
2025-10-02T09:37:04.574932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.574947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.574954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.574956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.574958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.574970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.574979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.574989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.575036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.575042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.575043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.575046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.575048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.575104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.575110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.575121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.575136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.575154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.575171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457508:10022], now have 1 active actors on pipe
2025-10-02T09:37:04.575178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457449:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.575183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.575188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.575190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.575179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3465
2025-10-02T09:37:04.575183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3465
2025-10-02T09:37:04.575201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.575214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.575215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.575218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.575219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.575231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.575237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.575266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.575274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.575284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.575290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.575302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.575311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c14c50d4-32f55821-e334f829-dcc0b642_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.575316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.575322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.575324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.575331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.575341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.575358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.575464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.575473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.575487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.575538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3466 partition: 0 MaxSeqNo: 36 sessionId: src_id|c14c50d4-32f55821-e334f829-dcc0b642_0
2025-10-02T09:37:04.575757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac525804-ec633019-4546bbd3-56d3d4c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c14c50d4-32f55821-e334f829-dcc0b642_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.579181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Write session: try to update token
2025-10-02T09:37:04.579196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.584601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.584614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.584616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.584617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.584621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.584626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.584628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753870436:4970]
2025-10-02T09:37:04.584649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.584654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.584654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.584656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.584657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.584659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.584791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.592035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3466 sessionId: src_id|c14c50d4-32f55821-e334f829-dcc0b642_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.594316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.657962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457516:4174]
2025-10-02T09:37:04.658164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3465, pipe: [1:7556556115829457516:4174]
2025-10-02T09:37:04.717403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.717733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.717745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.717758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457516:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.717901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:04.717920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:04.717939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457516:4174]
2025-10-02T09:37:04.717968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.717994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3466 reason: error at write: Disconnected sessionId: src_id|c14c50d4-32f55821-e334f829-dcc0b642_0
2025-10-02T09:37:04.718145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.718159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3466 sessionId: src_id|c14c50d4-32f55821-e334f829-dcc0b642_0 is DEAD
2025-10-02T09:37:04.718315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:04.718326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Write session will restart in 0.006297s
2025-10-02T09:37:04.718361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Write session: Do CDS request
2025-10-02T09:37:04.718366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.723237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.724253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.724384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.724391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.724397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.724426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.724452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753870513:5013]
2025-10-02T09:37:04.724822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.724968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.725001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.725191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.725205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.725221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.725225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.725226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.725227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.725228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.725229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.725229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.725230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.725230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.725231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.725232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.725232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.725235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.725241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.725243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.725245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.725247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.725249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.725259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.725263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.725268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.725272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.725276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.725281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.725284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.725287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.725289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.725292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.725297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.725299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.725302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.725305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.725307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.725309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.725311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.725314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.725316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.725319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.725322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.725325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.725327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.725330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.725323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.725340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3467
2025-10-02T09:37:04.725346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.725437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.725459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.725467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.725470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.725817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3467 sessionId:  describe result for acl check
2025-10-02T09:37:04.725849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.725855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.725856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.725860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.726283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.728123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.732214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.732224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.732226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829457542:10029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.732232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.732714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.734234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.734245Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.734246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.734248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.734252Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3466 [2:7556556115753870513:5013]
2025-10-02T09:37:04.734262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.734273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.734276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.734278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.734279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.734287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.734292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.734296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.734331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.734336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.734337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.734339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.734340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.734380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.734385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.734392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.734397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.734407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.734422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457517:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.734427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457577:10029], now have 1 active actors on pipe
2025-10-02T09:37:04.734431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.734432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.734433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.734440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.734449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.734453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.734455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.734456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.734459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.734461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.734450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3466
2025-10-02T09:37:04.734478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.734451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3466
2025-10-02T09:37:04.734483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.734484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.734498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.734505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.734541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.734553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.734557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.734558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.734565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.734571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.734583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.734680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.734684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.734696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.734763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3467 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0
2025-10-02T09:37:04.735035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14c50d4-32f55821-e334f829-dcc0b642_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.737928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Write session: try to update token
2025-10-02T09:37:04.737943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.743809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.743823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.743824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.743825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.743830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.743833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.743835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753870508:5013]
2025-10-02T09:37:04.743855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.743856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.743858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.743860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.743860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.743861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.743983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.750104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3467 sessionId: src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.752386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.818205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457607:4174]
2025-10-02T09:37:04.818383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3466, pipe: [1:7556556115829457607:4174]
2025-10-02T09:37:04.858981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:04.859311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.859320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.859333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457607:4174], now have 1 active actors on pipe
2025-10-02T09:37:04.859530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:04.859541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:04.859568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457607:4174]
2025-10-02T09:37:04.859603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:04.859695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3467 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0
2025-10-02T09:37:04.859851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3467 sessionId: src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0 is DEAD
2025-10-02T09:37:04.859992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:04.860003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Write session will restart in 0.007885s
2025-10-02T09:37:04.860023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Write session: Do CDS request
2025-10-02T09:37:04.860027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:04.865245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:04.866256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:04.866389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:04.866397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:04.866405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:04.866443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:04.866478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556115753870596:5012]
2025-10-02T09:37:04.867013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:04.867203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:04.867240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:04.867512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:04.867551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.867556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.867557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.867558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.867560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.867561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.867562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.867563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.867564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.867565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.867566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.867567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.867571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.867581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.867585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.867589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.867593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.867597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.867600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.867606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.867609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.867617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.867621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.867628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.867633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.867643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:04.867652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.867661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:04.867669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.867675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:04.867683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.867687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:04.867695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.867701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:04.867709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.867713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:04.867721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.867728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:04.867735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.867744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:04.867751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.867756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:04.867764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.867772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.867780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.867787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.867794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.867799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.867835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:04.869166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.869264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:04.869275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3468
2025-10-02T09:37:04.869396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:04.869417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:04.869425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:04.869428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:04.869787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3468 sessionId:  describe result for acl check
2025-10-02T09:37:04.869819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:04.869824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:04.869825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:04.869831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:04.870267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:04.872627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:04.875237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:04.875361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:04.875371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:04.875374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556115829457634:9986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:04.875379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:04.876924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:04.876934Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:04.876936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:04.876939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:04.876943Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3467 [2:7556556115753870596:5012]
2025-10-02T09:37:04.876952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:04.876965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:04.876971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.876973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.876975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.876987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:04.876995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:04.877001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:04.877039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.877045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.877048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.877051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:04.877053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:04.877104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:04.877110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.877120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:04.877134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:04.877154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:04.877171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457668:9986], now have 1 active actors on pipe
2025-10-02T09:37:04.877177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457608:2446], now have 1 active actors on pipe
2025-10-02T09:37:04.877183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.877186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.877189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.877182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3467
2025-10-02T09:37:04.877199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:04.877206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:04.877208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:04.877193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3467
2025-10-02T09:37:04.877209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:04.877211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:04.877223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:04.877225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:04.877254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.877261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.877269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.877279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:04.877285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:04.877299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:04.877310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:04.877316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:04.877320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:04.877326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:04.877337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:04.877354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.877459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:04.877467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:04.877478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:04.877542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3468 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0
2025-10-02T09:37:04.877778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a7b4946-9b5fb044-74393a73-ff339e0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:04.880644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Write session: try to update token
2025-10-02T09:37:04.880656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:04.886870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:04.886883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:04.886885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:04.886887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:04.886893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.886897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.886900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556115753870591:5012]
2025-10-02T09:37:04.886920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:04.886924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:04.886928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:04.886928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:04.886931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:04.886930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:04.887046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:04.893168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3468 sessionId: src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:04.895336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:04.959540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556115829457680:4174]
2025-10-02T09:37:04.959718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3467, pipe: [1:7556556115829457680:4174]
2025-10-02T09:37:05.017646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.018007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.018017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.018033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556115829457680:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.018198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.018237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.018239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.018254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.018286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556115829457680:4174]
2025-10-02T09:37:05.018324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3468 reason: error at write: Disconnected sessionId: src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0
2025-10-02T09:37:05.018484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3468 sessionId: src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0 is DEAD
2025-10-02T09:37:05.018614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.018624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Write session will restart in 0.005818s
2025-10-02T09:37:05.018645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Write session: Do CDS request
2025-10-02T09:37:05.018649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.023683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.024793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.024933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.024941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.024949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.024983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.025014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048837952:5028]
2025-10-02T09:37:05.025150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.025292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.025303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3469
2025-10-02T09:37:05.025412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.025434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.025442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.025445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.025565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.025756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3469 sessionId:  describe result for acl check
2025-10-02T09:37:05.025765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.025779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.025785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.025787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.025798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.025793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.026068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.026110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.026116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.026117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.026120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.026121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.026122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.026123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.026124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.026125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.026126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.026127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.026128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.026132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.026142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.026145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.026149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.026152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.026156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.026159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.026163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.026167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.026171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.026178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.026182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.026187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.026197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.026205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.026198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.026213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.026221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.026225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.026229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.026234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.026242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.026250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.026256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.026264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.026272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.026278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.026285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.026289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.026296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.026304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.026308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.026316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.026323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.026331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.026334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.026342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.026378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.027573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.031619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.031629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.031632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425006:9977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.031636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.033833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.035455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.035468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.035470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.035473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.035478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3468 [2:7556556120048837952:5028]
2025-10-02T09:37:05.035488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.035504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.035510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.035513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.035514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.035525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.035533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.035538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.035588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.035594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.035596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.035598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.035600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.035652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.035658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.035668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.035680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.035699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.035718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425043:9977], now have 1 active actors on pipe
2025-10-02T09:37:05.035724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124424981:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.035729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.035717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3468
2025-10-02T09:37:05.035722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3468
2025-10-02T09:37:05.035732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.035735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.035746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.035749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.035751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.035752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.035759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.035771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.035776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.035806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.035813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.035822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.035831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.035838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.035852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.035859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.035862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.035863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.035869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.035879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.035898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.036006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.036015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.036026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.036088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3469 partition: 0 MaxSeqNo: 36 sessionId: src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0
2025-10-02T09:37:05.036315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2e6a80-e64844ee-c0175e4a-b95b3d7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.039166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Write session: try to update token
2025-10-02T09:37:05.039180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.045075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.045090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.045092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.045093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.045100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.045102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.045105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048837947:5028]
2025-10-02T09:37:05.045129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.045130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.045131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.045133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.045134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.045136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.045270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.051532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3469 sessionId: src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.053869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.118266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425050:4174]
2025-10-02T09:37:05.118477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3468, pipe: [1:7556556120124425050:4174]
2025-10-02T09:37:05.157401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.157711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.157722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.157737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425050:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.157923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.157939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.157939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.157998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425050:4174]
2025-10-02T09:37:05.158010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3469 reason: error at write: Disconnected sessionId: src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0
2025-10-02T09:37:05.158078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.158155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3469 sessionId: src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0 is DEAD
2025-10-02T09:37:05.158314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.158324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Write session will restart in 0.008442s
2025-10-02T09:37:05.158340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Write session: Do CDS request
2025-10-02T09:37:05.158344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.163273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.164317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.164425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.164432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.164438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.164463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.164491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838016:5044]
2025-10-02T09:37:05.164884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.165058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.165085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.165282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.165312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.165316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.165317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.165317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.165318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.165321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.165321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.165322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.165323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.165323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.165324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.165324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.165327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.165334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.165336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.165338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.165340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.165342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.165344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.165347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.165350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.165354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.165357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.165361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.165366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.165373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.165381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.165384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.165387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.165390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.165392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.165395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.165399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.165402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.165404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.165406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.165410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.165412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.165416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.165419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.165425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.165428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.165430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.165436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.165438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.165441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.165442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.165446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.165463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.168144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.168244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.168257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3470
2025-10-02T09:37:05.168373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.168397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.168403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.168407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.168988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3470 sessionId:  describe result for acl check
2025-10-02T09:37:05.169010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.169015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.169017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.169021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.169438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.170888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.172854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.172898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.172909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.172911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425080:9960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.172915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.174304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.174317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.174321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.174324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.174328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3469 [2:7556556120048838016:5044]
2025-10-02T09:37:05.174340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.174354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.174359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.174361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.174363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.174372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.174379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.174383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.174421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.174426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.174427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.174429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.174430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.174465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.174470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.174476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.174482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.174489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.174502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425052:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.174508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425115:9960], now have 1 active actors on pipe
2025-10-02T09:37:05.174513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.174516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.174517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.174524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.174531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.174536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.174538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.174539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.174541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.174542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.174544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3469
2025-10-02T09:37:05.174551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3469
2025-10-02T09:37:05.174557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.174562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.174575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.174589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.174597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.174612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.174619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.174621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.174622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.174627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.174634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.174643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.174757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.174764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.174773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.174835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3470 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0
2025-10-02T09:37:05.175072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0aff3-c750636e-6512a711-e61f9cc3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.177634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Write session: try to update token
2025-10-02T09:37:05.177648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.183573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.183584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.183585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.183586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.183589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.183591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.183593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838011:5044]
2025-10-02T09:37:05.183611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.183614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.183617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.183617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.183618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.183619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.183746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.189854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3470 sessionId: src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.192026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.258039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425122:4174]
2025-10-02T09:37:05.258250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3469, pipe: [1:7556556120124425122:4174]
2025-10-02T09:37:05.301678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.301930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.301941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.301955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425122:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.302105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.302114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.302171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425122:4174]
2025-10-02T09:37:05.302194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:05.302268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3470 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0
2025-10-02T09:37:05.302406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3470 sessionId: src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0 is DEAD
2025-10-02T09:37:05.302543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:05.302554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Write session will restart in 0.005154s
2025-10-02T09:37:05.302573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Write session: Do CDS request
2025-10-02T09:37:05.302577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.307566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.308683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.308864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.308872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.308879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.308917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.308950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838091:5063]
2025-10-02T09:37:05.309185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.309249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.309261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3471
2025-10-02T09:37:05.309371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.309393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.309399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.309405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.309747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3471 sessionId:  describe result for acl check
2025-10-02T09:37:05.309785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.309793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.309795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.309799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.309878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.310087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.310120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.310205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.310522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.310565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.310570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.310571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.310572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.310573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.310574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.310575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.310576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.310577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.310578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.310579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.310579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.310584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.310593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.310597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.310600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.310603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.310607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.310614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.310618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.310621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.310629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.310632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.310640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.310645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.310651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.310660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.310668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.310673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.310680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.310687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.310693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.310701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.310705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.310708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.310713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.310717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.310723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.310727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.310735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.310738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.310744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.310748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.310754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.310759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.310765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.310769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.310775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.310807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.311751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.316105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.316115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.316118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425148:9948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.316124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.318331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.320023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.320035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.320037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.320039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.320046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3470 [2:7556556120048838091:5063]
2025-10-02T09:37:05.320056Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.320074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.320081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.320083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.320084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.320096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.320103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.320108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.320153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.320159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.320160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.320163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.320165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.320212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.320218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.320228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.320241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.320260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.320279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425201:9948], now have 1 active actors on pipe
2025-10-02T09:37:05.320285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425123:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.320277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3470
2025-10-02T09:37:05.320290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.320284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3470
2025-10-02T09:37:05.320295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.320297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.320303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.320308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.320310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.320311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.320318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.320335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.320340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.320353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.320360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.320385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.320395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.320398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.320409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23759dee-fa607004-982a5c9d-dceadb82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.320417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.320423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.320425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.320431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.320436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.320461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.320576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.320584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.320595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.320654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3471 partition: 0 MaxSeqNo: 36 sessionId: src_id|23759dee-fa607004-982a5c9d-dceadb82_0
2025-10-02T09:37:05.320895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f48dab3-fd5b7989-b7fc5675-6e7d5726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23759dee-fa607004-982a5c9d-dceadb82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.323697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Write session: try to update token
2025-10-02T09:37:05.323709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.329906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.329919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.329923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.329925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.329930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.329934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.329937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838086:5063]
2025-10-02T09:37:05.329962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.329965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.329969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.329970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.329971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.329972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.330097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.335717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3471 sessionId: src_id|23759dee-fa607004-982a5c9d-dceadb82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.338040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.354772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:37:05.354790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-02T09:37:05.402419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425225:4174]
2025-10-02T09:37:05.402601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3470, pipe: [1:7556556120124425225:4174]
2025-10-02T09:37:05.458807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.459058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.459069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.459106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425225:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.459273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.459284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.459303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.459313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425225:4174]
2025-10-02T09:37:05.459336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.459348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-02T09:37:05.459373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3471 reason: error at write: Disconnected sessionId: src_id|23759dee-fa607004-982a5c9d-dceadb82_0
2025-10-02T09:37:05.459522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3471 sessionId: src_id|23759dee-fa607004-982a5c9d-dceadb82_0 is DEAD
2025-10-02T09:37:05.459669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.459679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Write session will restart in 0.008564s
2025-10-02T09:37:05.459695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Write session: Do CDS request
2025-10-02T09:37:05.459698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.465118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.466195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.466323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.466330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.466338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.466372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.466409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838158:5039]
2025-10-02T09:37:05.466948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.467139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.467173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.467449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.467490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.467495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.467497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.467499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.467500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.467501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.467501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.467503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.467503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.467505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.467506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.467507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.467512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.467522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.467525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.467529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.467533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.467536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.467540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.467543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.467547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.467551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.467554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.467560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.467565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.467575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.467585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.467594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.467601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.467606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.467610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.467614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.467618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.467625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.467629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.467637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.467641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.467649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.467653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.467662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.467667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.467673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.467677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.467685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.467689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.467697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.467702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.467706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.467740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.469171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.469293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.469307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3472
2025-10-02T09:37:05.469435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.469458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.469465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.469468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.469838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3472 sessionId:  describe result for acl check
2025-10-02T09:37:05.469871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.469876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.469877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.469881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.470297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.472018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.474543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.474553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.474556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425256:9932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.474560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.475176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.476709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.476722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.476724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.476727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.476731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3471 [2:7556556120048838158:5039]
2025-10-02T09:37:05.476741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.476759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.476765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.476767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.476769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.476779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.476787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.476796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.476854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.476860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.476861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.476864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.476866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.476914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.476920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.476931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.476945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.476963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.476981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425226:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.476988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425292:9932], now have 1 active actors on pipe
2025-10-02T09:37:05.476992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.476981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3471
2025-10-02T09:37:05.476997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.476984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3471
2025-10-02T09:37:05.476999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.477005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.477012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.477014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.477015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.477015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.477027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.477034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.477051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.477058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.477095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.477104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.477108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.477119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdc4411b-99381c86-630cda71-e39d6435_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.477126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.477129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.477130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.477138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.477148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.477183Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:37:05.477224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.477323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 24 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:37:05.477344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.477352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.477346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:37:05.477363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.477427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3472 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdc4411b-99381c86-630cda71-e39d6435_0
2025-10-02T09:37:05.477655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23759dee-fa607004-982a5c9d-dceadb82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdc4411b-99381c86-630cda71-e39d6435_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.480358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Write session: try to update token
2025-10-02T09:37:05.480368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.486337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.486352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.486353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.486356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.486360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.486363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.486364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838153:5039]
2025-10-02T09:37:05.486389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.486390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.486393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.486395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.486396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.486398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.486507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.491708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3472 sessionId: src_id|cdc4411b-99381c86-630cda71-e39d6435_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.494095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.559577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425303:4174]
2025-10-02T09:37:05.559738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3471, pipe: [1:7556556120124425303:4174]
2025-10-02T09:37:05.607873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.608152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.608166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.608183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425303:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.608324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425303:4174]
2025-10-02T09:37:05.608347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.608379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.608395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.608415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.608505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3472 reason: error at write: Disconnected sessionId: src_id|cdc4411b-99381c86-630cda71-e39d6435_0
2025-10-02T09:37:05.608662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3472 sessionId: src_id|cdc4411b-99381c86-630cda71-e39d6435_0 is DEAD
2025-10-02T09:37:05.608797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.608814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Write session will restart in 0.005302s
2025-10-02T09:37:05.608833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Write session: Do CDS request
2025-10-02T09:37:05.608838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.614043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.615025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.615124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.615163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.615172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.615179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.615214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.615247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838223:5037]
2025-10-02T09:37:05.615263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.615275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3473
2025-10-02T09:37:05.615377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.615407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.615414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.615417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.615741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3473 sessionId:  describe result for acl check
2025-10-02T09:37:05.615775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.615783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.615782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.615783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.615787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.615975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.616009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.616201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.616277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.616319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.616324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.616325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.616326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.616327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.616328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.616330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.616331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.616332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.616333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.616334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.616335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.616340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.616349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.616352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.616356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.616360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.616365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.616370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.616375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.616378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.616382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.616385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.616392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.616397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.616407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.616415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.616424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.616431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.616436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.616440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.616445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.616451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.616456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.616463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.616467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.616474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.616479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.616488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.616495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.616499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.616505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.616508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.616514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.616521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.616525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.616534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.616541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.616574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.617936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.621818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.621829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.621832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425334:9923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.621837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.624008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.625619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.625632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.625634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.625638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.625643Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3472 [2:7556556120048838223:5037]
2025-10-02T09:37:05.625654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.625671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.625677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.625679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.625681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.625692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.625700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.625707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.625752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.625759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.625761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.625764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.625766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.625855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.625861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.625872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.625886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.625906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.625921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425373:9923], now have 1 active actors on pipe
2025-10-02T09:37:05.625923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425307:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.625928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.625932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.625934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.625933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3472
2025-10-02T09:37:05.625944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.625957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.625959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.625960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.625962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.625974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.625978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.626005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.626012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.626003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3472
2025-10-02T09:37:05.626022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.626030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.626031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.626051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.626056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.626060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.626062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.626068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.626075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.626090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.626236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.626243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.626255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.626332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3473 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0
2025-10-02T09:37:05.626597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4411b-99381c86-630cda71-e39d6435_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.629348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Write session: try to update token
2025-10-02T09:37:05.629358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.635262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.635274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.635275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.635277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.635281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.635283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.635287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838218:5037]
2025-10-02T09:37:05.635307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.635312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.635313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.635317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.635326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.635329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.635420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.641701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3473 sessionId: src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.643938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.708603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425381:4174]
2025-10-02T09:37:05.708835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3472, pipe: [1:7556556120124425381:4174]
2025-10-02T09:37:05.763153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.763418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.763428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.763443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425381:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.763597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.763624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.763645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.763645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425381:4174]
2025-10-02T09:37:05.763720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3473 reason: error at write: Disconnected sessionId: src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0
2025-10-02T09:37:05.763723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.763879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3473 sessionId: src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0 is DEAD
2025-10-02T09:37:05.764011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.764020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Write session will restart in 0.005393s
2025-10-02T09:37:05.764034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Write session: Do CDS request
2025-10-02T09:37:05.764039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.769059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.770111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.770123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.770239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.770247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.770254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.770244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.770260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3474
2025-10-02T09:37:05.770293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.770327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838302:5079]
2025-10-02T09:37:05.770375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.770397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.770404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.770407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.770790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3474 sessionId:  describe result for acl check
2025-10-02T09:37:05.770826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.770831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.770833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.770836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.770863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.771048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.771084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.771272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.771364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.771405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.771410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.771411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.771412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.771413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.771414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.771415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.771416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.771417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.771418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.771420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.771420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.771425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.771434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.771437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.771441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.771445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.771449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.771454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.771458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.771461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.771465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.771472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.771475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.771481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.771490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.771496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.771504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.771509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.771513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.771519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.771523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.771531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.771535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.771543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.771547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.771555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.771560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.771564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.771571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.771577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.771583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.771586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.771594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.771598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.771606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.771610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.771617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.771649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.773061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.776862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.776872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.776875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425410:9918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.776880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.779032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.780607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.780620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.780621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.780624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.780628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3473 [2:7556556120048838302:5079]
2025-10-02T09:37:05.780639Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.780655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.780662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.780664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.780666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.780676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.780684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.780689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.780734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.780740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.780741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.780743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.780745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.780793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.780799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.780821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.780836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.780854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.780872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425449:9918], now have 1 active actors on pipe
2025-10-02T09:37:05.780878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425382:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.780883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.780886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.780888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.780897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.780894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3473
2025-10-02T09:37:05.780910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.780911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.780913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.780898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3473
2025-10-02T09:37:05.780914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.780925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.780928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.780960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.780966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.780976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.780986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.780991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.781007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.781015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.781018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.781022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.781030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.781040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.781058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.781210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.781217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.781227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.781297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3474 partition: 0 MaxSeqNo: 36 sessionId: src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0
2025-10-02T09:37:05.781547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c6c7803-e0f6ea2f-5c720d4e-3548ba0a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.784350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Write session: try to update token
2025-10-02T09:37:05.784361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.790214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.790228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.790229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.790231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.790237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.790240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.790243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838297:5079]
2025-10-02T09:37:05.790273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.790274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.790278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.790280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.790282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.790284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.790386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.796208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3474 sessionId: src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.798690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:05.863747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556120124425479:4174]
2025-10-02T09:37:05.863955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3473, pipe: [1:7556556120124425479:4174]
2025-10-02T09:37:05.923219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:05.923468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.923478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.923491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425479:4174], now have 1 active actors on pipe
2025-10-02T09:37:05.923678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:05.923726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556120124425479:4174]
2025-10-02T09:37:05.923726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:05.923731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:05.923765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:05.923810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3474 reason: error at write: Disconnected sessionId: src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0
2025-10-02T09:37:05.923959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3474 sessionId: src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0 is DEAD
2025-10-02T09:37:05.924163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:05.924172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Write session will restart in 0.006306s
2025-10-02T09:37:05.924192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Write session: Do CDS request
2025-10-02T09:37:05.924197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:05.929380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:05.930365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:05.930492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:05.930500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:05.930508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:05.930542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:05.930576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556120048838392:5115]
2025-10-02T09:37:05.931127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.931122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:05.931254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:05.931271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3475
2025-10-02T09:37:05.931291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:05.931328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:05.931406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:05.931430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:05.931438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:05.931442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:05.931594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:05.931637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.931642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.931646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.931647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.931648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.931649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.931650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.931651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.931652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.931653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.931654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.931655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.931659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.931669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.931673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.931676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.931680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.931683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.931691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.931694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.931702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.931706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.931714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.931717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.931726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.931732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:05.931741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.931749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:05.931757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.931762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:05.931769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.931774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:05.931781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.931789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:05.931796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.931789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3475 sessionId:  describe result for acl check
2025-10-02T09:37:05.931801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:05.931809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.931814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:05.931818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.931822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:05.931826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.931832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:05.931820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:05.931825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:05.931827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:05.931836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.931844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.931831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:05.931849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.931853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.931857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.931863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.931895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:05.932269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:05.934304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:05.938878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:05.938890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:05.938893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556120124425512:9901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:05.938899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:05.939337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:05.940896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:05.940908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:05.940909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:05.940913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:05.940919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3474 [2:7556556120048838392:5115]
2025-10-02T09:37:05.940930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:05.940947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:05.940951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.940953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.940955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.940967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:05.940971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:05.940976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:05.941025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.941031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.941033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.941036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:05.941038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:05.941088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:05.941095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.941104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:05.941118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:05.941138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:05.941155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425480:2446], now have 1 active actors on pipe
2025-10-02T09:37:05.941162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556120124425551:9901], now have 1 active actors on pipe
2025-10-02T09:37:05.941167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.941173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.941175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.941167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3474
2025-10-02T09:37:05.941178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3474
2025-10-02T09:37:05.941186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:05.941198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:05.941199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:05.941205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:05.941206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:05.941211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:05.941214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:05.941243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.941250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.941260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.941269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:05.941277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:05.941294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:05.941302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:05.941306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:05.941308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:05.941316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:05.941326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:05.941343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.941473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:05.941482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:05.941493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:05.941562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3475 partition: 0 MaxSeqNo: 36 sessionId: src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0
2025-10-02T09:37:05.941843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabc087d-f2d5b647-62585f1a-88320fc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:05.944607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Write session: try to update token
2025-10-02T09:37:05.944618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:05.950618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:05.950633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:05.950635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:05.950637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:05.950643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.950650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.950653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556120048838387:5115]
2025-10-02T09:37:05.950682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:05.950685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:05.950686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:05.950688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:05.950689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:05.950692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:05.950844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:05.956555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3475 sessionId: src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:05.959065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.023985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419392860:4174]
2025-10-02T09:37:06.024231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3474, pipe: [1:7556556124419392860:4174]
2025-10-02T09:37:06.067682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.067965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.067976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.067991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419392860:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.068172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.068220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.068226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419392860:4174]
2025-10-02T09:37:06.068255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:06.068334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3475 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0
2025-10-02T09:37:06.068499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3475 sessionId: src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0 is DEAD
2025-10-02T09:37:06.068635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:06.068646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Write session will restart in 0.008344s
2025-10-02T09:37:06.068662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Write session: Do CDS request
2025-10-02T09:37:06.068666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.073872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.074863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.074984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.074992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.074998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.075031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.075059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343805756:5099]
2025-10-02T09:37:06.075720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.075911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.075945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.076250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.076285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.076290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.076290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.076291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.076292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.076292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.076293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.076294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.076295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.076295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.076296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.076297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.076300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.076307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.076309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.076312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.076314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.076316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.076318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.076320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.076322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.076325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.076327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.076329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.076333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.076339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.076342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.076345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.076348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.076351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.076353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.076356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.076360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.076362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.076365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.076367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.076370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.076374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.076376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.076379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.076381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.076384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.076386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.076389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.076392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.076395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.076397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.076400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.076418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.078147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.078268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.078286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3476
2025-10-02T09:37:06.078419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.078443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.078451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.078454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.078856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3476 sessionId:  describe result for acl check
2025-10-02T09:37:06.078896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.078902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.078904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.078910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.079342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.080744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.083274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.083284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.083287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419392895:9885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.083291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.083868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.085362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.085373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.085375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.085377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.085381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3475 [2:7556556124343805756:5099]
2025-10-02T09:37:06.085390Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.085404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.085412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.085416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.085419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.085429Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.085432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.085436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.085470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.085474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.085476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.085478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.085479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.085560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.085567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.085577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.085586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.085599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.085613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419392930:9885], now have 1 active actors on pipe
2025-10-02T09:37:06.085618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419392861:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.085622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.085624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.085626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.085618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3475
2025-10-02T09:37:06.085618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3475
2025-10-02T09:37:06.085637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.085650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.085650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.085653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.085654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.085666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.085672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.085700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.085707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.085716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.085726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.085741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.085747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.085755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.085758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.085761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.085769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.085782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.085805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.085906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.085913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.085924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.085996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3476 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0
2025-10-02T09:37:06.086219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cf67b7e-37ff0b16-d9cd5ed7-d92c84c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.088949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Write session: try to update token
2025-10-02T09:37:06.088959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.094930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.094944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.094945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.094946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.094951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.094953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.094956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343805751:5099]
2025-10-02T09:37:06.094984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.094993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.094999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.094998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.095002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.095005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.095136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.100348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3476 sessionId: src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.102721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.168364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419392938:4174]
2025-10-02T09:37:06.168622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3475, pipe: [1:7556556124419392938:4174]
2025-10-02T09:37:06.205871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.206123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.206132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.206144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419392938:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.206340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.206364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:06.206381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:06.206389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419392938:4174]
2025-10-02T09:37:06.206412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.206455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3476 reason: error at write: Disconnected sessionId: src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0
2025-10-02T09:37:06.206603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3476 sessionId: src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0 is DEAD
2025-10-02T09:37:06.206722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:06.206733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Write session will restart in 0.008196s
2025-10-02T09:37:06.206752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Write session: Do CDS request
2025-10-02T09:37:06.206757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.212352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.213418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.213525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.213532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.213537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.213566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.213590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343805826:5101]
2025-10-02T09:37:06.213943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.214148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.214175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.214363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.214393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.214397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.214398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.214398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.214399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.214400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.214400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.214401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.214401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.214402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.214403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.214403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.214407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.214418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.214421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.214424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.214428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.214431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.214434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.214437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.214441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.214446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.214451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.214455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.214464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.214470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.214478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.214482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.214488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.214492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.214495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.214500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.214503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.214511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.214515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.214521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.214525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.214531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.214535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.214540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.214545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.214549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.214555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.214560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.214566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.214571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.214577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.214580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.214598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.216204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.216327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.216344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3477
2025-10-02T09:37:06.216474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.216504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.216513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.216516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.216899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3477 sessionId:  describe result for acl check
2025-10-02T09:37:06.216930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.216936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.216937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.216945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.217373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.218970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.221474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.221484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.221487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419392975:9877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.221491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.221986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.223364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.223376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.223377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.223379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.223384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3476 [2:7556556124343805826:5101]
2025-10-02T09:37:06.223394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.223406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.223407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.223409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.223410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.223419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.223425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.223429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.223462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.223467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.223468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.223469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.223471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.223517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.223524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.223534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.223547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.223565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.223583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393010:9877], now have 1 active actors on pipe
2025-10-02T09:37:06.223590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419392940:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.223594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.223595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.223596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.223606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.223614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3476
2025-10-02T09:37:06.223621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3476
2025-10-02T09:37:06.223621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.223621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.223623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.223624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.223637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.223640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.223657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.223663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.223665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.223674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.223680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.223714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.223723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.223726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.223729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.223736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.223745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.223759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.223863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.223870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.223880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.223957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3477 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0
2025-10-02T09:37:06.224179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d28ad05-b7fa0ef3-8bf3cfdf-69cce13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.226835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Write session: try to update token
2025-10-02T09:37:06.226851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.232705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.232717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.232718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.232719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.232723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.232727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.232729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343805821:5101]
2025-10-02T09:37:06.232752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.232763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.232765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.232770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.232781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.232784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.232897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.239372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3477 sessionId: src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.241683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.306630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393017:4174]
2025-10-02T09:37:06.306849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3476, pipe: [1:7556556124419393017:4174]
2025-10-02T09:37:06.344365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.344647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.344656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.344668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393017:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.344881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.344892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393017:4174]
2025-10-02T09:37:06.344897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:06.344901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:06.344928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.344972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3477 reason: error at write: Disconnected sessionId: src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0
2025-10-02T09:37:06.345138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3477 sessionId: src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0 is DEAD
2025-10-02T09:37:06.345471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:06.345483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Write session will restart in 0.007413s
2025-10-02T09:37:06.345499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Write session: Do CDS request
2025-10-02T09:37:06.345504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.350802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.351816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.351920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.351927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.351932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.351960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.351987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343805908:5104]
2025-10-02T09:37:06.352336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.352535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.352562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.352747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.352778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.352782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.352782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.352783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.352785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.352786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.352786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.352787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.352788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.352788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.352789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.352789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.352792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.352799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.352812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.352814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.352816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.352819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.352821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.352823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.352825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.352827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.352829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.352831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.352835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.352839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.352842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.352845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.352848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.352850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.352852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.352860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.352862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.352866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.352869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.352874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.352877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.352879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.352881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.352883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.352885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.352887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.352889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.352892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.352897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.352900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.352902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.352904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.352922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.354137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.354253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.354265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3478
2025-10-02T09:37:06.354401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.354429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.354433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.354439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.354778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3478 sessionId:  describe result for acl check
2025-10-02T09:37:06.354808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.354813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.354815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.354819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.355287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.356722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.359762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.359771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.359773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419393057:9864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.359777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.360314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.361700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.361711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.361713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.361716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.361720Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3477 [2:7556556124343805908:5104]
2025-10-02T09:37:06.361728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.361740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.361745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.361747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.361748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.361758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.361761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.361765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.361803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.361808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.361809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.361812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.361813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.361859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.361865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.361875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.361889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.361906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.361924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393021:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.361929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393092:9864], now have 1 active actors on pipe
2025-10-02T09:37:06.361933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.361937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.361938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.361946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.361941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3477
2025-10-02T09:37:06.361946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3477
2025-10-02T09:37:06.361960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.361961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.361963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.361964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.361977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.361983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.362011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.362018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.362029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.362037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.362047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.362062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.362070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.362076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.362077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.362086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.362097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.362117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.362224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.362231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.362241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.362309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3478 partition: 0 MaxSeqNo: 36 sessionId: src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0
2025-10-02T09:37:06.362549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9fe8af-e14bb08a-391f947f-6025b42a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.365316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Write session: try to update token
2025-10-02T09:37:06.365327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.371324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.371338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.371342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.371343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.371350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.371353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.371356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343805903:5104]
2025-10-02T09:37:06.371380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.371382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.371386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.371388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.371388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.371391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.371511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.376787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3478 sessionId: src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.379286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.444877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393111:4174]
2025-10-02T09:37:06.445121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3477, pipe: [1:7556556124419393111:4174]
2025-10-02T09:37:06.480302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.480524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.480533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.480546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393111:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.480791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.480742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.480754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:06.480758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:06.480840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3478 reason: error at write: Disconnected sessionId: src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0
2025-10-02T09:37:06.480922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393111:4174]
2025-10-02T09:37:06.481000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3478 sessionId: src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0 is DEAD
2025-10-02T09:37:06.481150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:06.481161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Write session will restart in 0.007437s
2025-10-02T09:37:06.481177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Write session: Do CDS request
2025-10-02T09:37:06.481181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.486622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.487803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.487918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.487925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.487930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.487959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.487986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343805981:5110]
2025-10-02T09:37:06.488336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.488544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.488570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.488757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.488788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.488795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.488795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.488796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.488796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.488797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.488798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.488798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.488799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.488811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.488812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.488812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.488815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.488822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.488824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.488827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.488830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.488834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.488837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.488840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.488844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.488847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.488850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.488853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.488858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.488864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.488869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.488874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.488879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.488881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.488884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.488887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.488889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.488893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.488895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.488898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.488901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.488904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.488907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.488910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.488912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.488915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.488917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.488920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.488922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.488925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.488927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.488929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.488947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.489090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.489221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.489237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3479
2025-10-02T09:37:06.489385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.489410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.489418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.489422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.489761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3479 sessionId:  describe result for acl check
2025-10-02T09:37:06.489791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.489796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.489798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.489802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.490216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.491968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.495907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.495918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.495921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419393149:9851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.495927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.496372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.497852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.497865Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.497866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.497868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.497872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3478 [2:7556556124343805981:5110]
2025-10-02T09:37:06.497879Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.497888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.497893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.497894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.497895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.497907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.497910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.497920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.497954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.497959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.497960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.497962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.497963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.498011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.498017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.498027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.498040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.498055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.498073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393184:9851], now have 1 active actors on pipe
2025-10-02T09:37:06.498078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393112:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.498082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.498083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.498084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.498092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.498105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.498107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.498109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.498110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.498101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3478
2025-10-02T09:37:06.498103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3478
2025-10-02T09:37:06.498121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.498127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.498153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.498160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.498169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.498179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.498189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.498204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.498213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.498218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.498223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.498230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.498241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.498271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.498375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.498382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.498392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.498459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3479 partition: 0 MaxSeqNo: 36 sessionId: src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0
2025-10-02T09:37:06.498718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17d384f6-c18da7f7-a8b74c0e-d3773bfe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.501432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Write session: try to update token
2025-10-02T09:37:06.501443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.507311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.507324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.507326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.507327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.507331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.507333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.507335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343805976:5110]
2025-10-02T09:37:06.507360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.507364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.507366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.507374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.507378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.507382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.507477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.512488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3479 sessionId: src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.514931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.581092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393192:4174]
2025-10-02T09:37:06.581343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3478, pipe: [1:7556556124419393192:4174]
2025-10-02T09:37:06.618116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.618363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.618374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.618386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393192:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.618600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.618603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393192:4174]
2025-10-02T09:37:06.618610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:06.618614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:06.618640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.618686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3479 reason: error at write: Disconnected sessionId: src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0
2025-10-02T09:37:06.618802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3479 sessionId: src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0 is DEAD
2025-10-02T09:37:06.618896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:06.618906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Write session will restart in 0.007903s
2025-10-02T09:37:06.618928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Write session: Do CDS request
2025-10-02T09:37:06.618934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.624497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.625490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.625600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.625607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.625618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.625646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.625671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343806053:5119]
2025-10-02T09:37:06.626022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.626213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.626241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.626455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.626459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.626459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.626460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.626461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.626461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.626462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.626462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.626463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.626463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.626464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.626465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.626467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.626474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.626476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.626478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.626480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.626482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.626484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.626488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.626490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.626492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.626494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.626496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.626500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.626504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.626507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.626510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.626513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.626515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.626517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.626521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.626523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.626530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.626532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.626536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.626538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.626541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.626543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.626547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.626549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.626552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.626554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.626557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.626561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.626563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.626566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.626568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.626586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.628134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.628263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.628276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3480
2025-10-02T09:37:06.628376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.628399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.628407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.628410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.628736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3480 sessionId:  describe result for acl check
2025-10-02T09:37:06.628768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.628774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.628775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.628779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.629212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.630647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.633455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.633465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.633467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419393237:9835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.633471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.633989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.635474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.635486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.635487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.635489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.635493Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3479 [2:7556556124343806053:5119]
2025-10-02T09:37:06.635500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.635511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.635512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.635514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.635515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.635524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.635531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.635535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.635572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.635577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.635578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.635580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.635581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.635628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.635635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.635645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.635659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.635676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.635692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393199:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.635698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393272:9835], now have 1 active actors on pipe
2025-10-02T09:37:06.635701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.635702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.635703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.635711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.635715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3479
2025-10-02T09:37:06.635725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.635724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3479
2025-10-02T09:37:06.635726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.635732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.635734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.635739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.635740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.635757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.635764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.635765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.635777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.635783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.635818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.635827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.635832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.635833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.635841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.635852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.635867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.635977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.635984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.635995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.636063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3480 partition: 0 MaxSeqNo: 36 sessionId: src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0
2025-10-02T09:37:06.636279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f3613b-6deefdd9-c8f0001d-c1064eed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.638941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Write session: try to update token
2025-10-02T09:37:06.638957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.644921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.644932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.644933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.644935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.644938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.644941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.644945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343806048:5119]
2025-10-02T09:37:06.644970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.644977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.644979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.644988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.644999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.645003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.645090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.651840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3480 sessionId: src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.654057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.718770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393283:4174]
2025-10-02T09:37:06.718977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3479, pipe: [1:7556556124419393283:4174]
2025-10-02T09:37:06.757435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.757698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.757707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.757719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393283:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.757943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.757962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.757989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:06.757994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:06.758025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393283:4174]
2025-10-02T09:37:06.758066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3480 reason: error at write: Disconnected sessionId: src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0
2025-10-02T09:37:06.758217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3480 sessionId: src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0 is DEAD
2025-10-02T09:37:06.758364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:06.758376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Write session will restart in 0.009964s
2025-10-02T09:37:06.758401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Write session: Do CDS request
2025-10-02T09:37:06.758408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.764115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.765191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.765302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.765310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.765315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.765341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.765368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343806126:5118]
2025-10-02T09:37:06.765861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.766064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.766090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.766284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.766327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.766333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.766333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.766334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.766335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.766336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.766336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.766337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.766338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.766339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.766339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.766340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.766344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.766354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.766357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.766361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.766363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.766366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.766371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.766374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.766377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.766381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.766388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.766390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.766397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.766407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.766413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.766418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.766425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.766430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.766433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.766437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.766445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.766449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.766454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.766459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.766464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.766468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.766472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.766476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.766481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.766485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.766490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.766502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.766506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.766513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.766519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.766546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.769163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.769282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.769295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3481
2025-10-02T09:37:06.769389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.769413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.769422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.769425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.769775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3481 sessionId:  describe result for acl check
2025-10-02T09:37:06.769804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.769809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.769811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.769816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.770273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.772065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.773940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.773949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.773954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419393324:9814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.773959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.774053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.775612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.775625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.775626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.775629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.775634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3480 [2:7556556124343806126:5118]
2025-10-02T09:37:06.775643Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.775653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.775658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.775659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.775660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.775671Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.775677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.775681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.775715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.775721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.775721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.775724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.775725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.775772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.775778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.775788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.775800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.775817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.775835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393284:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.775840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393358:9814], now have 1 active actors on pipe
2025-10-02T09:37:06.775844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.775846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.775848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.775861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.775866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3480
2025-10-02T09:37:06.775877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3480
2025-10-02T09:37:06.775875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.775875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.775877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.775878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.775891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.775893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.775912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.775917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.775918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.775929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.775936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.775971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.775982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.775989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.775991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.775999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.776010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.776027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.776141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.776147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.776159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.776229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3481 partition: 0 MaxSeqNo: 36 sessionId: src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0
2025-10-02T09:37:06.776465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e241e9-85e4f4a1-7e4a4be6-9a5c16e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.779390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Write session: try to update token
2025-10-02T09:37:06.779403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.785218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.785233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.785235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.785236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.785241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.785244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.785246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343806121:5118]
2025-10-02T09:37:06.785272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.785281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.785283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.785284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.785287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.785290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.785395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.790933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3481 sessionId: src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.793497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.858009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393379:4174]
2025-10-02T09:37:06.858236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3480, pipe: [1:7556556124419393379:4174]
2025-10-02T09:37:06.896047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:06.896280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.896289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.896301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393379:4174], now have 1 active actors on pipe
2025-10-02T09:37:06.896497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:06.896508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:06.896518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393379:4174]
2025-10-02T09:37:06.896546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:06.896626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0
2025-10-02T09:37:06.896787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3481 sessionId: src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0 is DEAD
2025-10-02T09:37:06.897034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:06.897047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Write session will restart in 0.007842s
2025-10-02T09:37:06.897067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Write session: Do CDS request
2025-10-02T09:37:06.897073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:06.902487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:06.903582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:06.903691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:06.903699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:06.903705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:06.903731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:06.903755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556124343806236:5143]
2025-10-02T09:37:06.904104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:06.904312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:06.904338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:06.904520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:06.904549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.904553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.904553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.904554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.904554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.904555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.904555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.904556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.904557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.904557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.904558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.904558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.904561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.904568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.904570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.904572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.904574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.904576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.904578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.904580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.904583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.904586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.904588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.904590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.904594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.904598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:06.904601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.904604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:06.904606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.904609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:06.904611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.904614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:06.904617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.904620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:06.904623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.904628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:06.904630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.904634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:06.904636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.904638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:06.904641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.904643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:06.904645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.904648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.904651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.904654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.904656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.904659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.904676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:06.906183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.906282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:06.906297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3482
2025-10-02T09:37:06.906393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:06.906413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:06.906422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:06.906425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:06.906776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3482 sessionId:  describe result for acl check
2025-10-02T09:37:06.906816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:06.906821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:06.906823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:06.906827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:06.907276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:06.908666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:06.911876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:06.911887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:06.911890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556124419393429:9793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:06.911895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:06.912377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:06.913899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:06.913913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:06.913914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:06.913916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:06.913920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3481 [2:7556556124343806236:5143]
2025-10-02T09:37:06.913927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:06.913937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:06.913938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.913940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.913941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.913950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:06.913954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:06.913958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:06.913990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.913995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.913996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.913998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:06.913999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:06.914044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:06.914051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.914060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:06.914074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:06.914090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:06.914109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393389:2446], now have 1 active actors on pipe
2025-10-02T09:37:06.914114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393463:9793], now have 1 active actors on pipe
2025-10-02T09:37:06.914118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.914119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.914122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.914134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:06.914120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3481
2025-10-02T09:37:06.914125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3481
2025-10-02T09:37:06.914147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:06.914147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:06.914149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:06.914150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:06.914162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:06.914164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:06.914187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.914195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.914205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.914213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:06.914228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:06.914234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33551933-234b00d8-afff623e-dc026063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:06.914239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:06.914241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:06.914247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:06.914255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:06.914267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:06.914286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.914385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:06.914392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:06.914402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:06.914473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3482 partition: 0 MaxSeqNo: 36 sessionId: src_id|33551933-234b00d8-afff623e-dc026063_0
2025-10-02T09:37:06.914710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f3c576-1cf49b8-37ebe3cd-88ff74f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33551933-234b00d8-afff623e-dc026063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:06.917444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Write session: try to update token
2025-10-02T09:37:06.917458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:06.923335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:06.923347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:06.923349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:06.923350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:06.923353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.923355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.923360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556124343806231:5143]
2025-10-02T09:37:06.923384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:06.923392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:06.923394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:06.923397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:06.923401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:06.923403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:06.923507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:06.929915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3482 sessionId: src_id|33551933-234b00d8-afff623e-dc026063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:06.932117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:06.996774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556124419393476:4174]
2025-10-02T09:37:06.997039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3481, pipe: [1:7556556124419393476:4174]
2025-10-02T09:37:07.037134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.037439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.037450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.037463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556124419393476:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.037644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.037686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556124419393476:4174]
2025-10-02T09:37:07.037696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.037685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.037695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.037777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3482 reason: error at write: Disconnected sessionId: src_id|33551933-234b00d8-afff623e-dc026063_0
2025-10-02T09:37:07.037941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3482 sessionId: src_id|33551933-234b00d8-afff623e-dc026063_0 is DEAD
2025-10-02T09:37:07.038061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 123 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:37:07.038091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.038095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Write session will restart in 0.006368s
2025-10-02T09:37:07.038115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Write session: Do CDS request
2025-10-02T09:37:07.038121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.043608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.044619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.044723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.044730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.044735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.044761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.044788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638773606:5149]
2025-10-02T09:37:07.045174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.045285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.045298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3483
2025-10-02T09:37:07.045407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.045415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.045428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.045435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.045440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.045624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.045650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.045763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3483 sessionId:  describe result for acl check
2025-10-02T09:37:07.045800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.045805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.045807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.045811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.045836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.045865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.045869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.045870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.045871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.045871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.045872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.045872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.045873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.045873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.045874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.045874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.045875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.045878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.045885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.045887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.045898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.045901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.045904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.045905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.045907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.045909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.045911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.045913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.045915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.045920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.045925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.045929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.045932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.045934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.045937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.045939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.045942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.045945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.045947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.045951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.045954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.045956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.045959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.045961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.045963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.045966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.045969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.045971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.045973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.045975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.045978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.045980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.045982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.045999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.046236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.047912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.052302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.052315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.052318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714360816:9773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.052323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.053474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.054952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.054963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.054965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.054967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.054970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3482 [2:7556556128638773606:5149]
2025-10-02T09:37:07.054981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.054994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.055001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.055003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.055004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.055013Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.055020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.055025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.055056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.055061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.055063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.055065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.055066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.055121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.055127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.055137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.055150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.055167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.055185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360777:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.055190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360853:9773], now have 1 active actors on pipe
2025-10-02T09:37:07.055195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.055201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.055202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.055214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.055197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3482
2025-10-02T09:37:07.055216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3482
2025-10-02T09:37:07.055226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.055226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.055233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.055234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.055240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.055242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.055269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.055276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.055286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.055294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.055304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.055314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.055318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.055321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.055326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.055333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.055344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.055365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.055459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.055466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.055477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.055542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3483 partition: 0 MaxSeqNo: 36 sessionId: src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0
2025-10-02T09:37:07.055787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33551933-234b00d8-afff623e-dc026063_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.058211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Write session: try to update token
2025-10-02T09:37:07.058227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.064373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.064385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.064386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.064387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.064390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.064393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.064395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638773601:5149]
2025-10-02T09:37:07.064417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.064426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.064427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.064430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.064433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.064437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.064541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.070316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3483 sessionId: src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.072388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.138081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714360860:4174]
2025-10-02T09:37:07.138291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3482, pipe: [1:7556556128714360860:4174]
2025-10-02T09:37:07.173302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.173522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.173530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.173542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360860:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.173706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.173743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.173745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.173767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.173787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3483 reason: error at write: Disconnected sessionId: src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0
2025-10-02T09:37:07.173807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714360860:4174]
2025-10-02T09:37:07.173923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3483 sessionId: src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0 is DEAD
2025-10-02T09:37:07.174080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.174092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Write session will restart in 0.005533s
2025-10-02T09:37:07.174114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Write session: Do CDS request
2025-10-02T09:37:07.174119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.179606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.180118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.180206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.180218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3484
2025-10-02T09:37:07.180303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.180326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.180333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.180336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.180703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.180722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3484 sessionId:  describe result for acl check
2025-10-02T09:37:07.180759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.180764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.180765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.180769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.180830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.180837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.180843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.180879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.180918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638773684:5160]
2025-10-02T09:37:07.181207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.181273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.181499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.181527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.181708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.181748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.181753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.181754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.181755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.181756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.181757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.181759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.181760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.181761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.181762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.181763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.181764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.181768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.181775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.181777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.181780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.181782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.181784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.181786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.181788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.181790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.181792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.181794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.181796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.181801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.181805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.181809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.181812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.181814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.181821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.181823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.181826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.181830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.181836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.181838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.181840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.181844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.181848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.181850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.181856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.181861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.181864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.181866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.181870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.181872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.181875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.181880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.181882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.181899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.182692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.187682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.187693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.187695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714360900:9760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.187700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.189281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.190725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.190736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.190738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.190740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.190744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3483 [2:7556556128638773684:5160]
2025-10-02T09:37:07.190756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.190769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.190771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.190774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.190776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.190784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.190790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.190794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.190826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.190831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.190832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.190834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.190835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.190880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.190887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.190896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.190906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.190923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.190942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360939:9760], now have 1 active actors on pipe
2025-10-02T09:37:07.190947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360861:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.190952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.190953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.190955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.190963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.190976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.190976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.190983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.190967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3483
2025-10-02T09:37:07.190986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3483
2025-10-02T09:37:07.190984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.190989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.190992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.191008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.191011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.191012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.191025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.191031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.191067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.191075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.191079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.191084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.191090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.191109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.191159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.191255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.191262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.191272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.191339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3484 partition: 0 MaxSeqNo: 36 sessionId: src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0
2025-10-02T09:37:07.191553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd48c97-b655ff47-7bd62d48-c74a4088_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.194005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Write session: try to update token
2025-10-02T09:37:07.194019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.200065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.200077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.200079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.200081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.200087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.200089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.200090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638773679:5160]
2025-10-02T09:37:07.200112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.200120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.200122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.200126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.200130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.200133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.200252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.206322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3484 sessionId: src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.208397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.273761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714360955:4174]
2025-10-02T09:37:07.273958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3483, pipe: [1:7556556128714360955:4174]
2025-10-02T09:37:07.309902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.310173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.310182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.310194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360955:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.310357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.310366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.310391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.310408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3484 reason: error at write: Disconnected sessionId: src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0
2025-10-02T09:37:07.310442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714360955:4174]
2025-10-02T09:37:07.310492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.310545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3484 sessionId: src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0 is DEAD
2025-10-02T09:37:07.310708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.310723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Write session will restart in 0.006238s
2025-10-02T09:37:07.310750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Write session: Do CDS request
2025-10-02T09:37:07.310756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.316737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.317829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.317937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.317944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.317949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.317975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.318000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638773773:5162]
2025-10-02T09:37:07.318144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.318227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.318239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3485
2025-10-02T09:37:07.318325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.318343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.318349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.318352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.318348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.318554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.318580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.318688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3485 sessionId:  describe result for acl check
2025-10-02T09:37:07.318728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.318735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.318736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.318741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.318760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.318791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.318795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.318797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.318797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.318798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.318798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.318799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.318800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.318800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.318801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.318805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.318812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.318814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.318816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.318818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.318820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.318822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.318824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.318827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.318829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.318831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.318833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.318837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.318841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.318844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.318851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.318853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.318856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.318858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.318861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.318863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.318868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.318873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.318876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.318878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.318884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.318886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.318889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.318891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.318896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.318899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.318903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.318908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.318911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.318916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.318919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.318936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.319179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.320752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.325411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.325423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.325426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714360997:9754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.325433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.326569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.328060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.328072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.328073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.328076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.328079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3484 [2:7556556128638773773:5162]
2025-10-02T09:37:07.328087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.328102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.328107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.328109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.328110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.328119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.328125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.328130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.328165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.328170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.328171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.328173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.328174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.328220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.328227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.328237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.328250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.328268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.328287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361034:9754], now have 1 active actors on pipe
2025-10-02T09:37:07.328294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714360956:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.328298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.328303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.328305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.328314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.328310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3484
2025-10-02T09:37:07.328327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3484
2025-10-02T09:37:07.328326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.328328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.328334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.328335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.328340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.328342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.328371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.328379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.328388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.328398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.328408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.328423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.328434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.328440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.328441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.328450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.328460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.328479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.328567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.328574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.328585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.328654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3485 partition: 0 MaxSeqNo: 36 sessionId: src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0
2025-10-02T09:37:07.328917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b614bb-196e984a-35fc3ad7-ec73128e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.331338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Write session: try to update token
2025-10-02T09:37:07.331353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.337447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.337459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.337460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.337461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.337466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.337468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.337470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638773768:5162]
2025-10-02T09:37:07.337494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.337502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.337504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.337508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.337512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.337514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.337617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.343234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3485 sessionId: src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.345318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.410466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714361056:4174]
2025-10-02T09:37:07.410645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3484, pipe: [1:7556556128714361056:4174]
2025-10-02T09:37:07.447334Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.447600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.447610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.447622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361056:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.447809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714361056:4174]
2025-10-02T09:37:07.447839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.447846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.447897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.447917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.448001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3485 reason: error at write: Disconnected sessionId: src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0
2025-10-02T09:37:07.448179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3485 sessionId: src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0 is DEAD
2025-10-02T09:37:07.448327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.448340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Write session will restart in 0.005425s
2025-10-02T09:37:07.448361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Write session: Do CDS request
2025-10-02T09:37:07.448368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.453996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.455051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.455172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.455197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.455205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.455212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.455244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.455269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638773852:5174]
2025-10-02T09:37:07.455260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.455270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3486
2025-10-02T09:37:07.455368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.455388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.455394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.455398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.455625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.455760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3486 sessionId:  describe result for acl check
2025-10-02T09:37:07.455797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.455804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.455805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.455809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.455826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.455853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.456036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.456066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.456070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.456071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.456072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.456072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.456073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.456073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.456074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.456075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.456075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.456076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.456076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.456079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.456086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.456088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.456092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.456094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.456096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.456098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.456100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.456101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.456104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.456106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.456108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.456112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.456115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.456119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.456122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.456124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.456127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.456131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.456134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.456139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.456142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.456144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.456147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.456152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.456154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.456156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.456159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.456162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.456164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.456167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.456169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.456174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.456177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.456179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.456183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.456205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.456250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.458026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.462421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.462433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.462436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714361099:9730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.462441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.463593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.465078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.465091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.465092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.465094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.465098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3485 [2:7556556128638773852:5174]
2025-10-02T09:37:07.465105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.465115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.465121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.465122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.465123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.465133Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.465135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.465139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.465172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.465176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.465178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.465179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.465181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.465229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.465235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.465244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.465257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.465275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.465291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361136:9730], now have 1 active actors on pipe
2025-10-02T09:37:07.465297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361057:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.465301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.465306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.465307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.465317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.465310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3485
2025-10-02T09:37:07.465326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3485
2025-10-02T09:37:07.465325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.465332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.465333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.465335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.465344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.465350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.465378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.465383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.465392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.465400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.465413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.465425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8767bdee-25b95024-292aa0af-be7da931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.465433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.465443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.465448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.465455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.465466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.465486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.465578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.465585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.465596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.465661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3486 partition: 0 MaxSeqNo: 36 sessionId: src_id|8767bdee-25b95024-292aa0af-be7da931_0
2025-10-02T09:37:07.465935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67a240a-6ecd01ed-8ae3eeeb-c4c0c538_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8767bdee-25b95024-292aa0af-be7da931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.468326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Write session: try to update token
2025-10-02T09:37:07.468339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.474472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.474485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.474486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.474487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.474493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.474496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.474498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638773847:5174]
2025-10-02T09:37:07.474521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.474530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.474532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.474534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.474537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.474540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.474651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.480768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3486 sessionId: src_id|8767bdee-25b95024-292aa0af-be7da931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.482952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.548200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714361144:4174]
2025-10-02T09:37:07.548422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3485, pipe: [1:7556556128714361144:4174]
2025-10-02T09:37:07.585262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.585527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.585536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.585549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361144:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.585744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714361144:4174]
2025-10-02T09:37:07.585774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.585776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.585797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.585804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.585820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3486 reason: error at write: Disconnected sessionId: src_id|8767bdee-25b95024-292aa0af-be7da931_0
2025-10-02T09:37:07.585958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3486 sessionId: src_id|8767bdee-25b95024-292aa0af-be7da931_0 is DEAD
2025-10-02T09:37:07.586080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.586086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Write session will restart in 0.009070s
2025-10-02T09:37:07.586100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Write session: Do CDS request
2025-10-02T09:37:07.586104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.591946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.593005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.593115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.593121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.593127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.593154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.593182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638773931:5176]
2025-10-02T09:37:07.593525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.593723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.593748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.593934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.593966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.593970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.593971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.593971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.593972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.593972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.593973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.593973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.593974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.593974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.593975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.593976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.593978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.593986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.593988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.593990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.593992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.593994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.593996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.593998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.594000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.594003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.594005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.594007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.594011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.594015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.594018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.594021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.594024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.594027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.594029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.594032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.594034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.594038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.594040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.594042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.594045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.594047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.594051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.594054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.594058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.594061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.594062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.594065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.594070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.594073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.594075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.594077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.594094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.596223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.596322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.596333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3487
2025-10-02T09:37:07.596438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.596457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.596463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.596466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.596798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3487 sessionId:  describe result for acl check
2025-10-02T09:37:07.596848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.596855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.596856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.596861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.597286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.598813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.600948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.600963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.600967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714361190:9722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.600974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.601452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.602903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.602914Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.602915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.602918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.602924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3486 [2:7556556128638773931:5176]
2025-10-02T09:37:07.602932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.602943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.602949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.602950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.602952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.602961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.602966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.602971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.603001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.603007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.603008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.603010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.603011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.603061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.603068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.603077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.603088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.603114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.603132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361225:9722], now have 1 active actors on pipe
2025-10-02T09:37:07.603138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361145:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.603142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.603144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.603146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.603146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3486
2025-10-02T09:37:07.603158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.603159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3486
2025-10-02T09:37:07.603162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.603164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.603166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.603174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.603187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.603192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.603220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.603225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.603232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.603240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.603251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.603263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7974664-3626cebe-b536183d-a074e49a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.603270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.603274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.603276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.603282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.603294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.603350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.603458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.603465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.603475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.603534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3487 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7974664-3626cebe-b536183d-a074e49a_0
2025-10-02T09:37:07.603790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8767bdee-25b95024-292aa0af-be7da931_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7974664-3626cebe-b536183d-a074e49a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.606616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Write session: try to update token
2025-10-02T09:37:07.606627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.612427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.612442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.612444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.612445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.612449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.612452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.612455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638773926:5176]
2025-10-02T09:37:07.612481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.612492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.612494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.612495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.612498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.612501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.612601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.618902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3487 sessionId: src_id|b7974664-3626cebe-b536183d-a074e49a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.621118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.685908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714361233:4174]
2025-10-02T09:37:07.686123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3486, pipe: [1:7556556128714361233:4174]
2025-10-02T09:37:07.723094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.723368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.723380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.723396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361233:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.723522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714361233:4174]
2025-10-02T09:37:07.723549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.723551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.723558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.723581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.723596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3487 reason: error at write: Disconnected sessionId: src_id|b7974664-3626cebe-b536183d-a074e49a_0
2025-10-02T09:37:07.723746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3487 sessionId: src_id|b7974664-3626cebe-b536183d-a074e49a_0 is DEAD
2025-10-02T09:37:07.723869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.723878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Write session will restart in 0.008521s
2025-10-02T09:37:07.723896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Write session: Do CDS request
2025-10-02T09:37:07.723900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.729640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.730671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.730833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.730840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.730847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.730879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.730907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638774011:5201]
2025-10-02T09:37:07.731263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.731469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.731497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.731684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.731715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.731719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.731720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.731721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.731721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.731722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.731722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.731723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.731724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.731724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.731725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.731726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.731728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.731736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.731738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.731741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.731743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.731745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.731747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.731749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.731751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.731753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.731755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.731757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.731762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.731766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.731771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.731773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.731775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.731778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.731782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.731784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.731788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.731794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.731796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.731799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.731801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.731803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.731805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.731808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.731810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.731815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.731817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.731820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.731822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.731825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.731827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.731829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.731848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.733235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.733327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.733340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3488
2025-10-02T09:37:07.733448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.733468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.733474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.733476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.733835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3488 sessionId:  describe result for acl check
2025-10-02T09:37:07.733874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.733881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.733883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.733887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.734330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.736081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.738896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.738910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.738912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714361280:9714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.738918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.739421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.740863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.740874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.740875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.740879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.740883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3487 [2:7556556128638774011:5201]
2025-10-02T09:37:07.740890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.740902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.740908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.740911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.740912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.740921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.740925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.740930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.740963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.740968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.740969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.740971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.740972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.741047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.741055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.741064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.741080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.741098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.741118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361315:9714], now have 1 active actors on pipe
2025-10-02T09:37:07.741125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361234:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.741105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3487
2025-10-02T09:37:07.741127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3487
2025-10-02T09:37:07.741131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.741134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.741136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.741143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.741151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.741156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.741158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.741160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.741168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.741175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.741188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.741195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.741219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.741229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.741240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.741244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.741249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.741251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.741253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.741260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.741271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.741299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.741390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.741396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.741407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.741461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3488 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0
2025-10-02T09:37:07.741709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7974664-3626cebe-b536183d-a074e49a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.744515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Write session: try to update token
2025-10-02T09:37:07.744525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.750657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.750671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.750672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.750674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.750678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.750680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.750682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638774006:5201]
2025-10-02T09:37:07.750709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.750718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.750720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.750722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.750725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.750728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.750841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.756468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3488 sessionId: src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.758743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.823642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714361322:4174]
2025-10-02T09:37:07.823805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3487, pipe: [1:7556556128714361322:4174]
2025-10-02T09:37:07.860919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.861179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.861187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.861200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361322:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.861391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.861385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714361322:4174]
2025-10-02T09:37:07.861424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.861427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.861437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.861510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3488 reason: error at write: Disconnected sessionId: src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0
2025-10-02T09:37:07.861680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3488 sessionId: src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0 is DEAD
2025-10-02T09:37:07.861830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.861842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Write session will restart in 0.008617s
2025-10-02T09:37:07.861867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Write session: Do CDS request
2025-10-02T09:37:07.861873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:07.867287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:07.868376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:07.868499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:07.868506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:07.868512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:07.868544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:07.868604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556128638774121:5206]
2025-10-02T09:37:07.868963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:07.869163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:07.869191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:07.869375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:07.869403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.869407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.869410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.869411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.869411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.869412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.869412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.869413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.869413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.869414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.869415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.869415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.869418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.869424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.869426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.869428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.869430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.869432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.869434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.869436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.869437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.869440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.869441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.869443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.869448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.869452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:07.869455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.869459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:07.869461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.869464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:07.869466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.869468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:07.869472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.869475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:07.869477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.869479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:07.869482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.869488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:07.869490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.869492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:07.869495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.869499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:07.869502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.869507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.869509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.869512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.869516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.869518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.869535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:07.871171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.871267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:07.871283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3489
2025-10-02T09:37:07.871375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:07.871396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:07.871403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:07.871406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:07.871684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3489 sessionId:  describe result for acl check
2025-10-02T09:37:07.871706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:07.871711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:07.871712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:07.871716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:07.872110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:07.873715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:07.876412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:07.876423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:07.876425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556128714361384:9688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:07.876430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:07.876945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:07.878389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:07.878402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:07.878404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:07.878406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:07.878409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3488 [2:7556556128638774121:5206]
2025-10-02T09:37:07.878417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:07.878427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:07.878432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.878433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.878434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.878444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:07.878451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:07.878454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:07.878488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.878493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.878494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.878496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:07.878498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:07.878547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:07.878554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.878564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:07.878577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:07.878594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:07.878613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361326:2446], now have 1 active actors on pipe
2025-10-02T09:37:07.878620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361417:9688], now have 1 active actors on pipe
2025-10-02T09:37:07.878625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.878631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.878633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.878644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:07.878643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3488
2025-10-02T09:37:07.878654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:07.878656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:07.878659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:07.878660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:07.878669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:07.878673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:07.878666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3488
2025-10-02T09:37:07.878694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.878700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:07.878701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:07.878713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.878720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.878753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84deb1ea-d397b426-90ce9752-df09bb52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:07.878762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:07.878766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:07.878768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:07.878776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:07.878787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:07.878801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.878908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.878915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.878925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:07.878990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3489 partition: 0 MaxSeqNo: 36 sessionId: src_id|84deb1ea-d397b426-90ce9752-df09bb52_0
2025-10-02T09:37:07.879222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8eafd6-15599dac-6bda71f0-a41a90dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84deb1ea-d397b426-90ce9752-df09bb52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:07.881817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Write session: try to update token
2025-10-02T09:37:07.881831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:07.888018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:07.888033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:07.888034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:07.888035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:07.888039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.888041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.888043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556128638774116:5206]
2025-10-02T09:37:07.888064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:07.888067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:07.888068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:07.888076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:07.888085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:07.888088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:07.888179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:07.894266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3489 sessionId: src_id|84deb1ea-d397b426-90ce9752-df09bb52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:07.896421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:07.961362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556128714361441:4174]
2025-10-02T09:37:07.961503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3488, pipe: [1:7556556128714361441:4174]
2025-10-02T09:37:07.996009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:07.996331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:07.996341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:07.996352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361441:4174], now have 1 active actors on pipe
2025-10-02T09:37:07.996519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:07.996507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:07.996543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:07.996545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:07.996560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556128714361441:4174]
2025-10-02T09:37:07.996585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3489 reason: error at write: Disconnected sessionId: src_id|84deb1ea-d397b426-90ce9752-df09bb52_0
2025-10-02T09:37:07.996717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3489 sessionId: src_id|84deb1ea-d397b426-90ce9752-df09bb52_0 is DEAD
2025-10-02T09:37:07.996839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:07.996852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Write session will restart in 0.009913s
2025-10-02T09:37:07.996868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Write session: Do CDS request
2025-10-02T09:37:07.996872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.001693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.002751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.002875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.002883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.002891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.002929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.002960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741505:5216]
2025-10-02T09:37:08.003319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.003489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.003521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.003746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.003790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.003795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.003796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.003797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.003798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.003799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.003800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.003801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.003802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.003803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.003804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.003805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.003810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.003820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.003823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.003827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.003830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.003833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.003836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.003839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.003842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.003847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.003850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.003854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.003860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.003866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.003871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.003876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.003880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.003885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.003889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.003894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.003899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.003907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.003914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.003919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.003923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.003927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.003932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.003936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.003941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.003946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.003950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.003957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.003961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.003966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.003970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.003977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.004006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.008217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.008324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.008339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3490
2025-10-02T09:37:08.008461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.008484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.008491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.008495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.008851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3490 sessionId:  describe result for acl check
2025-10-02T09:37:08.008893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.008899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.008901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.008905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.009428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.011001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.011753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.012996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.013008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.013010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009328787:9677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.013016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.013251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.013264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.013267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.013269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.013273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3489 [2:7556556132933741505:5216]
2025-10-02T09:37:08.013286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.013298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.013301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.013303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.013305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.013316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.013324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.013331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.013368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.013374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.013375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.013378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.013380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.013426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.013432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.013442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.013453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.013472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.013489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328822:9677], now have 1 active actors on pipe
2025-10-02T09:37:08.013496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556128714361442:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.013500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.013502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.013503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.013509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.013482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3489
2025-10-02T09:37:08.013502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3489
2025-10-02T09:37:08.013515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.013519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.013523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.013524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.013531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.013534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.013547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.013552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.013577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.013586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.013594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.013598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.013603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.013605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.013607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.013613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.013620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.013649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.013732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.013737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.013746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.013802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3490 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0
2025-10-02T09:37:08.014048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb1ea-d397b426-90ce9752-df09bb52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.016453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Write session: try to update token
2025-10-02T09:37:08.016468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.022732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.022745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.022746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.022748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.022755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.022758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.022760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741500:5216]
2025-10-02T09:37:08.022782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.022784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.022785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.022786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.022788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.022790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.022903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.028812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3490 sessionId: src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.031039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.048984Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 34 CurrentSessionLifetimeMs: 541574 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:37:08.096543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009328832:4174]
2025-10-02T09:37:08.096708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3489, pipe: [1:7556556133009328832:4174]
2025-10-02T09:37:08.134208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.134529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.134544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.134557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328832:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.134713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.134722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:08.134737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:08.134774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.134787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3490 reason: error at write: Disconnected sessionId: src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0
2025-10-02T09:37:08.134840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009328832:4174]
2025-10-02T09:37:08.134922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3490 sessionId: src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0 is DEAD
2025-10-02T09:37:08.135033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:08.135043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Write session will restart in 0.009785s
2025-10-02T09:37:08.135061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Write session: Do CDS request
2025-10-02T09:37:08.135065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.140420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.141541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.141653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.141662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.141670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.141707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.141740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741588:5226]
2025-10-02T09:37:08.142096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.142264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.142295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.142510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.142554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.142559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.142560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.142561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.142562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.142563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.142564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.142565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.142566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.142568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.142573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.142584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.142588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.142591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.142595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.142598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.142603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.142606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.142609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.142613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.142616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.142620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.142626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.142632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.142638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.142642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.142648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.142653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.142661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.142667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.142674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.142679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.142686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.142691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.142699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.142704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.142708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.142716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.142720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.142728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.142733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.142741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.142745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.142750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.142757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.142761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.142797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.146235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.146275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.146289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3491
2025-10-02T09:37:08.146424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.146445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.146452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.146455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.146808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3491 sessionId:  describe result for acl check
2025-10-02T09:37:08.146848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.146853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.146855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.146858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.147300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.148758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.150178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.150685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.150696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.150700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009328883:9673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.150706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.151777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.151790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.151792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.151795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.151799Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3490 [2:7556556132933741588:5226]
2025-10-02T09:37:08.151809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.151824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.151826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.151829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.151832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.151843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.151852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.151858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.151902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.151908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.151909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.151911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.151913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.151967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.151974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.151984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.151995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.152014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.152032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328917:9673], now have 1 active actors on pipe
2025-10-02T09:37:08.152038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328833:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.152043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.152021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3490
2025-10-02T09:37:08.152046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.152036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3490
2025-10-02T09:37:08.152048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.152054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.152059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.152061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.152062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.152063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.152075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.152081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.152094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.152100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.152127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.152136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.152142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.152150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.152155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.152158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.152160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.152166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.152177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.152204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.152305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.152311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.152320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.152364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3491 partition: 0 MaxSeqNo: 36 sessionId: src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0
2025-10-02T09:37:08.152625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7243ba-6fd0f626-46d1f3a7-42c7e074_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.155018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Write session: try to update token
2025-10-02T09:37:08.155034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.161317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.161330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.161332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.161335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.161340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.161343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.161346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741582:5226]
2025-10-02T09:37:08.161370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.161371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.161374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.161375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.161376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.161377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.161491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.167442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3491 sessionId: src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.169789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.234766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009328925:4174]
2025-10-02T09:37:08.234944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3490, pipe: [1:7556556133009328925:4174]
2025-10-02T09:37:08.270190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.270486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.270495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.270511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328925:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.270631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009328925:4174]
2025-10-02T09:37:08.270651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:08.270653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:08.270668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.270689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3491 reason: error at write: Disconnected sessionId: src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0
2025-10-02T09:37:08.270722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.270839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3491 sessionId: src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0 is DEAD
2025-10-02T09:37:08.270986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:08.270997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Write session will restart in 0.008830s
2025-10-02T09:37:08.271018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Write session: Do CDS request
2025-10-02T09:37:08.271023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.276396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.277590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.277707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.277715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.277723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.277764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.277797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741673:5228]
2025-10-02T09:37:08.278147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.278314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.278348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.278548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.278590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.278595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.278596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.278597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.278598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.278599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.278600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.278601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.278602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.278603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.278604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.278605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.278609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.278620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.278624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.278627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.278631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.278635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.278638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.278642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.278646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.278650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.278654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.278658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.278663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.278670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.278679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.278684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.278691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.278697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.278705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.278710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.278717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.278722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.278728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.278733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.278740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.278745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.278753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.278758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.278765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.278770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.278777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.278782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.278789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.278795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.278801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.278807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.278842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.281170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.281249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.281262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3492
2025-10-02T09:37:08.281380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.281399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.281402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.281408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.281701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3492 sessionId:  describe result for acl check
2025-10-02T09:37:08.281719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.281722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.281723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.281726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.282076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.283390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.285718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.285728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.285730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009328976:9655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.285736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.286195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.287599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.287612Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.287614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.287617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.287622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3491 [2:7556556132933741673:5228]
2025-10-02T09:37:08.287631Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.287644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.287647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.287649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.287650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.287665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.287673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.287679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.287717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.287722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.287724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.287726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.287728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.287798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.287804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.287814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.287825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.287824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3491
2025-10-02T09:37:08.287846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.287863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329011:9655], now have 1 active actors on pipe
2025-10-02T09:37:08.287870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009328926:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.287861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3491
2025-10-02T09:37:08.287881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.287887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.287900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.287905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.287907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.287919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.287929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.287933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.287937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.287938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.287944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.287947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.287962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3487a6-22412b32-fabbee1e-899c456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.287970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.287974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.287977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.287985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.287994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.288016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.288025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.288032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.288037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.288119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.288124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.288134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.288176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3492 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d3487a6-22412b32-fabbee1e-899c456_0
2025-10-02T09:37:08.288429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68ae7024-bd5bae8-79e8d0d6-810125b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d3487a6-22412b32-fabbee1e-899c456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.290812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Write session: try to update token
2025-10-02T09:37:08.290827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.296877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:08.296889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.296893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.296916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:08.296918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:08.297055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:08.297182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:08.297295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:08.297435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:08.297654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:08.297684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:08.303088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3492 sessionId: src_id|1d3487a6-22412b32-fabbee1e-899c456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.305185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.305196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.305199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.305200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.305205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.305208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.305211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741668:5228]
2025-10-02T09:37:08.305232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.305235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.305235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.305237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.305241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.305242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.305351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.305383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.371008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009329021:4174]
2025-10-02T09:37:08.371261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3491, pipe: [1:7556556133009329021:4174]
2025-10-02T09:37:08.414722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.414974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.414984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.415000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329021:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.415151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.415165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:08.415180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:08.415225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3492 reason: error at write: Disconnected sessionId: src_id|1d3487a6-22412b32-fabbee1e-899c456_0
2025-10-02T09:37:08.415253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009329021:4174]
2025-10-02T09:37:08.415290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.415366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3492 sessionId: src_id|1d3487a6-22412b32-fabbee1e-899c456_0 is DEAD
2025-10-02T09:37:08.415523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:08.415535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Write session will restart in 0.007906s
2025-10-02T09:37:08.415554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Write session: Do CDS request
2025-10-02T09:37:08.415560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.420931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.422011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.422150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.422159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.422167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.422206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.422238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741772:5229]
2025-10-02T09:37:08.422599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.422763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.422796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.422989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.423030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.423035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.423039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.423040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.423041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.423042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.423043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.423044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.423045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.423046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.423047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.423047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.423052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.423063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.423067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.423070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.423074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.423078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.423082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.423085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.423088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.423092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.423095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.423097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.423112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.423118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.423123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.423128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.423132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.423137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.423141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.423151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.423155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.423165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.423168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.423176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.423182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.423189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.423193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.423199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.423203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.423208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.423216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.423221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.423228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.423233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.423240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.423245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.423278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.424142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.424263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.424274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3493
2025-10-02T09:37:08.424387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.424407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.424410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.424412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.424683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3493 sessionId:  describe result for acl check
2025-10-02T09:37:08.424702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.424703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.424704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.424707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.425051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.426732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.430475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.430490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.430492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009329085:9628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.430496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.430940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.432514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.432527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.432529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.432532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.432536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3492 [2:7556556132933741772:5229]
2025-10-02T09:37:08.432545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.432559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.432561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.432563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.432565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.432577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.432581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.432586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.432620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.432627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.432629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.432631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.432634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.432678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.432683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.432693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.432704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.432721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.432739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329034:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.432745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329119:9628], now have 1 active actors on pipe
2025-10-02T09:37:08.432750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.432752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.432754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.432734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3492
2025-10-02T09:37:08.432760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.432765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.432767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.432767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.432770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.432782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.432771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3492
2025-10-02T09:37:08.432784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.432827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.432834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.432844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.432854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.432861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.432875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.432885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.432888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.432889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.432896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.432905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.432923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.433010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.433015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.433024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.433076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3493 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0
2025-10-02T09:37:08.433341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3487a6-22412b32-fabbee1e-899c456_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.435717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Write session: try to update token
2025-10-02T09:37:08.435732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.441886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.441899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.441901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.441902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.441907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.441910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.441913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741767:5229]
2025-10-02T09:37:08.441932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.441935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.441937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.441937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.441941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.441943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.442057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.447910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3493 sessionId: src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.450196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.515354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009329128:4174]
2025-10-02T09:37:08.515529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3492, pipe: [1:7556556133009329128:4174]
2025-10-02T09:37:08.553129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.553393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.553402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.553418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329128:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.553544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.553536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.553571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:08.553573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:08.553617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3493 reason: error at write: Disconnected sessionId: src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0
2025-10-02T09:37:08.553627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009329128:4174]
2025-10-02T09:37:08.553746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3493 sessionId: src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0 is DEAD
2025-10-02T09:37:08.553898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:08.553910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Write session will restart in 0.009701s
2025-10-02T09:37:08.553934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Write session: Do CDS request
2025-10-02T09:37:08.553940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.559118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.560249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.560373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.560383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.560391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.560422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.560451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741858:5221]
2025-10-02T09:37:08.560793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.560998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.561215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.561273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.561277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.561277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.561278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.561278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.561280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.561280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.561281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.561281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.561282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.561282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.561283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.561285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.561293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.561295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.561297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.561299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.561301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.561303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.561305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.561307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.561310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.561312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.561313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.561317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.561321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.561325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.561328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.561330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.561336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.561338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.561341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.561343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.561346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.561347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.561350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.561353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.561355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.561357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.561360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.561362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.561365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.561367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.561369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.561372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.561375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.561377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.561380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.561405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.564238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.564309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.564319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3494
2025-10-02T09:37:08.564435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.564455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.564463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.564466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.564839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3494 sessionId:  describe result for acl check
2025-10-02T09:37:08.564880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.564886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.564887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.564891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.565321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.567028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.568760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.569034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.569044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.569047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009329181:9629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.569052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.570205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.570216Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.570217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.570219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.570222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3493 [2:7556556132933741858:5221]
2025-10-02T09:37:08.570230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.570239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.570245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.570247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.570249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.570257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.570260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.570264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.570292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.570298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.570299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.570300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.570302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.570350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.570356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.570366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.570378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.570396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.570413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329216:9629], now have 1 active actors on pipe
2025-10-02T09:37:08.570418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329129:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.570422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.570423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.570424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.570435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.570431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3493
2025-10-02T09:37:08.570447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.570447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3493
2025-10-02T09:37:08.570448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.570455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.570457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.570460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.570462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.570486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.570493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.570504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.570514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.570523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.570539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22b63259-7199be4-f06f523-58ec19bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.570547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.570550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.570552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.570558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.570568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.570586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.570675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.570683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.570696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.570759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3494 partition: 0 MaxSeqNo: 36 sessionId: src_id|22b63259-7199be4-f06f523-58ec19bf_0
2025-10-02T09:37:08.570986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a42b71a-460356b6-359a7f3b-d72331d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22b63259-7199be4-f06f523-58ec19bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.573320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Write session: try to update token
2025-10-02T09:37:08.573332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.579710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.579725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.579726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.579727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.579732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.579734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.579737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741853:5221]
2025-10-02T09:37:08.579761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.579770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.579772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.579781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.579793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.579796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.579891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.585755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3494 sessionId: src_id|22b63259-7199be4-f06f523-58ec19bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.588119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.653603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009329223:4174]
2025-10-02T09:37:08.653836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3493, pipe: [1:7556556133009329223:4174]
2025-10-02T09:37:08.693465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.693710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.693720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.693733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329223:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.693928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.693932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009329223:4174]
2025-10-02T09:37:08.693956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.693991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:08.694086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22b63259-7199be4-f06f523-58ec19bf_0
2025-10-02T09:37:08.694247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3494 sessionId: src_id|22b63259-7199be4-f06f523-58ec19bf_0 is DEAD
2025-10-02T09:37:08.694385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:08.694396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Write session will restart in 0.006391s
2025-10-02T09:37:08.694415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Write session: Do CDS request
2025-10-02T09:37:08.694421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.700746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.701971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.702077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.702085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.702092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.702127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.702151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.702159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933741944:5232]
2025-10-02T09:37:08.702254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.702266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3495
2025-10-02T09:37:08.702374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.702395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.702403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.702406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.702519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.702687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3495 sessionId:  describe result for acl check
2025-10-02T09:37:08.702709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.702710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.702700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.702711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.702735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.702714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.702919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.702950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.702954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.702955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.702955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.702958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.702959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.702960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.702960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.702961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.702962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.702963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.702963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.702966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.702973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.702975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.702977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.702979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.702981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.702983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.702985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.702987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.702990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.702992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.702993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.702997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.703001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.703004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.703007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.703010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.703013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.703015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.703017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.703020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.703022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.703025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.703028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.703031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.703034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.703036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.703038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.703042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.703045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.703047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.703051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.703053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.703056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.703058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.703060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.703077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.703069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.704866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.709452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.709462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.709465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009329276:9610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.709470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.710635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.712154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.712166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.712167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.712170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.712173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3494 [2:7556556132933741944:5232]
2025-10-02T09:37:08.712180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.712190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.712192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.712195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.712196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.712207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.712214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.712217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.712251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.712256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.712257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.712259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.712260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.712296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.712301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.712307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.712312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.712322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.712336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329225:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.712342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329313:9610], now have 1 active actors on pipe
2025-10-02T09:37:08.712346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.712347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.712348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.712356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.712366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.712368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.712370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.712371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.712375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.712377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.712390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.712396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.712397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.712385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3494
2025-10-02T09:37:08.712405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3494
2025-10-02T09:37:08.712419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.712424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.712443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.712454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.712458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.712460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.712467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.712475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.712486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.712592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.712603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.712619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.712687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3495 partition: 0 MaxSeqNo: 36 sessionId: src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0
2025-10-02T09:37:08.712936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b63259-7199be4-f06f523-58ec19bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.715268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Write session: try to update token
2025-10-02T09:37:08.715284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.721945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.721959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.721961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.721962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.721965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.721968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.721970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933741939:5232]
2025-10-02T09:37:08.721991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.721994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.721993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.721995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.721996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.721999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.722101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.727208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3495 sessionId: src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.729550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.793887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009329320:4174]
2025-10-02T09:37:08.794139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3494, pipe: [1:7556556133009329320:4174]
2025-10-02T09:37:08.832769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.833060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.833069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.833097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329320:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.833240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.833282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:08.833290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:08.833331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3495 reason: error at write: Disconnected sessionId: src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0
2025-10-02T09:37:08.833336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009329320:4174]
2025-10-02T09:37:08.833356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.833455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3495 sessionId: src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0 is DEAD
2025-10-02T09:37:08.833583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:08.833591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Write session will restart in 0.008550s
2025-10-02T09:37:08.833612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Write session: Do CDS request
2025-10-02T09:37:08.833619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.839828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.841145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.841303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.841311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.841317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.841348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.841374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933742038:5233]
2025-10-02T09:37:08.841714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.841885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.841907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.842084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.842113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.842117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.842118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.842118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.842119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.842119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.842120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.842121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.842121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.842122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.842122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.842123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.842126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.842131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.842133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.842136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.842138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.842140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.842142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.842144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.842146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.842148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.842150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.842152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.842158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.842162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.842165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.842169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.842172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.842175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.842178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.842181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.842184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.842187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.842189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.842192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.842194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.842198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.842200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.842203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.842205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.842208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.842210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.842213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.842215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.842217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.842219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.842222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.842239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.843135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.843246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.843258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3496
2025-10-02T09:37:08.843362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.843382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.843387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.843390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.843631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3496 sessionId:  describe result for acl check
2025-10-02T09:37:08.843650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.843653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.843655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.843658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.843949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.845557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.849183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.849200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.849259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009329375:9603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.849268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.849674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.851158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.851169Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.851171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.851173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.851176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3495 [2:7556556132933742038:5233]
2025-10-02T09:37:08.851184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.851196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.851198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.851199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.851200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.851209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.851212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.851215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.851249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.851250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.851251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.851253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.851254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.851292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.851297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.851303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.851308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.851316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.851328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329321:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.851333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329411:9603], now have 1 active actors on pipe
2025-10-02T09:37:08.851337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.851338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.851339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.851347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.851355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.851356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.851358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.851359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.851362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.851363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.851364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3495
2025-10-02T09:37:08.851379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.851382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3495
2025-10-02T09:37:08.851384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.851391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.851401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.851408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.851425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.851432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.851434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.851435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.851440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.851446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.851457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.851542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.851546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.851554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.851611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3496 partition: 0 MaxSeqNo: 36 sessionId: src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0
2025-10-02T09:37:08.851869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e259ac6a-c733cecc-a29d658e-20ccf41e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.854274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Write session: try to update token
2025-10-02T09:37:08.854290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.860851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.860860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.860861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.860862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.860865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.860867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.860869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933742031:5233]
2025-10-02T09:37:08.860887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.860888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.860890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.860890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.860891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.860891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.861002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:08.866380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3496 sessionId: src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:08.868562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:08.933658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556133009329443:4174]
2025-10-02T09:37:08.933817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3495, pipe: [1:7556556133009329443:4174]
2025-10-02T09:37:08.970441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:08.970701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.970709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.970721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329443:4174], now have 1 active actors on pipe
2025-10-02T09:37:08.970871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:08.970875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:08.970916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:08.970948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556133009329443:4174]
2025-10-02T09:37:08.970970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0
2025-10-02T09:37:08.971126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3496 sessionId: src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0 is DEAD
2025-10-02T09:37:08.971278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:08.971288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Write session will restart in 0.006937s
2025-10-02T09:37:08.971308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Write session: Do CDS request
2025-10-02T09:37:08.971314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:08.976403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:08.977620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:08.977742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:08.977751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:08.977759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:08.977798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:08.977830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556132933742157:5249]
2025-10-02T09:37:08.978180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:08.978348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:08.978379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:08.978574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:08.978616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.978621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.978622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.978623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.978624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.978625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.978626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.978627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.978628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.978630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.978631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.978632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.978636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.978647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.978651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.978657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.978661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.978665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.978669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.978672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.978676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.978680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.978684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.978688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.978697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.978704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:08.978712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.978717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:08.978721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.978725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:08.978732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.978737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:08.978744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.978749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:08.978753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.978761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:08.978765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.978773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:08.978777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.978785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:08.978789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.978796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:08.978801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.978809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.978813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.978821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.978825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.978833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.978868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:08.979162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.979269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:08.979281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3497
2025-10-02T09:37:08.979385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:08.979406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:08.979409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:08.979417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:08.979760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3497 sessionId:  describe result for acl check
2025-10-02T09:37:08.979799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:08.979804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:08.979806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:08.979810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:08.980218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:08.981990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:08.985767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:08.985777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:08.985780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556133009329503:9576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:08.985784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:08.986227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:08.987710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:08.987723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:08.987725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:08.987728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:08.987732Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3496 [2:7556556132933742157:5249]
2025-10-02T09:37:08.987744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:08.987757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:08.987760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.987762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.987764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.987775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:08.987783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:08.987788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:08.987826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.987832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.987833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.987836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:08.987838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:08.987883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:08.987890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.987900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:08.987911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:08.987930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:08.987947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329538:9576], now have 1 active actors on pipe
2025-10-02T09:37:08.987954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556133009329448:2446], now have 1 active actors on pipe
2025-10-02T09:37:08.987959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.987964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.987966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.987955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3496
2025-10-02T09:37:08.987969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3496
2025-10-02T09:37:08.987972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:08.987981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:08.987982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:08.987983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:08.987985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:08.987996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:08.987999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:08.988012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.988018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.988043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.988053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:08.988060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:08.988067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:08.988072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:08.988078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:08.988079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:08.988086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:08.988096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:08.988156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.988243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:08.988249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:08.988259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:08.988315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3497 partition: 0 MaxSeqNo: 36 sessionId: src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0
2025-10-02T09:37:08.988558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6418-94aea1ea-7d625fb9-c5c0a863_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:08.990872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Write session: try to update token
2025-10-02T09:37:08.990884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:08.997187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:08.997200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:08.997202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:08.997203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:08.997210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.997213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.997215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556132933742152:5249]
2025-10-02T09:37:08.997234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:08.997237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:08.997239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:08.997239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:08.997243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:08.997244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:08.997356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.002867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3497 sessionId: src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.005087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.070880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304296845:4174]
2025-10-02T09:37:09.071071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3496, pipe: [1:7556556137304296845:4174]
2025-10-02T09:37:09.107019Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.107300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.107311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.107326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304296845:4174], now have 1 active actors on pipe
2025-10-02T09:37:09.107459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.107474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304296845:4174]
2025-10-02T09:37:09.107502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:09.107546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.107556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0
2025-10-02T09:37:09.107686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3497 sessionId: src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0 is DEAD
2025-10-02T09:37:09.107814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:09.107824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Write session will restart in 0.006060s
2025-10-02T09:37:09.107840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Write session: Do CDS request
2025-10-02T09:37:09.107843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.113474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.114639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.114750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.114758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.114766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.114806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.114838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228709542:5263]
2025-10-02T09:37:09.115161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.115295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.115309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3498
2025-10-02T09:37:09.115435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.115455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.115462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.115464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.115499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.115679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.115712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.115759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3498 sessionId:  describe result for acl check
2025-10-02T09:37:09.115780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.115786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.115787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.115790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.116007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.116049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.116054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.116055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.116056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.116057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.116058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.116059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.116061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.116061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.116062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.116064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.116065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.116070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.116081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.116085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.116090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.116094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.116099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.116102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.116107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.116111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.116115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.116119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.116123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.116128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.116135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.116126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.116142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.116147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.116151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.116159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.116163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.116168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.116173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.116178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.116182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.116188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.116192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.116197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.116202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.116207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.116213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.116221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.116225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.116231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.116236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.116241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.116246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.116251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.116282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.117489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.121700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.121711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.121713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304296900:9566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.121719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.123747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.125248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.125264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.125266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.125269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.125273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3497 [2:7556556137228709542:5263]
2025-10-02T09:37:09.125286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.125299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.125301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.125303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.125306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.125318Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.125325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.125332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.125378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.125384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.125386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.125388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.125391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.125443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.125450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.125459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.125469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.125485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.125501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304296846:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.125507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304296937:9566], now have 1 active actors on pipe
2025-10-02T09:37:09.125510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.125512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.125514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.125519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.125505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3497
2025-10-02T09:37:09.125522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3497
2025-10-02T09:37:09.125528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.125529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.125535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.125537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.125541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.125544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.125571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.125578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.125587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.125596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.125603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.125616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.125625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.125628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.125630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.125636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.125647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.125667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.125771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.125778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.125789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.125843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3498 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0
2025-10-02T09:37:09.126067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3872bcd5-cd930ae4-6c87660c-b8cdb51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.129198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Write session: try to update token
2025-10-02T09:37:09.129210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.136329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.136347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.136348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.136350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.136356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.136360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.136366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228709537:5263]
2025-10-02T09:37:09.136393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.136400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.136402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.136403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.136404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.136406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.136523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.142147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3498 sessionId: src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.144254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.207574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304296945:4174]
2025-10-02T09:37:09.207783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3497, pipe: [1:7556556137304296945:4174]
2025-10-02T09:37:09.245703Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.245961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.245971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.245986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304296945:4174], now have 1 active actors on pipe
2025-10-02T09:37:09.246165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.246154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.246194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304296945:4174]
2025-10-02T09:37:09.246215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.246230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.246305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3498 reason: error at write: Disconnected sessionId: src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0
2025-10-02T09:37:09.246450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3498 sessionId: src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0 is DEAD
2025-10-02T09:37:09.246572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.246583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Write session will restart in 0.005364s
2025-10-02T09:37:09.246601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Write session: Do CDS request
2025-10-02T09:37:09.246606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.252183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.253128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.253217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.253228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3499
2025-10-02T09:37:09.253278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.253323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.253344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.253351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.253354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.253387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.253394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.253402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.253437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.253470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228709635:5268]
2025-10-02T09:37:09.253647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3499 sessionId:  describe result for acl check
2025-10-02T09:37:09.253668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.253675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.253676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.253679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.253849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.254012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.254017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.254048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.254240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.254280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.254284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.254285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.254287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.254288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.254289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.254290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.254291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.254292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.254293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.254294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.254295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.254299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.254309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.254313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.254316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.254320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.254324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.254328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.254331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.254335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.254340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.254343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.254347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.254352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.254358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.254363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.254367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.254372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.254382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.254386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.254394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.254398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.254406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.254410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.254414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.254421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.254426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.254431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.254436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.254443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.254450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.254457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.254461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.254466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.254473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.254478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.254485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.254517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.255715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.259797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.259807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.259810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304296999:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.259816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.261982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.263488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.263502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.263503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.263506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.263510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3498 [2:7556556137228709635:5268]
2025-10-02T09:37:09.263517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.263532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.263539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.263541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.263543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.263560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.263567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.263571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.263603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.263608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.263609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.263611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.263612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.263653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.263658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.263664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.263673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.263681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.263696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304296946:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.263701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297038:9560], now have 1 active actors on pipe
2025-10-02T09:37:09.263705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.263706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.263707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.263715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.263725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.263727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.263729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.263731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.263736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.263739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.263754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.263762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.263760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3498
2025-10-02T09:37:09.263777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.263763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3498
2025-10-02T09:37:09.263835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.263842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.263867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.263878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.263885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.263887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.263894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.263902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.263913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.264074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.264081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.264092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.264166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3499 partition: 0 MaxSeqNo: 36 sessionId: src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0
2025-10-02T09:37:09.264372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8320f3b-304cbc1f-183cf654-5c8c8a52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.267185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Write session: try to update token
2025-10-02T09:37:09.267196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.272954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.272968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.272969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.272970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.272974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.272979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.272981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228709630:5268]
2025-10-02T09:37:09.273006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.273013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.273014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.273030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.273044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.273047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.273129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.278627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3499 sessionId: src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.280684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.346315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304297048:4174]
2025-10-02T09:37:09.346493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3498, pipe: [1:7556556137304297048:4174]
2025-10-02T09:37:09.385413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.385645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.385655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.385666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297048:4174], now have 1 active actors on pipe
2025-10-02T09:37:09.385849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.385838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.385871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304297048:4174]
2025-10-02T09:37:09.385877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.385879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.385924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3499 reason: error at write: Disconnected sessionId: src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0
2025-10-02T09:37:09.386080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3499 sessionId: src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0 is DEAD
2025-10-02T09:37:09.386447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.386457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Write session will restart in 0.009866s
2025-10-02T09:37:09.386473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Write session: Do CDS request
2025-10-02T09:37:09.386477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.392756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.393942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.394126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.394135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.394143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.394183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.394209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228709740:5273]
2025-10-02T09:37:09.394551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.394750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.394777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.394958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.394990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.394994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.394995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.394995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.394997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.394998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.394999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.394999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.395003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.395010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.395012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.395014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.395016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.395018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.395020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.395022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.395024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.395026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.395028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.395029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.395033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.395037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.395040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.395043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.395045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.395048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.395050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.395053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.395055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.395057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.395060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.395063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.395070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.395073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.395075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.395078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.395080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.395082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.395085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.395088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.395091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.395097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.395099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.395102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.395127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.397111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.397190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.397203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3500
2025-10-02T09:37:09.397330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.397350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.397358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.397361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.397686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3500 sessionId:  describe result for acl check
2025-10-02T09:37:09.397725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.397731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.397732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.397736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.398142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.399477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.401953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.401964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.401966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304297119:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.401971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.402448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.403802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.403814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.403815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.403817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.403820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3499 [2:7556556137228709740:5273]
2025-10-02T09:37:09.403827Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.403838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.403839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.403842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.403843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.403852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.403859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.403863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.403900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.403904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.403905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.403907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.403909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.403984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.403990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.403999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.404012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.404024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.404038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297153:9539], now have 1 active actors on pipe
2025-10-02T09:37:09.404044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297061:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.404048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.404055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.404057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.404063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.404045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3499
2025-10-02T09:37:09.404077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.404078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.404079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.404081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.404092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.404101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.404114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.404118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3499
2025-10-02T09:37:09.404117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.404138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.404140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.404142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.404151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c150a86-f5beb085-58952fae-4fbe4652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.404157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.404165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.404167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.404174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.404185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.404219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.404308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.404315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.404325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.404382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3500 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c150a86-f5beb085-58952fae-4fbe4652_0
2025-10-02T09:37:09.404596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77250b9-61cd2feb-fd7209d4-59be5856_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c150a86-f5beb085-58952fae-4fbe4652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.407628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Write session: try to update token
2025-10-02T09:37:09.407640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.414713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.414729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.414730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.414731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.414736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.414739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.414741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228709734:5273]
2025-10-02T09:37:09.414766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.414770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.414772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.414783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.414794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.414799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.414886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.420452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3500 sessionId: src_id|5c150a86-f5beb085-58952fae-4fbe4652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.422560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.486102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304297160:4174]
2025-10-02T09:37:09.486284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3499, pipe: [1:7556556137304297160:4174]
2025-10-02T09:37:09.525106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.525390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.525399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.525411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297160:4174], now have 1 active actors on pipe
2025-10-02T09:37:09.525605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.525620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.525668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3500 reason: error at write: Disconnected sessionId: src_id|5c150a86-f5beb085-58952fae-4fbe4652_0
2025-10-02T09:37:09.525675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.525730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304297160:4174]
2025-10-02T09:37:09.525799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3500 sessionId: src_id|5c150a86-f5beb085-58952fae-4fbe4652_0 is DEAD
2025-10-02T09:37:09.525818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.526159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.526170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Write session will restart in 0.007601s
2025-10-02T09:37:09.526184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Write session: Do CDS request
2025-10-02T09:37:09.526189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.531986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.533100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.533207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.533213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.533219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.533245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.533268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228709834:5293]
2025-10-02T09:37:09.533880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.534089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.534113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.534393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.534425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.534429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.534430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.534430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.534431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.534431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.534432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.534432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.534433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.534434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.534434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.534435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.534438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.534445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.534447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.534450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.534452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.534454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.534456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.534458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.534460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.534462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.534464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.534466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.534470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.534474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.534478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.534480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.534483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.534486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.534489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.534492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.534494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.534498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.534501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.534503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.534506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.534508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.534511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.534513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.534515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.534519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.534521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.534524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.534526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.534529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.534530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.534551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.535104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.535215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.535228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3501
2025-10-02T09:37:09.535319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.535346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.535355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.535358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.535744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3501 sessionId:  describe result for acl check
2025-10-02T09:37:09.535780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.535786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.535788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.535791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.536230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.537773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.541481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.541491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.541494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304297221:9534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.541499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.541952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.543506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.543519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.543520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.543522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.543525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3500 [2:7556556137228709834:5293]
2025-10-02T09:37:09.543531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.543541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.543543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.543549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.543550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.543559Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.543565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.543569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.543602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.543606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.543608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.543609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.543610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.543644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.543649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.543657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.543670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.543688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.543704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297256:9534], now have 1 active actors on pipe
2025-10-02T09:37:09.543707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297162:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.543710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.543711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.543712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.543721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.543728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.543735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.543718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3500
2025-10-02T09:37:09.543732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3500
2025-10-02T09:37:09.543737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.543739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.543739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.543740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.543761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.543763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.543774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.543783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.543794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.543798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.543802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.543804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.543804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.543810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.543815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.543826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.543915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.543922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.543932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.543984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3501 partition: 0 MaxSeqNo: 36 sessionId: src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0
2025-10-02T09:37:09.544175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c150a86-f5beb085-58952fae-4fbe4652_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.547223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Write session: try to update token
2025-10-02T09:37:09.547236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.554339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.554355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.554357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.554358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.554362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.554364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.554366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228709829:5293]
2025-10-02T09:37:09.554390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.554400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.554406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.554418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.554429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.554433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.554520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.560506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3501 sessionId: src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.562633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.625892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304297263:4174]
2025-10-02T09:37:09.626115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3500, pipe: [1:7556556137304297263:4174]
2025-10-02T09:37:09.666990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.667313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.667325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.667339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297263:4174], now have 1 active actors on pipe
2025-10-02T09:37:09.667549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.667565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.667592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.667615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3501 reason: error at write: Disconnected sessionId: src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0
2025-10-02T09:37:09.667650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304297263:4174]
2025-10-02T09:37:09.667681Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:37:09.667752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3501 sessionId: src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0 is DEAD
2025-10-02T09:37:09.667766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.667856Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 35 consumer shared/user session shared/user_1_35_15119197923035340636_v1 is DEAD
2025-10-02T09:37:09.667985Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:37:09.668016Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556077174733429:4160] disconnected; active server actors: 1
2025-10-02T09:37:09.668024Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556077174733429:4160] client user disconnected session shared/user_1_35_15119197923035340636_v1
2025-10-02T09:37:09.668063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.668073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Write session will restart in 0.005803s
2025-10-02T09:37:09.668089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Write session: Do CDS request
2025-10-02T09:37:09.668093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.668101Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:09.668105Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:09.668111Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007950s
2025-10-02T09:37:09.674159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.675084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.675178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.675191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3502
2025-10-02T09:37:09.675208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.675287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.675308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.675316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.675319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.675356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.675364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.675371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.675405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.675429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228709928:5307]
2025-10-02T09:37:09.675670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3502 sessionId:  describe result for acl check
2025-10-02T09:37:09.675706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.675711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.675712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.675717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.675774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.675971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.675999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.676148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.676185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.676214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.676218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.676219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.676219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.676220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.676221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.676223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.676223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.676225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.676225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.676228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.676235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.676237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.676239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.676241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.676243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.676245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.676247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.676249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.676251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.676253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.676255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.676259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.676262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.676265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.676268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.676270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.676273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.676275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.676278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.676280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.676283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.676285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.676287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.676289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.676292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.676295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.676298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.676299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.676302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.676305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.676308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.676310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.676312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.676318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.676320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.676336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.677007Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:37:09.677177Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:37:09.677186Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 36
2025-10-02T09:37:09.677267Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 36 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:09.677297Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:09.677358Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 auth for : user
2025-10-02T09:37:09.677420Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 Handle describe topics response
2025-10-02T09:37:09.677435Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 auth is DEAD
2025-10-02T09:37:09.677469Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:37:09.677536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.677655Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:37:09.677724Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556137304297347:9522] connected; active server actors: 1
2025-10-02T09:37:09.677734Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:09.677736Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556137304297347:9522] session shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:09.677746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:37:09.677753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:37:09.677761Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_36_12331362819099053869_v1" (Sender=[1:7556556137304297343:9522], Pipe=[1:7556556137304297347:9522], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:09.677763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:37:09.677770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:37:09.677778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_36_12331362819099053869_v1" (Sender=[1:7556556137304297343:9522], Pipe=[1:7556556137304297347:9522], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:09.677785Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_36_12331362819099053869_v1" sender [1:7556556137304297343:9522] lock partition 0 for ReadingSession "shared/user_1_36_12331362819099053869_v1" (Sender=[1:7556556137304297343:9522], Pipe=[1:7556556137304297347:9522], Partitions=[], ActiveFamilyCount=1) generation 1 step 36
2025-10-02T09:37:09.677794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:37:09.677797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:37:09.677952Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 36 Session: "shared/user_1_36_12331362819099053869_v1" ClientId: "user" PipeClient { RawX1: 7556556137304297347 RawX2: 4503603922347314 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:37:09.677967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:37:09.681618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.681630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.681633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304297320:9525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.681638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.683695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.685057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.685067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.685069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.685071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.685075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3501 [2:7556556137228709928:5307]
2025-10-02T09:37:09.685082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.685092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.685098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.685101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.685103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.685115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.685124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.685134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.685175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.685180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.685181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.685183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.685184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.685228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.685235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.685244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.685257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.685275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.685294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297367:9525], now have 1 active actors on pipe
2025-10-02T09:37:09.685300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297264:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.685303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297357:9514], now have 1 active actors on pipe
2025-10-02T09:37:09.685307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.685312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.685314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.685295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3501
2025-10-02T09:37:09.685305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3501
2025-10-02T09:37:09.685320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.685322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3501, pipe: [1:7556556137304297357:9514]
2025-10-02T09:37:09.685330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.685335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.685338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.685339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.685347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.685349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.685382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.685389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.685400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.685404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.685408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_36_12331362819099053869_v1 on pipe: [1:7556556137304297357:9514]
2025-10-02T09:37:09.685416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.685423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.685430Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_36_12331362819099053869_v1:1 with generation 3501
2025-10-02T09:37:09.685438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.685448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d89ac0b-90bd92c-f448989-91cc6209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.685457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.685464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.685466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.685475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.685486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.685497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.685504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.685505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.685515Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:09.685520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.685544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.685559Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:37:09.685695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3502 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d89ac0b-90bd92c-f448989-91cc6209_0
2025-10-02T09:37:09.685866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339ae061-141cd9be-d6e7e1b7-46f7a735_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d89ac0b-90bd92c-f448989-91cc6209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.685630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.685637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.685646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.688875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Write session: try to update token
2025-10-02T09:37:09.688886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.689392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:37:09.689410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:37:09.689416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.689421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.689423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.689428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:37:09.689433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:37:09.689515Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397829685 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:37:09.689530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:37:09.689552Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 sending to client partition status
2025-10-02T09:37:09.695916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.695930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.695932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.695933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.695938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.695940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.695945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228709923:5307]
2025-10-02T09:37:09.695969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.695978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.695980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.695983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.695987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.695990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.696089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.702361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3502 sessionId: src_id|9d89ac0b-90bd92c-f448989-91cc6209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.704426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.806615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.806875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.806884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.807041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.807055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.807101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3502 reason: error at write: Disconnected sessionId: src_id|9d89ac0b-90bd92c-f448989-91cc6209_0
2025-10-02T09:37:09.807103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.807167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304297357:9514]
2025-10-02T09:37:09.807225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3502 sessionId: src_id|9d89ac0b-90bd92c-f448989-91cc6209_0 is DEAD
2025-10-02T09:37:09.807279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:09.807299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.807314Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:09.807347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.807357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Write session will restart in 0.008943s
2025-10-02T09:37:09.807381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Write session: Do CDS request
2025-10-02T09:37:09.807385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.813974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.815070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.815189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.815196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.815202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.815230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.815255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228710027:5310]
2025-10-02T09:37:09.815869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.816082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.816109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.816391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.816422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.816426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.816427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.816427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.816428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.816429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.816429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.816431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.816431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.816432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.816435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.816442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.816444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.816447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.816449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.816451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.816453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.816455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.816457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.816460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.816463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.816465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.816469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.816473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.816476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.816480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.816482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.816486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.816488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.816491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.816494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.816497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.816499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.816502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.816506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.816509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.816512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.816515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.816517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.816520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.816522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.816525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.816527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.816529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.816533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.816536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.816553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.817112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.817183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.817195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3503
2025-10-02T09:37:09.817338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.817358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.817363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.817366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.817653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3503 sessionId:  describe result for acl check
2025-10-02T09:37:09.817671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.817675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.817676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.817679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.818047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.819429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.823505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.823518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.823521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304297441:9508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.823526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.823994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.825506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.825518Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.825519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.825521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.825524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3502 [2:7556556137228710027:5310]
2025-10-02T09:37:09.825531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.825541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.825547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.825548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.825549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.825559Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.825562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.825566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.825599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.825604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.825605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.825606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.825607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.825655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.825661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.825671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.825682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.825699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.825719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297380:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.825725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297476:9508], now have 1 active actors on pipe
2025-10-02T09:37:09.825728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.825729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.825730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.825740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.825753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.825753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.825761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.825762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.825738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3502
2025-10-02T09:37:09.825765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.825768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.825756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3502
2025-10-02T09:37:09.825798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.825805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.825813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.825822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.825832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.825844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.825852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.825855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.825858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.825864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.825870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.825889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.825988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.825994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.826004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.826071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3503 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0
2025-10-02T09:37:09.826274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d89ac0b-90bd92c-f448989-91cc6209_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.829403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Write session: try to update token
2025-10-02T09:37:09.829415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.836430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.836455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.836457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.836459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.836468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.836475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.836478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228710022:5310]
2025-10-02T09:37:09.836509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.836517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.836521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.836521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.836523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.836523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.836652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.842746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3503 sessionId: src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.844776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:09.907473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556137304297484:9514]
2025-10-02T09:37:09.907608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3502, pipe: [1:7556556137304297484:9514]
2025-10-02T09:37:09.947379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:09.947593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.947602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.947614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297484:9514], now have 1 active actors on pipe
2025-10-02T09:37:09.947730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:09.947726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:09.947739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:09.947746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556137304297484:9514]
2025-10-02T09:37:09.947765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:09.947776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3503 reason: error at write: Disconnected sessionId: src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0
2025-10-02T09:37:09.947904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3503 sessionId: src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0 is DEAD
2025-10-02T09:37:09.948036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:09.948044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Write session will restart in 0.005959s
2025-10-02T09:37:09.948063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Write session: Do CDS request
2025-10-02T09:37:09.948067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:09.953974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:09.955083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:09.955139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.955200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:09.955210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3504
2025-10-02T09:37:09.955230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:09.955240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:09.955249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:09.955290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:09.955317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556137228710159:5322]
2025-10-02T09:37:09.955325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:09.955342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:09.955347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:09.955350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:09.955660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:09.955683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3504 sessionId:  describe result for acl check
2025-10-02T09:37:09.955723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:09.955729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:09.955730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:09.955734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:09.955840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:09.955866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:09.956045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:09.956075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.956078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.956079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.956079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.956080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.956081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.956081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.956082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.956082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.956083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.956083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.956084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.956087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.956092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.956095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.956097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.956099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.956101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.956103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.956105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.956107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.956110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.956112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.956113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:09.956114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.956117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.956121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:09.956124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.956127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:09.956130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.956133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:09.956135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.956138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:09.956140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.956143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:09.956145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.956147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:09.956154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.956156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:09.956158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.956162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:09.956165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.956168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:09.956172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.956174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.956176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.956179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.956181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.956184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.956202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:09.957515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:09.962031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:09.962046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:09.962048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556137304297575:9484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:09.962054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:09.963542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:09.965025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:09.965036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:09.965038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:09.965041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:09.965045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3503 [2:7556556137228710159:5322]
2025-10-02T09:37:09.965055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:09.965070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:09.965072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.965073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.965074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.965083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:09.965089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:09.965094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:09.965127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.965131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.965132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.965134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:09.965136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:09.965202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:09.965206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.965214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:09.965223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:09.965235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:09.965239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3503
2025-10-02T09:37:09.965249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297510:2446], now have 1 active actors on pipe
2025-10-02T09:37:09.965257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556137304297610:9484], now have 1 active actors on pipe
2025-10-02T09:37:09.965260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.965261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.965262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.965268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:09.965283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3503
2025-10-02T09:37:09.965273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:09.965275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:09.965275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:09.965276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:09.965282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:09.965284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:09.965316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.965322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.965330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.965335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:09.965342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:09.965352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:09.965355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:09.965361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:09.965362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:09.965367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:09.965373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:09.965384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.965470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:09.965474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:09.965483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:09.965543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3504 partition: 0 MaxSeqNo: 36 sessionId: src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0
2025-10-02T09:37:09.965717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bbe142-892b8dd2-3da4dfd1-b15db298_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:09.968456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Write session: try to update token
2025-10-02T09:37:09.968466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:09.974534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:09.974547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:09.974549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:09.974550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:09.974557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.974559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.974561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556137228710154:5322]
2025-10-02T09:37:09.974586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:09.974593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:09.974595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:09.974598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:09.974609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:09.974613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:09.974727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:09.979892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3504 sessionId: src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:09.981900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.047770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599264917:9514]
2025-10-02T09:37:10.047981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3503, pipe: [1:7556556141599264917:9514]
2025-10-02T09:37:10.084395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.084671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.084679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.084691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599264917:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.084847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.084893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.084923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599264917:9514]
2025-10-02T09:37:10.085106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:10.085410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:10.085419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Write session will restart in 0.005547s
2025-10-02T09:37:10.085432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Write session: Do CDS request
2025-10-02T09:37:10.085436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.085161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3504 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0
2025-10-02T09:37:10.085291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3504 sessionId: src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0 is DEAD
2025-10-02T09:37:10.091731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.092093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.092177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.092188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3505
2025-10-02T09:37:10.092317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.092336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.092341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.092343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.092689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3505 sessionId:  describe result for acl check
2025-10-02T09:37:10.092725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.092732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.092734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.092738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.092888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.093007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.093014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.093020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.093053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.093078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523677551:5332]
2025-10-02T09:37:10.093195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.093425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.093634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.093660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.093841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.093871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.093875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.093875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.093876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.093876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.093877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.093877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.093878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.093878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.093879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.093879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.093880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.093882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.093889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.093891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.093893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.093895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.093897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.093899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.093901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.093903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.093906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.093908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.093910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.093913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.093917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.093920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.093925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.093928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.093932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.093938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.093943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.093949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.093953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.093960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.093965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.093970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.093976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.093983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.093988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.093994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.093997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.093999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.094001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.094007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.094010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.094013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.094015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.094032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.094864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.099771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.099783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.099785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599264977:9470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.099790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.101402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.102803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.102814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.102815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.102818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.102821Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3504 [2:7556556141523677551:5332]
2025-10-02T09:37:10.102828Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.102837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.102839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.102840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.102841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.102851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.102858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.102862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.102894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.102899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.102900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.102901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.102903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.102947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.102953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.102962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.102976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.102992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.103012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599264918:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.103018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265016:9470], now have 1 active actors on pipe
2025-10-02T09:37:10.103023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.103025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.103027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.103013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3504
2025-10-02T09:37:10.103030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3504
2025-10-02T09:37:10.103033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.103045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.103047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.103051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.103053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.103059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.103061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.103092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.103098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.103106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.103121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.103132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.103146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.103155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.103159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.103161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.103169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.103176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.103196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.103279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.103286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.103297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.103362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3505 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0
2025-10-02T09:37:10.103565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99297319-6cdcc723-3e1c121b-e89f5f86_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.106591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Write session: try to update token
2025-10-02T09:37:10.106603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.113755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.113767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.113768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.113769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.113774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.113776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.113778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523677546:5332]
2025-10-02T09:37:10.113806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.113810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.113811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.113814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.113814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.113817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.113935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.120000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3505 sessionId: src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.122116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.184979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265024:9514]
2025-10-02T09:37:10.185167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3504, pipe: [1:7556556141599265024:9514]
2025-10-02T09:37:10.224754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.224992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.225001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.225014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265024:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.225149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:10.225163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:10.225202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265024:9514]
2025-10-02T09:37:10.225217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3505 reason: error at write: Disconnected sessionId: src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0
2025-10-02T09:37:10.225211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.225242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.225387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3505 sessionId: src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0 is DEAD
2025-10-02T09:37:10.225504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:10.225512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Write session will restart in 0.009303s
2025-10-02T09:37:10.225526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Write session: Do CDS request
2025-10-02T09:37:10.225531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.231215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.232334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.232435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.232442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.232447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.232472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.232494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523677651:5338]
2025-10-02T09:37:10.232852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.233020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.233042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.233222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.233251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.233255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.233255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.233256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.233257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.233257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.233258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.233258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.233259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.233259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.233260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.233261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.233263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.233269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.233272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.233274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.233276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.233278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.233280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.233282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.233283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.233286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.233288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.233289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.233294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.233298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.233301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.233304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.233306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.233310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.233312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.233315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.233317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.233320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.233322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.233325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.233328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.233330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.233332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.233334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.233336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.233339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.233341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.233343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.233346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.233348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.233350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.233353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.233369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.236166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.236318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.236329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3506
2025-10-02T09:37:10.236405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.236423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.236426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.236428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.236819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3506 sessionId:  describe result for acl check
2025-10-02T09:37:10.236858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.236867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.236868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.236875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.237342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.238691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.240732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.240744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.240746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265090:9451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.240750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.240746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.242095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.242107Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.242108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.242110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.242114Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3505 [2:7556556141523677651:5338]
2025-10-02T09:37:10.242121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.242130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.242136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.242137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.242139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.242150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.242156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.242160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.242192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.242197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.242198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.242199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.242201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.242236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.242241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.242248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.242253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.242264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.242278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265025:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.242283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265124:9451], now have 1 active actors on pipe
2025-10-02T09:37:10.242287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.242288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.242289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.242296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.242307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.242309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.242311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.242312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.242318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.242320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.242308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3505
2025-10-02T09:37:10.242319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3505
2025-10-02T09:37:10.242335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.242340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.242341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.242352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.242357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.242433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7995b32-969006a0-46563a-9238d8fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.242441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.242443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.242445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.242449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.242455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.242470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.242560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.242565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.242574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.242629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3506 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7995b32-969006a0-46563a-9238d8fe_0
2025-10-02T09:37:10.242793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2d0005-405d919f-cd0f1d7-321f38a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7995b32-969006a0-46563a-9238d8fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.245559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Write session: try to update token
2025-10-02T09:37:10.245569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.251789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.251800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.251801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.251802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.251809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.251811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.251813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523677646:5338]
2025-10-02T09:37:10.251833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.251836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.251837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.251837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.251839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.251841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.251950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.257886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3506 sessionId: src_id|c7995b32-969006a0-46563a-9238d8fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.260093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.325267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265131:9514]
2025-10-02T09:37:10.325437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3505, pipe: [1:7556556141599265131:9514]
2025-10-02T09:37:10.361395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.361628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.361636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.361650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265131:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.361776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.361798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265131:9514]
2025-10-02T09:37:10.361820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:10.361852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.361869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7995b32-969006a0-46563a-9238d8fe_0
2025-10-02T09:37:10.361991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3506 sessionId: src_id|c7995b32-969006a0-46563a-9238d8fe_0 is DEAD
2025-10-02T09:37:10.362148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:10.362159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Write session will restart in 0.005101s
2025-10-02T09:37:10.362182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Write session: Do CDS request
2025-10-02T09:37:10.362187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.367802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.368147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.368201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.368210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3507
2025-10-02T09:37:10.368326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.368346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.368352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.368355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.368706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3507 sessionId:  describe result for acl check
2025-10-02T09:37:10.368741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.368748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.368750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.368754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.368998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.369109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.369115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.369122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.369151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.369176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523677761:5348]
2025-10-02T09:37:10.369212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.369786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.369966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.369989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.370182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.370218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.370222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.370223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.370223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.370224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.370224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.370225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.370225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.370226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.370227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.370227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.370228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.370230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.370237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.370239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.370241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.370243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.370245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.370247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.370249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.370251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.370253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.370255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.370257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.370261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.370265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.370268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.370270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.370273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.370275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.370278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.370281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.370283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.370285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.370287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.370290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.370296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.370300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.370302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.370305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.370307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.370313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.370316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.370318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.370320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.370323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.370325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.370327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.370348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.370730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.375306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.375339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.375341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265196:9446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.375346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.377956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.379410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.379420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.379421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.379423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.379428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3506 [2:7556556141523677761:5348]
2025-10-02T09:37:10.379436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.379447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.379453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.379455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.379456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.379465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.379469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.379474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.379506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.379511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.379512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.379514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.379515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.379552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.379557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.379564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.379570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.379581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.379595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265135:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.379600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265235:9446], now have 1 active actors on pipe
2025-10-02T09:37:10.379604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.379605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.379606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.379614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.379620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.379622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.379623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.379624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.379604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3506
2025-10-02T09:37:10.379627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3506
2025-10-02T09:37:10.379631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.379635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.379661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.379665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.379673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.379680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.379689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.379700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b91f935-d0003ef6-42da2524-9075e891_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.379707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.379710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.379714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.379719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.379725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.379739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.379826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.379831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.379838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.379881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3507 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b91f935-d0003ef6-42da2524-9075e891_0
2025-10-02T09:37:10.380085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7995b32-969006a0-46563a-9238d8fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b91f935-d0003ef6-42da2524-9075e891_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.382670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Write session: try to update token
2025-10-02T09:37:10.382687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.388911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.388920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.388921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.388922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.388925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.388927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.388929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523677756:5348]
2025-10-02T09:37:10.388954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.388961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.388962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.388963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.388965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.388967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.389080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.394845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3507 sessionId: src_id|1b91f935-d0003ef6-42da2524-9075e891_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.397019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.461985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265254:9514]
2025-10-02T09:37:10.462167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3506, pipe: [1:7556556141599265254:9514]
2025-10-02T09:37:10.498478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.498774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.498783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.498795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265254:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.498937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.498965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265254:9514]
2025-10-02T09:37:10.498979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.498994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:10.499006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:10.499084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3507 reason: error at write: Disconnected sessionId: src_id|1b91f935-d0003ef6-42da2524-9075e891_0
2025-10-02T09:37:10.499264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3507 sessionId: src_id|1b91f935-d0003ef6-42da2524-9075e891_0 is DEAD
2025-10-02T09:37:10.499418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:10.499431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Write session will restart in 0.008581s
2025-10-02T09:37:10.499452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Write session: Do CDS request
2025-10-02T09:37:10.499457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.505495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.506650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.506758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.506764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.506771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.506798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.506824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523677863:5350]
2025-10-02T09:37:10.507187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.507353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.507379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.507557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.507588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.507592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.507593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.507593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.507594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.507594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.507595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.507595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.507596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.507596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.507597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.507598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.507601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.507608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.507610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.507612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.507614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.507616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.507618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.507620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.507622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.507624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.507626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.507628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.507632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.507636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.507639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.507642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.507645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.507647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.507650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.507653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.507655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.507658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.507660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.507663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.507665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.507668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.507670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.507674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.507681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.507683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.507685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.507688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.507690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.507693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.507695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.507698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.507718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.509178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.509282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.509298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3508
2025-10-02T09:37:10.509427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.509448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.509451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.509453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.509742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3508 sessionId:  describe result for acl check
2025-10-02T09:37:10.509761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.509765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.509766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.509769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.510108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.511610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.514704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.514714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.514717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265321:9430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.514722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.515211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.516649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.516659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.516660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.516664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.516667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3507 [2:7556556141523677863:5350]
2025-10-02T09:37:10.516674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.516684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.516689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.516690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.516691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.516700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.516702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.516706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.516737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.516742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.516743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.516744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.516746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.516782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.516789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.516797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.516815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.516823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.516834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265357:9430], now have 1 active actors on pipe
2025-10-02T09:37:10.516840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265255:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.516843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.516845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.516845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.516853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.516865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.516865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.516861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3507
2025-10-02T09:37:10.516871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.516872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.516878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3507
2025-10-02T09:37:10.516873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.516875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.516890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.516895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.516896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.516905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.516911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.516936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.516943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.516945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.516947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.516952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.516957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.516969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.517099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.517105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.517112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.517168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3508 partition: 0 MaxSeqNo: 36 sessionId: src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0
2025-10-02T09:37:10.517418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b91f935-d0003ef6-42da2524-9075e891_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.519754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Write session: try to update token
2025-10-02T09:37:10.519768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.526093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.526103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.526104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.526104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.526108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.526110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.526113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523677858:5350]
2025-10-02T09:37:10.526133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.526133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.526135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.526137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.526138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.526140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.526253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.532017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3508 sessionId: src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.534216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.599201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265364:9514]
2025-10-02T09:37:10.599559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3507, pipe: [1:7556556141599265364:9514]
2025-10-02T09:37:10.634776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.635037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.635046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.635059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265364:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.635228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.635220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.635257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:10.635259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:10.635289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265364:9514]
2025-10-02T09:37:10.635346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3508 reason: error at write: Disconnected sessionId: src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0
2025-10-02T09:37:10.635469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3508 sessionId: src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0 is DEAD
2025-10-02T09:37:10.635625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:10.635637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Write session will restart in 0.009624s
2025-10-02T09:37:10.635658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Write session: Do CDS request
2025-10-02T09:37:10.635663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.641654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.642964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.643076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.643083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.643089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.643129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.643166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523677963:5358]
2025-10-02T09:37:10.643554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.643735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.643765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.643999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.644037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.644042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.644043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.644043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.644044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.644044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.644045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.644046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.644046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.644047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.644048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.644048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.644051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.644059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.644062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.644064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.644067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.644069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.644072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.644074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.644076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.644079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.644081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.644084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.644089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.644094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.644098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.644101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.644103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.644107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.644109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.644117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.644120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.644123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.644127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.644130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.644132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.644135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.644139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.644142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.644145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.644148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.644150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.644154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.644159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.644162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.644164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.644167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.644189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.646212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.646306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.646314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3509
2025-10-02T09:37:10.646439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.646471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.646478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.646481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.646830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3509 sessionId:  describe result for acl check
2025-10-02T09:37:10.646866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.646874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.646880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.646884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.647340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.648870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.652401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.652416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.652419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265433:9426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.652424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.654429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.654440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.654442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.654444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.654448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3508 [2:7556556141523677963:5358]
2025-10-02T09:37:10.654455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.654466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.654471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.654473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.654474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.654484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.654487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.654492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.654528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.654534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.654535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.654537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.654539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.654579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.654584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.654591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.654597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.654611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.654624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265467:9426], now have 1 active actors on pipe
2025-10-02T09:37:10.654631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265365:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.654635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.654636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.654638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.654647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.654659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.654661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.654663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.654664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.654668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.654670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.654653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3508
2025-10-02T09:37:10.654685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.654691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.654669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3508
2025-10-02T09:37:10.654692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.654701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.654703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.654735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.654743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.654745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.654746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.654753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.654760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.654772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.654861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.654866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.654874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.654955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3509 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0
2025-10-02T09:37:10.655220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860c360e-6e3a6eed-fe3ad062-f5338de6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.657614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Write session: try to update token
2025-10-02T09:37:10.657629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.664712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.664722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.664723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.664724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.664728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.664730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.664732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523677958:5358]
2025-10-02T09:37:10.664750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.664751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.664753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.664754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.664754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.664756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.664893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.669855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3509 sessionId: src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.672145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.735390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265475:9514]
2025-10-02T09:37:10.735552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3508, pipe: [1:7556556141599265475:9514]
2025-10-02T09:37:10.774682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.774919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.774928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.774959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265475:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.775092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.775229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265475:9514]
2025-10-02T09:37:10.775254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:10.775266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.775311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3509 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0
2025-10-02T09:37:10.775440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3509 sessionId: src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0 is DEAD
2025-10-02T09:37:10.775577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:10.775586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Write session will restart in 0.005659s
2025-10-02T09:37:10.775610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Write session: Do CDS request
2025-10-02T09:37:10.775616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.781815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.782155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.782251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.782261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3510
2025-10-02T09:37:10.782368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.782390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.782398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.782401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.782752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3510 sessionId:  describe result for acl check
2025-10-02T09:37:10.782783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.782788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.782790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.782794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.783016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.783128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.783135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.783141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.783169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.783193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523678065:5370]
2025-10-02T09:37:10.783233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.783546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.783736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.783764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.783949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.783977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.783981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.783982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.783982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.783983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.783983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.783984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.783984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.783985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.783985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.783986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.783986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.783989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.783996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.783998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.784000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.784002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.784004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.784006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.784008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.784010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.784014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.784016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.784020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.784024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.784027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.784030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.784032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.784035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.784037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.784040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.784044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.784046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.784049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.784051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.784054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.784056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.784059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.784061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.784064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.784066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.784068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.784071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.784073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.784076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.784079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.784098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.784990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.789819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.789829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.789831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265540:9415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.789836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.791454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.792851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.792860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.792861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.792863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.792868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3509 [2:7556556141523678065:5370]
2025-10-02T09:37:10.792876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.792886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.792890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.792892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.792893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.792902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.792906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.792910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.792944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.792948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.792950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.792951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.792953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.792998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.793005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.793015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.793028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.793044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.793062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265579:9415], now have 1 active actors on pipe
2025-10-02T09:37:10.793068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265476:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.793071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.793072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.793073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.793084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.793097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.793097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.793085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3509
2025-10-02T09:37:10.793094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3509
2025-10-02T09:37:10.793099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.793101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.793113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.793115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.793139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.793146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.793157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.793165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.793175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.793190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.793198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.793203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.793204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.793214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.793225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.793243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.793328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.793334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.793345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.793403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3510 partition: 0 MaxSeqNo: 36 sessionId: src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0
2025-10-02T09:37:10.793669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd5cfd0-e300777d-b73d69af-7515359f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.796033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Write session: try to update token
2025-10-02T09:37:10.796047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.802196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.802207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.802208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.802209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.802213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.802215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.802217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523678060:5370]
2025-10-02T09:37:10.802240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.802250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.802252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.802254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.802257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.802259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.802360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.807914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3510 sessionId: src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.810199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:10.875154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556141599265587:9514]
2025-10-02T09:37:10.875331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3509, pipe: [1:7556556141599265587:9514]
2025-10-02T09:37:10.910225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:10.910497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.910507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.910520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265587:9514], now have 1 active actors on pipe
2025-10-02T09:37:10.910690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:10.910696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:10.910705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:10.910743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3510 reason: error at write: Disconnected sessionId: src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0
2025-10-02T09:37:10.910875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3510 sessionId: src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0 is DEAD
2025-10-02T09:37:10.910917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556141599265587:9514]
2025-10-02T09:37:10.910955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:10.911011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:10.911016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Write session will restart in 0.007765s
2025-10-02T09:37:10.911040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Write session: Do CDS request
2025-10-02T09:37:10.911046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:10.917885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:10.918998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:10.919107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:10.919124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:10.919129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:10.919160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:10.919188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556141523678182:5388]
2025-10-02T09:37:10.919754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:10.919956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:10.919984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:10.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:10.920190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.920204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.920208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.920209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.920209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.920210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.920211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.920211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.920212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.920212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.920213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.920214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.920214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.920217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.920223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.920225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.920227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.920229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.920231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.920233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.920235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.920238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.920240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.920242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.920244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.920248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.920251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:10.920255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.920258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:10.920260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.920263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:10.920266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.920268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:10.920271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.920274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:10.920276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.920278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:10.920281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.920284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:10.920286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.920289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:10.920291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.920294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:10.920296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.920298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.920301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.920303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.920306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.920313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.920289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:10.920300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3511
2025-10-02T09:37:10.920331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:10.920415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:10.920435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:10.920438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:10.920441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:10.920781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3511 sessionId:  describe result for acl check
2025-10-02T09:37:10.920829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:10.920834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:10.920836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:10.920841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:10.921282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:10.922682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:10.926751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:10.926760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:10.926762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556141599265657:9400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:10.926768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:10.927922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:10.929428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:10.929439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:10.929440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:10.929442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:10.929445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3510 [2:7556556141523678182:5388]
2025-10-02T09:37:10.929452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:10.929462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:10.929463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.929466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.929468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.929477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:10.929483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:10.929486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:10.929517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.929522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.929523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.929525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:10.929527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:10.929562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:10.929567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.929574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:10.929584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:10.929601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:10.929619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265588:2446], now have 1 active actors on pipe
2025-10-02T09:37:10.929625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556141599265690:9400], now have 1 active actors on pipe
2025-10-02T09:37:10.929629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.929629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.929631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.929637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:10.929645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:10.929649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:10.929651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:10.929652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:10.929655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:10.929657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:10.929671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.929680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:10.929684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:10.929713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3510
2025-10-02T09:37:10.929747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3510
2025-10-02T09:37:10.929769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.929775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.929788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d906cfe-e7277a40-3c815e42-77af546b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:10.929793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:10.929796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:10.929796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:10.929801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:10.929809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:10.929816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.929905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:10.929909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:10.929916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:10.929974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3511 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d906cfe-e7277a40-3c815e42-77af546b_0
2025-10-02T09:37:10.930257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89df20c1-ecb7bf6b-89906c0a-24ef62ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d906cfe-e7277a40-3c815e42-77af546b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:10.932593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Write session: try to update token
2025-10-02T09:37:10.932605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:10.938896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:10.938909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:10.938911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:10.938911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:10.938915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.938917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.938919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556141523678177:5388]
2025-10-02T09:37:10.938939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:10.938942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:10.938942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:10.938943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:10.938945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:10.938947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:10.939051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:10.945776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3511 sessionId: src_id|2d906cfe-e7277a40-3c815e42-77af546b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:10.948042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.010851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233021:9514]
2025-10-02T09:37:11.011052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3510, pipe: [1:7556556145894233021:9514]
2025-10-02T09:37:11.048910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.049154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.049163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.049175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233021:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.049307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.049362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233021:9514]
2025-10-02T09:37:11.049386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:11.049433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.049445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d906cfe-e7277a40-3c815e42-77af546b_0
2025-10-02T09:37:11.049579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3511 sessionId: src_id|2d906cfe-e7277a40-3c815e42-77af546b_0 is DEAD
2025-10-02T09:37:11.049709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:11.049720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Write session will restart in 0.005203s
2025-10-02T09:37:11.049741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Write session: Do CDS request
2025-10-02T09:37:11.049746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.055512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.056154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.056250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.056259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3512
2025-10-02T09:37:11.056354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.056376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.056384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.056386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.056657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3512 sessionId:  describe result for acl check
2025-10-02T09:37:11.056669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.056677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.056684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.056685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.056687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.056781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.056787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.056793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.056835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.056861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818645603:5398]
2025-10-02T09:37:11.057048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.057205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.057357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.057395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.057576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.057607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.057611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.057611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.057612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.057612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.057613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.057613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.057614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.057614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.057615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.057616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.057616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.057619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.057625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.057627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.057629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.057631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.057633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.057635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.057637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.057638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.057641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.057642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.057644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.057648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.057652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.057655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.057658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.057662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.057665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.057667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.057670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.057672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.057675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.057677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.057680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.057683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.057690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.057692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.057699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.057705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.057708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.057710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.057713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.057716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.057718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.057721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.057737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.059067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.063411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.063420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.063423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233092:9373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.063428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.065080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.066584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.066596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.066597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.066599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.066602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3511 [2:7556556145818645603:5398]
2025-10-02T09:37:11.066610Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.066619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.066624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.066626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.066627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.066636Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.066639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.066643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.066677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.066682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.066684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.066686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.066687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.066724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.066729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.066735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.066740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.066750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.066764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233026:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.066769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233131:9373], now have 1 active actors on pipe
2025-10-02T09:37:11.066772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.066773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.066774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.066782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.066787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.066789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.066790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.066793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.066774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3511
2025-10-02T09:37:11.066799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.066805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.066790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3511
2025-10-02T09:37:11.066840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.066848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.066856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.066863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.066871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.066881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b939739-c10ab6de-676a618-cc534ec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.066885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.066887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.066889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.066894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.066901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.066913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.067000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.067005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.067012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.067066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3512 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b939739-c10ab6de-676a618-cc534ec0_0
2025-10-02T09:37:11.067339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d906cfe-e7277a40-3c815e42-77af546b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b939739-c10ab6de-676a618-cc534ec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.069656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Write session: try to update token
2025-10-02T09:37:11.069671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.075842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.075854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.075855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.075856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.075860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.075864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.075866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818645598:5398]
2025-10-02T09:37:11.075885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.075886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.075887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.075888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.075889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.075891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.075991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.081777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3512 sessionId: src_id|1b939739-c10ab6de-676a618-cc534ec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.084081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.149600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233138:9514]
2025-10-02T09:37:11.149761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3511, pipe: [1:7556556145894233138:9514]
2025-10-02T09:37:11.185800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.186069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.186078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.186090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233138:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.186287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.186256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:11.186264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:11.186309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3512 reason: error at write: Disconnected sessionId: src_id|1b939739-c10ab6de-676a618-cc534ec0_0
2025-10-02T09:37:11.186443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3512 sessionId: src_id|1b939739-c10ab6de-676a618-cc534ec0_0 is DEAD
2025-10-02T09:37:11.186587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:11.186593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Write session will restart in 0.006614s
2025-10-02T09:37:11.186573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233138:9514]
2025-10-02T09:37:11.186617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Write session: Do CDS request
2025-10-02T09:37:11.186626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.186763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.192689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.194032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.194134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.194141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.194147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.194168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.194183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.194209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818645711:5408]
2025-10-02T09:37:11.194247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.194255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3513
2025-10-02T09:37:11.194352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.194370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.194377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.194379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.194557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.194727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.194721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3513 sessionId:  describe result for acl check
2025-10-02T09:37:11.194750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.194761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.194770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.194774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.194779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.194931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.194963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.194966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.194967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.194967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.194968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.194968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.194969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.194970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.194970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.194971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.194971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.194972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.194974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.194981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.194983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.194985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.194987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.194989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.194991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.194993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.194995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.194997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.194999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.195001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.195005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.195009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.195012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.195015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.195018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.195020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.195022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.195025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.195027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.195030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.195035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.195041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.195045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.195051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.195055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.195064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.195069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.195073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.195076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.195080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.195082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.195085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.195087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.195089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.195108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.195225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.196628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.201264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.201276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.201279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233209:9370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.201283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.202415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.203842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.203853Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.203855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.203857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.203860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3512 [2:7556556145818645711:5408]
2025-10-02T09:37:11.203868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.203878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.203884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.203885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.203886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.203895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.203900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.203904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.203940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.203945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.203946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.203947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.203949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.203986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.203990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.203997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.204002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.204014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.204028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233140:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.204034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233245:9370], now have 1 active actors on pipe
2025-10-02T09:37:11.204037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.204038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.204039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.204046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.204043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3512
2025-10-02T09:37:11.204058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3512
2025-10-02T09:37:11.204053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.204056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.204060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.204061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.204063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.204065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.204077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.204083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.204084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.204096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.204100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.204127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.204133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.204135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.204136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.204141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.204148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.204161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.204240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.204244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.204252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.204297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3513 partition: 0 MaxSeqNo: 36 sessionId: src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0
2025-10-02T09:37:11.204521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b939739-c10ab6de-676a618-cc534ec0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.206791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Write session: try to update token
2025-10-02T09:37:11.206804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.213127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.213139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.213140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.213142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.213146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.213149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.213153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818645706:5408]
2025-10-02T09:37:11.213175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.213179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.213182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.213183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.213184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.213185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.213294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.218851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3513 sessionId: src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.221143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.286807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233252:9514]
2025-10-02T09:37:11.286999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3512, pipe: [1:7556556145894233252:9514]
2025-10-02T09:37:11.322008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.322201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.322209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.322221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233252:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.322371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.322399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:11.322404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:11.322402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.322443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233252:9514]
2025-10-02T09:37:11.322476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3513 reason: error at write: Disconnected sessionId: src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0
2025-10-02T09:37:11.322601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3513 sessionId: src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0 is DEAD
2025-10-02T09:37:11.322742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:11.322757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Write session will restart in 0.007825s
2025-10-02T09:37:11.322777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Write session: Do CDS request
2025-10-02T09:37:11.322782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.328482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.329748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.329848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.329855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.329861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.329886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.329911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818645828:5416]
2025-10-02T09:37:11.330267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.330434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.330457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.330634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.330664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.330668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.330668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.330669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.330670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.330670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.330671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.330671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.330672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.330672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.330673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.330673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.330676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.330682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.330684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.330687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.330689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.330691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.330693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.330695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.330697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.330699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.330701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.330703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.330706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.330710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.330713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.330716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.330718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.330721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.330723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.330726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.330728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.330730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.330733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.330735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.330738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.330741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.330743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.330745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.330747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.330750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.330752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.330755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.330761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.330763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.330765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.330768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.330788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.331164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.331237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.331244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3514
2025-10-02T09:37:11.331362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.331379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.331385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.331387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.331657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3514 sessionId:  describe result for acl check
2025-10-02T09:37:11.331676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.331680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.331681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.331685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.332015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.333490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.337627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.337640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.337642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233325:9359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.337647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.338133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.339653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.339665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.339666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.339668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.339672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3513 [2:7556556145818645828:5416]
2025-10-02T09:37:11.339678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.339691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.339696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.339697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.339698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.339707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.339710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.339714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.339811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.339820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.339821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.339824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.339826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.339867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.339872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.339879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.339884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.339895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.339909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233360:9359], now have 1 active actors on pipe
2025-10-02T09:37:11.339914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233253:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.339918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.339919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.339920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.339931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.339930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3513
2025-10-02T09:37:11.339942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.339947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.339949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.339950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.339947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3513
2025-10-02T09:37:11.339958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.339962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.339986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.339993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.340001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.340010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.340025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.340036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|384665da-91e56fd-e608c03f-d31909c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.340044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.340051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.340053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.340061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.340072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.340092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.340188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.340194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.340205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.340262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3514 partition: 0 MaxSeqNo: 36 sessionId: src_id|384665da-91e56fd-e608c03f-d31909c8_0
2025-10-02T09:37:11.340499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164850e4-a1d7eae4-b95f102c-33e5d1e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|384665da-91e56fd-e608c03f-d31909c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.342843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Write session: try to update token
2025-10-02T09:37:11.342857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.349053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.349063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.349066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.349067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.349070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.349072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.349074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818645823:5416]
2025-10-02T09:37:11.349096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.349103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.349104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.349106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.349107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.349110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.349228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.355459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3514 sessionId: src_id|384665da-91e56fd-e608c03f-d31909c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.357734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.422492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233382:9514]
2025-10-02T09:37:11.422658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3513, pipe: [1:7556556145894233382:9514]
2025-10-02T09:37:11.457753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.457982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.457991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.458002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233382:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.458133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233382:9514]
2025-10-02T09:37:11.458152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:11.458154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:11.458197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3514 reason: error at write: Disconnected sessionId: src_id|384665da-91e56fd-e608c03f-d31909c8_0
2025-10-02T09:37:11.458206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.458197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.458317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3514 sessionId: src_id|384665da-91e56fd-e608c03f-d31909c8_0 is DEAD
2025-10-02T09:37:11.458460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:11.458473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Write session will restart in 0.005111s
2025-10-02T09:37:11.458493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Write session: Do CDS request
2025-10-02T09:37:11.458499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.464167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.464257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.464265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3515
2025-10-02T09:37:11.464448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.464467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.464473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.464475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.464719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.464837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3515 sessionId:  describe result for acl check
2025-10-02T09:37:11.464875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.464882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.464884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.464888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.465333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.465820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.465926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.465932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.465937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.465963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.465986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818645938:5425]
2025-10-02T09:37:11.466354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.466535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.466561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.466743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.466775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.466780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.466781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.466782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.466783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.466784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.466784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.466785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.466786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.466787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.466788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.466789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.466793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.466801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.466803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.466805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.466807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.466809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.466811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.466813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.466815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.466817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.466819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.466821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.466825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.466829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.466832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.466834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.466837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.466839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.466841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.466843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.466846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.466848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.466851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.466853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.466856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.466858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.466861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.466863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.466865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.466868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.466870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.466872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.466875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.466877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.466879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.466881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.466899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.467006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.471725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.471736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.471738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233451:9340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.471742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.474352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.475709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.475721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.475722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.475725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.475728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3514 [2:7556556145818645938:5425]
2025-10-02T09:37:11.475734Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.475744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.475745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.475747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.475748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.475757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.475760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.475764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.475796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.475802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.475803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.475805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.475808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.475857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.475863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.475872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.475885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.475902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.475921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233383:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.475927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233489:9340], now have 1 active actors on pipe
2025-10-02T09:37:11.475931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.475932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.475933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.475944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.475944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3514
2025-10-02T09:37:11.475957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.475961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.475964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.475965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.475957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3514
2025-10-02T09:37:11.475972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.475975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.475995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.476004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.476015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.476019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.476021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.476058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.476068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.476071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.476072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.476079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.476090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.476106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.476201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.476208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.476218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.476277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3515 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0
2025-10-02T09:37:11.476499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384665da-91e56fd-e608c03f-d31909c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.479355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Write session: try to update token
2025-10-02T09:37:11.479367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.485350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.485362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.485364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.485365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.485371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.485374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.485376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818645932:5425]
2025-10-02T09:37:11.485401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.485410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.485412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.485415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.485416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.485419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.485537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.491484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3515 sessionId: src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.493755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.558169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233497:9514]
2025-10-02T09:37:11.558339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3514, pipe: [1:7556556145894233497:9514]
2025-10-02T09:37:11.595521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.595828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.595838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.595850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233497:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.595997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.595994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.596014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:11.596017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:11.596027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233497:9514]
2025-10-02T09:37:11.596081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3515 reason: error at write: Disconnected sessionId: src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0
2025-10-02T09:37:11.596168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3515 sessionId: src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0 is DEAD
2025-10-02T09:37:11.596266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:11.596277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Write session will restart in 0.005019s
2025-10-02T09:37:11.596298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Write session: Do CDS request
2025-10-02T09:37:11.596303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.602088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.602129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.602137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3516
2025-10-02T09:37:11.602211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.602231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.602237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.602240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.602552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3516 sessionId:  describe result for acl check
2025-10-02T09:37:11.602574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.602582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.602588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.602589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.602593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.603017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.603715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.603817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.603824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.603830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.603857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.603883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818646046:5437]
2025-10-02T09:37:11.604266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.604422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.604447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.604632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.604665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.604669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.604669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.604670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.604670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.604671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.604671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.604672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.604672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.604673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.604674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.604674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.604677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.604683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.604685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.604687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.604689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.604691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.604693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.604695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.604697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.604699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.604701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.604703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.604707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.604711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.604714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.604717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.604720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.604722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.604724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.604727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.604729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.604732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.604734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.604737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.604740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.604742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.604744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.604747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.604750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.604754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.604739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.604758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.604764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.604769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.604778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.604781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.604785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.604814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.609554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.609564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.609566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233573:9315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.609571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.612176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.613740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.613752Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.613754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.613756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.613760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3515 [2:7556556145818646046:5437]
2025-10-02T09:37:11.613768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.613778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.613785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.613787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.613788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.613797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.613803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.613807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.613838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.613843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.613844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.613845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.613846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.613884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.613889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.613896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.613901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.613911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.613927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233504:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.613932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233613:9315], now have 1 active actors on pipe
2025-10-02T09:37:11.613935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.613936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.613938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.613947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.613958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.613961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.613965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.613966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.613974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.613959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3515
2025-10-02T09:37:11.613978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3515
2025-10-02T09:37:11.613976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.614004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.614009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.614017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.614025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.614032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.614041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1602f86-c23f1d96-c09de726-f733019_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.614048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.614050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.614051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.614057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.614065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.614077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.614183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.614188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.614196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.614271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3516 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1602f86-c23f1d96-c09de726-f733019_0
2025-10-02T09:37:11.614515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9838e8b-8b7ee9d3-6e65d9c5-cdd1c919_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1602f86-c23f1d96-c09de726-f733019_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.617094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Write session: try to update token
2025-10-02T09:37:11.617108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.623125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.623136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.623137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.623138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.623141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.623144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.623146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818646041:5437]
2025-10-02T09:37:11.623165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.623170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.623171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.623172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.623173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.623175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.623308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.629267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3516 sessionId: src_id|b1602f86-c23f1d96-c09de726-f733019_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.631490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.696425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233621:9514]
2025-10-02T09:37:11.696643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3515, pipe: [1:7556556145894233621:9514]
2025-10-02T09:37:11.734212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.734455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.734464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.734476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233621:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.734615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.734650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233621:9514]
2025-10-02T09:37:11.734670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.734685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:11.734815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3516 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1602f86-c23f1d96-c09de726-f733019_0
2025-10-02T09:37:11.734967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3516 sessionId: src_id|b1602f86-c23f1d96-c09de726-f733019_0 is DEAD
2025-10-02T09:37:11.735094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:11.735107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Write session will restart in 0.009060s
2025-10-02T09:37:11.735134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Write session: Do CDS request
2025-10-02T09:37:11.735141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.740959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.742073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.742171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.742178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.742183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.742207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.742233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818646155:5436]
2025-10-02T09:37:11.742575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.742730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.742752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.742925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.742952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.742956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.742957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.742957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.742958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.742958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.742959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.742959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.742960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.742960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.742961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.742961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.742964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.742970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.742972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.742974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.742976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.742978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.742980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.742982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.742984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.742987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.742988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.742991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.742994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.742998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.743001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.743004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.743008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.743010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.743016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.743019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.743021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.743024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.743026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.743028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.743034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.743037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.743039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.743042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.743047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.743050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.743052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.743055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.743060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.743064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.743069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.743072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.743089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.745135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.745257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.745269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3517
2025-10-02T09:37:11.745360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.745383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.745392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.745395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.745724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3517 sessionId:  describe result for acl check
2025-10-02T09:37:11.745750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.745756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.745758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.745762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.746194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.747623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.749940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.749954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.749957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233697:9309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.749966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.750497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.752031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.752042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.752043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.752045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.752048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3516 [2:7556556145818646155:5436]
2025-10-02T09:37:11.752055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.752065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.752070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.752071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.752072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.752081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.752084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.752088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.752122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.752127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.752128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.752131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.752132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.752167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.752173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.752179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.752185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.752193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.752208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233622:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.752213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233736:9309], now have 1 active actors on pipe
2025-10-02T09:37:11.752217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.752218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.752220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.752227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.752235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.752237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.752237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.752238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.752245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.752246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.752261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.752254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3516
2025-10-02T09:37:11.752268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.752272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.752267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3516
2025-10-02T09:37:11.752300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.752305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.752318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.752325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.752327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.752328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.752333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.752340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.752348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.752466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.752473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.752482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.752551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3517 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0
2025-10-02T09:37:11.752768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1602f86-c23f1d96-c09de726-f733019_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.755011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Write session: try to update token
2025-10-02T09:37:11.755027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.761271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.761283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.761284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.761287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.761291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.761293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.761295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818646150:5436]
2025-10-02T09:37:11.761313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.761314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.761316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.761317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.761320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.761323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.761422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.766854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3517 sessionId: src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.769098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.834670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233743:9514]
2025-10-02T09:37:11.834892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3516, pipe: [1:7556556145894233743:9514]
2025-10-02T09:37:11.871107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:11.871372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.871381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.871394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233743:9514], now have 1 active actors on pipe
2025-10-02T09:37:11.871555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:11.871590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:11.871635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:11.871640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233743:9514]
2025-10-02T09:37:11.871730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3517 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0
2025-10-02T09:37:11.871882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3517 sessionId: src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0 is DEAD
2025-10-02T09:37:11.872027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:11.872040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Write session will restart in 0.007084s
2025-10-02T09:37:11.872059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Write session: Do CDS request
2025-10-02T09:37:11.872064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:11.878219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:11.879410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:11.879526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:11.879532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:11.879538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:11.879565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:11.879594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556145818646264:5444]
2025-10-02T09:37:11.879970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:11.880151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:11.880179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:11.880291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.880362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:11.880376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:11.880371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3518
2025-10-02T09:37:11.880409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.880413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.880414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.880414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.880415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.880416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.880416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.880417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.880417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.880418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.880419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.880419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.880422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.880429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.880431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.880433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.880435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.880437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.880439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.880441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.880443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.880445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.880447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.880449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.880453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.880457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:11.880462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.880467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:11.880472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.880476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:11.880480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.880484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:11.880488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.880487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:11.880496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:11.880499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.880502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:11.880504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.880507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:11.880507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:11.880509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.880511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:11.880513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.880516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:11.880513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:11.880518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.880516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:11.880520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.880522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.880525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.880527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.880530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.880552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:11.880910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3518 sessionId:  describe result for acl check
2025-10-02T09:37:11.880948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:11.880955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:11.880956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:11.880961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:11.881472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:11.883263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:11.887644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:11.887655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:11.887658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556145894233820:9300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:11.887664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:11.888215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:11.889710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:11.889724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:11.889725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:11.889727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:11.889731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3517 [2:7556556145818646264:5444]
2025-10-02T09:37:11.889739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:11.889749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:11.889754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.889755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.889756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.889765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:11.889768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:11.889772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:11.889808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.889813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.889814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.889816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:11.889818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:11.889856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:11.889861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.889868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:11.889874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:11.889884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:11.889899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233744:2446], now have 1 active actors on pipe
2025-10-02T09:37:11.889905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233856:9300], now have 1 active actors on pipe
2025-10-02T09:37:11.889909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.889910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.889912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.889920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:11.889929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:11.889933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:11.889935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:11.889937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:11.889937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:11.889939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:11.889934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3517
2025-10-02T09:37:11.889952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3517
2025-10-02T09:37:11.889955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.889960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:11.889961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:11.889977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.889981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.889999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:11.890006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:11.890009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:11.890010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:11.890014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:11.890022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:11.890032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.890119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:11.890124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:11.890132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:11.890185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3518 partition: 0 MaxSeqNo: 36 sessionId: src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0
2025-10-02T09:37:11.890406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb529e40-cf5f0c69-7bdbee01-59e10b3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:11.892776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Write session: try to update token
2025-10-02T09:37:11.892791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:11.899229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:11.899239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:11.899241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:11.899242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:11.899245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.899247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.899249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556145818646259:5444]
2025-10-02T09:37:11.899268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:11.899269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:11.899272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:11.899274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:11.899274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:11.899276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:11.899386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:11.904884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3518 sessionId: src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:11.907155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:11.971860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556145894233870:9514]
2025-10-02T09:37:11.971998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3517, pipe: [1:7556556145894233870:9514]
2025-10-02T09:37:12.009000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.009279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.009287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.009298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556145894233870:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.009409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.009419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.009426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556145894233870:9514]
2025-10-02T09:37:12.009448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.009517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3518 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0
2025-10-02T09:37:12.009678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3518 sessionId: src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0 is DEAD
2025-10-02T09:37:12.009817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.009822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Write session will restart in 0.009159s
2025-10-02T09:37:12.009841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Write session: Do CDS request
2025-10-02T09:37:12.009845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.016045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.017382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.017536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.017545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.017552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.017584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.017610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113613707:5487]
2025-10-02T09:37:12.017968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.018150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.018173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.018356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.018385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.018390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.018390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.018391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.018392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.018392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.018394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.018395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.018395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.018396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.018396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.018397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.018400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.018406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.018408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.018412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.018415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.018418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.018422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.018425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.018428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.018432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.018435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.018441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.018446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.018451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.018455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.018458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.018460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.018462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.018465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.018467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.018469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.018474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.018476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.018478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.018481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.018484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.018487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.018489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.018491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.018494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.018496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.018498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.018501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.018503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.018505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.018508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.018526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.020183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.020240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.020252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3519
2025-10-02T09:37:12.020339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.020362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.020370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.020374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.020708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3519 sessionId:  describe result for acl check
2025-10-02T09:37:12.020736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.020742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.020743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.020747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.021145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.022444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.025831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.025844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.025846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201269:9268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.025850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.026357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.027761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.027773Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.027774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.027775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.027779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3518 [2:7556556150113613707:5487]
2025-10-02T09:37:12.027788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.027798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.027804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.027806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.027807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.027817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.027820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.027826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.027858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.027863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.027864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.027866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.027867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.027904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.027909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.027917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.027922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.027933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.027948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201189:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.027953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201304:9268], now have 1 active actors on pipe
2025-10-02T09:37:12.027956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.027958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.027959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.027966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.027975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.027980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.027982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.027983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.027984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.027985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.027977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3518
2025-10-02T09:37:12.027979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3518
2025-10-02T09:37:12.028000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.028005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.028006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.028018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.028023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.028048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.028055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.028059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.028061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.028066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.028071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.028083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.028186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.028192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.028200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.028258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3519 partition: 0 MaxSeqNo: 36 sessionId: src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0
2025-10-02T09:37:12.028449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d671a1-d01d57f6-2d08c93c-332259d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.030823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Write session: try to update token
2025-10-02T09:37:12.030837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.037623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.037638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.037640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.037641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.037647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.037651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.037653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113613702:5487]
2025-10-02T09:37:12.037673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.037673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.037676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.037676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.037677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.037679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.037848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.043342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3519 sessionId: src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.045576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.109618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201312:9514]
2025-10-02T09:37:12.109795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3518, pipe: [1:7556556150189201312:9514]
2025-10-02T09:37:12.147193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.147447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.147457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.147474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201312:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.147619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.147701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.147707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.147797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0
2025-10-02T09:37:12.147894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201312:9514]
2025-10-02T09:37:12.147962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3519 sessionId: src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0 is DEAD
2025-10-02T09:37:12.148115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.148128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Write session will restart in 0.009806s
2025-10-02T09:37:12.148148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Write session: Do CDS request
2025-10-02T09:37:12.148154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.154190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.155484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.155602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.155609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.155614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.155642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.155667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113613819:5496]
2025-10-02T09:37:12.156015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.156215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.156254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.156573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.156609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.156613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.156614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.156614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.156615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.156615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.156616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.156617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.156617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.156618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.156619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.156620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.156623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.156630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.156632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.156634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.156636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.156638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.156640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.156642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.156644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.156647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.156649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.156651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.156655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.156659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.156662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.156665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.156668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.156671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.156673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.156676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.156678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.156681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.156684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.156686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.156689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.156691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.156694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.156697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.156701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.156703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.156706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.156709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.156712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.156714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.156716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.156719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.156738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.159217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.159291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.159306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3520
2025-10-02T09:37:12.159459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.159487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.159491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.159494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.159834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3520 sessionId:  describe result for acl check
2025-10-02T09:37:12.159862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.159870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.159871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.159875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.160306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.161847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.163905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.163917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.163920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201392:9260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.163924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.164487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.166060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.166071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.166072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.166074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.166078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3519 [2:7556556150113613819:5496]
2025-10-02T09:37:12.166085Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.166094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.166096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.166097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.166098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.166108Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.166111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.166119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.166152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.166157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.166157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.166159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.166160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.166199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.166204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.166210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.166216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.166224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.166238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201426:9260], now have 1 active actors on pipe
2025-10-02T09:37:12.166244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201313:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.166247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.166248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.166250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.166257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.166265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.166271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.166273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.166274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.166275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.166278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.166280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3519
2025-10-02T09:37:12.166292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.166297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.166298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.166287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3519
2025-10-02T09:37:12.166311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.166316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.166337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14fe11a3-3af49785-efbdff36-332b332_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.166344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.166346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.166347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.166352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.166358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.166410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.166527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.166532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.166539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.166601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3520 partition: 0 MaxSeqNo: 36 sessionId: src_id|14fe11a3-3af49785-efbdff36-332b332_0
2025-10-02T09:37:12.166821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbeb8495-2cdd0a7c-6b9d5140-10c290f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14fe11a3-3af49785-efbdff36-332b332_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.169265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Write session: try to update token
2025-10-02T09:37:12.169280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.175709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.175725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.175727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.175728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.175734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.175737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.175740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113613814:5496]
2025-10-02T09:37:12.175764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.175767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.175770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.175773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.175773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.175775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.175883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.181227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3520 sessionId: src_id|14fe11a3-3af49785-efbdff36-332b332_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.183497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.247868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201433:9514]
2025-10-02T09:37:12.248053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3519, pipe: [1:7556556150189201433:9514]
2025-10-02T09:37:12.286533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.286760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.286769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.286781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201433:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.286933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.287000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201433:9514]
2025-10-02T09:37:12.287005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.287031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.287089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14fe11a3-3af49785-efbdff36-332b332_0
2025-10-02T09:37:12.287273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3520 sessionId: src_id|14fe11a3-3af49785-efbdff36-332b332_0 is DEAD
2025-10-02T09:37:12.287367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.287379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Write session will restart in 0.006208s
2025-10-02T09:37:12.287402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Write session: Do CDS request
2025-10-02T09:37:12.287406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.293891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.294154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.294347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.294358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3521
2025-10-02T09:37:12.294463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.294488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.294498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.294501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.294842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3521 sessionId:  describe result for acl check
2025-10-02T09:37:12.294871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.294878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.294879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.294883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.295191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.295295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.295301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.295307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.295321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.295332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.295359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113613933:5498]
2025-10-02T09:37:12.295713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.295881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.295904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.296091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.296121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.296125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.296126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.296126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.296127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.296127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.296128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.296128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.296129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.296129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.296130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.296130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.296133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.296140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.296142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.296144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.296146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.296148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.296150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.296152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.296154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.296156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.296158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.296160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.296165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.296168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.296171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.296174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.296177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.296179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.296181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.296184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.296186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.296189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.296191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.296194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.296196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.296199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.296201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.296203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.296205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.296208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.296211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.296214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.296216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.296218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.296221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.296223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.296251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.296965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.302205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.302218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.302222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201510:9251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.302227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.303911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.305397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.305409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.305410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.305412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.305416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3520 [2:7556556150113613933:5498]
2025-10-02T09:37:12.305423Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.305435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.305439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.305442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.305443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.305452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.305458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.305462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.305500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.305505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.305505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.305507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.305509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.305555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.305562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.305573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.305586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.305603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.305622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201435:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.305627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201548:9251], now have 1 active actors on pipe
2025-10-02T09:37:12.305631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.305632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.305633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.305642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.305656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.305658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.305660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.305662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.305672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.305678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.305665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3520
2025-10-02T09:37:12.305670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3520
2025-10-02T09:37:12.305695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.305701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.305702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.305715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.305722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.305755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|730f419f-52e2898c-1ea3d037-cb21682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.305764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.305771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.305776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.305783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.305793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.305809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.305917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.305927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.305941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.306020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3521 partition: 0 MaxSeqNo: 36 sessionId: src_id|730f419f-52e2898c-1ea3d037-cb21682_0
2025-10-02T09:37:12.306258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fe11a3-3af49785-efbdff36-332b332_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|730f419f-52e2898c-1ea3d037-cb21682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.308982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Write session: try to update token
2025-10-02T09:37:12.308992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.315352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.315364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.315365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.315366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.315370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.315372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.315374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113613928:5498]
2025-10-02T09:37:12.315397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.315399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.315400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.315401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.315403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.315405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.315552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.320892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3521 sessionId: src_id|730f419f-52e2898c-1ea3d037-cb21682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.323178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.387096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201570:9514]
2025-10-02T09:37:12.387257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3520, pipe: [1:7556556150189201570:9514]
2025-10-02T09:37:12.425056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.425403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.425412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.425424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201570:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.425550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.425604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.425624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.425655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201570:9514]
2025-10-02T09:37:12.425704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3521 reason: status is not ok: tablet will be restarted right now sessionId: src_id|730f419f-52e2898c-1ea3d037-cb21682_0
2025-10-02T09:37:12.425860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3521 sessionId: src_id|730f419f-52e2898c-1ea3d037-cb21682_0 is DEAD
2025-10-02T09:37:12.425995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.426006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Write session will restart in 0.007578s
2025-10-02T09:37:12.426026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Write session: Do CDS request
2025-10-02T09:37:12.426031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.432312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.433475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.433573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.433580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.433586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.433634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113614061:5509]
2025-10-02T09:37:12.433976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.434134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.434144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.434156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.434280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.434291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3522
2025-10-02T09:37:12.434334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.434361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.434365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.434365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.434366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.434367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.434367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.434368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.434368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.434369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.434369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.434370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.434370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.434373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.434386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.434380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.434383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.434385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.434387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.434389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.434391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.434393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.434395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.434397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.434399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.434401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.434404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.434408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.434409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.434411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.434418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.434422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.434414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.434416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.434419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.434421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.434423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.434426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.434429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.434431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.434433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.434435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.434437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.434440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.434442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.434444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.434447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.434449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.434451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.434453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.434456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.434458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.434461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.434478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.434752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3522 sessionId:  describe result for acl check
2025-10-02T09:37:12.434778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.434785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.434787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.434791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.435217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.436735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.440901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.440911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.440914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201652:9216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.440918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.442178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.443596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.443608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.443609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.443611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.443614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3521 [2:7556556150113614061:5509]
2025-10-02T09:37:12.443625Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.443635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.443637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.443638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.443639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.443649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.443654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.443658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.443698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.443704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.443705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.443707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.443709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.443748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.443753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.443759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.443765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.443773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.443787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201687:9216], now have 1 active actors on pipe
2025-10-02T09:37:12.443792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201572:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.443796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.443797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.443798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.443806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.443814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.443826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3521
2025-10-02T09:37:12.443831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3521
2025-10-02T09:37:12.443818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.443820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.443821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.443828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.443829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.443844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.443846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.443856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.443910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.443915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.443936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.443943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.443945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.443946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.443951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.443957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.443966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.444063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.444068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.444076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.444133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3522 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0
2025-10-02T09:37:12.444366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730f419f-52e2898c-1ea3d037-cb21682_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.446857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Write session: try to update token
2025-10-02T09:37:12.446870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.453337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.453351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.453353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.453354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.453359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.453363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.453366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113614056:5509]
2025-10-02T09:37:12.453386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.453387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.453390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.453391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.453392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.453395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.453506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.458770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3522 sessionId: src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.460911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.525879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201694:9514]
2025-10-02T09:37:12.526086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3521, pipe: [1:7556556150189201694:9514]
2025-10-02T09:37:12.562780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.562982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.562991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.563018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201694:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.563152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.563200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:12.563211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:12.563292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3522 reason: error at write: Disconnected sessionId: src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0
2025-10-02T09:37:12.563405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.563448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3522 sessionId: src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0 is DEAD
2025-10-02T09:37:12.563466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201694:9514]
2025-10-02T09:37:12.563594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:12.563607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Write session will restart in 0.006838s
2025-10-02T09:37:12.563626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Write session: Do CDS request
2025-10-02T09:37:12.563632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.569956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.571129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.571167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.571229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.571235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.571241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.571265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.571289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113614176:5530]
2025-10-02T09:37:12.571298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.571310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3523
2025-10-02T09:37:12.571408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.571433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.571442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.571446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.571628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.571788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.571786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3523 sessionId:  describe result for acl check
2025-10-02T09:37:12.571812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.571816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.571823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.571825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.571828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.571990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.572019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.572023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.572023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.572024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.572025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.572025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.572026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.572026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.572027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.572027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.572028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.572028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.572031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.572038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.572040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.572042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.572044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.572046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.572048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.572050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.572052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.572054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.572056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.572058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.572062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.572066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.572069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.572072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.572074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.572077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.572080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.572083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.572086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.572088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.572090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.572093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.572095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.572097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.572099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.572102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.572104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.572107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.572109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.572112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.572114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.572117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.572119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.572121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.572138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.572263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.574041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.578586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.578597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.578600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201774:9212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.578604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.579831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.581291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.581302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.581303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.581305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.581309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3522 [2:7556556150113614176:5530]
2025-10-02T09:37:12.581316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.581330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.581335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.581336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.581337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.581348Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.581351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.581357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.581400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.581404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.581405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.581407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.581409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.581447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.581451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.581457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.581466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.581478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.581491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201811:9212], now have 1 active actors on pipe
2025-10-02T09:37:12.581496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201695:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.581500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.581503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.581505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.581512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.581525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.581525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.581527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.581528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.581535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.581537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.581533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3522
2025-10-02T09:37:12.581539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3522
2025-10-02T09:37:12.581551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.581556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.581559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.581587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.581592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.581613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.581620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.581622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.581627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.581633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.581639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.581655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.581759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.581763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.581771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.581832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3523 partition: 0 MaxSeqNo: 36 sessionId: src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0
2025-10-02T09:37:12.582060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fc7332-e483273c-f07a7fbb-eba12487_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.584314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Write session: try to update token
2025-10-02T09:37:12.584326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.591075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.591088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.591090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.591091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.591095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.591097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.591099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113614171:5530]
2025-10-02T09:37:12.591119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.591119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.591132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.591132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.591134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.591136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.591241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.596206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3523 sessionId: src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.598291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.663612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201819:9514]
2025-10-02T09:37:12.663828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3522, pipe: [1:7556556150189201819:9514]
2025-10-02T09:37:12.701529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.701836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.701845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.701871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201819:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.702014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.702070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:12.702078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.702081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:12.702117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201819:9514]
2025-10-02T09:37:12.702169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3523 reason: error at write: Disconnected sessionId: src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0
2025-10-02T09:37:12.702358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3523 sessionId: src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0 is DEAD
2025-10-02T09:37:12.702465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:12.702476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Write session will restart in 0.008340s
2025-10-02T09:37:12.702499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Write session: Do CDS request
2025-10-02T09:37:12.702505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.708974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.710226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.710342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.710349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.710355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.710380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.710406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113614291:5541]
2025-10-02T09:37:12.710753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.710923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.710945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.711135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.711167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.711171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.711171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.711172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.711173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.711173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.711174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.711174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.711175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.711175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.711176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.711177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.711179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.711186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.711189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.711191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.711192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.711195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.711197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.711199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.711201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.711203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.711205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.711207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.711211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.711214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.711217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.711220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.711222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.711225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.711227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.711230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.711232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.711235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.711237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.711239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.711241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.711244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.711246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.711249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.711251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.711254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.711256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.711260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.711262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.711265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.711267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.711269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.711287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.712147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.712269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.712283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3524
2025-10-02T09:37:12.712385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.712411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.712421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.712425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.712762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3524 sessionId:  describe result for acl check
2025-10-02T09:37:12.712790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.712797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.712816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.712821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.713261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.714718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.718452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.718465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.718469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189201902:9194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.718477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.718963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.720489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.720501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.720503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.720505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.720508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3523 [2:7556556150113614291:5541]
2025-10-02T09:37:12.720516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.720527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.720530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.720531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.720533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.720542Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.720546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.720551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.720584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.720589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.720590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.720592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.720593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.720631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.720635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.720642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.720647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.720657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.720672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201937:9194], now have 1 active actors on pipe
2025-10-02T09:37:12.720677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201820:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.720680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.720682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.720683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.720689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.720697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.720700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.720702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.720703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.720707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.720709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.720724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.720719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3523
2025-10-02T09:37:12.720724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3523
2025-10-02T09:37:12.720732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.720746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.720774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.720779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.720794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.720816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.720820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.720821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.720826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.720833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.720842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.720967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.720979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.720997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.721066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3524 partition: 0 MaxSeqNo: 36 sessionId: src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0
2025-10-02T09:37:12.721288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25c02ef-a33ee431-19ed9fb2-680c513c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.723574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Write session: try to update token
2025-10-02T09:37:12.723586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.730153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.730164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.730165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.730166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.730170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.730172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.730174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113614286:5541]
2025-10-02T09:37:12.730193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.730194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.730197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.730197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.730198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.730199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.730315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.735241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3524 sessionId: src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.737482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.802372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189201945:9514]
2025-10-02T09:37:12.802566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3523, pipe: [1:7556556150189201945:9514]
2025-10-02T09:37:12.838349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.838583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.838593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.838619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201945:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.838751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.838812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.838836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189201945:9514]
2025-10-02T09:37:12.838861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.838951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0
2025-10-02T09:37:12.839100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3524 sessionId: src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0 is DEAD
2025-10-02T09:37:12.839244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.839256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Write session will restart in 0.006038s
2025-10-02T09:37:12.839277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Write session: Do CDS request
2025-10-02T09:37:12.839282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.845283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.846132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.846229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.846241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3525
2025-10-02T09:37:12.846330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.846355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.846364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.846367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.846474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.846575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.846582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.846588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.846614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.846640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113614408:5542]
2025-10-02T09:37:12.846702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3525 sessionId:  describe result for acl check
2025-10-02T09:37:12.846733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.846740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.846741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.846745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.846985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.847157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.847180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.847232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.847356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.847386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.847390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.847391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.847391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.847392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.847393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.847393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.847394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.847394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.847395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.847396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.847396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.847399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.847405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.847407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.847409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.847411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.847413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.847415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.847417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.847419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.847421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.847423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.847424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.847428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.847432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.847435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.847438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.847440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.847442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.847444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.847447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.847450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.847453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.847455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.847458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.847461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.847464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.847466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.847469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.847471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.847473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.847475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.847478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.847483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.847486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.847488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.847491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.847511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.848933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.852962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.852976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.852978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189202025:9186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.852984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.855154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.856656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.856669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.856670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.856672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.856676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3524 [2:7556556150113614408:5542]
2025-10-02T09:37:12.856685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.856695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.856703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.856704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.856705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.856715Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.856717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.856722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.856755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.856760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.856761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.856762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.856764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.856813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.856818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.856826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.856832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.856844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.856858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189201946:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.856864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189202064:9186], now have 1 active actors on pipe
2025-10-02T09:37:12.856867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.856868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.856869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.856872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3524
2025-10-02T09:37:12.856887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3524
2025-10-02T09:37:12.856878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.856885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.856887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.856888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.856891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.856899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.856900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.856924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.856928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.856935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.856941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.856948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.856958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd96fbc5-45a19023-d15c9f77-392def70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.856965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.856967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.856968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.856975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.856980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.856992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.857092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.857097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.857105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.857169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3525 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd96fbc5-45a19023-d15c9f77-392def70_0
2025-10-02T09:37:12.857408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b148e-5f740647-fb6e12ae-4534bcdf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd96fbc5-45a19023-d15c9f77-392def70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.859693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Write session: try to update token
2025-10-02T09:37:12.859707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:12.866203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:12.866219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:12.866221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:12.866222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:12.866228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.866234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.866236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113614403:5542]
2025-10-02T09:37:12.866256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:12.866258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:12.866261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:12.866262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.866263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:12.866263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:12.866385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:12.871703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3525 sessionId: src_id|bd96fbc5-45a19023-d15c9f77-392def70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:12.873975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:12.939050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556150189202075:9514]
2025-10-02T09:37:12.939255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3524, pipe: [1:7556556150189202075:9514]
2025-10-02T09:37:12.973856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:12.974191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.974202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.974213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189202075:9514], now have 1 active actors on pipe
2025-10-02T09:37:12.974321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:12.974387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:12.974439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:12.974446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556150189202075:9514]
2025-10-02T09:37:12.974536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3525 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd96fbc5-45a19023-d15c9f77-392def70_0
2025-10-02T09:37:12.974692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3525 sessionId: src_id|bd96fbc5-45a19023-d15c9f77-392def70_0 is DEAD
2025-10-02T09:37:12.974838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:12.974852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Write session will restart in 0.008612s
2025-10-02T09:37:12.974873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Write session: Do CDS request
2025-10-02T09:37:12.974879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:12.981076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:12.982279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:12.982377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:12.982383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:12.982389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:12.982414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:12.982436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556150113614555:5572]
2025-10-02T09:37:12.982779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:12.982936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:12.982957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:12.983140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:12.983167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.983171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.983172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.983172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.983173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.983173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.983174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.983175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.983176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.983176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.983177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.983178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.983208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.983216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.983220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.983222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.983224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.983226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.983228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.983230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.983232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.983235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.983238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.983240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.983244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.983248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:12.983255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.983257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:12.983261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.983265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:12.983267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.983270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:12.983272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.983274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:12.983276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.983279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:12.983281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.983284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:12.983286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.983292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:12.983295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.983298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:12.983299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.983302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.983304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.983307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.983310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.983313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.983328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:12.984145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.984220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:12.984235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3526
2025-10-02T09:37:12.984321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:12.984344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:12.984353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:12.984357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:12.984704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3526 sessionId:  describe result for acl check
2025-10-02T09:37:12.984735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:12.984741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:12.984743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:12.984747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:12.985155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:12.986493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:12.990461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:12.990472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:12.990474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556150189202165:9159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:12.990479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:12.990995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:12.992412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:12.992423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:12.992424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:12.992426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:12.992429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3525 [2:7556556150113614555:5572]
2025-10-02T09:37:12.992436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:12.992445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:12.992451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.992452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.992453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.992462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:12.992466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:12.992471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:12.992503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.992508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.992509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.992511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:12.992512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:12.992548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:12.992553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:12.992559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:12.992564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:12.992575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:12.992588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189202197:9159], now have 1 active actors on pipe
2025-10-02T09:37:12.992594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556150189202078:2446], now have 1 active actors on pipe
2025-10-02T09:37:12.992598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:12.992599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:12.992600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:12.992607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:12.992616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:12.992620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:12.992622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:12.992623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:12.992628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:12.992629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:12.992628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3525
2025-10-02T09:37:12.992634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3525
2025-10-02T09:37:12.992643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:12.992649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:12.992654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:12.992666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.992670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.992689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:12.992695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:12.992697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:12.992699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:12.992704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:12.992711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:12.992720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.992814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:12.992819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:12.992826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:12.992877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3526 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0
2025-10-02T09:37:12.993074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd96fbc5-45a19023-d15c9f77-392def70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:12.995309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Write session: try to update token
2025-10-02T09:37:12.995319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.002075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.002088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.002090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.002092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.002097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:13.002100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:13.002105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556150113614549:5572]
2025-10-02T09:37:13.002127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.002130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.002133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.002134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.002135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.002136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.002888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.009037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3526 sessionId: src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.011327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.074741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484169525:9514]
2025-10-02T09:37:13.074915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3525, pipe: [1:7556556154484169525:9514]
2025-10-02T09:37:13.112510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.112744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.112752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.112765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169525:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.112933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.112981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.112986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:13.112991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:13.113042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484169525:9514]
2025-10-02T09:37:13.113067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3526 reason: error at write: Disconnected sessionId: src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0
2025-10-02T09:37:13.113237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3526 sessionId: src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0 is DEAD
2025-10-02T09:37:13.113394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:13.113405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Write session will restart in 0.008750s
2025-10-02T09:37:13.113429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Write session: Do CDS request
2025-10-02T09:37:13.113435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.119582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.120767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.120907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.120915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.120921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.120954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.120979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408581976:5587]
2025-10-02T09:37:13.121352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.121532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.121555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.121745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.121780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.121784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.121784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.121786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.121787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.121787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.121788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.121788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.121789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.121789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.121792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.121799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.121801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.121803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.121805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.121808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.121809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.121811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.121813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.121816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.121818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.121820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.121823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.121828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.121833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.121838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.121842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.121847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.121852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.121857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.121860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.121863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.121865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.121868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.121870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.121873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.121875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.121878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.121881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.121884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.121886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.121888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.121891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.121894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.121896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.121899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.121916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.123170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.123830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.123842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3527
2025-10-02T09:37:13.123925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.123949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.123959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.123962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.124312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3527 sessionId:  describe result for acl check
2025-10-02T09:37:13.124344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.124351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.124353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.124357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.124781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.126511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.129128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.129139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.129142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484169612:9131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.129146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.129600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.131138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.131147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.131148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.131150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.131154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3526 [2:7556556154408581976:5587]
2025-10-02T09:37:13.131160Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.131170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.131175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.131177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.131178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.131186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.131190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.131194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.131230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.131235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.131236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.131238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.131240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.131276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.131281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.131288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.131293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.131301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.131313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169527:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.131319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169647:9131], now have 1 active actors on pipe
2025-10-02T09:37:13.131323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.131325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.131326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.131333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.131343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.131345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.131347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.131348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.131354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.131355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.131371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.131376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.131377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.131369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3526
2025-10-02T09:37:13.131380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3526
2025-10-02T09:37:13.131398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.131403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.131417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.131426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.131430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.131431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.131436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.131441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.131451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.131572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.131577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.131586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.131645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3527 partition: 0 MaxSeqNo: 36 sessionId: src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0
2025-10-02T09:37:13.131855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ede6877-ef64f2ef-a7347499-754b31a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.134226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Write session: try to update token
2025-10-02T09:37:13.134244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.140841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.140854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.140857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.140858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.140863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.140868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.140872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408581971:5587]
2025-10-02T09:37:13.140898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.140898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.140902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.140904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.140906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.140908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.141020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.146277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3527 sessionId: src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.148605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.212986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484169654:9514]
2025-10-02T09:37:13.213186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3526, pipe: [1:7556556154484169654:9514]
2025-10-02T09:37:13.249722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.249988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.249996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.250009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169654:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.250138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.250172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.250201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484169654:9514]
2025-10-02T09:37:13.250225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:13.250312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3527 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0
2025-10-02T09:37:13.250466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3527 sessionId: src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0 is DEAD
2025-10-02T09:37:13.250603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:13.250614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Write session will restart in 0.007806s
2025-10-02T09:37:13.250634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Write session: Do CDS request
2025-10-02T09:37:13.250639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.256848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.258089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.258195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.258201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.258207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.258235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.258259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582098:5593]
2025-10-02T09:37:13.258610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.258770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.258792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.258968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.258996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.259000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.259001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.259001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.259002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.259002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.259003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.259003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.259004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.259005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.259005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.259006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.259009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.259016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.259018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.259020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.259022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.259024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.259026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.259028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.259030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.259032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.259033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.259035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.259039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.259043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.259046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.259049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.259052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.259054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.259057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.259059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.259062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.259069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.259071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.259073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.259076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.259079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.259081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.259084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.259086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.259090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.259092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.259095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.259097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.259099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.259101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.259104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.259108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.259120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.259212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.259224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3528
2025-10-02T09:37:13.259332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.259355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.259364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.259367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.259723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3528 sessionId:  describe result for acl check
2025-10-02T09:37:13.259757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.259763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.259765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.259769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.260243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.261574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.265602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.265614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.265616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484169742:9121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.265621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.266855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.268334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.268346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.268347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.268349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.268353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3527 [2:7556556154408582098:5593]
2025-10-02T09:37:13.268360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.268372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.268377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.268379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.268380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.268390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.268393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.268397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.268429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.268434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.268436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.268438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.268439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.268477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.268482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.268489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.268494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.268502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.268515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169777:9121], now have 1 active actors on pipe
2025-10-02T09:37:13.268521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169655:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.268525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.268526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.268527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.268534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.268545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.268551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.268553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.268554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.268556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.268558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.268572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.268577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.268582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.268576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3527
2025-10-02T09:37:13.268576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3527
2025-10-02T09:37:13.268599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.268604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.268622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.268629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.268631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.268632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.268637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.268643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.268655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.268773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.268778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.268785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.268847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3528 partition: 0 MaxSeqNo: 36 sessionId: src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0
2025-10-02T09:37:13.269056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a519e5-5da76b5e-d3b97770-a82d2dec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.271384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Write session: try to update token
2025-10-02T09:37:13.271396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.278096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.278109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.278111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.278115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.278121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.278124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.278127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582093:5593]
2025-10-02T09:37:13.278150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.278153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.278156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.278157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.278157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.278159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.278265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.283895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3528 sessionId: src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.286024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.350167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484169786:9514]
2025-10-02T09:37:13.350360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3527, pipe: [1:7556556154484169786:9514]
2025-10-02T09:37:13.385956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.386237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.386247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.386259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169786:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.386376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.386378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:13.386388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:13.386404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484169786:9514]
2025-10-02T09:37:13.386440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3528 reason: error at write: Disconnected sessionId: src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0
2025-10-02T09:37:13.386484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.386589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3528 sessionId: src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0 is DEAD
2025-10-02T09:37:13.386712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:13.386724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Write session will restart in 0.005878s
2025-10-02T09:37:13.386743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Write session: Do CDS request
2025-10-02T09:37:13.386747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.393088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.393183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.393193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3529
2025-10-02T09:37:13.393279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.393302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.393311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.393314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.393646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3529 sessionId:  describe result for acl check
2025-10-02T09:37:13.393677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.393680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.393681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.393685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.394017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.394040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.395212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.395313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.395320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.395326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.395351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.395380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582231:5595]
2025-10-02T09:37:13.395731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.395780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.395887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.395909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.396099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.396132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.396136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.396137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.396137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.396138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.396139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.396139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.396140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.396140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.396141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.396141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.396142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.396145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.396152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.396154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.396156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.396157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.396159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.396161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.396163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.396165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.396169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.396171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.396173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.396177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.396181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.396184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.396187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.396189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.396192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.396194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.396197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.396199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.396201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.396204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.396206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.396208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.396211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.396213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.396216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.396218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.396222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.396224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.396227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.396229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.396232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.396235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.396238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.396254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.400047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.400057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.400059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484169880:9110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.400064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.403717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.405404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.405415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.405416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.405419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.405422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3528 [2:7556556154408582231:5595]
2025-10-02T09:37:13.405430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.405441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.405443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.405445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.405446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.405456Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.405461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.405470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.405502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.405506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.405508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.405510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.405511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.405551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.405556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.405562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.405567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.405575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.405590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169799:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.405596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169921:9110], now have 1 active actors on pipe
2025-10-02T09:37:13.405600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.405601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.405602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.405610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.405620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.405627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.405630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.405630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.405631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.405632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.405651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.405661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.405657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3528
2025-10-02T09:37:13.405665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3528
2025-10-02T09:37:13.405675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.405699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.405704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.405718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffd68d05-6971c632-cf623d46-42369e76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.405725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.405730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.405731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.405736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.405744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.405753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.405872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.405877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.405884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.405945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3529 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffd68d05-6971c632-cf623d46-42369e76_0
2025-10-02T09:37:13.406168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a1bc5-faaa7f4d-56c86769-77ec95f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffd68d05-6971c632-cf623d46-42369e76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.408441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Write session: try to update token
2025-10-02T09:37:13.408456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.414911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.414922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.414923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.414924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.414928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.414931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.414933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582225:5595]
2025-10-02T09:37:13.414953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.414955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.414956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.414957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.414959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.414959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.415070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.420587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3529 sessionId: src_id|ffd68d05-6971c632-cf623d46-42369e76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.422765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.486392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484169929:9514]
2025-10-02T09:37:13.486574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3528, pipe: [1:7556556154484169929:9514]
2025-10-02T09:37:13.526614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.526864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.526873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.526885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169929:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.527032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.527112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.527120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:13.527180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484169929:9514]
2025-10-02T09:37:13.527225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3529 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffd68d05-6971c632-cf623d46-42369e76_0
2025-10-02T09:37:13.527378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3529 sessionId: src_id|ffd68d05-6971c632-cf623d46-42369e76_0 is DEAD
2025-10-02T09:37:13.527532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:13.527547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Write session will restart in 0.007073s
2025-10-02T09:37:13.527569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Write session: Do CDS request
2025-10-02T09:37:13.527574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.533689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.534831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.534948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.534955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.534960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.534987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.535014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582354:5603]
2025-10-02T09:37:13.535151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.535248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.535259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3530
2025-10-02T09:37:13.535351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.535367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.535375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.535384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.535387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.535524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.535547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.535685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3530 sessionId:  describe result for acl check
2025-10-02T09:37:13.535710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.535717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.535723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.535718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.535722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.535753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.535756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.535757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.535758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.535758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.535760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.535760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.535761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.535761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.535762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.535765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.535771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.535774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.535776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.535778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.535780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.535786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.535788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.535790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.535792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.535796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.535800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.535806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.535809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.535812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.535814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.535817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.535820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.535823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.535825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.535828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.535830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.535832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.535834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.535837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.535842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.535844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.535846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.535849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.535851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.535854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.535856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.535858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.535877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.536134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.537507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.542103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.542113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.542118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484170016:9098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.542123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.543299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.544777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.544788Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.544789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.544791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.544794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3529 [2:7556556154408582354:5603]
2025-10-02T09:37:13.544817Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.544827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.544832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.544834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.544835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.544844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.544847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.544853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.544886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.544893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.544894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.544896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.544897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.544935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.544939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.544946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.544951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.544959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.544972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484169930:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.544978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170053:9098], now have 1 active actors on pipe
2025-10-02T09:37:13.544981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.544982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.544985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.544992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.545003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.545005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.545010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.545012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.545013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.545014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.545026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.545031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.545017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3529
2025-10-02T09:37:13.545021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3529
2025-10-02T09:37:13.545042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.545072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.545077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.545091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d341b882-edb42560-48b04805-f6472d3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.545097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.545099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.545100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.545105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.545112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.545119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.545241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.545253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.545270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.545334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3530 partition: 0 MaxSeqNo: 36 sessionId: src_id|d341b882-edb42560-48b04805-f6472d3c_0
2025-10-02T09:37:13.545541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd68d05-6971c632-cf623d46-42369e76_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d341b882-edb42560-48b04805-f6472d3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.547804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Write session: try to update token
2025-10-02T09:37:13.547817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.558484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:13.558499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.558507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.558534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:13.558545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:13.558705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:13.558834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.558967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.559144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.559320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:13.559346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:13.560195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3530 sessionId: src_id|d341b882-edb42560-48b04805-f6472d3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.562299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.562480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.562494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.562505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.562509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.562510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.562511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.562515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.562517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.562519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582349:5603]
2025-10-02T09:37:13.562536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.562541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.562543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.562545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.562545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.562546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.562648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.627218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484170061:9514]
2025-10-02T09:37:13.627470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3529, pipe: [1:7556556154484170061:9514]
2025-10-02T09:37:13.675923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.676210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:13.676235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170061:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.676386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.676386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:13.676441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484170061:9514]
2025-10-02T09:37:13.676488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:13.676499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:13.676560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3530 reason: error at write: Disconnected sessionId: src_id|d341b882-edb42560-48b04805-f6472d3c_0
2025-10-02T09:37:13.676676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3530 sessionId: src_id|d341b882-edb42560-48b04805-f6472d3c_0 is DEAD
2025-10-02T09:37:13.676843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:13.676867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Write session will restart in 0.008247s
2025-10-02T09:37:13.676887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Write session: Do CDS request
2025-10-02T09:37:13.676893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.683867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.685086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.685184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.685190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.685196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.685223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.685248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582477:5611]
2025-10-02T09:37:13.685591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.685758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.685780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.685955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.685983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.685987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.685988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.685990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.685991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.685991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.685992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.685992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.685993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.685993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.685994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.685994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.685997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.686004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.686006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.686008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.686010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.686011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.686013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.686015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.686017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.686019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.686021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.686023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.686026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.686030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.686033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.686036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.686038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.686040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.686042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.686045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.686047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.686050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.686053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.686056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.686058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.686060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.686063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.686065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.686069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.686071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.686074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.686077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.686079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.686081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.686083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.686085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.686101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.686159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.686268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.686279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3531
2025-10-02T09:37:13.686368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.686392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.686401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.686404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.686716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3531 sessionId:  describe result for acl check
2025-10-02T09:37:13.686745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.686752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.686753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.686757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.687205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.688537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.692929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.692938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.692941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484170151:9083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.692945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.693482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.694888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.694898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.694899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.694902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.694905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3530 [2:7556556154408582477:5611]
2025-10-02T09:37:13.694915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.694925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.694930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.694932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.694933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.694943Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.694946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.694954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.694986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.694991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.694992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.694994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.694995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.695030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.695036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.695043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.695048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.695058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.695071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170186:9083], now have 1 active actors on pipe
2025-10-02T09:37:13.695076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170062:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.695081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.695082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.695083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.695090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.695100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.695103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.695105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.695107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.695111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.695112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.695105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3530
2025-10-02T09:37:13.695114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3530
2025-10-02T09:37:13.695126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.695141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.695144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.695163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.695168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.695185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.695192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.695195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.695196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.695201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.695207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.695216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.695330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.695338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.695346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.695412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3531 partition: 0 MaxSeqNo: 36 sessionId: src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0
2025-10-02T09:37:13.695596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d341b882-edb42560-48b04805-f6472d3c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.697968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Write session: try to update token
2025-10-02T09:37:13.697980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.704261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.704271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.704272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.704273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.704277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.704280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.704282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582472:5611]
2025-10-02T09:37:13.704301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.704304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.704305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.704305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.704308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.704310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.704418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.710194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3531 sessionId: src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.712324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.776714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484170194:9514]
2025-10-02T09:37:13.776956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3530, pipe: [1:7556556154484170194:9514]
2025-10-02T09:37:13.818262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.818493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.818502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.818515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170194:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.818642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.818689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.818704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484170194:9514]
2025-10-02T09:37:13.818739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:13.818869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0
2025-10-02T09:37:13.819015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3531 sessionId: src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0 is DEAD
2025-10-02T09:37:13.819158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:13.819168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Write session will restart in 0.007444s
2025-10-02T09:37:13.819188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Write session: Do CDS request
2025-10-02T09:37:13.819194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.826206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.827155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.827259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.827272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3532
2025-10-02T09:37:13.827367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.827392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.827401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.827404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.827464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.827592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.827600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.827605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.827634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.827660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582601:5622]
2025-10-02T09:37:13.827747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3532 sessionId:  describe result for acl check
2025-10-02T09:37:13.827775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.827782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.827783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.827788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.828013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.828180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.828205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.828383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.828413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.828417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.828418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.828418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.828419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.828419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.828420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.828421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.828421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.828422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.828422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.828423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.828425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.828432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.828434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.828436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.828438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.828440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.828442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.828444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.828446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.828448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.828450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.828452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.828456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.828460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.828463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.828466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.828468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.828471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.828473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.828476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.828478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.828481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.828484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.828488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.828490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.828493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.828497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.828499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.828502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.828505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.828507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.828512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.828515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.828518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.828520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.828522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.828541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.829873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.833756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.833767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.833769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484170281:9078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.833773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.835946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.837513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.837524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.837525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.837528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.837531Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3531 [2:7556556154408582601:5622]
2025-10-02T09:37:13.837540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.837551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.837552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.837554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.837555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.837564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.837567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.837571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.837604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.837609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.837611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.837612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.837614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.837652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.837656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.837663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.837668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.837676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.837689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.837694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.837695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.837700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.837707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.837709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.837715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.837716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.837716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.837717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.837724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170319:9078], now have 1 active actors on pipe
2025-10-02T09:37:13.837727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170195:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.837740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.837748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.837762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.837763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3531
2025-10-02T09:37:13.837776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3531
2025-10-02T09:37:13.837823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.837829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.837847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.837854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.837856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.837857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.837862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.837868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.837875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.838001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.838005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.838013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.838080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3532 partition: 0 MaxSeqNo: 36 sessionId: src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0
2025-10-02T09:37:13.838284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1625397-154623d8-a5e4b81d-5fb21f5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.840516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Write session: try to update token
2025-10-02T09:37:13.840528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.846909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.846919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.846920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.846921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.846925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.846929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.846931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582596:5622]
2025-10-02T09:37:13.846951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.846954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.846956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.846956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.846959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.846961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.847095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:13.852643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3532 sessionId: src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.854883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.919039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556154484170327:9514]
2025-10-02T09:37:13.919227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3531, pipe: [1:7556556154484170327:9514]
2025-10-02T09:37:13.959166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:13.959403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.959411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.959424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170327:9514], now have 1 active actors on pipe
2025-10-02T09:37:13.959629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556154484170327:9514]
2025-10-02T09:37:13.959629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:13.959634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:13.959664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:13.959733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3532 reason: error at write: Disconnected sessionId: src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0
2025-10-02T09:37:13.959784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:13.959917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3532 sessionId: src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0 is DEAD
2025-10-02T09:37:13.960061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:13.960072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Write session will restart in 0.006860s
2025-10-02T09:37:13.960093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Write session: Do CDS request
2025-10-02T09:37:13.960099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:13.966650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:13.967732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:13.967898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:13.967906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:13.967912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:13.967946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:13.967970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556154408582726:5624]
2025-10-02T09:37:13.968161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.968249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:13.968260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3533
2025-10-02T09:37:13.968336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:13.968359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:13.968383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:13.968387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:13.968391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:13.968503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:13.968527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:13.968708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:13.968712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3533 sessionId:  describe result for acl check
2025-10-02T09:37:13.968736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.968739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:13.968740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.968740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:13.968741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.968742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:13.968746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:13.968741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.968742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.968743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.968743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.968744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.968745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.968745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.968746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.968746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.968749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.968756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.968758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.968760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.968762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.968764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.968766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.968768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.968771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.968773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.968775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.968777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.968782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.968786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:13.968789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.968792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:13.968794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.968796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:13.968798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.968814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:13.968816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.968818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:13.968820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.968823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:13.968825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.968827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:13.968829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.968832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:13.968834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.968836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:13.968838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.968841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.968843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.968845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.968847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.968850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.968867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:13.969197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:13.970706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:13.975561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:13.975570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:13.975572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556154484170427:9069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:13.975578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:13.976261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:13.977796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:13.977806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:13.977808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:13.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:13.977816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3532 [2:7556556154408582726:5624]
2025-10-02T09:37:13.977823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:13.977834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:13.977837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.977839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.977840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.977849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:13.977851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:13.977856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:13.977888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.977893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.977894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.977896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:13.977898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:13.977935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:13.977940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.977946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:13.977952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:13.977960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:13.977976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170339:2446], now have 1 active actors on pipe
2025-10-02T09:37:13.977981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556154484170460:9069], now have 1 active actors on pipe
2025-10-02T09:37:13.977985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.977987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.977988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.977996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:13.978006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:13.978009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:13.978011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:13.978012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:13.978015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:13.978016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:13.978030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.978035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:13.978025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3532
2025-10-02T09:37:13.978030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3532
2025-10-02T09:37:13.978041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:13.978060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.978065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.978081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:13.978088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:13.978090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:13.978091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:13.978096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:13.978104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:13.978113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.978218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:13.978222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:13.978230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:13.978297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3533 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0
2025-10-02T09:37:13.978514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fcb738-af9e3250-4709c4c2-b9cbf54a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:13.980815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Write session: try to update token
2025-10-02T09:37:13.980828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:13.986979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:13.986993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.986998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.987022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:13.987024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:13.987165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:13.987283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.987443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.987574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:13.987746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:13.987771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:13.993100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3533 sessionId: src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:13.995294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:13.995305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:13.995307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:13.995308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:13.995312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.995314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.995316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556154408582720:5624]
2025-10-02T09:37:13.995334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:13.995336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:13.995340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:13.995340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:13.995341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:13.995341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:13.995391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:13.995454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.059821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779137780:9514]
2025-10-02T09:37:14.060143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3532, pipe: [1:7556556158779137780:9514]
2025-10-02T09:37:14.106718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.106960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.106969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.106982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779137780:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.107162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.107190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:14.107200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:14.107226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779137780:9514]
2025-10-02T09:37:14.107248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.107270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3533 reason: error at write: Disconnected sessionId: src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0
2025-10-02T09:37:14.107432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3533 sessionId: src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0 is DEAD
2025-10-02T09:37:14.107556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:14.107567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Write session will restart in 0.009317s
2025-10-02T09:37:14.107594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Write session: Do CDS request
2025-10-02T09:37:14.107599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.114032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.115179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.115282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.115289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.115295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.115322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.115347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550184:5650]
2025-10-02T09:37:14.115695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.115886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.115908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.116084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.116113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.116117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.116118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.116118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.116119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.116119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.116120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.116120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.116121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.116121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.116122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.116123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.116125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.116132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.116134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.116136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.116138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.116140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.116142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.116145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.116147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.116149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.116151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.116153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.116158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.116162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.116166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.116169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.116171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.116174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.116176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.116178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.116180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.116183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.116185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.116188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.116193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.116195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.116197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.116200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.116202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.116209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.116211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.116213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.116215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.116219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.116221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.116226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.116242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.118158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.118746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.118757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3534
2025-10-02T09:37:14.118868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.118896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.118904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.118908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.119235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3534 sessionId:  describe result for acl check
2025-10-02T09:37:14.119261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.119266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.119267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.119271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.119682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.121234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.123228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.123237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.123239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779137885:9035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.123244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.123671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.125236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.125247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.125248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.125250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.125254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3533 [2:7556556158703550184:5650]
2025-10-02T09:37:14.125261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.125272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.125273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.125275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.125279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.125288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.125291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.125296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.125328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.125329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.125331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.125332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.125334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.125374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.125380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.125386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.125391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.125399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.125412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779137791:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.125417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779137919:9035], now have 1 active actors on pipe
2025-10-02T09:37:14.125420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.125422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.125423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.125430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.125438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.125444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.125446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.125446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.125447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.125448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.125464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.125469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.125478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.125470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3533
2025-10-02T09:37:14.125473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3533
2025-10-02T09:37:14.125496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.125502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.125519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.125527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.125529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.125530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.125535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.125544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.125552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.125663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.125667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.125675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.125744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3534 partition: 0 MaxSeqNo: 36 sessionId: src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0
2025-10-02T09:37:14.125958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4dd5feb-8960efe1-6ea0d04-bb6c9af7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.128333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Write session: try to update token
2025-10-02T09:37:14.128347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.134481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:14.134500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.134507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.134534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:14.134538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:14.134675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:14.134794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.134942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.135086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.135259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:14.135284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:14.141620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3534 sessionId: src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.142990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.143002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.143003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.143004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.143009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.143013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.143017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550179:5650]
2025-10-02T09:37:14.143037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.143040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.143040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.143041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.143043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.143045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.143167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.143967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.207293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779137926:9514]
2025-10-02T09:37:14.207536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3533, pipe: [1:7556556158779137926:9514]
2025-10-02T09:37:14.254099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.254334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.254342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.254354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779137926:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.254505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.254546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.254579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779137926:9514]
2025-10-02T09:37:14.254594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:14.254679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0
2025-10-02T09:37:14.254825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3534 sessionId: src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0 is DEAD
2025-10-02T09:37:14.254967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:14.254975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Write session will restart in 0.008083s
2025-10-02T09:37:14.255003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Write session: Do CDS request
2025-10-02T09:37:14.255008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.262128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.263387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.263489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.263496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.263502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.263528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.263554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550313:5648]
2025-10-02T09:37:14.263921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.264101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.264128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.264178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.264282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.264292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3535
2025-10-02T09:37:14.264323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.264354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.264358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.264358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.264359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.264359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.264360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.264361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.264361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.264362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.264362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.264363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.264363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.264366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.264373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.264376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.264378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.264380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.264382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.264384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.264385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.264387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.264388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.264389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.264391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.264393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.264398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.264411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.264402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.264406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.264409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.264411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.264414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.264416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.264418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.264417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.264420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.264421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.264423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.264425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.264428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.264431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.264433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.264435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.264438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.264440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.264443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.264445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.264447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.264450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.264452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.264454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.264457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.264473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.264817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3535 sessionId:  describe result for acl check
2025-10-02T09:37:14.264848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.264853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.264855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.264859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.265294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.266858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.270797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.270806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.270810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138021:9030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.270815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.271978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.273571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.273582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.273583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.273586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.273589Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3534 [2:7556556158703550313:5648]
2025-10-02T09:37:14.273597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.273609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.273614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.273615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.273616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.273625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.273630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.273634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.273666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.273671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.273672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.273674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.273675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.273715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.273720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.273727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.273732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.273742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.273757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138055:9030], now have 1 active actors on pipe
2025-10-02T09:37:14.273762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779137928:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.273767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.273768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.273769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.273777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.273785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.273792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.273792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.273794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.273795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.273795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.273813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.273821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.273821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.273813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3534
2025-10-02T09:37:14.273836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3534
2025-10-02T09:37:14.273840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.273845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.273864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40a787da-e44884da-aebb9a59-2d78d457_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.273871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.273872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.273874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.273879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.273885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.273893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.273997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.274002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.274009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.274078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3535 partition: 0 MaxSeqNo: 36 sessionId: src_id|40a787da-e44884da-aebb9a59-2d78d457_0
2025-10-02T09:37:14.274299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847c31b-39dfc3f0-3326eb0b-d3173377_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40a787da-e44884da-aebb9a59-2d78d457_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.276642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Write session: try to update token
2025-10-02T09:37:14.276654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.282923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.282934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.282935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.282936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.282940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.282942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.282944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550308:5648]
2025-10-02T09:37:14.282964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.282967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.282970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.282971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.282972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.282972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.283097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.288870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3535 sessionId: src_id|40a787da-e44884da-aebb9a59-2d78d457_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.291088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.354738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779138065:9514]
2025-10-02T09:37:14.354969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3534, pipe: [1:7556556158779138065:9514]
2025-10-02T09:37:14.392975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.393209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.393217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.393230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138065:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.393344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.393377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.393398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779138065:9514]
2025-10-02T09:37:14.393420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:14.393496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3535 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40a787da-e44884da-aebb9a59-2d78d457_0
2025-10-02T09:37:14.393697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3535 sessionId: src_id|40a787da-e44884da-aebb9a59-2d78d457_0 is DEAD
2025-10-02T09:37:14.393830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:14.393835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Write session will restart in 0.008721s
2025-10-02T09:37:14.393854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Write session: Do CDS request
2025-10-02T09:37:14.393858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.400461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.401815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.401915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.401921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.401927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.401953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.401976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550453:5655]
2025-10-02T09:37:14.402317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.402488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.402511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.402688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.402716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.402721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.402721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.402722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.402722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.402723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.402724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.402724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.402725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.402725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.402725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.402726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.402729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.402736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.402738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.402740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.402742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.402744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.402746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.402748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.402750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.402752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.402754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.402756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.402760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.402764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.402767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.402770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.402773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.402775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.402777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.402780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.402782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.402785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.402787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.402790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.402792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.402795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.402798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.402801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.402804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.402806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.402808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.402811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.402813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.402816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.402818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.402824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.402841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.403146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.403222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.403231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3536
2025-10-02T09:37:14.403317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.403336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.403341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.403344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.403679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3536 sessionId:  describe result for acl check
2025-10-02T09:37:14.403707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.403711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.403713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.403717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.404087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.405287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.409696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.409706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.409708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138172:9011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.409714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.410200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.411779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.411790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.411791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.411794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.411797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3535 [2:7556556158703550453:5655]
2025-10-02T09:37:14.411805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.411814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.411819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.411820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.411821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.411831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.411833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.411838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.411869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.411874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.411875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.411877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.411879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.411916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.411921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.411927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.411932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.411940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.411956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138078:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.411961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138207:9011], now have 1 active actors on pipe
2025-10-02T09:37:14.411964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.411966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.411967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.411975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.411985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.411989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.411991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.411992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.411999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.412001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.412000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3535
2025-10-02T09:37:14.412019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.412002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3535
2025-10-02T09:37:14.412025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.412027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.412041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.412045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.412072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.412079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.412081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.412082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.412087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.412095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.412107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.412233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.412238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.412246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.412311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3536 partition: 0 MaxSeqNo: 36 sessionId: src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0
2025-10-02T09:37:14.412557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a787da-e44884da-aebb9a59-2d78d457_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.414890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Write session: try to update token
2025-10-02T09:37:14.414906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.421021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.421033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.421034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.421034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.421038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.421040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.421042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550448:5655]
2025-10-02T09:37:14.421062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.421067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.421067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.421069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.421070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.421072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.421278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.427200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3536 sessionId: src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.429306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.493505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779138215:9514]
2025-10-02T09:37:14.493671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3535, pipe: [1:7556556158779138215:9514]
2025-10-02T09:37:14.528995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.529207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.529217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.529231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138215:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.529435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.529435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779138215:9514]
2025-10-02T09:37:14.529473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:14.529476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:14.529545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.529555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3536 reason: error at write: Disconnected sessionId: src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0
2025-10-02T09:37:14.529713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3536 sessionId: src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0 is DEAD
2025-10-02T09:37:14.529845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:14.529850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Write session will restart in 0.007796s
2025-10-02T09:37:14.529871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Write session: Do CDS request
2025-10-02T09:37:14.529876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.536575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.537805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.537906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.537913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.537919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.537946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.537971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550583:10238]
2025-10-02T09:37:14.538121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.538228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.538238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3537
2025-10-02T09:37:14.538315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.538351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.538374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.538379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.538382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.538479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.538502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.538691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.538702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3537 sessionId:  describe result for acl check
2025-10-02T09:37:14.538723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.538727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.538727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.538728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.538728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.538733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.538739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.538729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.538744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.538750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.538729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.538730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.538730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.538731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.538731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.538732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.538735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.538742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.538744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.538746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.538748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.538750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.538752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.538754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.538756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.538758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.538760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.538762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.538767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.538771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.538774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.538777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.538780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.538782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.538785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.538788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.538790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.538793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.538795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.538797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.538800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.538803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.538805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.538807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.538810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.538814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.538816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.538819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.538821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.538823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.538825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.538828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.538846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.539261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.541154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.545048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.545057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.545060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138309:9002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.545065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.546217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.547676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.547689Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.547690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.547692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.547696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3536 [2:7556556158703550583:10238]
2025-10-02T09:37:14.547703Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.547713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.547717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.547718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.547719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.547728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.547735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.547740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.547769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.547774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.547775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.547777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.547778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.547816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.547821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.547828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.547833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.547841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.547855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138216:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.547861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138346:9002], now have 1 active actors on pipe
2025-10-02T09:37:14.547864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.547866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.547867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.547874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.547884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.547886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.547888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.547889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.547893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.547895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.547910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.547917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.547912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3536
2025-10-02T09:37:14.547921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.547915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3536
2025-10-02T09:37:14.547979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.547985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.547999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da9bc95-a66ba722-a459078-68910186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.548005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.548007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.548008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.548014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.548023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.548031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.548140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.548144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.548151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.548210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3537 partition: 0 MaxSeqNo: 36 sessionId: src_id|da9bc95-a66ba722-a459078-68910186_0
2025-10-02T09:37:14.548453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04e0f95-df01cdaa-404dbe12-c7f23db1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da9bc95-a66ba722-a459078-68910186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.550840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Write session: try to update token
2025-10-02T09:37:14.550853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.557214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.557232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.557234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.557236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.557242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.557246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.557253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550578:10238]
2025-10-02T09:37:14.557283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.557287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.557291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.557292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.557293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.557293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.557431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.563354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3537 sessionId: src_id|da9bc95-a66ba722-a459078-68910186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.565548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.629695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779138354:9514]
2025-10-02T09:37:14.629912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3536, pipe: [1:7556556158779138354:9514]
2025-10-02T09:37:14.667093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.667429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.667437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.667449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138354:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.667568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.667711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:14.667721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:14.667775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.667800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3537 reason: error at write: Disconnected sessionId: src_id|da9bc95-a66ba722-a459078-68910186_0
2025-10-02T09:37:14.667834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779138354:9514]
2025-10-02T09:37:14.667952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3537 sessionId: src_id|da9bc95-a66ba722-a459078-68910186_0 is DEAD
2025-10-02T09:37:14.668110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:14.668116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Write session will restart in 0.009073s
2025-10-02T09:37:14.668134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Write session: Do CDS request
2025-10-02T09:37:14.668140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.674859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.676068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.676171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.676178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.676183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.676211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.676237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550713:10232]
2025-10-02T09:37:14.676600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.676773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.676796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.676990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.677019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.677023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.677024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.677024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.677025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.677025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.677026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.677026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.677027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.677027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.677028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.677028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.677031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.677038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.677040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.677043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.677045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.677047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.677048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.677051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.677052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.677055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.677056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.677058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.677063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.677067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.677070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.677073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.677075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.677078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.677080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.677083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.677085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.677088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.677090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.677092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.677094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.677097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.677099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.677101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.677103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.677106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.677108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.677111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.677113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.677117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.677119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.677121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.677136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.678148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.678258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.678268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3538
2025-10-02T09:37:14.678360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.678382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.678385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.678390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.678734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3538 sessionId:  describe result for acl check
2025-10-02T09:37:14.678764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.678769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.678770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.678774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.679218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.680862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.683926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.683935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.683937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138451:8997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.683941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.684441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.685990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.686002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.686004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.686006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.686009Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3537 [2:7556556158703550713:10232]
2025-10-02T09:37:14.686018Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.686029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.686034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.686035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.686037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.686046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.686049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.686053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.686088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.686092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.686094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.686096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.686097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.686132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.686138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.686145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.686150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.686158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.686173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138486:8997], now have 1 active actors on pipe
2025-10-02T09:37:14.686179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138355:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.686182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.686184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.686185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.686192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.686203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.686205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.686207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.686208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.686213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.686214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.686228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.686233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.686235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.686219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3537
2025-10-02T09:37:14.686220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3537
2025-10-02T09:37:14.686253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.686258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.686274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f715592e-5245421b-898512ec-6427c2b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.686281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.686283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.686284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.686289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.686296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.686307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.686412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.686417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.686425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.686492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3538 partition: 0 MaxSeqNo: 36 sessionId: src_id|f715592e-5245421b-898512ec-6427c2b1_0
2025-10-02T09:37:14.686705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9bc95-a66ba722-a459078-68910186_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f715592e-5245421b-898512ec-6427c2b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.689056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Write session: try to update token
2025-10-02T09:37:14.689069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.695226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.695236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.695237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.695240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.695244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.695245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.695247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550708:10232]
2025-10-02T09:37:14.695266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.695266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.695268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.695269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.695270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.695271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.695379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.701533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3538 sessionId: src_id|f715592e-5245421b-898512ec-6427c2b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.703707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.767902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779138494:9514]
2025-10-02T09:37:14.768088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3537, pipe: [1:7556556158779138494:9514]
2025-10-02T09:37:14.804943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.805157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.805166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.805178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138494:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.805330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.805379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:14.805381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779138494:9514]
2025-10-02T09:37:14.805390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:14.805404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.805461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3538 reason: error at write: Disconnected sessionId: src_id|f715592e-5245421b-898512ec-6427c2b1_0
2025-10-02T09:37:14.805616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3538 sessionId: src_id|f715592e-5245421b-898512ec-6427c2b1_0 is DEAD
2025-10-02T09:37:14.805750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:14.805756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Write session will restart in 0.005343s
2025-10-02T09:37:14.805776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Write session: Do CDS request
2025-10-02T09:37:14.805781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.812137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.812233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.812244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3539
2025-10-02T09:37:14.812337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.812361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.812368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.812371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.812473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.812706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3539 sessionId:  describe result for acl check
2025-10-02T09:37:14.812733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.812738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.812739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.812743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.813170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.813722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.813822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.813828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.813834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.813859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.813883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550844:10230]
2025-10-02T09:37:14.814266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.814427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.814457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.814686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.814737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.814744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.814745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.814746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.814747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.814747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.814749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.814750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.814751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.814752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.814753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.814754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.814758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.814768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.814771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.814775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.814778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.814782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.814784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.814792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.814794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.814800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.814804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.814807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.814817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.814823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.814832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.814836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.814840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.814844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.814848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.814852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.814858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.814863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.814867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.814871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.814876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.814881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.814889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.814893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.814899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.814903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.814910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.814915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.814923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.814927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.814935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.814939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.814971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.815024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.819776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.819786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.819788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138589:8991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.819793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.822382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.823903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.823915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.823917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.823919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.823923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3538 [2:7556556158703550844:10230]
2025-10-02T09:37:14.823931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.823941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.823946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.823947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.823949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.823957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.823960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.823965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.823997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.824002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.824003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.824005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.824006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.824054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.824060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.824067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.824072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.824081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.824092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138628:8991], now have 1 active actors on pipe
2025-10-02T09:37:14.824094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138497:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.824098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.824099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.824100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.824108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.824117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.824126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.824128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.824128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.824130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.824130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.824143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.824145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.824147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.824141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3538
2025-10-02T09:37:14.824146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3538
2025-10-02T09:37:14.824207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.824214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.824231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.824238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.824241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.824242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.824247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.824255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.824263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.824397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.824405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.824414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.824482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3539 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0
2025-10-02T09:37:14.824700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f715592e-5245421b-898512ec-6427c2b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.827085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Write session: try to update token
2025-10-02T09:37:14.827098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.833120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:14.833133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.833138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.833159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:14.833167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:14.833299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:14.833417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.833564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.833680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:14.833836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:14.833859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:14.839654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3539 sessionId: src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.841774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.841787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.841789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.841791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.841796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.841799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.841803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550839:10230]
2025-10-02T09:37:14.841822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.841827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.841819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:14.841829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.841830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.841830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.841832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.841940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.905647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556158779138635:9514]
2025-10-02T09:37:14.905830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3538, pipe: [1:7556556158779138635:9514]
2025-10-02T09:37:14.952388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:14.952656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.952665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.952678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138635:9514], now have 1 active actors on pipe
2025-10-02T09:37:14.952798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:14.952857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:14.952868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556158779138635:9514]
2025-10-02T09:37:14.952895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:14.952983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3539 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0
2025-10-02T09:37:14.953126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3539 sessionId: src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0 is DEAD
2025-10-02T09:37:14.953265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:14.953271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Write session will restart in 0.005818s
2025-10-02T09:37:14.953291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Write session: Do CDS request
2025-10-02T09:37:14.953297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:14.959964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:14.960169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.960271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:14.960281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3540
2025-10-02T09:37:14.960375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:14.960398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:14.960404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:14.960408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:14.960719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3540 sessionId:  describe result for acl check
2025-10-02T09:37:14.960744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:14.960750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:14.960751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:14.960755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:14.961166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:14.961225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:14.961329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:14.961335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:14.961341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:14.961365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:14.961389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556158703550975:10216]
2025-10-02T09:37:14.961789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:14.961970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:14.961997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:14.962180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:14.962210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.962214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.962214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.962215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.962216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.962216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.962217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.962217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.962218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.962218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.962219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.962219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.962222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.962228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.962230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.962233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.962234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.962236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.962238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.962240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.962242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.962244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.962246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.962248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.962251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.962255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:14.962259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.962261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:14.962264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.962266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:14.962268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.962271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:14.962273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.962276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:14.962278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.962281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:14.962283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.962287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:14.962289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.962292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:14.962295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.962297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:14.962299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.962302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.962304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.962307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.962309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.962312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.962331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:14.962957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:14.968140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:14.968150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:14.968155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556158779138741:8979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:14.968160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:14.969732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:14.971256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:14.971268Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:14.971269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:14.971271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:14.971275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3539 [2:7556556158703550975:10216]
2025-10-02T09:37:14.971283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:14.971293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:14.971295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.971297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.971298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.971306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:14.971313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:14.971318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:14.971348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.971353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.971355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.971357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:14.971359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:14.971454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:14.971459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.971465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:14.971471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:14.971482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:14.971477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3539
2025-10-02T09:37:14.971496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138777:8979], now have 1 active actors on pipe
2025-10-02T09:37:14.971501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556158779138645:2446], now have 1 active actors on pipe
2025-10-02T09:37:14.971482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3539
2025-10-02T09:37:14.971504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.971505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.971506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.971512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:14.971519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:14.971519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:14.971521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:14.971522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:14.971526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:14.971527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:14.971538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.971540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.971560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.971570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:14.971580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:14.971586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:14.971588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:14.971589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:14.971591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:14.971594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:14.971599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:14.971617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.971753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:14.971760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:14.971770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:14.971839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3540 partition: 0 MaxSeqNo: 36 sessionId: src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0
2025-10-02T09:37:14.972109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7903e7d-21842d0a-1ec9837-aed9d942_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:14.974450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Write session: try to update token
2025-10-02T09:37:14.974463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:14.980591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:14.980603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:14.980604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:14.980605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:14.980609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.980611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.980612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556158703550970:10216]
2025-10-02T09:37:14.980633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:14.980632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:14.980635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:14.980636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:14.980637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:14.980637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:14.980738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:14.986310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3540 sessionId: src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:14.988407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.053121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106083:9514]
2025-10-02T09:37:15.053279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3539, pipe: [1:7556556163074106083:9514]
2025-10-02T09:37:15.093445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.093688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.093697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.093709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106083:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.093826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.093840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.093846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106083:9514]
2025-10-02T09:37:15.093864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:15.093917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3540 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0
2025-10-02T09:37:15.094068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3540 sessionId: src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0 is DEAD
2025-10-02T09:37:15.094208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:15.094214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Write session will restart in 0.005384s
2025-10-02T09:37:15.094232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Write session: Do CDS request
2025-10-02T09:37:15.094237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.100171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.100248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.100255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3541
2025-10-02T09:37:15.100374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.100396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.100399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.100402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.100715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3541 sessionId:  describe result for acl check
2025-10-02T09:37:15.100741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.100745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.100747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.100751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.100898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.101151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.102199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.102302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.102309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.102314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.102340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.102369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998518440:10208]
2025-10-02T09:37:15.102736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.102907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.102933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.102965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.103111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.103154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.103159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.103160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.103162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.103163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.103163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.103164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.103164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.103165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.103165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.103169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.103175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.103177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.103179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.103181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.103183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.103185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.103187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.103189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.103192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.103194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.103196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.103199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.103203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.103207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.103212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.103215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.103220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.103224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.103229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.103235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.103240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.103247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.103249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.103252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.103254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.103257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.103260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.103266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.103269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.103271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.103273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.103276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.103282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.103284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.103287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.103305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.108516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.108529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.108531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106204:8957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.108536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.111386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.112926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.112939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.112941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.112944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.112949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3540 [2:7556556162998518440:10208]
2025-10-02T09:37:15.112961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.112975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.112981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.112983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.112984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.112993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.112996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.113000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.113033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.113038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.113040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.113042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.113043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.113080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.113086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.113093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.113098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.113107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.113119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106241:8957], now have 1 active actors on pipe
2025-10-02T09:37:15.113125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106110:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.113129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.113130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.113132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.113140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.113150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.113155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.113157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.113159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.113159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.113161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.113176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.113181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.113182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.113183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3540
2025-10-02T09:37:15.113194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3540
2025-10-02T09:37:15.113241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.113247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.113264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.113271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.113273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.113274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.113280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.113288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.113296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.113431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.113439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.113449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.113527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3541 partition: 0 MaxSeqNo: 36 sessionId: src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0
2025-10-02T09:37:15.113809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543c218-da5810d9-132f44c4-f4fb9adb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.116125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Write session: try to update token
2025-10-02T09:37:15.116140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.122887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.122905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.122906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.122907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.122914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.122916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.122919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998518435:10208]
2025-10-02T09:37:15.122941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.122945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.122946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.122959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.122972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.122976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.123051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.128698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3541 sessionId: src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.130975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.193886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106248:9514]
2025-10-02T09:37:15.194089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3540, pipe: [1:7556556163074106248:9514]
2025-10-02T09:37:15.238650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.238874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.238884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.238896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106248:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.239014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.239076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:15.239122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.239166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106248:9514]
2025-10-02T09:37:15.239177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0
2025-10-02T09:37:15.239355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3541 sessionId: src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0 is DEAD
2025-10-02T09:37:15.239516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:15.239529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Write session will restart in 0.005090s
2025-10-02T09:37:15.239551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Write session: Do CDS request
2025-10-02T09:37:15.239555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.245081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.245215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.245223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3542
2025-10-02T09:37:15.245323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.245344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.245360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.245366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.245685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3542 sessionId:  describe result for acl check
2025-10-02T09:37:15.245716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.245717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.245718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.245721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.246082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.246908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.247770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.248096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.248214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.248222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.248227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.248255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.248284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998518576:10186]
2025-10-02T09:37:15.248633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.248795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.248833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.249013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.249043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.249047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.249048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.249049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.249049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.249050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.249051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.249051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.249052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.249052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.249053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.249053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.249056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.249062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.249064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.249066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.249068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.249070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.249072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.249074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.249076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.249079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.249081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.249083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.249086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.249090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.249093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.249096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.249099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.249102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.249104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.249107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.249109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.249112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.249114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.249117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.249119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.249122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.249126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.249128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.249130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.249133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.249135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.249138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.249140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.249143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.249146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.249149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.249166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.249570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.249579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.249581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106322:8944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.249585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.256719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.258326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.258340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.258341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.258344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.258348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3541 [2:7556556162998518576:10186]
2025-10-02T09:37:15.258363Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.258377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.258379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.258381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.258382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.258391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.258394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.258399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.258431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.258432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.258434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.258436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.258437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.258478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.258484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.258491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.258497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.258504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.258516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106383:8944], now have 1 active actors on pipe
2025-10-02T09:37:15.258522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106249:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.258525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.258527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.258528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.258536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.258544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.258549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.258551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.258551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.258552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.258552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.258567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.258569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.258571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.258580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3541
2025-10-02T09:37:15.258586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3541
2025-10-02T09:37:15.258639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.258646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.258661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.258665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.258667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.258668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.258674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.258679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.258686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.258804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.258809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.258816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.258884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3542 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0
2025-10-02T09:37:15.259156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533255-45b5ff44-f87a9c2c-ea6973f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.261578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Write session: try to update token
2025-10-02T09:37:15.261598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.267778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.267793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.267794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.267795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.267800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.267803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.267806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998518571:10186]
2025-10-02T09:37:15.267828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.267829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.267831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.267833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.267834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.267836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.267964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.274528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3542 sessionId: src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.276690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.339343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106392:9514]
2025-10-02T09:37:15.339557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3541, pipe: [1:7556556163074106392:9514]
2025-10-02T09:37:15.383220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.383478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.383487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.383501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106392:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.383683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.383725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:15.383728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.383736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:15.383764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106392:9514]
2025-10-02T09:37:15.383809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3542 reason: error at write: Disconnected sessionId: src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0
2025-10-02T09:37:15.383966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3542 sessionId: src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0 is DEAD
2025-10-02T09:37:15.384092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:15.384102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Write session will restart in 0.005303s
2025-10-02T09:37:15.384122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Write session: Do CDS request
2025-10-02T09:37:15.384128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.390146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.390308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.390317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3543
2025-10-02T09:37:15.390442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.390465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.390472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.390474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.390767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3543 sessionId:  describe result for acl check
2025-10-02T09:37:15.390795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.390801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.390802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.390805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.391119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.391842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.392406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.393102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.393224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.393231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.393236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.393266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.393292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998518722:10198]
2025-10-02T09:37:15.393631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.393796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.393818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.393992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.394022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.394026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.394026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.394027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.394027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.394028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.394028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.394029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.394030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.394030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.394031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.394031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.394034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.394040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.394042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.394044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.394046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.394048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.394050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.394052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.394054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.394057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.394059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.394060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.394064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.394068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.394072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.394075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.394079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.394082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.394084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.394086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.394089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.394091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.394093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.394096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.394099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.394101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.394103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.394106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.394108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.394111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.394113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.394116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.394118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.394120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.394123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.394126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.394144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.394504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.394514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.394516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106491:8930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.394520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.401537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.403103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.403115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.403116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.403118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.403122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3542 [2:7556556162998518722:10198]
2025-10-02T09:37:15.403130Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.403150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.403155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.403157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.403158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.403167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.403170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.403174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.403207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.403211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.403213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.403214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.403216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.403260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.403267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.403276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.403285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.403295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.403310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106395:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.403316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106541:8930], now have 1 active actors on pipe
2025-10-02T09:37:15.403320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.403321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.403323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.403332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.403341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.403345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.403347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.403348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.403352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.403353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.403366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.403371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.403372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.403346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3542
2025-10-02T09:37:15.403347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3542
2025-10-02T09:37:15.403381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.403386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.403412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.403418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.403420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.403421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.403426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.403431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.403444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.403559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.403564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.403573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.403627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3543 partition: 0 MaxSeqNo: 36 sessionId: src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0
2025-10-02T09:37:15.403840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff14d299-b00bd49c-ec230e4-ae2b3dea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.406121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Write session: try to update token
2025-10-02T09:37:15.406136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.412638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.412650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.412652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.412652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.412656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.412659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.412661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998518717:10198]
2025-10-02T09:37:15.412680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.412683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.412686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.412687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.412688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.412688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.412824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.418446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3543 sessionId: src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.420852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.483716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106551:9514]
2025-10-02T09:37:15.483930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3542, pipe: [1:7556556163074106551:9514]
2025-10-02T09:37:15.528554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.528818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.528828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.528841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106551:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.529064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.529089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.529111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:15.529116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:15.529130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106551:9514]
2025-10-02T09:37:15.529248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3543 reason: error at write: Disconnected sessionId: src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0
2025-10-02T09:37:15.529396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3543 sessionId: src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0 is DEAD
2025-10-02T09:37:15.529552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:15.529563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Write session will restart in 0.005188s
2025-10-02T09:37:15.529587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Write session: Do CDS request
2025-10-02T09:37:15.529592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.536176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.536255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.536268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.536280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3544
2025-10-02T09:37:15.536373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.536407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.536415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.536420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.536743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3544 sessionId:  describe result for acl check
2025-10-02T09:37:15.536774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.536779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.536780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.536783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.537142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.537538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.537634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.537643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.537650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.537680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.537705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998518860:10195]
2025-10-02T09:37:15.538055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.538250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.538277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.538472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.538503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.538507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.538507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.538508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.538509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.538510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.538511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.538512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.538513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.538514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.538515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.538516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.538520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.538529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.538533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.538537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.538540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.538543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.538546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.538547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.538549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.538551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.538553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.538555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.538559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.538563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.538568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.538571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.538573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.538576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.538581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.538583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.538586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.538588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.538592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.538594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.538597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.538600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.538602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.538604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.538607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.538609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.538611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.538614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.538618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.538620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.538623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.538625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.538644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.539030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.543505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.543515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.543517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106650:8914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.543521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.546076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.547584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.547597Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.547598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.547600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.547604Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3543 [2:7556556162998518860:10195]
2025-10-02T09:37:15.547611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.547621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.547628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.547630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.547631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.547643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.547647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.547655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.547690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.547695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.547696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.547698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.547700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.547736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.547741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.547748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.547753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.547761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.547776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106689:8914], now have 1 active actors on pipe
2025-10-02T09:37:15.547781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106552:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.547785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.547787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.547788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.547796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.547805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.547808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.547810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.547811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.547816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.547817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.547831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.547836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.547818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3543
2025-10-02T09:37:15.547847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.547857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.547859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.547822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3543
2025-10-02T09:37:15.547874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|570786f4-f712fa38-adf4e105-adf32d05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.547882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.547884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.547890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.547897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.547905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.547917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.548078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.548086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.548095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.548164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3544 partition: 0 MaxSeqNo: 36 sessionId: src_id|570786f4-f712fa38-adf4e105-adf32d05_0
2025-10-02T09:37:15.548379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da211d1a-8e9a8afd-eae606e4-657ba584_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|570786f4-f712fa38-adf4e105-adf32d05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.550635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Write session: try to update token
2025-10-02T09:37:15.550646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.557014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.557027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.557029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.557030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.557034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.557037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.557040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998518855:10195]
2025-10-02T09:37:15.557059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.557062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.557064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.557067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.557070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.557072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.557192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.563325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3544 sessionId: src_id|570786f4-f712fa38-adf4e105-adf32d05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.565655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.629117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106697:9514]
2025-10-02T09:37:15.629449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3543, pipe: [1:7556556163074106697:9514]
2025-10-02T09:37:15.660115Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:37:15.674688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.675055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.675064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.675077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106697:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.675238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.675293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.675323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:15.675335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106697:9514]
2025-10-02T09:37:15.675418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|570786f4-f712fa38-adf4e105-adf32d05_0
2025-10-02T09:37:15.675589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3544 sessionId: src_id|570786f4-f712fa38-adf4e105-adf32d05_0 is DEAD
2025-10-02T09:37:15.675739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:15.675754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Write session will restart in 0.006225s
2025-10-02T09:37:15.675775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Write session: Do CDS request
2025-10-02T09:37:15.675782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.682908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.683148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.683424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.683436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3545
2025-10-02T09:37:15.683550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.683574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.683584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.683587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.683939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3545 sessionId:  describe result for acl check
2025-10-02T09:37:15.683967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.683973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.683975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.683983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.684165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.684275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.684282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.684288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.684314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.684345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998518997:10193]
2025-10-02T09:37:15.684427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.684709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.684906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.684930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.685123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.685158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.685162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.685162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.685163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.685163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.685164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.685165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.685165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.685166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.685166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.685170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.685177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.685179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.685181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.685183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.685185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.685187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.685189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.685191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.685193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.685195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.685197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.685201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.685205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.685209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.685211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.685214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.685217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.685219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.685222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.685224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.685227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.685229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.685231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.685234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.685236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.685238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.685241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.685244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.685246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.685248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.685251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.685255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.685258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.685260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.685262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.685281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.686023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.691092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.691103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.691106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106796:8905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.691111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.692742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.694424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.694435Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.694436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.694438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.694442Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3544 [2:7556556162998518997:10193]
2025-10-02T09:37:15.694451Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.694461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.694463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.694465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.694466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.694475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.694481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.694485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.694515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.694520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.694521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.694523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.694524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.694562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.694567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.694577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.694591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.694606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.694621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106836:8905], now have 1 active actors on pipe
2025-10-02T09:37:15.694626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106698:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.694630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.694631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.694632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.694640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.694647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.694654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.694656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.694657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.694657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.694658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.694652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3544
2025-10-02T09:37:15.694653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3544
2025-10-02T09:37:15.694673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.694678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.694680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.694690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.694692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.694718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.694725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.694727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.694728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.694733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.694738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.694750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.694865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.694870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.694879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.694942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3545 partition: 0 MaxSeqNo: 36 sessionId: src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0
2025-10-02T09:37:15.695212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570786f4-f712fa38-adf4e105-adf32d05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.697590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Write session: try to update token
2025-10-02T09:37:15.697605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.703881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.703893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.703894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.703895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.703899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.703903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.703905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998518992:10193]
2025-10-02T09:37:15.703925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.703926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.703929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.703931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.703933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.703934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.704089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.710983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3545 sessionId: src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.713299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.775537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106844:9514]
2025-10-02T09:37:15.775757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3544, pipe: [1:7556556163074106844:9514]
2025-10-02T09:37:15.818726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.819000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.819012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.819027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106844:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.819198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.819271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:15.819283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106844:9514]
2025-10-02T09:37:15.819285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:15.819312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.819379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3545 reason: error at write: Disconnected sessionId: src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0
2025-10-02T09:37:15.819533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3545 sessionId: src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0 is DEAD
2025-10-02T09:37:15.819685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:15.819698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Write session will restart in 0.009359s
2025-10-02T09:37:15.819718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Write session: Do CDS request
2025-10-02T09:37:15.819722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.826994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.828267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.828379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.828385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.828391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.828419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.828446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998519135:10191]
2025-10-02T09:37:15.828818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.828990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.829078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.829263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.829294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.829295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.829295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.829296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.829296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.829297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.829297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.829298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.829298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.829299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.829299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.829302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.829309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.829311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.829313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.829315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.829317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.829319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.829321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.829323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.829325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.829327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.829329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.829332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.829336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.829340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.829343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.829345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.829348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.829350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.829352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.829355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.829357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.829360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.829362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.829365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.829368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.829370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.829372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.829374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.829377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.829379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.829382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.829384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.829387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.829391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.829394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.829412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.830176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.830295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.830311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3546
2025-10-02T09:37:15.830409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.830431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.830439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.830442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.830794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3546 sessionId:  describe result for acl check
2025-10-02T09:37:15.830825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.830831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.830833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.830837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.831304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.832856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.836239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.836249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.836251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074106949:8890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.836256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.836775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.838252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.838264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.838266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.838268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.838272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3545 [2:7556556162998519135:10191]
2025-10-02T09:37:15.838280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.838290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.838295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.838297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.838298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.838307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.838313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.838318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.838353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.838358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.838360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.838362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.838363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.838435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.838440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.838450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.838462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.838481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.838477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3545
2025-10-02T09:37:15.838481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3545
2025-10-02T09:37:15.838497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106845:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.838502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106984:8890], now have 1 active actors on pipe
2025-10-02T09:37:15.838506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.838507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.838509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.838513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.838520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.838522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.838527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.838528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.838530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.838531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.838543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.838547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.838568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.838575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.838583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.838584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.838588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.838590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.838592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.838596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.838601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.838620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.838727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.838732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.838741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.838792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3546 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0
2025-10-02T09:37:15.839007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91650e6-43918e8e-60efd06d-3fd018bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.841318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Write session: try to update token
2025-10-02T09:37:15.841331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.847654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.847669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.847671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.847672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.847677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.847680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.847683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998519130:10191]
2025-10-02T09:37:15.847704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.847706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.847710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.847710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.847711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.847712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.847829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.853699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3546 sessionId: src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.855982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:15.919421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556163074106991:9514]
2025-10-02T09:37:15.919635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3545, pipe: [1:7556556163074106991:9514]
2025-10-02T09:37:15.962306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:15.962576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.962585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.962598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074106991:9514], now have 1 active actors on pipe
2025-10-02T09:37:15.962752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:15.962794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:15.962807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556163074106991:9514]
2025-10-02T09:37:15.962834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:15.962921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0
2025-10-02T09:37:15.963080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3546 sessionId: src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0 is DEAD
2025-10-02T09:37:15.963243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:15.963254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Write session will restart in 0.008480s
2025-10-02T09:37:15.963291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Write session: Do CDS request
2025-10-02T09:37:15.963296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:15.970076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:15.971325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:15.971439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:15.971445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:15.971451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:15.971477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:15.971563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556162998519274:10189]
2025-10-02T09:37:15.971924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:15.972101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:15.972129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:15.972317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:15.972354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.972359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.972360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.972361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.972361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.972362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.972363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.972363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.972364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.972364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.972365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.972366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.972369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.972375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.972378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.972380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.972382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.972384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.972386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.972388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.972390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.972392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.972394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.972396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.972399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.972403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:15.972406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.972409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:15.972411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.972414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:15.972416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.972419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:15.972421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.972424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:15.972426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.972428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:15.972430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.972432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:15.972436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.972438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:15.972441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.972444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:15.972446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.972449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.972451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.972454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.972456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.972458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.972473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:15.973121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.973251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:15.973264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3547
2025-10-02T09:37:15.973367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:15.973393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:15.973398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:15.973401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:15.973737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3547 sessionId:  describe result for acl check
2025-10-02T09:37:15.973764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:15.973770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:15.973771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:15.973776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:15.974211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:15.975707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:15.979268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:15.979278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:15.979280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556163074107105:8873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:15.979286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:15.979835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:15.981325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:15.981337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:15.981339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:15.981341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:15.981345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3546 [2:7556556162998519274:10189]
2025-10-02T09:37:15.981351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:15.981361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:15.981363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.981364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.981365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.981374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:15.981377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:15.981381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:15.981412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.981417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.981420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.981422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:15.981423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:15.981497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:15.981502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.981508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:15.981514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:15.981523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:15.981534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074107000:2446], now have 1 active actors on pipe
2025-10-02T09:37:15.981536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556163074107139:8873], now have 1 active actors on pipe
2025-10-02T09:37:15.981540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.981541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.981542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.981549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:15.981557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:15.981545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3546
2025-10-02T09:37:15.981562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:15.981552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3546
2025-10-02T09:37:15.981564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:15.981565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:15.981566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:15.981568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:15.981582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.981584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:15.981586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:15.981597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.981599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.981625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:15.981631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:15.981633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:15.981635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:15.981640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:15.981645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:15.981658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.981768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:15.981773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:15.981780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:15.981846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3547 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0
2025-10-02T09:37:15.982069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e2db8f-c2abadb6-1fad98d9-703f143_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:15.984582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Write session: try to update token
2025-10-02T09:37:15.984598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:15.990772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:15.990785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:15.990789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:15.990790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:15.990795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.990797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.990799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556162998519269:10189]
2025-10-02T09:37:15.990820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:15.990824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:15.990825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:15.990826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:15.990828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:15.990830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:15.990931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:15.996948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3547 sessionId: src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:15.999269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.062783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369074445:9514]
2025-10-02T09:37:16.062951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3546, pipe: [1:7556556167369074445:9514]
2025-10-02T09:37:16.103039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.103293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.103302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.103315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074445:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.103474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.103496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369074445:9514]
2025-10-02T09:37:16.103522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.103552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:16.103627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3547 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0
2025-10-02T09:37:16.103782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3547 sessionId: src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0 is DEAD
2025-10-02T09:37:16.103968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:16.103979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Write session will restart in 0.008280s
2025-10-02T09:37:16.103994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Write session: Do CDS request
2025-10-02T09:37:16.103999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.110912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.112225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.112354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.112362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.112369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.112403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.112428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293486738:10156]
2025-10-02T09:37:16.112784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.112975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.113004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.113163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.113209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.113244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.113248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.113248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.113249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.113250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.113250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.113251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.113252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.113252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.113262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.113271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3548
2025-10-02T09:37:16.113253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.113253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.113254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.113257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.113263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.113265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.113267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.113269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.113271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.113273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.113275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.113277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.113279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.113281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.113283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.113290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.113294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.113297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.113300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.113302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.113305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.113307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.113310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.113314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.113317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.113319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.113321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.113323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.113326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.113328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.113331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.113333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.113337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.113339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.113342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.113344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.113346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.113348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.113351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.113369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.113374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.113397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.113405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.113408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.113681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3548 sessionId:  describe result for acl check
2025-10-02T09:37:16.113702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.113707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.113708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.113712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.114129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.115418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.119662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.119671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.119673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369074566:8834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.119678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.120877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.122524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.122536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.122537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.122539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.122543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3547 [2:7556556167293486738:10156]
2025-10-02T09:37:16.122549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.122561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.122564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.122566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.122567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.122576Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.122581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.122585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.122623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.122630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.122631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.122634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.122636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.122670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.122675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.122681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.122687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.122695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.122710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074600:8834], now have 1 active actors on pipe
2025-10-02T09:37:16.122716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074460:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.122720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.122721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.122722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.122727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.122713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3547
2025-10-02T09:37:16.122734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3547
2025-10-02T09:37:16.122734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.122734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.122736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.122737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.122744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.122746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.122758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.122763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.122783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.122792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.122799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.122800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.122803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.122806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.122807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.122811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.122817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.122834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.123089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.123096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.123108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.123191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3548 partition: 0 MaxSeqNo: 36 sessionId: src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0
2025-10-02T09:37:16.123418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc1644-1a2d7eef-98d7df99-d7dcad9a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.125747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Write session: try to update token
2025-10-02T09:37:16.125760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.131963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.131974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.131976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.131977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.131980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.131982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.131984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293486733:10156]
2025-10-02T09:37:16.132004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.132005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.132008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.132008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.132009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.132011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.132133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.137822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3548 sessionId: src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.140112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.203570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369074617:9514]
2025-10-02T09:37:16.203755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3547, pipe: [1:7556556167369074617:9514]
2025-10-02T09:37:16.243325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.243609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.243619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.243632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074617:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.243777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.243802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.243838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:16.243853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369074617:9514]
2025-10-02T09:37:16.243930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0
2025-10-02T09:37:16.244086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3548 sessionId: src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0 is DEAD
2025-10-02T09:37:16.244223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:16.244233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Write session will restart in 0.006450s
2025-10-02T09:37:16.244257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Write session: Do CDS request
2025-10-02T09:37:16.244263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.251273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.252183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.252290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.252297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3549
2025-10-02T09:37:16.252414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.252436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.252447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.252453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.252555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.252722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.252730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.252737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.252763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3549 sessionId:  describe result for acl check
2025-10-02T09:37:16.252772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.252797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293486888:10161]
2025-10-02T09:37:16.252789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.252793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.252794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.252811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.253185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.253261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.253353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.253377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.253564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.253599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.253603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.253604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.253605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.253605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.253606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.253606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.253607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.253607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.253608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.253609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.253609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.253612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.253619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.253621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.253623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.253625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.253627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.253629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.253631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.253633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.253635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.253637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.253639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.253644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.253648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.253651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.253654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.253656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.253659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.253661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.253664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.253666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.253669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.253672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.253676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.253684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.253688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.253694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.253698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.253704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.253708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.253713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.253716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.253718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.253721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.253723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.253725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.253744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.255058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.259955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.259966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.259969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369074721:8838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.259974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.261212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.262862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.262875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.262877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.262880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.262884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3548 [2:7556556167293486888:10161]
2025-10-02T09:37:16.262894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.262908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.262911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.262913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.262916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.262929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.262933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.262938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.262974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.262980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.262981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.262983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.262985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.263025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.263031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.263039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.263044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.263052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.263065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074761:8838], now have 1 active actors on pipe
2025-10-02T09:37:16.263069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074618:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.263073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.263074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.263075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.263083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.263091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.263095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.263097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.263098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.263099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.263100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.263118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.263120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.263121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.263135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3548
2025-10-02T09:37:16.263135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3548
2025-10-02T09:37:16.263217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.263225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.263242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.263246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.263249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.263251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.263256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.263262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.263270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.263389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.263395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.263406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.263472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3549 partition: 0 MaxSeqNo: 36 sessionId: src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0
2025-10-02T09:37:16.263739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40fbd623-4e7dbeb4-866cb52d-9ec859ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.266027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Write session: try to update token
2025-10-02T09:37:16.266042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.272391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.272406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.272408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.272409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.272414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.272416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.272419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293486883:10161]
2025-10-02T09:37:16.272439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.272442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.272444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.272445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.272448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.272451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.272563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.278002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3549 sessionId: src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.280278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.343856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369074768:9514]
2025-10-02T09:37:16.344160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3548, pipe: [1:7556556167369074768:9514]
2025-10-02T09:37:16.385712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.385949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.385958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.385970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074768:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.386127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.386195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:16.386206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:16.386277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3549 reason: error at write: Disconnected sessionId: src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0
2025-10-02T09:37:16.386384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369074768:9514]
2025-10-02T09:37:16.386418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.386433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3549 sessionId: src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0 is DEAD
2025-10-02T09:37:16.386562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:16.386573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Write session will restart in 0.009190s
2025-10-02T09:37:16.386592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Write session: Do CDS request
2025-10-02T09:37:16.386597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.395406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.397165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.397178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.397282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.397290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.397297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.397307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.397318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3550
2025-10-02T09:37:16.397332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.397359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293487041:10153]
2025-10-02T09:37:16.397425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.397447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.397454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.397458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.397724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.397809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3550 sessionId:  describe result for acl check
2025-10-02T09:37:16.397834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.397839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.397840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.397844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.397930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.397954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.398144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.398180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.398183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.398184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.398184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.398185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.398186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.398186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.398187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.398187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.398188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.398189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.398189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.398192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.398198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.398200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.398202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.398204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.398206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.398208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.398214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.398210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.398212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.398214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.398216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.398218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.398222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.398226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.398229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.398232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.398234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.398237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.398239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.398242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.398245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.398247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.398250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.398253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.398255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.398258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.398260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.398263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.398265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.398268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.398270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.398272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.398274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.398277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.398279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.398282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.398298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.399507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.403576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.403585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.403587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369074888:8821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.403592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.405768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.407328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.407339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.407340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.407343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.407346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3549 [2:7556556167293487041:10153]
2025-10-02T09:37:16.407352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.407362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.407363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.407365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.407366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.407376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.407382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.407388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.407417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.407421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.407422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.407424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.407425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.407463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.407468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.407474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.407479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.407489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.407503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074926:8821], now have 1 active actors on pipe
2025-10-02T09:37:16.407508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074771:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.407512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.407513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.407514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.407521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.407533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.407535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.407538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.407539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.407548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.407552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.407560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3549
2025-10-02T09:37:16.407569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.407574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.407576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.407564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3549
2025-10-02T09:37:16.407591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.407596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.407615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75f627b9-87f04521-cefe551b-93526e31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.407621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.407623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.407625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.407630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.407637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.407649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.407758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.407765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.407775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.407842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3550 partition: 0 MaxSeqNo: 36 sessionId: src_id|75f627b9-87f04521-cefe551b-93526e31_0
2025-10-02T09:37:16.408112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1421e5cc-12f7b47b-f7edfd40-1330a4be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75f627b9-87f04521-cefe551b-93526e31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.410385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Write session: try to update token
2025-10-02T09:37:16.410401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.416722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.416737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.416738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.416739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.416744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.416747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.416750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293487036:10153]
2025-10-02T09:37:16.416772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.416776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.416778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.416779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.416780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.416783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.416992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.422466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3550 sessionId: src_id|75f627b9-87f04521-cefe551b-93526e31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.424727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.486717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369074934:9514]
2025-10-02T09:37:16.486950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3549, pipe: [1:7556556167369074934:9514]
2025-10-02T09:37:16.530114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.530428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.530441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.530457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074934:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.530591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.530679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:16.530680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369074934:9514]
2025-10-02T09:37:16.530689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:16.530706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.530759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3550 reason: error at write: Disconnected sessionId: src_id|75f627b9-87f04521-cefe551b-93526e31_0
2025-10-02T09:37:16.530911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3550 sessionId: src_id|75f627b9-87f04521-cefe551b-93526e31_0 is DEAD
2025-10-02T09:37:16.531067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:16.531078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Write session will restart in 0.006927s
2025-10-02T09:37:16.531098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Write session: Do CDS request
2025-10-02T09:37:16.531104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.539074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.539175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.539185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3551
2025-10-02T09:37:16.539287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.539313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.539317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.539320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.539599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.539635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3551 sessionId:  describe result for acl check
2025-10-02T09:37:16.539660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.539665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.539667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.539671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.540083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.541266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.541379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.541386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.541391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.541421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.541451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293487186:10149]
2025-10-02T09:37:16.541569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.541807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.541998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.542042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.542384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.542432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.542438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.542439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.542440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.542441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.542442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.542443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.542445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.542446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.542447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.542447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.542448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.542451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.542458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.542461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.542463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.542465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.542467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.542469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.542472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.542474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.542476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.542479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.542481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.542485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.542489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.542493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.542496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.542498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.542501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.542503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.542506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.542508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.542511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.542513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.542516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.542518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.542521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.542524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.542526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.542528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.542531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.542533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.542536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.542540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.542542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.542545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.542548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.542566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.546450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.546459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.546462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369075039:8813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.546467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.549991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.551440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.551451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.551453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.551455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.551459Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3550 [2:7556556167293487186:10149]
2025-10-02T09:37:16.551466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.551475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.551478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.551480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.551481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.551491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.551498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.551502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.551575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.551580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.551581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.551583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.551584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.551621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.551626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.551633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.551639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.551648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.551665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075079:8813], now have 1 active actors on pipe
2025-10-02T09:37:16.551672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369074935:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.551677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.551681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.551683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.551693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.551704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.551705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.551706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.551708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.551713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.551715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.551732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.551737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.551741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.551727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3550
2025-10-02T09:37:16.551759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.551728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3550
2025-10-02T09:37:16.551764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.551784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.551791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.551794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.551794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.551799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.551807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.551817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.551967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.551974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.551983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.552053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3551 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0
2025-10-02T09:37:16.552306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f627b9-87f04521-cefe551b-93526e31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.554605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Write session: try to update token
2025-10-02T09:37:16.554621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.561080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.561091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.561092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.561094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.561097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.561099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.561102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293487181:10149]
2025-10-02T09:37:16.561122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.561124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.561127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.561129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.561131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.561133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.561357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.566720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3551 sessionId: src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.569033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.631110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369075090:9514]
2025-10-02T09:37:16.631340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3550, pipe: [1:7556556167369075090:9514]
2025-10-02T09:37:16.680124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.680366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.680376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.680389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075090:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.680544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.680616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:16.680620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369075090:9514]
2025-10-02T09:37:16.680655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.680717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0
2025-10-02T09:37:16.680909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3551 sessionId: src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0 is DEAD
2025-10-02T09:37:16.681051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:16.681063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Write session will restart in 0.006232s
2025-10-02T09:37:16.681084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Write session: Do CDS request
2025-10-02T09:37:16.681089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.688107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.688212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.688313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.688323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3552
2025-10-02T09:37:16.688418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.688441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.688449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.688453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.688862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3552 sessionId:  describe result for acl check
2025-10-02T09:37:16.688898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.688904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.688906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.688910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.689369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.689446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.689554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.689561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.689566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.689592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.689616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293487331:10143]
2025-10-02T09:37:16.689988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.690235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.690259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.690451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.690488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.690492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.690493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.690493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.690494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.690495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.690495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.690496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.690496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.690497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.690497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.690498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.690500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.690507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.690509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.690511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.690514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.690516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.690518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.690520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.690522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.690524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.690526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.690528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.690532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.690536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.690539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.690542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.690545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.690547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.690549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.690552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.690554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.690557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.690559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.690562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.690564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.690567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.690569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.690571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.690573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.690576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.690578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.690581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.690585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.690588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.690590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.690593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.690609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.691017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.695492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.695502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.695505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369075198:8802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.695509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.698163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.699828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.699841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.699842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.699844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.699848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3551 [2:7556556167293487331:10143]
2025-10-02T09:37:16.699857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.699867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.699872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.699874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.699875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.699884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.699887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.699895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.699927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.699932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.699933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.699935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.699936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.699977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.699982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.699988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.699993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.700005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.700017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075236:8802], now have 1 active actors on pipe
2025-10-02T09:37:16.700022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075092:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.700025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.700026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.700028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.700035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.700045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.700050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.700052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.700053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.700056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.700058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.700074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.700082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.700076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3551
2025-10-02T09:37:16.700086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.700098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3551
2025-10-02T09:37:16.700157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.700162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.700176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.700183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.700185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.700186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.700194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.700203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.700212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.700332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.700337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.700344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.700409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3552 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0
2025-10-02T09:37:16.700619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf26ac17-19c928fb-e20d968e-77f821f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.702873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Write session: try to update token
2025-10-02T09:37:16.702886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.709326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.709339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.709341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.709342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.709347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.709350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.709355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293487326:10143]
2025-10-02T09:37:16.709385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.709386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.709391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.709392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.709394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.709397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.709600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.714874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3552 sessionId: src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.717198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.780598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369075244:9514]
2025-10-02T09:37:16.780842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3551, pipe: [1:7556556167369075244:9514]
2025-10-02T09:37:16.823717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.823992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.824003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.824015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075244:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.824152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.824216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.824237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369075244:9514]
2025-10-02T09:37:16.824265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:16.824345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3552 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0
2025-10-02T09:37:16.824500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3552 sessionId: src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0 is DEAD
2025-10-02T09:37:16.824643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:16.824654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Write session will restart in 0.008323s
2025-10-02T09:37:16.824673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Write session: Do CDS request
2025-10-02T09:37:16.824679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.832414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.833803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.833912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.833921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.833928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.833959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.833983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293487476:10140]
2025-10-02T09:37:16.834195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.834282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.834296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3553
2025-10-02T09:37:16.834336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.834402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.834424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.834432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.834435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.834491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.834514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.834695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.834725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.834728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.834729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.834730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.834730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.834731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.834732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.834732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.834733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.834733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.834733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.834734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.834737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.834744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.834746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.834748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.834750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.834752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.834754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.834756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.834758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.834760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.834762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.834764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.834768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.834772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.834775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.834778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.834780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.834783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.834785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.834788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.834789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.834792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.834795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.834797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.834799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.834802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.834804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.834806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.834809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.834811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.834813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.834816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.834820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.834823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.834825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.834827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.834825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3553 sessionId:  describe result for acl check
2025-10-02T09:37:16.834844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.834863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.834868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.834869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.834875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.835360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.836903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.841068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.841078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.841080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369075354:8786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.841085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.842261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.843784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.843796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.843797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.843799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.843803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3552 [2:7556556167293487476:10140]
2025-10-02T09:37:16.843811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.843822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.843827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.843829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.843830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.843839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.843846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.843851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.843884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.843889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.843890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.843894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.843895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.844004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.844009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.844016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.844022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.844014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3552
2025-10-02T09:37:16.844019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3552
2025-10-02T09:37:16.844035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.844050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075391:8786], now have 1 active actors on pipe
2025-10-02T09:37:16.844056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075245:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.844060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.844061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.844062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.844070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.844080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.844087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.844088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.844089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.844089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.844103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.844114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.844118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.844140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.844147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.844149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.844150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.844156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.844165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.844172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.844177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.844185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.844194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.844297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.844302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.844310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.844379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3553 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0
2025-10-02T09:37:16.844608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad0be9-164d19ed-293ff9fc-a2697939_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.846897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Write session: try to update token
2025-10-02T09:37:16.846911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.853328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.853340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.853342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.853343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.853347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.853350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.853352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293487471:10140]
2025-10-02T09:37:16.853371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.853378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.853379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.853384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.853388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.853392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.853500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:16.859186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3553 sessionId: src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:16.861350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:16.924452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556167369075399:9514]
2025-10-02T09:37:16.924632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3552, pipe: [1:7556556167369075399:9514]
2025-10-02T09:37:16.965624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:16.965936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.965946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.965959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075399:9514], now have 1 active actors on pipe
2025-10-02T09:37:16.966083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:16.966140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:16.966144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556167369075399:9514]
2025-10-02T09:37:16.966164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:16.966243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3553 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0
2025-10-02T09:37:16.966400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3553 sessionId: src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0 is DEAD
2025-10-02T09:37:16.966552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:16.966562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Write session will restart in 0.005304s
2025-10-02T09:37:16.966585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Write session: Do CDS request
2025-10-02T09:37:16.966590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:16.973087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.973181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:16.973189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3554
2025-10-02T09:37:16.973292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:16.973315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:16.973323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:16.973327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:16.973682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3554 sessionId:  describe result for acl check
2025-10-02T09:37:16.973706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:16.973711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:16.973713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:16.973716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:16.973920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:16.974129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:16.975243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:16.975345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:16.975353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:16.975361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:16.975389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:16.975416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556167293487621:10126]
2025-10-02T09:37:16.975581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:16.975774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:16.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:16.975958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:16.976153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:16.976186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.976190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.976191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.976192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.976192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.976193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.976193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.976194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.976194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.976195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.976195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.976196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.976199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.976205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.976207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.976209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.976211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.976213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.976215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.976217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.976219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.976222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.976223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.976225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.976229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.976233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:16.976236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.976239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:16.976241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.976244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:16.976246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.976249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:16.976251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.976254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:16.976257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.976262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:16.976264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.976267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:16.976269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.976271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:16.976273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.976276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:16.976283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.976286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.976288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.976291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.976293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.976295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.976315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:16.980091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:16.980100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:16.980103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556167369075512:8778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:16.980108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:16.983733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:16.985353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:16.985364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:16.985365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:16.985367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:16.985371Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3553 [2:7556556167293487621:10126]
2025-10-02T09:37:16.985378Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:16.985388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:16.985393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.985394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.985395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.985406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:16.985410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:16.985414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:16.985445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.985450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.985451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.985454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:16.985455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:16.985491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:16.985496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.985503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:16.985508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:16.985517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:16.985532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075552:8778], now have 1 active actors on pipe
2025-10-02T09:37:16.985537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556167369075405:2446], now have 1 active actors on pipe
2025-10-02T09:37:16.985540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.985542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.985543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.985551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:16.985561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:16.985564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:16.985566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:16.985567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:16.985571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:16.985573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:16.985573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3553
2025-10-02T09:37:16.985588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.985578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3553
2025-10-02T09:37:16.985595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:16.985596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:16.985608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.985610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.985639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5175e183-76995174-ec079759-6684f633_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:16.985646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:16.985648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:16.985649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:16.985655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:16.985662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:16.985671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.985775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:16.985780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:16.985788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:16.985849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3554 partition: 0 MaxSeqNo: 36 sessionId: src_id|5175e183-76995174-ec079759-6684f633_0
2025-10-02T09:37:16.986081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd55d49a-f0a4866d-7a2f43ef-29117186_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5175e183-76995174-ec079759-6684f633_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:16.988373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Write session: try to update token
2025-10-02T09:37:16.988387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:16.994873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:16.994885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:16.994886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:16.994887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:16.994890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.994894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.994897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556167293487616:10126]
2025-10-02T09:37:16.994915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:16.994918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:16.994919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:16.994929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:16.994933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:16.994936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:16.995032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.000720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3554 sessionId: src_id|5175e183-76995174-ec079759-6684f633_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.002886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.066293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664042858:9514]
2025-10-02T09:37:17.066510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3553, pipe: [1:7556556171664042858:9514]
2025-10-02T09:37:17.108030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.108303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.108312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.108324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664042858:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.108432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.108499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664042858:9514]
2025-10-02T09:37:17.108511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.108532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.108607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5175e183-76995174-ec079759-6684f633_0
2025-10-02T09:37:17.108760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3554 sessionId: src_id|5175e183-76995174-ec079759-6684f633_0 is DEAD
2025-10-02T09:37:17.108926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.108936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Write session will restart in 0.005658s
2025-10-02T09:37:17.108956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Write session: Do CDS request
2025-10-02T09:37:17.108961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.115112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.115244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.115251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3555
2025-10-02T09:37:17.115329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.115349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.115356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.115359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.115680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3555 sessionId:  describe result for acl check
2025-10-02T09:37:17.115696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.115710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.115715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.115716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.115721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.116129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.117022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.117180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.117190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.117198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.117235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.117258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455093:10130]
2025-10-02T09:37:17.117376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.117613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.117771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.117795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.117985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.118019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.118023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.118024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.118024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.118025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.118025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.118026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.118026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.118027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.118027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.118028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.118028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.118031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.118037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.118039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.118041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.118043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.118045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.118047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.118049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.118051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.118053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.118055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.118057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.118061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.118065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.118068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.118071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.118073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.118076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.118077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.118080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.118083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.118085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.118087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.118090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.118092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.118095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.118097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.118100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.118102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.118105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.118107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.118109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.118113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.118116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.118118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.118120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.118137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.121895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.121904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.121906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664042971:8856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.121911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.125483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.126932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.126943Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.126944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.126946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.126950Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3554 [2:7556556171588455093:10130]
2025-10-02T09:37:17.126957Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.126966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.126968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.126970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.126971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.126980Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.126987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.126992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.127022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.127027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.127028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.127029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.127031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.127071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.127076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.127082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.127087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.127098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.127111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664042863:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.127117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043008:8856], now have 1 active actors on pipe
2025-10-02T09:37:17.127120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.127122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.127123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.127129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.127139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.127140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.127142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.127143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.127164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.127166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.127144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3554
2025-10-02T09:37:17.127180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3554
2025-10-02T09:37:17.127191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.127196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.127207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.127215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.127217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.127235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9581527-ec545139-deaf86f0-4ce60e68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.127242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.127244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.127246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.127251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.127260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.127271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.127371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.127376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.127383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.127453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3555 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9581527-ec545139-deaf86f0-4ce60e68_0
2025-10-02T09:37:17.127697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175e183-76995174-ec079759-6684f633_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9581527-ec545139-deaf86f0-4ce60e68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.129959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Write session: try to update token
2025-10-02T09:37:17.129971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.136387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.136401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.136402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.136403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.136407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.136409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.136411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455088:10130]
2025-10-02T09:37:17.136431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.136438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.136440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.136444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.136455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.136459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.136563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.141862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3555 sessionId: src_id|f9581527-ec545139-deaf86f0-4ce60e68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.144059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.208627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043037:9514]
2025-10-02T09:37:17.208842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3554, pipe: [1:7556556171664043037:9514]
2025-10-02T09:37:17.251497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.251750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.251760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.251773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043037:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.251899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.251963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.251981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043037:9514]
2025-10-02T09:37:17.252009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.252094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9581527-ec545139-deaf86f0-4ce60e68_0
2025-10-02T09:37:17.252245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3555 sessionId: src_id|f9581527-ec545139-deaf86f0-4ce60e68_0 is DEAD
2025-10-02T09:37:17.252387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.252400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Write session will restart in 0.006378s
2025-10-02T09:37:17.252420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Write session: Do CDS request
2025-10-02T09:37:17.252426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.259356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.260110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.260195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.260204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3556
2025-10-02T09:37:17.260711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.260768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.260792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.260796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.260811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.260828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.260835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.260841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.260868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.260895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455250:10117]
2025-10-02T09:37:17.261181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3556 sessionId:  describe result for acl check
2025-10-02T09:37:17.261207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.261212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.261213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.261216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.261246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.261429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.261453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.261625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.261638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.261667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.261671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.261671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.261672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.261672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.261673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.261673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.261674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.261674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.261675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.261676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.261676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.261679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.261686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.261688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.261690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.261692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.261694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.261696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.261697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.261699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.261701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.261703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.261705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.261709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.261713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.261716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.261719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.261721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.261723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.261726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.261729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.261731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.261733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.261740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.261742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.261745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.261748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.261750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.261752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.261755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.261757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.261760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.261765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.261768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.261771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.261773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.261776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.261795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.263330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.267991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.268000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.268002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043149:8875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.268006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.269136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.270618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.270630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.270631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.270633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.270637Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3555 [2:7556556171588455250:10117]
2025-10-02T09:37:17.270644Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.270655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.270658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.270660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.270661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.270670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.270676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.270680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.270710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.270714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.270716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.270718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.270719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.270755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.270759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.270766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.270774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.270786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.270800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043038:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.270806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043188:8875], now have 1 active actors on pipe
2025-10-02T09:37:17.270810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.270811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.270812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.270819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.270829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.270833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.270835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.270837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.270840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.270843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.270849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3555
2025-10-02T09:37:17.270857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3555
2025-10-02T09:37:17.270857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.270865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.270870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.270888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.270894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.270910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.270917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.270919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.270921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.270926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.270933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.270940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.271063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.271068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.271075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.271141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3556 partition: 0 MaxSeqNo: 36 sessionId: src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0
2025-10-02T09:37:17.271338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9581527-ec545139-deaf86f0-4ce60e68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.273626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Write session: try to update token
2025-10-02T09:37:17.273640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.279659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:17.279671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.279674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.279693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:17.279703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:17.279835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:17.279954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:17.280072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:17.280193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:17.280345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:17.280367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:17.286346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3556 sessionId: src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.287943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.287954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.287956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.287956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.287962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.287965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.287966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455245:10117]
2025-10-02T09:37:17.287983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.287987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.287988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.287988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.287991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.287993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.288096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.288590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.351968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043197:9514]
2025-10-02T09:37:17.352142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3555, pipe: [1:7556556171664043197:9514]
2025-10-02T09:37:17.396302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.396520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.396529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.396541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043197:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.396669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.396665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:17.396676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:17.396678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.396715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043197:9514]
2025-10-02T09:37:17.396740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3556 reason: error at write: Disconnected sessionId: src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0
2025-10-02T09:37:17.396907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3556 sessionId: src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0 is DEAD
2025-10-02T09:37:17.397042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:17.397054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Write session will restart in 0.006601s
2025-10-02T09:37:17.397075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Write session: Do CDS request
2025-10-02T09:37:17.397081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.404130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.404220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.404229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3557
2025-10-02T09:37:17.404313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.404335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.404343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.404346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.404460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.404668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3557 sessionId:  describe result for acl check
2025-10-02T09:37:17.404707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.404712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.404714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.404719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.405134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.405836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.405991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.405999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.406006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.406035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.406059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455410:10112]
2025-10-02T09:37:17.406405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.406564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.406585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.406759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.406788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.406791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.406792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.406793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.406794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.406794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.406795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.406795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.406796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.406794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.406796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.406797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.406797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.406800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.406807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.406809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.406812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.406814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.406816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.406818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.406820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.406822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.406824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.406826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.406828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.406832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.406835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.406840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.406843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.406845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.406848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.406850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.406852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.406855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.406857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.406859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.406862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.406864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.406867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.406869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.406872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.406878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.406880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.406882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.406886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.406892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.406895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.406897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.406899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.406916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.411732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.411743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.411746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043321:8887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.411753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.414283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.415850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.415861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.415862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.415865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.415868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3556 [2:7556556171588455410:10112]
2025-10-02T09:37:17.415875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.415884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.415889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.415891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.415892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.415901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.415903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.415908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.415941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.415946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.415947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.415949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.415951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.415986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.415991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.415997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.416002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.416012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.416027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043359:8887], now have 1 active actors on pipe
2025-10-02T09:37:17.416032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043210:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.416036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.416037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.416038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.416045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.416054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.416060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.416062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.416063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.416065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.416066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.416080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.416088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.416102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.416077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3556
2025-10-02T09:37:17.416108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.416110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.416125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc6e0744-476874c6-a909fce0-70404827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.416082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3556
2025-10-02T09:37:17.416128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.416131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.416132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.416136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.416141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.416151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.416244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.416249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.416259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.416325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3557 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc6e0744-476874c6-a909fce0-70404827_0
2025-10-02T09:37:17.416598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103a4517-84dc261d-ad99d89a-5f813e8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc6e0744-476874c6-a909fce0-70404827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.418909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Write session: try to update token
2025-10-02T09:37:17.418923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.425131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.425145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.425146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.425147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.425151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.425153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.425155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455405:10112]
2025-10-02T09:37:17.425174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.425177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.425178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.425186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.425190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.425194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.425285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.431238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3557 sessionId: src_id|dc6e0744-476874c6-a909fce0-70404827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.433427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.496893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043368:9514]
2025-10-02T09:37:17.497075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3556, pipe: [1:7556556171664043368:9514]
2025-10-02T09:37:17.534602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.534858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.534868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.534880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043368:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.535010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.535068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.535085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043368:9514]
2025-10-02T09:37:17.535107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.535168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc6e0744-476874c6-a909fce0-70404827_0
2025-10-02T09:37:17.535308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3557 sessionId: src_id|dc6e0744-476874c6-a909fce0-70404827_0 is DEAD
2025-10-02T09:37:17.535452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.535463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Write session will restart in 0.008026s
2025-10-02T09:37:17.535482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Write session: Do CDS request
2025-10-02T09:37:17.535487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.542769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.544089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.544175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.544241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.544249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.544257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.544264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.544287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.544273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3558
2025-10-02T09:37:17.544311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455562:10097]
2025-10-02T09:37:17.544361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.544384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.544391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.544394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.544664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.544727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3558 sessionId:  describe result for acl check
2025-10-02T09:37:17.544750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.544751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.544753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.544756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.544839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.544862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.545044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.545073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.545076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.545077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.545078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.545078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.545079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.545081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.545081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.545082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.545082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.545085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.545091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.545094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.545096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.545098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.545100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.545102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.545104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.545106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.545108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.545110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.545112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.545116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.545120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.545123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.545126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.545127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.545130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.545132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.545135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.545137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.545139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.545141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.545144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.545146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.545149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.545151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.545154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.545156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.545159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.545162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.545169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.545171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.545174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.545176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.545179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.545196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.545204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.546437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.550427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.550437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.550442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043481:8898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.550447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.552624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.554153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.554166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.554167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.554170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.554175Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3557 [2:7556556171588455562:10097]
2025-10-02T09:37:17.554182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.554195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.554201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.554202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.554203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.554213Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.554217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.554225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.554259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.554264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.554265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.554267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.554268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.554307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.554312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.554319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.554324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.554332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.554347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043520:8898], now have 1 active actors on pipe
2025-10-02T09:37:17.554353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043369:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.554356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.554358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.554359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.554367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.554377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.554380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.554382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.554384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.554388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.554389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.554386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3557
2025-10-02T09:37:17.554405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.554410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.554390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3557
2025-10-02T09:37:17.554413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.554426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.554431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.554454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.554461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.554466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.554467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.554472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.554480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.554490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.554589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.554594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.554602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.554658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3558 partition: 0 MaxSeqNo: 36 sessionId: src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0
2025-10-02T09:37:17.554878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc6e0744-476874c6-a909fce0-70404827_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.557167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Write session: try to update token
2025-10-02T09:37:17.557182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.563803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.563818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.563820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.563820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.563825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.563828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.563830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455557:10097]
2025-10-02T09:37:17.563851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.563854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.563854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.563855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.563857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.563860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.563962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.569686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3558 sessionId: src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.571883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.635135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043528:9514]
2025-10-02T09:37:17.635365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3557, pipe: [1:7556556171664043528:9514]
2025-10-02T09:37:17.678418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.678667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.678675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.678688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043528:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.678834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.678915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043528:9514]
2025-10-02T09:37:17.678923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.678951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.679029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0
2025-10-02T09:37:17.679188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3558 sessionId: src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0 is DEAD
2025-10-02T09:37:17.679341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.679355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Write session will restart in 0.005651s
2025-10-02T09:37:17.679386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Write session: Do CDS request
2025-10-02T09:37:17.679393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.686148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.686212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.686221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3559
2025-10-02T09:37:17.686301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.686322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.686325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.686328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.686693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3559 sessionId:  describe result for acl check
2025-10-02T09:37:17.686722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.686727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.686728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.686732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.686925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.687190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.688197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.688296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.688303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.688308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.688333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.688367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455713:10101]
2025-10-02T09:37:17.688723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.688866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.688926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.688969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.689180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.689215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.689219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.689219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.689220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.689221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.689222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.689222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.689223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.689223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.689224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.689225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.689226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.689229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.689236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.689239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.689241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.689243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.689245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.689247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.689249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.689251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.689254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.689255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.689258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.689262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.689266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.689270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.689273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.689276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.689279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.689281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.689284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.689286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.689289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.689291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.689294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.689297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.689300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.689302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.689305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.689308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.689311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.689313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.689315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.689318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.689320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.689322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.689325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.689344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.693127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.693135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.693138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043641:8911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.693143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.696668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.698257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.698269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.698271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.698273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.698277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3558 [2:7556556171588455713:10101]
2025-10-02T09:37:17.698284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.698295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.698300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.698302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.698303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.698312Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.698317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.698321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.698351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.698356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.698357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.698359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.698361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.698396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.698401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.698407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.698412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.698421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.698435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043529:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.698441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043681:8911], now have 1 active actors on pipe
2025-10-02T09:37:17.698444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.698446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.698447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.698454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.698465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.698467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.698469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.698470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.698476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.698478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.698474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3558
2025-10-02T09:37:17.698477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3558
2025-10-02T09:37:17.698495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.698500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.698502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.698513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.698519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.698544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43fe3775-61645a4-2be83e63-7fbb475e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.698551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.698553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.698555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.698560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.698568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.698579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.698677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.698682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.698689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.698749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3559 partition: 0 MaxSeqNo: 36 sessionId: src_id|43fe3775-61645a4-2be83e63-7fbb475e_0
2025-10-02T09:37:17.698963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fef5a3-dff73ef3-ff41a997-c3bdff7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43fe3775-61645a4-2be83e63-7fbb475e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.701293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Write session: try to update token
2025-10-02T09:37:17.701306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.707733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.707748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.707749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.707750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.707755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.707757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.707759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455708:10101]
2025-10-02T09:37:17.707780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.707782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.707782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.707784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.707785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.707786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.707913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.713529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3559 sessionId: src_id|43fe3775-61645a4-2be83e63-7fbb475e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.715632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.778984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043689:9514]
2025-10-02T09:37:17.779192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3558, pipe: [1:7556556171664043689:9514]
2025-10-02T09:37:17.818192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.818576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.818586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.818598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043689:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.818912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.818918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.818954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043689:9514]
2025-10-02T09:37:17.818965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.819045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43fe3775-61645a4-2be83e63-7fbb475e_0
2025-10-02T09:37:17.819191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3559 sessionId: src_id|43fe3775-61645a4-2be83e63-7fbb475e_0 is DEAD
2025-10-02T09:37:17.819325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.819336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Write session will restart in 0.007866s
2025-10-02T09:37:17.819356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Write session: Do CDS request
2025-10-02T09:37:17.819362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.826724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.828056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.828151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.828203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.828210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.828217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.828226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.828234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3560
2025-10-02T09:37:17.828247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.828273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588455865:10098]
2025-10-02T09:37:17.828340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.828361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.828368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.828371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.828699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3560 sessionId:  describe result for acl check
2025-10-02T09:37:17.828728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.828734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.828737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.828742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.828904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.829070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.829092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.829194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.829371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.829399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.829403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.829404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.829405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.829405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.829406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.829406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.829407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.829407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.829408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.829408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.829409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.829412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.829419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.829421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.829423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.829425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.829427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.829429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.829431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.829433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.829436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.829438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.829440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.829444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.829448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.829451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.829454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.829459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.829462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.829464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.829467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.829470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.829472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.829474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.829477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.829479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.829482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.829484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.829487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.829489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.829492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.829494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.829497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.829499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.829504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.829506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.829509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.829529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.830613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.834703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.834711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.834714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043804:8919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.834718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.836911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:17.838457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:17.838469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:17.838471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:17.838473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:17.838476Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3559 [2:7556556171588455865:10098]
2025-10-02T09:37:17.838483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:17.838493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:17.838498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.838500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.838501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.838510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:17.838513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:17.838517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:17.838550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.838556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.838557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.838558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:17.838560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:17.838594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:17.838599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.838607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.838615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.838623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:17.838637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043690:2446], now have 1 active actors on pipe
2025-10-02T09:37:17.838642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043843:8919], now have 1 active actors on pipe
2025-10-02T09:37:17.838646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.838647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.838648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.838656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:17.838666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:17.838668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:17.838670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:17.838672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:17.838678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:17.838679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:17.838673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3559
2025-10-02T09:37:17.838674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3559
2025-10-02T09:37:17.838693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.838697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:17.838699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:17.838711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.838716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.838742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:17.838752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:17.838754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:17.838755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:17.838760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:17.838765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:17.838777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.838887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.838892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.838900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:17.838959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3560 partition: 0 MaxSeqNo: 36 sessionId: src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0
2025-10-02T09:37:17.839146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fe3775-61645a4-2be83e63-7fbb475e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:17.841420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Write session: try to update token
2025-10-02T09:37:17.841434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:17.847747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:17.847760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:17.847761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:17.847762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:17.847765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.847768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.847769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588455860:10098]
2025-10-02T09:37:17.847788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:17.847790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.847791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:17.847793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:17.847794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:17.847796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:17.847898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:17.853796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3560 sessionId: src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:17.855914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:17.919278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556171664043850:9514]
2025-10-02T09:37:17.919461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3559, pipe: [1:7556556171664043850:9514]
2025-10-02T09:37:17.958239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:17.958473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:17.958486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:17.958503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043850:9514], now have 1 active actors on pipe
2025-10-02T09:37:17.958638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:17.958674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556171664043850:9514]
2025-10-02T09:37:17.958694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:17.958696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:17.958776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3560 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0
2025-10-02T09:37:17.958919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3560 sessionId: src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0 is DEAD
2025-10-02T09:37:17.959062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:17.959072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Write session will restart in 0.005921s
2025-10-02T09:37:17.959091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Write session: Do CDS request
2025-10-02T09:37:17.959096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:17.966296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.966372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:17.966382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3561
2025-10-02T09:37:17.966488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:17.966509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:17.966517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:17.966520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:17.966810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:17.966861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3561 sessionId:  describe result for acl check
2025-10-02T09:37:17.966890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:17.966895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:17.966896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:17.966901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:17.967338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:17.968625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:17.968728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:17.968736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:17.968742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:17.968787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:17.968829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556171588456017:10090]
2025-10-02T09:37:17.969259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:17.969514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:17.971940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:17.971951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:17.971957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556171664043971:8928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:17.971962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:17.976731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:17.976763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:17.976969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:17.977003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.977008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.977008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.977009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.977010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.977010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.977011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.977011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.977012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.977013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.977013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.977014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.977017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.977023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.977025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.977027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.977029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.977031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.977033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.977035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.977038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.977040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.977042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.977044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.977048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.977052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:17.977056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.977059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:17.977062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.977065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:17.977067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.977070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:17.977072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.977075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:17.977077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.977080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:17.977082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.977085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:17.977087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.977089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:17.977092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.977095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:17.977098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.977101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:17.977103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.977106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:17.977110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.977113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:17.977130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:17.999023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.000691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.000704Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.000706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.000708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.000714Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3560 [2:7556556171588456017:10090]
2025-10-02T09:37:18.000722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.000733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.000735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.000737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.000738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.000748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.000753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.000757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.000792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.000798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.000799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.000819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.000820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.000861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.000867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.000873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.000879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.000890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.000903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664043857:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.000909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556171664044020:8928], now have 1 active actors on pipe
2025-10-02T09:37:18.000913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.000915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.000917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.000925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.000935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.000937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.000939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.000941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.000944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.000946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.000964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.000971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.000975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.000999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3560
2025-10-02T09:37:18.001001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3560
2025-10-02T09:37:18.001033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.001039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.001056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.001062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.001065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.001066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.001073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.001082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.001092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.001219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.001224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.001232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.001293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3561 partition: 0 MaxSeqNo: 36 sessionId: src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0
2025-10-02T09:37:18.001566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11aaf2b-20548766-ef8bba15-54f3d9e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.003820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Write session: try to update token
2025-10-02T09:37:18.003834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.010219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.010233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.010234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.010236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.010240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.010242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.010244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556171588456012:10090]
2025-10-02T09:37:18.010265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.010269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.010272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.010272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.010273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.010275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.010401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.016428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3561 sessionId: src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.018591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.059060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959011332:9514]
2025-10-02T09:37:18.059284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3560, pipe: [1:7556556175959011332:9514]
2025-10-02T09:37:18.120269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.120581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.120592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.120605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011332:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.120781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.120821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.120825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.120846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959011332:9514]
2025-10-02T09:37:18.120904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3561 reason: error at write: Disconnected sessionId: src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0
2025-10-02T09:37:18.120925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.121044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3561 sessionId: src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0 is DEAD
2025-10-02T09:37:18.121171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.121183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Write session will restart in 0.007849s
2025-10-02T09:37:18.121207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Write session: Do CDS request
2025-10-02T09:37:18.121211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.128473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.129806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.129901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.129907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.129913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.129937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.129959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883423480:10079]
2025-10-02T09:37:18.130271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.130301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.130352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.130363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3562
2025-10-02T09:37:18.130461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.130483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.130500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.130527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.130536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.130539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.130655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.130685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.130689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.130689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.130690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.130690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.130692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.130692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.130692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.130693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.130694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.130696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.130702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.130704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.130706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.130708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.130710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.130712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.130714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.130716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.130718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.130720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.130722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.130726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.130730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.130733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.130735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.130737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.130740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.130742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.130753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.130758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.130760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.130762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.130765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.130769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.130774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.130777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.130779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.130781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.130784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.130788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.130791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.130793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.130795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.130798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.130800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.130817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.130881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3562 sessionId:  describe result for acl check
2025-10-02T09:37:18.130910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.130915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.130916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.130920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.131362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.132635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.137682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.137692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.137695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959011452:8950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.137701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.138128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.139540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.139552Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.139553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.139555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.139559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3561 [2:7556556175883423480:10079]
2025-10-02T09:37:18.139565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.139576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.139581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.139583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.139584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.139593Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.139596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.139601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.139629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.139634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.139635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.139636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.139638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.139672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.139677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.139683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.139690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.139698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.139714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011334:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.139719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011489:8950], now have 1 active actors on pipe
2025-10-02T09:37:18.139723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.139724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.139725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.139732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.139741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.139745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.139747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.139748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.139750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.139751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.139767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.139771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.139773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.139795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3561
2025-10-02T09:37:18.139813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3561
2025-10-02T09:37:18.139847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.139852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.139869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.139876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.139878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.139879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.139884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.139891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.139900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.140020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.140024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.140031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.140103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3562 partition: 0 MaxSeqNo: 36 sessionId: src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0
2025-10-02T09:37:18.140368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d918b237-727fc81c-5ecdce95-a67a8bdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.143164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Write session: try to update token
2025-10-02T09:37:18.143175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.148874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.148885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.148886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.148887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.148891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.148894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.148896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883423475:10079]
2025-10-02T09:37:18.148916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.148919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.148919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.148920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.148921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.148923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.149032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.156031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3562 sessionId: src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.158398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.220991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959011518:9514]
2025-10-02T09:37:18.221210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3561, pipe: [1:7556556175959011518:9514]
2025-10-02T09:37:18.257826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.258138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.258147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.258159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011518:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.258370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.258378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959011518:9514]
2025-10-02T09:37:18.258413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.258415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.258469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.258496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3562 reason: error at write: Disconnected sessionId: src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0
2025-10-02T09:37:18.258640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3562 sessionId: src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0 is DEAD
2025-10-02T09:37:18.258775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.258786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Write session will restart in 0.009247s
2025-10-02T09:37:18.258802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Write session: Do CDS request
2025-10-02T09:37:18.258806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.266409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.267750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.267852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.267858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.267864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.267889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.267914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883423660:10059]
2025-10-02T09:37:18.268257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.268419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.268442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.268616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.268645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.268649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.268650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.268650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.268651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.268651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.268652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.268652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.268653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.268653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.268654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.268654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.268657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.268664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.268666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.268668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.268670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.268672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.268674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.268676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.268678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.268680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.268682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.268684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.268688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.268691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.268695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.268698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.268700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.268703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.268705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.268708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.268710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.268713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.268715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.268717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.268719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.268722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.268724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.268727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.268731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.268734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.268735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.268738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.268740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.268742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.268744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.268747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.268765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.269181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.269399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.269408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3563
2025-10-02T09:37:18.269540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.269563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.269572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.269576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.269926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3563 sessionId:  describe result for acl check
2025-10-02T09:37:18.269959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.269964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.269966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.269972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.270382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.272485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.275585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.275594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.275596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959011641:8973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.275600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.276082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.277652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.277664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.277666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.277668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.277671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3562 [2:7556556175883423660:10059]
2025-10-02T09:37:18.277678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.277688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.277693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.277694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.277695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.277704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.277707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.277710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.277739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.277744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.277745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.277747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.277748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.277783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.277788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.277795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.277800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.277808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.277821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011519:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.277827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011676:8973], now have 1 active actors on pipe
2025-10-02T09:37:18.277830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.277831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.277832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.277840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.277848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.277851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.277853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.277854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.277858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.277860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.277851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3562
2025-10-02T09:37:18.277873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.277878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.277879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.277852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3562
2025-10-02T09:37:18.277891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.277895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.277919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.277926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.277928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.277929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.277934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.277939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.277949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.278065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.278070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.278078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.278141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3563 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0
2025-10-02T09:37:18.278356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9804d4b0-579bcde8-2d6e657d-f59b9745_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.280946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Write session: try to update token
2025-10-02T09:37:18.280958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.286977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.286989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.286989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.286990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.286994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.286996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.286998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883423655:10059]
2025-10-02T09:37:18.287016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.287017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.287018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.287019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.287020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.287021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.287129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.293196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3563 sessionId: src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.295341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.358570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959011689:9514]
2025-10-02T09:37:18.358761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3562, pipe: [1:7556556175959011689:9514]
2025-10-02T09:37:18.394704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.394938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.394947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.394959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011689:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.395061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.395067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.395078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.395103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959011689:9514]
2025-10-02T09:37:18.395138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3563 reason: error at write: Disconnected sessionId: src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0
2025-10-02T09:37:18.395325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3563 sessionId: src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0 is DEAD
2025-10-02T09:37:18.395449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.395458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Write session will restart in 0.007271s
2025-10-02T09:37:18.395447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.395477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Write session: Do CDS request
2025-10-02T09:37:18.395483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.402895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.404095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.404205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.404194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.404203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3564
2025-10-02T09:37:18.404292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.404312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.404318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.404321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.404326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.404333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.404339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.404365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.404389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883423827:10053]
2025-10-02T09:37:18.404638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3564 sessionId:  describe result for acl check
2025-10-02T09:37:18.404662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.404664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.404665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.404669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.404733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.404902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.404926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.405105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.405167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.405202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.405206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.405207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.405207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.405208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.405208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.405209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.405209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.405210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.405210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.405211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.405211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.405214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.405220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.405223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.405225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.405227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.405229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.405230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.405232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.405234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.405237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.405239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.405241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.405245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.405249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.405252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.405255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.405257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.405260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.405262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.405265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.405267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.405270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.405273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.405275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.405278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.405280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.405282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.405285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.405287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.405290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.405292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.405294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.405296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.405299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.405301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.405303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.405320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.406617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.410621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.410630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.410632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959011821:9004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.410638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.412837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.414337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.414348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.414350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.414352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.414356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3563 [2:7556556175883423827:10053]
2025-10-02T09:37:18.414364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.414374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.414377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.414379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.414380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.414389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.414392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.414397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.414427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.414432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.414433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.414435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.414436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.414472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.414477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.414484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.414489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.414498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.414512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011702:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.414518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011860:9004], now have 1 active actors on pipe
2025-10-02T09:37:18.414521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.414523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.414524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.414532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.414542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.414542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.414544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.414545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.414552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.414554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.414568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.414574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.414577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.414564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3563
2025-10-02T09:37:18.414569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3563
2025-10-02T09:37:18.414599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.414604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.414618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.414624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.414626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.414627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.414633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.414640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.414646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.414783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.414788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.414796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.414858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3564 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0
2025-10-02T09:37:18.415144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f89afce-8f92f271-c3d272b0-7f0458fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.417488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Write session: try to update token
2025-10-02T09:37:18.417502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.423621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.423635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.423636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.423637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.423640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.423643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.423645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883423822:10053]
2025-10-02T09:37:18.423661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.423664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.423667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.423668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.423670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.423672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.423781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.429654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3564 sessionId: src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.431901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.495297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959011868:9514]
2025-10-02T09:37:18.495468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3563, pipe: [1:7556556175959011868:9514]
2025-10-02T09:37:18.532090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.532319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.532328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.532340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011868:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.532467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.532509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.532548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:18.532556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959011868:9514]
2025-10-02T09:37:18.532604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0
2025-10-02T09:37:18.532740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3564 sessionId: src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0 is DEAD
2025-10-02T09:37:18.532910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:18.532922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Write session will restart in 0.008740s
2025-10-02T09:37:18.532943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Write session: Do CDS request
2025-10-02T09:37:18.532948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.540629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.542085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.542240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.542248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.542255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.542287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.542311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883423986:10048]
2025-10-02T09:37:18.542651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.542807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.542830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.543001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.543029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.543032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.543033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.543033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.543034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.543035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.543035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.543036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.543036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.543036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.543037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.543038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.543040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.543047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.543049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.543051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.543053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.543055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.543057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.543059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.543061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.543064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.543065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.543067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.543071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.543075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.543079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.543081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.543085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.543088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.543090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.543093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.543095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.543098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.543100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.543103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.543105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.543108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.543109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.543112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.543114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.543116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.543118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.543123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.543126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.543127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.543130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.543147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.543203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.543279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.543289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3565
2025-10-02T09:37:18.543399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.543419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.543422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.543425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.543763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3565 sessionId:  describe result for acl check
2025-10-02T09:37:18.543797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.543980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.543985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.543989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.544417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.545920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.550043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.550053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.550056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959011992:9001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.550061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.550488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.552053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.552065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.552066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.552068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.552071Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3564 [2:7556556175883423986:10048]
2025-10-02T09:37:18.552078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.552087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.552092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.552094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.552094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.552103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.552107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.552112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.552139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.552144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.552145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.552147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.552149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.552186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.552191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.552197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.552202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.552209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.552224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959011869:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.552229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012027:9001], now have 1 active actors on pipe
2025-10-02T09:37:18.552233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.552234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.552235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.552242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.552251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.552254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.552255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.552256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.552262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.552263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.552251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3564
2025-10-02T09:37:18.552277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.552281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.552283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.552265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3564
2025-10-02T09:37:18.552294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.552299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.552325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.552332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.552335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.552336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.552341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.552350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.552362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.552452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.552456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.552463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.552516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3565 partition: 0 MaxSeqNo: 36 sessionId: src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0
2025-10-02T09:37:18.552763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0a5a7-e4b9ccab-5c8cd39-763db604_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.555047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Write session: try to update token
2025-10-02T09:37:18.555060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.561481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.561493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.561494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.561495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.561498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.561500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.561504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883423981:10048]
2025-10-02T09:37:18.561521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.561522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.561523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.561525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.561526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.561526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.561678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.567246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3565 sessionId: src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.569424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.632479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959012035:9514]
2025-10-02T09:37:18.632654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3564, pipe: [1:7556556175959012035:9514]
2025-10-02T09:37:18.671261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.671493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.671502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.671514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012035:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.671837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.671846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.671889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3565 reason: error at write: Disconnected sessionId: src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0
2025-10-02T09:37:18.671910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959012035:9514]
2025-10-02T09:37:18.671939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.672026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3565 sessionId: src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0 is DEAD
2025-10-02T09:37:18.672068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.672189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.672200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Write session will restart in 0.007473s
2025-10-02T09:37:18.672221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Write session: Do CDS request
2025-10-02T09:37:18.672226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.680250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.681171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.681261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.681270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3566
2025-10-02T09:37:18.681354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.681374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.681377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.681380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.681669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.681690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3566 sessionId:  describe result for acl check
2025-10-02T09:37:18.681710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.681711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.681712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.681715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.681824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.681832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.681838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.681869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.681892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883424144:10039]
2025-10-02T09:37:18.682066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.682227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.682387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.682409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.682582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.682608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.682612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.682613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.682613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.682615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.682615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.682616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.682616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.682617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.682617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.682620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.682626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.682628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.682631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.682633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.682635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.682637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.682639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.682641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.682643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.682645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.682647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.682651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.682655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.682658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.682661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.682663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.682666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.682668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.682671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.682673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.682676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.682678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.682681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.682683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.682685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.682691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.682693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.682696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.682698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.682701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.682703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.682705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.682708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.682710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.682727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.683612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.688432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.688444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.688446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959012156:9009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.688450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.690069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.691551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.691561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.691562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.691564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.691567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3565 [2:7556556175883424144:10039]
2025-10-02T09:37:18.691573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.691583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.691584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.691585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.691586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.691595Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.691598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.691603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.691632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.691638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.691639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.691641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.691642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.691677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.691682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.691688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.691693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.691703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.691717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012036:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.691722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012194:9009], now have 1 active actors on pipe
2025-10-02T09:37:18.691725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.691727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.691728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.691735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.691745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.691748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.691749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.691751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.691755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.691756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.691770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.691753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3565
2025-10-02T09:37:18.691775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.691776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.691795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3565
2025-10-02T09:37:18.691828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.691833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.691847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.691853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.691855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.691856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.691861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.691867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.691876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.691973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.691978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.691985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.692055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3566 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0
2025-10-02T09:37:18.692294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165cad2e-db14e9b6-162597e3-2d35cd12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.694597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Write session: try to update token
2025-10-02T09:37:18.694611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.704711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:18.704723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.704726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.704746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:18.704753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:18.705160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:18.705273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:18.705379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:18.705488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:18.705642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:18.705664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:18.708983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.708994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.708995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.708996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.709000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.709002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.709005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883424139:10039]
2025-10-02T09:37:18.709022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.709022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.709024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.709025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.709026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.709028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.709137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.710704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3566 sessionId: src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.712916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.772256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959012203:9514]
2025-10-02T09:37:18.772405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3565, pipe: [1:7556556175959012203:9514]
2025-10-02T09:37:18.817470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.817701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.817709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.817722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012203:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.817871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.817890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959012203:9514]
2025-10-02T09:37:18.817915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.817917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.817933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.817965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3566 reason: error at write: Disconnected sessionId: src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0
2025-10-02T09:37:18.818099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3566 sessionId: src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0 is DEAD
2025-10-02T09:37:18.818276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.818288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Write session will restart in 0.009900s
2025-10-02T09:37:18.818315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Write session: Do CDS request
2025-10-02T09:37:18.818321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.826293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.827647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.827755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.827762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.827769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.827795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.827820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883424303:10043]
2025-10-02T09:37:18.828171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.828326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.828349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.828529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.828557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.828561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.828561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.828562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.828563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.828563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.828564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.828564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.828565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.828566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.828566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.828567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.828569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.828576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.828578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.828580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.828582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.828584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.828586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.828588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.828590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.828592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.828594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.828596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.828600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.828605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.828608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.828611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.828613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.828616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.828618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.828622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.828626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.828629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.828631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.828633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.828635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.828638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.828640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.828642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.828645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.828647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.828649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.828652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.828654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.828657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.828659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.828662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.828678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.829206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.829297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.829309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3567
2025-10-02T09:37:18.829450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.829472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.829479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.829482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.829789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3567 sessionId:  describe result for acl check
2025-10-02T09:37:18.829812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.829818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.829819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.829823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.830173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.831668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.835707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.835717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.835720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959012330:9014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.835726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.836129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.837656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.837668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.837669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.837671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.837675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3566 [2:7556556175883424303:10043]
2025-10-02T09:37:18.837682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.837691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.837693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.837694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.837695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.837704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.837706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.837711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.837739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.837745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.837746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.837748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.837750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.837785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.837790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.837796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.837801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.837809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.837820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012364:9014], now have 1 active actors on pipe
2025-10-02T09:37:18.837822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012204:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.837826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.837827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.837828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.837836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.837843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.837849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.837851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.837852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.837852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.837853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.837865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.837867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.837867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3566
2025-10-02T09:37:18.837875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.837880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3566
2025-10-02T09:37:18.837884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.837886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.837904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.837911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.837913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.837914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.837918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.837923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.837930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.838026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.838038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.838053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.838110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3567 partition: 0 MaxSeqNo: 36 sessionId: src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0
2025-10-02T09:37:18.838341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab721d49-6e0b651f-ea69e39b-3f8ffaef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.840593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Write session: try to update token
2025-10-02T09:37:18.840607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.846948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.846961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.846962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.846963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.846969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.846971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.846973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883424298:10043]
2025-10-02T09:37:18.846993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.846994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.846996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.846996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.846997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.846998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.847114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.857162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3567 sessionId: src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.859440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:18.918171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556175959012371:9514]
2025-10-02T09:37:18.918298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3566, pipe: [1:7556556175959012371:9514]
2025-10-02T09:37:18.957637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:18.957879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.957888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.957901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012371:9514], now have 1 active actors on pipe
2025-10-02T09:37:18.958015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:18.957998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:18.958008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:18.958041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556175959012371:9514]
2025-10-02T09:37:18.958046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3567 reason: error at write: Disconnected sessionId: src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0
2025-10-02T09:37:18.958059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:18.958167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3567 sessionId: src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0 is DEAD
2025-10-02T09:37:18.958322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:18.958328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Write session will restart in 0.009230s
2025-10-02T09:37:18.958347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Write session: Do CDS request
2025-10-02T09:37:18.958353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:18.966741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:18.968085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:18.968167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.968191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:18.968198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:18.968204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:18.968230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:18.968252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556175883424462:10040]
2025-10-02T09:37:18.968254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:18.968264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3568
2025-10-02T09:37:18.968391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:18.968412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:18.968421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:18.968423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:18.968592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:18.968753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:18.968776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:18.968770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3568 sessionId:  describe result for acl check
2025-10-02T09:37:18.968822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:18.968829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:18.968831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:18.968836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:18.968965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:18.968995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.969000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.969000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.969001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.969001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.969002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.969002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.969003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.969003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.969004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.969004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.969005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.969008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.969015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.969017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.969019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.969021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.969023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.969025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.969027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.969029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.969031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.969033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.969035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.969039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.969043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:18.969046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.969049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:18.969051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.969054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:18.969056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.969058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:18.969060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.969063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:18.969065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.969068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:18.969070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.969073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:18.969076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.969079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:18.969081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.969083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:18.969086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.969088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.969090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.969093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.969095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.969097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.969114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:18.969265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:18.970850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:18.975319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:18.975329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:18.975331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556175959012502:9046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:18.975336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:18.976499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:18.977988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:18.978000Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:18.978001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:18.978003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:18.978006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3567 [2:7556556175883424462:10040]
2025-10-02T09:37:18.978013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:18.978022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:18.978023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.978025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.978026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.978036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:18.978042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:18.978046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:18.978075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.978080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.978081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.978082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:18.978084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:18.978119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:18.978124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.978130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:18.978136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:18.978143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:18.978155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012378:2446], now have 1 active actors on pipe
2025-10-02T09:37:18.978161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556175959012539:9046], now have 1 active actors on pipe
2025-10-02T09:37:18.978164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.978166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.978167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.978174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:18.978183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:18.978188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:18.978190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:18.978191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:18.978193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:18.978179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3567
2025-10-02T09:37:18.978197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3567
2025-10-02T09:37:18.978195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:18.978209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.978211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:18.978213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:18.978223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.978225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.978252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:18.978259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:18.978262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:18.978262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:18.978267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:18.978272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:18.978282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.978375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:18.978380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:18.978387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:18.978437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3568 partition: 0 MaxSeqNo: 36 sessionId: src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0
2025-10-02T09:37:18.978668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdfda68-2edd704f-e6541bcb-2d0ff259_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:18.980960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Write session: try to update token
2025-10-02T09:37:18.980975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:18.987284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:18.987295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:18.987296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:18.987297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:18.987301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.987303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.987305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556175883424457:10040]
2025-10-02T09:37:18.987323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:18.987324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:18.987326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:18.987327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:18.987328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:18.987328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:18.987504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:18.993198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3568 sessionId: src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:18.995322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.057980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253979845:9514]
2025-10-02T09:37:19.058184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3567, pipe: [1:7556556180253979845:9514]
2025-10-02T09:37:19.096901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.097146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.097156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.097168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253979845:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.097290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.097423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253979845:9514]
2025-10-02T09:37:19.097452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.097459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.097532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3568 reason: status is not ok: tablet will be restarted right now sessionId: src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0
2025-10-02T09:37:19.097675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3568 sessionId: src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0 is DEAD
2025-10-02T09:37:19.097815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:19.097826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Write session will restart in 0.008541s
2025-10-02T09:37:19.097849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Write session: Do CDS request
2025-10-02T09:37:19.097854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.105943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.107179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.107291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.107319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.107329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3569
2025-10-02T09:37:19.107394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.107401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.107407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.107432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.107439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.107455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178391919:10032]
2025-10-02T09:37:19.107462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.107466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.107469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.107799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.107822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3569 sessionId:  describe result for acl check
2025-10-02T09:37:19.107853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.107858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.107860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.107864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.107957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.107979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.108158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.108184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.108188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.108189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.108189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.108190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.108190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.108191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.108192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.108192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.108193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.108193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.108194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.108197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.108204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.108206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.108208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.108210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.108212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.108214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.108216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.108217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.108219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.108221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.108223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.108227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.108230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.108234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.108237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.108240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.108243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.108245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.108247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.108250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.108252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.108255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.108257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.108261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.108264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.108266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.108271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.108275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.108277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.108279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.108282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.108284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.108287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.108289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.108291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.108278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.108307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.109705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.113512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.113523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.113526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253979970:9049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.113531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.115643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.117116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.117128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.117129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.117132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.117135Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3568 [2:7556556180178391919:10032]
2025-10-02T09:37:19.117141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.117151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.117152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.117154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.117155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.117164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.117168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.117172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.117200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.117205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.117206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.117208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.117209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.117245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.117250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.117256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.117261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.117269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.117282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253979847:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.117287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980009:9049], now have 1 active actors on pipe
2025-10-02T09:37:19.117291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.117293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.117294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.117302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.117309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.117318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.117319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.117313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3568
2025-10-02T09:37:19.117312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3568
2025-10-02T09:37:19.117325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.117334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.117335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.117337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.117338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.117339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.117346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.117348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.117415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24f97a8d-991eda30-7136a6d7-4a398536_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.117424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.117426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.117427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.117433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.117438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.117450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.117559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.117564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.117572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.117633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3569 partition: 0 MaxSeqNo: 36 sessionId: src_id|24f97a8d-991eda30-7136a6d7-4a398536_0
2025-10-02T09:37:19.117853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feead1a4-35ab0227-1826e65b-bc5ffb8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24f97a8d-991eda30-7136a6d7-4a398536_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.120140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Write session: try to update token
2025-10-02T09:37:19.120154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.126514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.126527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.126529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.126529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.126533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.126535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.126539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178391914:10032]
2025-10-02T09:37:19.126557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.126559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.126561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.126563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.126563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.126564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.126675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.133519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3569 sessionId: src_id|24f97a8d-991eda30-7136a6d7-4a398536_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.135863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.197723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980029:9514]
2025-10-02T09:37:19.198141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3568, pipe: [1:7556556180253980029:9514]
2025-10-02T09:37:19.235128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.235414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.235423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.235436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980029:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.235539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.235586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.235630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980029:9514]
2025-10-02T09:37:19.235635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.235710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3569 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24f97a8d-991eda30-7136a6d7-4a398536_0
2025-10-02T09:37:19.235863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3569 sessionId: src_id|24f97a8d-991eda30-7136a6d7-4a398536_0 is DEAD
2025-10-02T09:37:19.236021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:19.236032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Write session will restart in 0.005641s
2025-10-02T09:37:19.236049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Write session: Do CDS request
2025-10-02T09:37:19.236053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.243230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.243300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.243312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3570
2025-10-02T09:37:19.243411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.243434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.243441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.243445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.243796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3570 sessionId:  describe result for acl check
2025-10-02T09:37:19.243824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.243829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.243830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.243834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.244051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.244258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.245347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.245447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.245453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.245459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.245486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.245508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392119:10012]
2025-10-02T09:37:19.245846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.245991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.246013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.246188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.246275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.246280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.246280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.246281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.246282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.246282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.246283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.246283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.246284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.246285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.246285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.246286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.246288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.246295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.246297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.246299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.246301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.246303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.246305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.246307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.246309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.246311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.246313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.246315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.246319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.246324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.246327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.246330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.246335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.246337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.246341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.246344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.246347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.246350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.246352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.246355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.246357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.246360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.246362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.246364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.246367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.246370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.246372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.246375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.246377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.246383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.246385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.246388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.246405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.246410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.251965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.251975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.251978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253980162:9068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.251983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.254865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.256445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.256456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.256458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.256460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.256464Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3569 [2:7556556180178392119:10012]
2025-10-02T09:37:19.256471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.256483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.256484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.256486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.256487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.256496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.256499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.256506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.256538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.256544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.256545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.256547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.256549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.256589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.256596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.256602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.256608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.256618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.256632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980039:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.256636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980202:9068], now have 1 active actors on pipe
2025-10-02T09:37:19.256639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.256640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.256641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.256648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.256657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.256663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.256665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.256667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.256669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.256671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.256686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.256692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.256699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.256691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3569
2025-10-02T09:37:19.256723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.256728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.256744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5011e4ec-86250744-71439a82-b8021eab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.256751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.256753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.256755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.256762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.256769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.256777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.256922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.256928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.256937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.257007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3570 partition: 0 MaxSeqNo: 36 sessionId: src_id|5011e4ec-86250744-71439a82-b8021eab_0
2025-10-02T09:37:19.257011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3569
2025-10-02T09:37:19.257274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f97a8d-991eda30-7136a6d7-4a398536_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5011e4ec-86250744-71439a82-b8021eab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.259735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Write session: try to update token
2025-10-02T09:37:19.259749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.266862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.266876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.266877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.266878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.266882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.266884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.266887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392113:10012]
2025-10-02T09:37:19.266907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.266911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.266914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.266914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.266915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.266916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.267114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.272060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3570 sessionId: src_id|5011e4ec-86250744-71439a82-b8021eab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.274359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.335981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980210:9514]
2025-10-02T09:37:19.336149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3569, pipe: [1:7556556180253980210:9514]
2025-10-02T09:37:19.376094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.376287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.376296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.376320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980210:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.376456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.376504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.376530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980210:9514]
2025-10-02T09:37:19.376547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.376628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3570 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5011e4ec-86250744-71439a82-b8021eab_0
2025-10-02T09:37:19.376776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3570 sessionId: src_id|5011e4ec-86250744-71439a82-b8021eab_0 is DEAD
2025-10-02T09:37:19.376960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:19.376970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Write session will restart in 0.009624s
2025-10-02T09:37:19.376990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Write session: Do CDS request
2025-10-02T09:37:19.376994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.384756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.386153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.386261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.386268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.386273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.386301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.386323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392293:10003]
2025-10-02T09:37:19.386670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.386848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.386871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.387046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.387074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.387079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.387080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.387081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.387081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.387082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.387082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.387083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.387083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.387084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.387087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.387094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.387096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.387098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.387100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.387102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.387104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.387105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.387107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.387110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.387112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.387114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.387118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.387121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.387124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.387127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.387129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.387132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.387134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.387136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.387138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.387141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.387143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.387145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.387166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.387148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.387150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.387152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.387154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.387166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.387169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.387171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.387173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.387175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.387178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.387180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.387182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.387198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.387438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.387450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3571
2025-10-02T09:37:19.387539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.387560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.387567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.387570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.387897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3571 sessionId:  describe result for acl check
2025-10-02T09:37:19.387926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.387931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.387932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.387936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.388349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.389669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.394084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.394093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.394096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253980342:9081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.394101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.394618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.396276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.396289Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.396290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.396292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.396296Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3570 [2:7556556180178392293:10003]
2025-10-02T09:37:19.396304Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.396314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.396320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.396322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.396323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.396333Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.396336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.396341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.396373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.396378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.396379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.396381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.396382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.396468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.396474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.396480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.396486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.396494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.396502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3570
2025-10-02T09:37:19.396505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3570
2025-10-02T09:37:19.396511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980213:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.396516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980377:9081], now have 1 active actors on pipe
2025-10-02T09:37:19.396519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.396521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.396522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.396528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.396536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.396541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.396543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.396543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.396544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.396544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.396571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.396577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.396585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.396590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.396597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.396609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef64845f-6a8acab6-964e3652-2554012f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.396615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.396617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.396618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.396624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.396629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.396639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.396737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.396743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.396750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.396830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3571 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef64845f-6a8acab6-964e3652-2554012f_0
2025-10-02T09:37:19.397063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011e4ec-86250744-71439a82-b8021eab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef64845f-6a8acab6-964e3652-2554012f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.399384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Write session: try to update token
2025-10-02T09:37:19.399397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.405645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.405657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.405658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.405659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.405663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.405665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.405669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392288:10003]
2025-10-02T09:37:19.405687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.405688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.405690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.405690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.405691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.405692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.405814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.411713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3571 sessionId: src_id|ef64845f-6a8acab6-964e3652-2554012f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.414038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.476811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980397:9514]
2025-10-02T09:37:19.477040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3570, pipe: [1:7556556180253980397:9514]
2025-10-02T09:37:19.513392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.513684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.513693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.513705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980397:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.513845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.513931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.514036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3571 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef64845f-6a8acab6-964e3652-2554012f_0
2025-10-02T09:37:19.514149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.514188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3571 sessionId: src_id|ef64845f-6a8acab6-964e3652-2554012f_0 is DEAD
2025-10-02T09:37:19.514209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980397:9514]
2025-10-02T09:37:19.514329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:19.514339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Write session will restart in 0.006820s
2025-10-02T09:37:19.514361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Write session: Do CDS request
2025-10-02T09:37:19.514366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.522006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.522160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.522287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.522297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3572
2025-10-02T09:37:19.522396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.522420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.522428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.522431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.522760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3572 sessionId:  describe result for acl check
2025-10-02T09:37:19.522784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.522791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.522792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.522796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.523238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.523403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.523525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.523532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.523539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.523568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.523593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392460:9998]
2025-10-02T09:37:19.523933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.524134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.524169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.524431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.524468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.524472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.524472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.524473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.524473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.524474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.524474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.524475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.524475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.524476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.524476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.524477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.524480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.524486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.524488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.524490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.524492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.524494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.524496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.524498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.524500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.524502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.524504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.524506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.524510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.524514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.524517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.524520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.524522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.524525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.524527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.524530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.524533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.524536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.524538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.524540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.524542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.524545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.524547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.524549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.524551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.524554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.524556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.524558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.524561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.524563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.524565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.524568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.524585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.524912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.529454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.529463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.529466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253980524:9094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.529470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.531979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.533418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.533431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.533432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.533436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.533440Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3571 [2:7556556180178392460:9998]
2025-10-02T09:37:19.533447Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.533457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.533458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.533460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.533461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.533470Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.533473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.533477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.533506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.533511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.533512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.533515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.533516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.533553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.533559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.533565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.533570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.533579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.533590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980398:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.533594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980562:9094], now have 1 active actors on pipe
2025-10-02T09:37:19.533598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.533599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.533602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.533611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.533619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.533626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.533629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.533630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.533630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.533631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.533645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.533650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.533651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.533647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3571
2025-10-02T09:37:19.533657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3571
2025-10-02T09:37:19.533722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.533728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.533744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.533747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.533749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.533750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.533755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.533762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.533769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.533894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.533899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.533905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.533970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3572 partition: 0 MaxSeqNo: 36 sessionId: src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0
2025-10-02T09:37:19.534195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64845f-6a8acab6-964e3652-2554012f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.536494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Write session: try to update token
2025-10-02T09:37:19.536508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.542744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.542754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.542755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.542756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.542760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.542762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.542765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392455:9998]
2025-10-02T09:37:19.542783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.542788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.542789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.542797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.542801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.542807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.542900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.548418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3572 sessionId: src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.550693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.614524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980570:9514]
2025-10-02T09:37:19.614732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3571, pipe: [1:7556556180253980570:9514]
2025-10-02T09:37:19.653170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.653445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.653454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.653465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980570:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.653580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.653670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.653674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.653744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980570:9514]
2025-10-02T09:37:19.653757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0
2025-10-02T09:37:19.653906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3572 sessionId: src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0 is DEAD
2025-10-02T09:37:19.654042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:19.654047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Write session will restart in 0.009935s
2025-10-02T09:37:19.654065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Write session: Do CDS request
2025-10-02T09:37:19.654071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.661857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.663402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.663508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.663515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.663521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.663546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.663588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392624:9996]
2025-10-02T09:37:19.663929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.664098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.664122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.664299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.664330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.664334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.664335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.664335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.664336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.664336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.664337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.664338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.664338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.664339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.664339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.664340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.664342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.664349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.664352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.664354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.664356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.664358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.664360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.664362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.664364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.664366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.664368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.664370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.664373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.664377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.664380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.664383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.664386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.664388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.664390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.664393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.664395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.664398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.664400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.664402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.664405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.664411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.664415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.664417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.664420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.664422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.664424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.664426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.664429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.664431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.664433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.664439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.664456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.665197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.665315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.665326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3573
2025-10-02T09:37:19.665422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.665443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.665451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.665455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.665778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3573 sessionId:  describe result for acl check
2025-10-02T09:37:19.665804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.665809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.665811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.665816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.666227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.667715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.671328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.671337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.671339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253980703:9109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.671345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.671884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.673446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.673459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.673460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.673463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.673466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3572 [2:7556556180178392624:9996]
2025-10-02T09:37:19.673473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.673483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.673484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.673486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.673487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.673496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.673500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.673505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.673536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.673541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.673542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.673544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.673545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.673585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.673590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.673596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.673602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.673610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.673623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980737:9109], now have 1 active actors on pipe
2025-10-02T09:37:19.673628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980571:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.673632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.673633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.673635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.673642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.673649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.673652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.673654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.673655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.673658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.673660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.673674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.673679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.673681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.673687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3572
2025-10-02T09:37:19.673694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3572
2025-10-02T09:37:19.673721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.673727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.673743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.673746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.673748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.673749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.673754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.673764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.673772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.673873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.673878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.673885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.673955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3573 partition: 0 MaxSeqNo: 36 sessionId: src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0
2025-10-02T09:37:19.674188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2237b9-180d67ba-c04bb1df-cb964e4d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.676451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Write session: try to update token
2025-10-02T09:37:19.676463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.682661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:19.682674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.682678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.682698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:19.682703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:19.682829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:19.682944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.683055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.683180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.683350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:19.683372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:19.688871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3573 sessionId: src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.691070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.691082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.691083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.691084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.691088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.691091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.691093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392619:9996]
2025-10-02T09:37:19.691111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.691114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.691117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.691117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.691118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.691119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.691154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.691237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.753784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980748:9514]
2025-10-02T09:37:19.753944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3572, pipe: [1:7556556180253980748:9514]
2025-10-02T09:37:19.800131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.800442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.800450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.800464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980748:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.800598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:19.800626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980748:9514]
2025-10-02T09:37:19.800657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.800658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:19.800661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:19.800742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3573 reason: error at write: Disconnected sessionId: src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0
2025-10-02T09:37:19.800914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3573 sessionId: src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0 is DEAD
2025-10-02T09:37:19.801062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:19.801068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Write session will restart in 0.006223s
2025-10-02T09:37:19.801091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Write session: Do CDS request
2025-10-02T09:37:19.801097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.808179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.808265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.808275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3574
2025-10-02T09:37:19.808364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.808388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.808395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.808398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.808733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3574 sessionId:  describe result for acl check
2025-10-02T09:37:19.808760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.808765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.808766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.808770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.808871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.809230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.810242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.810341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.810348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.810354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.810379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.810404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392790:9993]
2025-10-02T09:37:19.810597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.810747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.810934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.810956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.811155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.811202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.811207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.811207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.811208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.811209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.811209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.811210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.811210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.811211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.811211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.811212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.811212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.811215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.811222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.811224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.811226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.811228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.811230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.811232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.811234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.811236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.811239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.811241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.811243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.811247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.811251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.811254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.811257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.811259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.811262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.811264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.811267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.811269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.811272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.811274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.811277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.811280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.811282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.811284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.811287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.811290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.811292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.811295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.811298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.811301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.811303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.811306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.811308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.811325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.815448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.815460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.815464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253980878:9116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.815471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.819117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.820634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.820644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.820645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.820647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.820651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3573 [2:7556556180178392790:9993]
2025-10-02T09:37:19.820659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.820669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.820671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.820673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.820674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.820683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.820689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.820694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.820725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.820730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.820732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.820734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.820735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.820773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.820778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.820784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.820789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.820798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.820828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980751:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.820833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980918:9116], now have 1 active actors on pipe
2025-10-02T09:37:19.820837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.820838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.820839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.820846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.820855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.820860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.820862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.820862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.820866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.820867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.820882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.820888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.820880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3573
2025-10-02T09:37:19.820899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.820885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3573
2025-10-02T09:37:19.820918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.820923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.820938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.820945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.820948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.820949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.820953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.820959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.820970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.821085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.821089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.821097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.821165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3574 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0
2025-10-02T09:37:19.821460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69498d5-5fb4b000-e4bc5e81-6f51e9cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.823810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Write session: try to update token
2025-10-02T09:37:19.823827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.830218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:19.830229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.830233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.830253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:19.830253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:19.830389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:19.830505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.830620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.830735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:19.830917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:19.830941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:19.836529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3574 sessionId: src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.838831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:19.839098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.839111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.839119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.839120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.839122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.839123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.839127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.839129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.839131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392785:9993]
2025-10-02T09:37:19.839149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.839151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.839154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.839154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.839156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.839158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.839284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.900714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556180253980925:9514]
2025-10-02T09:37:19.900940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3573, pipe: [1:7556556180253980925:9514]
2025-10-02T09:37:19.949123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:19.949430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:19.949455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980925:9514], now have 1 active actors on pipe
2025-10-02T09:37:19.949521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:19.949595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:19.949616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:19.949623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:19.949651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556180253980925:9514]
2025-10-02T09:37:19.949682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3574 reason: error at write: Disconnected sessionId: src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0
2025-10-02T09:37:19.949806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3574 sessionId: src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0 is DEAD
2025-10-02T09:37:19.950009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:19.950019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Write session will restart in 0.009241s
2025-10-02T09:37:19.950042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Write session: Do CDS request
2025-10-02T09:37:19.950048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:19.958223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:19.959617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:19.959776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:19.959784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:19.959791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:19.959821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:19.959844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556180178392957:9990]
2025-10-02T09:37:19.960183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.960193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:19.960296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:19.960309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3575
2025-10-02T09:37:19.960353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:19.960375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:19.960417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:19.960440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:19.960447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:19.960451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:19.960552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:19.960579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.960583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.960584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.960584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.960585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.960586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.960586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.960587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.960587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.960588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.960588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.960589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.960592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.960599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.960601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.960603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.960605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.960607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.960609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.960611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.960613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.960615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.960617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.960619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.960623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.960626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:19.960630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.960633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:19.960635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.960638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:19.960640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.960642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:19.960645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.960647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:19.960650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.960652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:19.960656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.960659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:19.960661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.960664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:19.960667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.960675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:19.960677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.960679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.960682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.960685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.960688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.960691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.960706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:19.960775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3575 sessionId:  describe result for acl check
2025-10-02T09:37:19.960815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:19.960820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:19.960821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:19.960826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:19.961303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:19.962630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:19.967328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:19.967338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:19.967340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556180253981067:9130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:19.967345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:19.968027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:19.969505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:19.969516Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:19.969517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:19.969520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:19.969524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3574 [2:7556556180178392957:9990]
2025-10-02T09:37:19.969532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:19.969543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:19.969547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.969548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.969549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.969559Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:19.969563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:19.969568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:19.969605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.969610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.969612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.969614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:19.969615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:19.969655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:19.969660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.969667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:19.969674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:19.969685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:19.969698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253981101:9130], now have 1 active actors on pipe
2025-10-02T09:37:19.969703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556180253980930:2446], now have 1 active actors on pipe
2025-10-02T09:37:19.969707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.969709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.969711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.969719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:19.969726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:19.969733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:19.969735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:19.969737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:19.969737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:19.969739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:19.969735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3574
2025-10-02T09:37:19.969737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3574
2025-10-02T09:37:19.969756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.969761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:19.969763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:19.969772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.969776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.969803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee00b518-687283a-18e9c2f9-36c5737e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:19.969810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:19.969813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:19.969814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:19.969820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:19.969825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:19.969835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.969942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:19.969947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:19.969955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:19.970014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3575 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee00b518-687283a-18e9c2f9-36c5737e_0
2025-10-02T09:37:19.970277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d9a78b-f233c6dc-10f57e23-c89de684_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee00b518-687283a-18e9c2f9-36c5737e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:19.972609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Write session: try to update token
2025-10-02T09:37:19.972622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:19.978927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:19.978937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:19.978939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:19.978940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:19.978944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.978947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.978951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556180178392952:9990]
2025-10-02T09:37:19.978970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:19.978973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:19.978974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:19.978987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:19.979000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:19.979003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:19.979088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:19.985541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3575 sessionId: src_id|ee00b518-687283a-18e9c2f9-36c5737e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:19.987849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.049722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548948407:9514]
2025-10-02T09:37:20.049955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3574, pipe: [1:7556556184548948407:9514]
2025-10-02T09:37:20.095215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.095587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.095595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.095608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948407:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.095746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.095792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:20.095802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:20.095821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548948407:9514]
2025-10-02T09:37:20.095842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.095877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3575 reason: error at write: Disconnected sessionId: src_id|ee00b518-687283a-18e9c2f9-36c5737e_0
2025-10-02T09:37:20.096022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3575 sessionId: src_id|ee00b518-687283a-18e9c2f9-36c5737e_0 is DEAD
2025-10-02T09:37:20.096166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:20.096176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Write session will restart in 0.005762s
2025-10-02T09:37:20.096197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Write session: Do CDS request
2025-10-02T09:37:20.096202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.103175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.103288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.103297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3576
2025-10-02T09:37:20.103410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.103433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.103440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.103443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.103813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3576 sessionId:  describe result for acl check
2025-10-02T09:37:20.103836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.103841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.103842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.103846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.104327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.104362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.105776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.105876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.105883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.105889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.105914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.105938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473360421:9988]
2025-10-02T09:37:20.106033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.106280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.106435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.106458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.106630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.106660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.106664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.106664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.106665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.106665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.106666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.106666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.106666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.106667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.106668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.106668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.106669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.106671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.106678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.106680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.106682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.106684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.106686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.106688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.106690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.106692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.106694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.106695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.106697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.106701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.106705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.106708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.106711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.106713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.106716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.106718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.106720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.106722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.106725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.106727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.106730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.106732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.106735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.106737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.106740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.106742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.106745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.106747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.106749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.106752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.106756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.106758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.106764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.106781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.110598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.110608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.110611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548948536:9137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.110616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.114139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.115565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.115575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.115576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.115579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.115582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3575 [2:7556556184473360421:9988]
2025-10-02T09:37:20.115589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.115600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.115603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.115605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.115606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.115614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.115620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.115624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.115739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.115744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.115745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.115747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.115749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.115784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.115789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.115796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.115801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.115810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.115824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948578:9137], now have 1 active actors on pipe
2025-10-02T09:37:20.115828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948409:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.115832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.115833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.115834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.115841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.115850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.115854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.115856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.115858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.115859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.115861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.115875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.115884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.115869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3575
2025-10-02T09:37:20.115876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3575
2025-10-02T09:37:20.115890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.115903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.115908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.115924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.115931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.115933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.115934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.115940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.115946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.115953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.116078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.116087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.116103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.116175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3576 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0
2025-10-02T09:37:20.116452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee00b518-687283a-18e9c2f9-36c5737e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.118824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Write session: try to update token
2025-10-02T09:37:20.118842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.125024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.125035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.125037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.125038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.125041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.125043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.125046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473360416:9988]
2025-10-02T09:37:20.125067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.125070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.125072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.125078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.125084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.125087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.125182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.131345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3576 sessionId: src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.133743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.196140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548948585:9514]
2025-10-02T09:37:20.196335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3575, pipe: [1:7556556184548948585:9514]
2025-10-02T09:37:20.238967Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.239198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.239207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.239221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948585:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.239351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.239392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548948585:9514]
2025-10-02T09:37:20.239432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.239467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.239538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0
2025-10-02T09:37:20.239689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3576 sessionId: src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0 is DEAD
2025-10-02T09:37:20.239841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:20.239846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Write session will restart in 0.005308s
2025-10-02T09:37:20.239868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Write session: Do CDS request
2025-10-02T09:37:20.239873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.246141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.246212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.246223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3577
2025-10-02T09:37:20.246314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.246341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.246348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.246351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.246647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3577 sessionId:  describe result for acl check
2025-10-02T09:37:20.246668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.246673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.246674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.246678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.247054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.248224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.248562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.249724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.249818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.249825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.249830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.249855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.249875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473360628:9959]
2025-10-02T09:37:20.250218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.250256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.250265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.250267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548948696:9169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.250271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.250371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.250394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.250564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.250591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.250594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.250595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.250595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.250596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.250596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.250597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.250597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.250598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.250598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.250599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.250599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.250602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.250608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.250610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.250612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.250614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.250616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.250618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.250620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.250622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.250624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.250626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.250628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.250632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.250635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.250639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.250641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.250643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.250646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.250648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.250651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.250653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.250655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.250658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.250660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.250662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.250665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.250666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.250669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.250671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.250674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.250676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.250678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.250681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.250683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.250687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.250690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.250708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.258302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.259969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.259978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.259979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.259982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.259987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3576 [2:7556556184473360628:9959]
2025-10-02T09:37:20.259996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.260005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.260009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.260010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.260011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.260020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.260027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.260031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.260063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.260068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.260069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.260071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.260072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.260109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.260113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.260120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.260130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.260146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.260164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.260169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.260171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.260181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.260192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948599:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.260197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948775:9169], now have 1 active actors on pipe
2025-10-02T09:37:20.260200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.260202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.260203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.260204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.260209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.260212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.260229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.260236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.260242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.260232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3576
2025-10-02T09:37:20.260242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3576
2025-10-02T09:37:20.260280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.260285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.260301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.260308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.260310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.260312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.260317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.260325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.260333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.260474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.260479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.260486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.260555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3577 partition: 0 MaxSeqNo: 36 sessionId: src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0
2025-10-02T09:37:20.260821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0233cc-d2f9cc40-9eef5004-b97c1ab8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.263066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Write session: try to update token
2025-10-02T09:37:20.263078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.269588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:20.269599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.269603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.269623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:20.269627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:20.269764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:20.269881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.269994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.270107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.270254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:20.270275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:20.275125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3577 sessionId: src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.277340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.277452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.277461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.277476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:20.277541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.278574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.278584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.278586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.278587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.278591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.278593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.278595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473360623:9959]
2025-10-02T09:37:20.278613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.278614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.278616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.278619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.278620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.278621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.278740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.339514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548948786:9514]
2025-10-02T09:37:20.339696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3576, pipe: [1:7556556184548948786:9514]
2025-10-02T09:37:20.390532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.397337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.397354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.397489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.397549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.397606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.397659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.397702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.397708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.397759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.397813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.397866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.397926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.397961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.397965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.398016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.398065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.398116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.398168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.398204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.398209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.398260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.398507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.398557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.398606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.398643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.398649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.398701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.398755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.398815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.398871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.398924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.398932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.399015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.399073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.399122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.399187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.399234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.399240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.399306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.399360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.399420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.399476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.399516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.399522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.399583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.399636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.399708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.399782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.399831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.399838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.399908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.399971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.400039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.400091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.400135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.400140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.400201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:20.400250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:20.400303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:20.400351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:20.400406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:20.400411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:20.400442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948786:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.400584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.400673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548948786:9514]
2025-10-02T09:37:20.400693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:20.400697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:20.400717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3577 reason: error at write: Disconnected sessionId: src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0
2025-10-02T09:37:20.400891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.400901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3577 sessionId: src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0 is DEAD
2025-10-02T09:37:20.401032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:20.401037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Write session will restart in 0.006565s
2025-10-02T09:37:20.401058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Write session: Do CDS request
2025-10-02T09:37:20.401063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.408210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.408250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.408262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3578
2025-10-02T09:37:20.408449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.408474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.408485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.408489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.408811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3578 sessionId:  describe result for acl check
2025-10-02T09:37:20.408835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.408840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.408841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.408845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.409246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.409387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.410800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.410840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.410908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.410914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.410920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.410946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.410969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473360809:9942]
2025-10-02T09:37:20.411326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.411489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.411510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.411688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.411723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.411727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.411728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.411728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.411729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.411729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.411730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.411730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.411731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.411731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.411732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.411732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.411735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.411742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.411744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.411746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.411748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.411750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.411752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.411754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.411756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.411758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.411760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.411762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.411766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.411770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.411773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.411776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.411778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.411781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.411783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.411786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.411788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.411790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.411792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.411795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.411803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.411805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.411808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.411810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.411813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.411815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.411819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.411823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.411826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.411828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.411830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.411847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.415662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.415673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.415675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548948933:9188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.415682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.419225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.420684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.420695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.420697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.420699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.420702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3577 [2:7556556184473360809:9942]
2025-10-02T09:37:20.420709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.420719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.420721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.420722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.420723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.420732Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.420735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.420739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.420772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.420777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.420778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.420780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.420782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.420835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.420840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.420847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.420852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.420862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.420874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948975:9188], now have 1 active actors on pipe
2025-10-02T09:37:20.420879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948804:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.420883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.420885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.420886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.420893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.420902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.420908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.420910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.420911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.420911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.420913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.420927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.420930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.420931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.420934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3577
2025-10-02T09:37:20.420939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3577
2025-10-02T09:37:20.420976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.420981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.420996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.420999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.421005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.421006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.421012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.421017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.421025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.421152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.421156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.421164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.421232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3578 partition: 0 MaxSeqNo: 36 sessionId: src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0
2025-10-02T09:37:20.421480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a1f4ef-a1170351-705fbd90-2ac50169_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.423742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Write session: try to update token
2025-10-02T09:37:20.423756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.429871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:20.429880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.429886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.429907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:20.429916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:20.430035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:20.430145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.430252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.430362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:20.430528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:20.430552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:20.436566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3578 sessionId: src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.438466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.438476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.438477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.438479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.438484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.438486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.438489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473360804:9942]
2025-10-02T09:37:20.438508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.438511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.438513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.438518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.438522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.438525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.438635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.438754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.500791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548948982:9514]
2025-10-02T09:37:20.500978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3577, pipe: [1:7556556184548948982:9514]
2025-10-02T09:37:20.550776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.550987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.550995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.551010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948982:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.551152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.551229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.551320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3578 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0
2025-10-02T09:37:20.551448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548948982:9514]
2025-10-02T09:37:20.551483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.551492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3578 sessionId: src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0 is DEAD
2025-10-02T09:37:20.551620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:20.551626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Write session will restart in 0.008208s
2025-10-02T09:37:20.551649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Write session: Do CDS request
2025-10-02T09:37:20.551654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.559793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.561175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.561254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.561322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.561333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3579
2025-10-02T09:37:20.561375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.561382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.561388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.561418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.561420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.561442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.561445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.561449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.561450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473360983:9937]
2025-10-02T09:37:20.561809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3579 sessionId:  describe result for acl check
2025-10-02T09:37:20.561820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.561841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.561848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.561850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.561854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.561995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.562025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.562263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.562322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.562352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.562357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.562357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.562358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.562358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.562359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.562360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.562360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.562361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.562362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.562362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.562363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.562366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.562373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.562375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.562377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.562379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.562382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.562384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.562386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.562388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.562390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.562392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.562394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.562398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.562402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.562405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.562408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.562411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.562413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.562415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.562420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.562422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.562425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.562427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.562429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.562431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.562434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.562436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.562438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.562441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.562443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.562445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.562447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.562450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.562452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.562454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.562456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.562474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.563697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.567702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.567711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.567713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548949117:9195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.567719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.569814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.571174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.571183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.571184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.571186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.571190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3578 [2:7556556184473360983:9937]
2025-10-02T09:37:20.571197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.571208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.571212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.571214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.571215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.571224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.571229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.571233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.571265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.571270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.571271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.571273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.571274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.571309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.571314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.571320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.571327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.571340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.571355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949155:9195], now have 1 active actors on pipe
2025-10-02T09:37:20.571361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548948984:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.571364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.571366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.571367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.571375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.571382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.571387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.571389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.571390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.571392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.571394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.571389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3578
2025-10-02T09:37:20.571407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.571412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.571397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3578
2025-10-02T09:37:20.571415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.571432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.571437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.571453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.571460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.571462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.571463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.571468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.571476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.571483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.571594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.571599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.571607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.571667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3579 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0
2025-10-02T09:37:20.571902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ddff5f-5c8ff602-f96c9dc2-f8c416f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.574161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Write session: try to update token
2025-10-02T09:37:20.574172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.580447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.580457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.580458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.580459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.580463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.580465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.580467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473360978:9937]
2025-10-02T09:37:20.580486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.580486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.580489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.580490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.580493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.580495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.580672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.585965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3579 sessionId: src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.588151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.651841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548949162:9514]
2025-10-02T09:37:20.652085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3578, pipe: [1:7556556184548949162:9514]
2025-10-02T09:37:20.693467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.693903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.693913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.693926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949162:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.694056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.694148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.694167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548949162:9514]
2025-10-02T09:37:20.694186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.694239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3579 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0
2025-10-02T09:37:20.694383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3579 sessionId: src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0 is DEAD
2025-10-02T09:37:20.694615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:20.694622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Write session will restart in 0.007104s
2025-10-02T09:37:20.694641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Write session: Do CDS request
2025-10-02T09:37:20.694646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.702570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.703140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.703265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.703276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3580
2025-10-02T09:37:20.703374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.703397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.703412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.703414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.703748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3580 sessionId:  describe result for acl check
2025-10-02T09:37:20.703776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.703777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.703778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.703782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.703978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.704074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.704081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.704086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.704111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.704135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473361155:9935]
2025-10-02T09:37:20.704194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.704481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.704649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.704671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.704859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.704889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.704893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.704894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.704894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.704895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.704895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.704896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.704896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.704897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.704897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.704898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.704898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.704901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.704908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.704910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.704912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.704914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.704916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.704918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.704920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.704922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.704924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.704926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.704928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.704931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.704935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.704938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.704941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.704943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.704946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.704948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.704950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.704953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.704956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.704957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.704960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.704964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.704966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.704968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.704971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.704973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.704976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.704978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.704981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.704983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.704986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.704987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.704990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.705007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.705510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.710681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.710690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.710692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548949298:9206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.710696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.712312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.713942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.713952Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.713954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.713956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.713960Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3579 [2:7556556184473361155:9935]
2025-10-02T09:37:20.713967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.713977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.713978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.713980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.713981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.713991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.713994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.713998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.714031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.714036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.714038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.714040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.714041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.714078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.714083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.714090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.714095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.714104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.714120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949336:9206], now have 1 active actors on pipe
2025-10-02T09:37:20.714125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949164:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.714130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.714131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.714133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.714140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.714152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.714154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.714159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.714160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.714162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.714164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.714181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.714186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.714172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3579
2025-10-02T09:37:20.714172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3579
2025-10-02T09:37:20.714195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.714214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.714219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.714233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.714242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.714244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.714247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.714252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.714257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.714265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.714384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.714389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.714397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.714461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3580 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0
2025-10-02T09:37:20.714685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f7e632-18efbfdd-24259b2d-3e1230f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.716971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Write session: try to update token
2025-10-02T09:37:20.716986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.723465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.723473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.723475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.723476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.723480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.723482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.723484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473361150:9935]
2025-10-02T09:37:20.723505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.723505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.723507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.723508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.723509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.723509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.723684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.729283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3580 sessionId: src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.731644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.794185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548949343:9514]
2025-10-02T09:37:20.794418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3579, pipe: [1:7556556184548949343:9514]
2025-10-02T09:37:20.835555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.835820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.835829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.835841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949343:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.835964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.836050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.836052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548949343:9514]
2025-10-02T09:37:20.836075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.836155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3580 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0
2025-10-02T09:37:20.836316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3580 sessionId: src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0 is DEAD
2025-10-02T09:37:20.836458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:20.836465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Write session will restart in 0.009319s
2025-10-02T09:37:20.836490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Write session: Do CDS request
2025-10-02T09:37:20.836495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.844877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.846161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.846265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.846272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.846278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.846302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.846324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473361328:9933]
2025-10-02T09:37:20.846663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.846829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.846851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.847025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.847052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.847056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.847057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.847057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.847058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.847059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.847059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.847060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.847060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.847061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.847061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.847062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.847065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.847071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.847073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.847076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.847078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.847080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.847081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.847083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.847085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.847087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.847089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.847091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.847095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.847099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.847102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.847105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.847107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.847110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.847111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.847114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.847117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.847119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.847121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.847124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.847126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.847129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.847131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.847134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.847136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.847138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.847140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.847143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.847145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.847147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.847149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.847152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.847178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.847204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.847301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.847311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3581
2025-10-02T09:37:20.847409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.847437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.847445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.847448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.847784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3581 sessionId:  describe result for acl check
2025-10-02T09:37:20.847811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.847816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.847818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.847822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.848246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.849914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.854034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.854043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.854046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548949483:9215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.854051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.854581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.856021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.856033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.856034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.856036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.856040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3580 [2:7556556184473361328:9933]
2025-10-02T09:37:20.856047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.856058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.856059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.856062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.856063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.856073Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.856081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.856085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.856116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.856121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.856122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.856125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.856126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.856245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3580
2025-10-02T09:37:20.856255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3580
2025-10-02T09:37:20.856257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.856263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.856269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.856275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.856284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.856298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949344:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.856301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949518:9215], now have 1 active actors on pipe
2025-10-02T09:37:20.856309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.856311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.856312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.856320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.856327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.856332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.856333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.856334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.856335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.856344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.856352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.856357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.856377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa82521c-107bc538-271cf69c-68237b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.856384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.856386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.856387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.856392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.856398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.856402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.856409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.856417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.856425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.856543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.856549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.856557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.856619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3581 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa82521c-107bc538-271cf69c-68237b66_0
2025-10-02T09:37:20.856849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5842cde-b5f7c109-fa27228c-bde5f662_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa82521c-107bc538-271cf69c-68237b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:20.859135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Write session: try to update token
2025-10-02T09:37:20.859149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:20.865595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:20.865606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:20.865607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:20.865608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:20.865612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.865614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.865617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473361323:9933]
2025-10-02T09:37:20.865636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:20.865637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:20.865640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:20.865640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.865641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:20.865641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:20.865753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:20.872007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3581 sessionId: src_id|aa82521c-107bc538-271cf69c-68237b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:20.874261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:20.935978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556184548949525:9514]
2025-10-02T09:37:20.936217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3580, pipe: [1:7556556184548949525:9514]
2025-10-02T09:37:20.977840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:20.978088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.978097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.978110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949525:9514], now have 1 active actors on pipe
2025-10-02T09:37:20.978252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:20.978335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:20.978338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556184548949525:9514]
2025-10-02T09:37:20.978372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:20.978425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3581 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa82521c-107bc538-271cf69c-68237b66_0
2025-10-02T09:37:20.978594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3581 sessionId: src_id|aa82521c-107bc538-271cf69c-68237b66_0 is DEAD
2025-10-02T09:37:20.978713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:20.978719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Write session will restart in 0.006046s
2025-10-02T09:37:20.978739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Write session: Do CDS request
2025-10-02T09:37:20.978744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:20.986153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.986280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:20.986290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3582
2025-10-02T09:37:20.986397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:20.986422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:20.986433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:20.986437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:20.986791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3582 sessionId:  describe result for acl check
2025-10-02T09:37:20.986820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:20.986825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:20.986827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:20.986832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:20.987182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:20.987307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:20.988680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:20.988672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:20.988781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:20.988788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:20.988793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:20.988832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:20.988855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556184473361502:9926]
2025-10-02T09:37:20.989197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:20.989365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:20.989387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:20.989562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:20.989594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.989598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.989599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.989599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.989600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.989600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.989601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.989601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.989602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.989602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.989603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.989603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.989606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.989612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.989614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.989616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.989618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.989620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.989622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.989624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.989626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.989628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.989630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.989632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.989636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.989640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:20.989643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.989646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:20.989648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.989651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:20.989653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.989655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:20.989659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.989661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:20.989663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.989666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:20.989668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.989670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:20.989672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.989675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:20.989677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.989680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:20.989682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.989684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.989686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.989689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.989691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.989693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.989710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:20.989835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:20.989844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:20.989847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556184548949667:9224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:20.989851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:20.997171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:20.998598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:20.998609Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:20.998610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:20.998612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:20.998616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3581 [2:7556556184473361502:9926]
2025-10-02T09:37:20.998622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:20.998631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:20.998633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.998635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.998636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.998644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:20.998651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:20.998655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:20.998686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.998690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.998691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.998693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:20.998694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:20.998731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:20.998736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:20.998742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:20.998747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:20.998758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:20.998770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949711:9224], now have 1 active actors on pipe
2025-10-02T09:37:20.998776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556184548949533:2446], now have 1 active actors on pipe
2025-10-02T09:37:20.998779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:20.998780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:20.998783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:20.998792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:20.998801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:20.998806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:20.998808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:20.998810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:20.998814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:20.998815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:20.998823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:20.998825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:20.998826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:20.998832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3581
2025-10-02T09:37:20.998837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3581
2025-10-02T09:37:20.998877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.998882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.998897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:20.998901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:20.998907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:20.998908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:20.998913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:20.998918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:20.998926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.999048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:20.999054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:20.999062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:20.999128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3582 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0
2025-10-02T09:37:20.999421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82521c-107bc538-271cf69c-68237b66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.001697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Write session: try to update token
2025-10-02T09:37:21.001712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.007896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.007907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.007908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.007909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.007913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:21.007915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:21.007917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556184473361497:9926]
2025-10-02T09:37:21.007936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.007938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.007939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.007940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.007941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.007943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.008154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.013768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3582 sessionId: src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.015986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.078334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917022:9514]
2025-10-02T09:37:21.078569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3581, pipe: [1:7556556188843917022:9514]
2025-10-02T09:37:21.120835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.121174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.121183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.121196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917022:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.121401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917022:9514]
2025-10-02T09:37:21.121427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.121413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.121433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:21.121436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:21.121506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3582 reason: error at write: Disconnected sessionId: src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0
2025-10-02T09:37:21.121663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3582 sessionId: src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0 is DEAD
2025-10-02T09:37:21.121805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:21.121811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Write session will restart in 0.005601s
2025-10-02T09:37:21.121835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Write session: Do CDS request
2025-10-02T09:37:21.121840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.128168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.128295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.128306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3583
2025-10-02T09:37:21.128412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.128434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.128441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.128444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.128824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3583 sessionId:  describe result for acl check
2025-10-02T09:37:21.128855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.128860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.128861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.128867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.129294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.130383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.131123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.131806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.131910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.131916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.131922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.131949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.131972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768328972:9924]
2025-10-02T09:37:21.132320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.132499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.132521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.132695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.132723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.132727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.132727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.132728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.132729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.132729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.132730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.132730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.132731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.132731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.132735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.132742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.132744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.132746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.132748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.132750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.132752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.132754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.132756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.132759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.132761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.132763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.132767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.132771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.132774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.132777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.132779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.132782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.132784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.132786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.132788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.132791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.132794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.132797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.132799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.132815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.132817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.132819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.132822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.132824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.132826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.132829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.132831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.132833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.132835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.132838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.132857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.132983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.132992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.132995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843917120:9232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.133001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.140296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.141680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.141690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.141691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.141694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.141698Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3582 [2:7556556188768328972:9924]
2025-10-02T09:37:21.141705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.141717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.141720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.141722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.141723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.141734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.141743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.141749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.141796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.141803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.141806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.141808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.141810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.141852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.141856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.141863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.141868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.141879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.141893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917198:9232], now have 1 active actors on pipe
2025-10-02T09:37:21.141898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917023:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.141902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.141903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.141904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.141912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.141920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.141927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.141930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.141931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.141932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.141932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.141948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.141953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.141954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.141959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3582
2025-10-02T09:37:21.141961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3582
2025-10-02T09:37:21.141999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.142004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.142019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.142026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.142028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.142029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.142034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.142040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.142049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.142152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.142156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.142164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.142225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3583 partition: 0 MaxSeqNo: 36 sessionId: src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0
2025-10-02T09:37:21.142519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e29b55-6ffe8523-8eda4b1a-bdaca365_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.144869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Write session: try to update token
2025-10-02T09:37:21.144883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.151336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.151347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.151348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.151349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.151353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.151355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.151358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768328967:9924]
2025-10-02T09:37:21.151377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.151381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.151382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.151382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.151385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.151388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.151497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.157271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3583 sessionId: src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.159667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.221707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917207:9514]
2025-10-02T09:37:21.221872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3582, pipe: [1:7556556188843917207:9514]
2025-10-02T09:37:21.262998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.263413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.263422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.263435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917207:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.263573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.263634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:21.263710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3583 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0
2025-10-02T09:37:21.263866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3583 sessionId: src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0 is DEAD
2025-10-02T09:37:21.264009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:21.264018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Write session will restart in 0.005135s
2025-10-02T09:37:21.264037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Write session: Do CDS request
2025-10-02T09:37:21.264042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.264044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.264085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917207:9514]
2025-10-02T09:37:21.270181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.270259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.270269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3584
2025-10-02T09:37:21.270353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.270375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.270381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.270385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.270692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3584 sessionId:  describe result for acl check
2025-10-02T09:37:21.270715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.270719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.270721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.270724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.271119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.272594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.272825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.274001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.274106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.274113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.274119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.274149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.274183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768329179:9897]
2025-10-02T09:37:21.274527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.274690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.274713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.274761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.274769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.274773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843917297:9241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.274778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.274908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.274943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.274947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.274948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.274948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.274949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.274949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.274950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.274951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.274951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.274952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.274952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.274953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.274956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.274962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.274964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.274967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.274968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.274970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.274972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.274974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.274976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.274978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.274980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.274982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.274986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.274990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.274993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.274996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.274998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.275001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.275003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.275006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.275008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.275011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.275013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.275016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.275018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.275021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.275023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.275025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.275027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.275030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.275033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.275036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.275041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.275046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.275050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.275070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.282443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.284038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.284050Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.284051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.284053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.284058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3583 [2:7556556188768329179:9897]
2025-10-02T09:37:21.284066Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.284076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.284078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.284080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.284081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.284090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.284092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.284096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.284127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.284132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.284133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.284135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.284137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.284175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.284180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.284187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.284192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.284203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.284217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917394:9241], now have 1 active actors on pipe
2025-10-02T09:37:21.284223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917221:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.284227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.284230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.284231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.284238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.284246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.284248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.284250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.284251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.284256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.284258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.284273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.284280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.284284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.284282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3583
2025-10-02T09:37:21.284286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3583
2025-10-02T09:37:21.284329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.284334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.284349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.284355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.284358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.284358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.284364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.284369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.284378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.284492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.284497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.284505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.284569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3584 partition: 0 MaxSeqNo: 36 sessionId: src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0
2025-10-02T09:37:21.284846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f19a84ad-926055fa-902bf2fe-db50bf63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.287645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Write session: try to update token
2025-10-02T09:37:21.287658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.293645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.293659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.293660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.293661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.293666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.293673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.293675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768329174:9897]
2025-10-02T09:37:21.293697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.293701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.293702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.293701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.293704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.293707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.293814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.300045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3584 sessionId: src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.302431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.364011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917417:9514]
2025-10-02T09:37:21.364236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3583, pipe: [1:7556556188843917417:9514]
2025-10-02T09:37:21.405316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.405603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.405612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.405625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917417:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.405763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.405796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917417:9514]
2025-10-02T09:37:21.405804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:21.405807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:21.405821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.405869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3584 reason: error at write: Disconnected sessionId: src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0
2025-10-02T09:37:21.406021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3584 sessionId: src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0 is DEAD
2025-10-02T09:37:21.406157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:21.406168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Write session will restart in 0.009190s
2025-10-02T09:37:21.406183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Write session: Do CDS request
2025-10-02T09:37:21.406187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.414715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.416186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.416194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.416312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.416318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.416324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3585
2025-10-02T09:37:21.416325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.416331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.416361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.416386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768329375:9890]
2025-10-02T09:37:21.416650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.416674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.416682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.416685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.416753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.416937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.416966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.417039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3585 sessionId:  describe result for acl check
2025-10-02T09:37:21.417066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.417071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.417072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.417075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.417178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.417212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.417216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.417216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.417217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.417217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.417218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.417218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.417219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.417219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.417220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.417220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.417221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.417224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.417231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.417233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.417235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.417237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.417239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.417241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.417243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.417245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.417247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.417249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.417251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.417255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.417259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.417263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.417266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.417268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.417271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.417275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.417277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.417280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.417283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.417285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.417288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.417290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.417296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.417298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.417301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.417303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.417306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.417308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.417310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.417312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.417315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.417317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.417319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.417338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.417457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.418719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.422695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.422704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.422707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843917571:9264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.422712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.424738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.426261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.426272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.426273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.426275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.426279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3584 [2:7556556188768329375:9890]
2025-10-02T09:37:21.426289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.426299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.426303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.426304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.426305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.426315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.426318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.426323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.426356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.426361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.426362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.426364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.426366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.426405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.426410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.426417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.426423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.426434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.426449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917608:9264], now have 1 active actors on pipe
2025-10-02T09:37:21.426453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917430:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.426456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.426457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.426459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.426465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.426473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.426478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.426480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.426481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.426483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.426485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.426483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3584
2025-10-02T09:37:21.426485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3584
2025-10-02T09:37:21.426501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.426506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.426507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.426516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.426518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.426548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.426557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.426559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.426560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.426565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.426571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.426582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.426695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.426699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.426706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.426768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3585 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0
2025-10-02T09:37:21.427011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48d3e33-b6564270-fe49f1b8-5d9617e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.429525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Write session: try to update token
2025-10-02T09:37:21.429540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.435696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.435706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.435707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.435708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.435713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.435715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.435717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768329369:9890]
2025-10-02T09:37:21.435736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.435738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.435740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.435741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.435744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.435746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.435842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.441401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3585 sessionId: src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.443688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.505853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917616:9514]
2025-10-02T09:37:21.506039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3584, pipe: [1:7556556188843917616:9514]
2025-10-02T09:37:21.547584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.547830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.547839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.547851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917616:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.547975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.548066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.548086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917616:9514]
2025-10-02T09:37:21.548115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:21.548208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3585 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0
2025-10-02T09:37:21.548349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3585 sessionId: src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0 is DEAD
2025-10-02T09:37:21.548493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:21.548504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Write session will restart in 0.007505s
2025-10-02T09:37:21.548528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Write session: Do CDS request
2025-10-02T09:37:21.548533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.556959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.557194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.557309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.557320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3586
2025-10-02T09:37:21.557436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.557462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.557470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.557474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.557821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3586 sessionId:  describe result for acl check
2025-10-02T09:37:21.557845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.557850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.557852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.557856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.558228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.558295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.558327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.558333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.558339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.558363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.558387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768329554:9885]
2025-10-02T09:37:21.558737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.558900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.558921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.559098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.559124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.559128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.559129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.559129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.559130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.559130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.559131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.559131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.559132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.559132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.559133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.559133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.559136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.559143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.559145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.559147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.559149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.559151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.559153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.559155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.559157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.559159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.559161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.559163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.559166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.559179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.559182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.559185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.559187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.559193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.559195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.559198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.559200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.559203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.559205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.559208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.559210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.559216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.559218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.559220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.559224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.559227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.559229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.559233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.559238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.559241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.559243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.559245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.559261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.560119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.565069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.565080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.565082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843917757:9274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.565089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.566696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.568160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.568170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.568171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.568174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.568177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3585 [2:7556556188768329554:9885]
2025-10-02T09:37:21.568184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.568195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.568196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.568198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.568199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.568209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.568215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.568220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.568249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.568254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.568255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.568257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.568258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.568297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.568301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.568308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.568313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.568321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.568337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917796:9274], now have 1 active actors on pipe
2025-10-02T09:37:21.568342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917617:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.568346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.568347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.568349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.568356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.568365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.568367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.568372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.568373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.568374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.568376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.568390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.568398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.568382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3585
2025-10-02T09:37:21.568389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3585
2025-10-02T09:37:21.568400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.568419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.568424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.568441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.568448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.568450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.568452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.568457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.568463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.568470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.568575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.568580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.568588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.568653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3586 partition: 0 MaxSeqNo: 36 sessionId: src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0
2025-10-02T09:37:21.568956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0cc242-b04f4b67-d6b6889-1bbb8b6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.571391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Write session: try to update token
2025-10-02T09:37:21.571406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.577651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.577663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.577664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.577665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.577668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.577671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.577673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768329549:9885]
2025-10-02T09:37:21.577691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.577696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.577695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.577697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.577698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.577709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.577816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.583699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3586 sessionId: src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.586051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.648191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917806:9514]
2025-10-02T09:37:21.648420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3585, pipe: [1:7556556188843917806:9514]
2025-10-02T09:37:21.691318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.691625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.691636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.691649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917806:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.691845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917806:9514]
2025-10-02T09:37:21.691864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:21.691867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:21.691876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.691944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3586 reason: error at write: Disconnected sessionId: src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0
2025-10-02T09:37:21.692119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3586 sessionId: src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0 is DEAD
2025-10-02T09:37:21.692139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.692254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:21.692264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Write session will restart in 0.008169s
2025-10-02T09:37:21.692283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Write session: Do CDS request
2025-10-02T09:37:21.692287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.700427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.701178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.701259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.701270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3587
2025-10-02T09:37:21.701379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.701403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.701411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.701414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.701769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3587 sessionId:  describe result for acl check
2025-10-02T09:37:21.701800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.701805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.701806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.701811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.701843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.701940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.701946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.701952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.701977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.702001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768329734:9882]
2025-10-02T09:37:21.702297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.702335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.702496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.702517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.702689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.702717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.702721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.702721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.702722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.702722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.702724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.702724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.702725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.702726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.702726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.702729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.702735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.702737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.702740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.702742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.702744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.702745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.702747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.702749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.702752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.702753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.702755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.702759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.702762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.702766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.702769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.702771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.702773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.702776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.702778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.702782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.702784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.702786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.702788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.702791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.702793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.702795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.702798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.702800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.702803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.702805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.702807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.702810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.702815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.702817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.702819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.702835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.703916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.708032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.708042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.708044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843917949:9286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.708050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.710207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.711569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.711578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.711579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.711582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.711586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3586 [2:7556556188768329734:9882]
2025-10-02T09:37:21.711594Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.711605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.711610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.711612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.711613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.711622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.711628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.711632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.711665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.711670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.711671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.711673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.711674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.711712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.711716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.711723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.711728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.711739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.711755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917808:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.711760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917988:9286], now have 1 active actors on pipe
2025-10-02T09:37:21.711763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.711765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.711766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.711774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.711784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.711788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.711790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.711791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.711792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.711794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.711808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.711813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.711815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.711811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3586
2025-10-02T09:37:21.711812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3586
2025-10-02T09:37:21.711846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.711851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.711865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.711872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.711875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.711876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.711882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.711890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.711897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.712022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.712027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.712034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.712095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3587 partition: 0 MaxSeqNo: 36 sessionId: src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0
2025-10-02T09:37:21.712334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96fb4f81-b3c4bd58-55be80ef-4775b4bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.714694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Write session: try to update token
2025-10-02T09:37:21.714708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.724985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:21.724999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.725006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.725034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:21.725041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:21.725180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:21.725301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:21.725411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:21.725536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:21.725695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:21.725721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:21.727310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3587 sessionId: src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.729505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.729517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.729518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.729519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.729524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.729526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.729529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768329729:9882]
2025-10-02T09:37:21.729549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.729551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.729553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.729556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.729558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.729558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.729671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.729755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.792063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843917995:9514]
2025-10-02T09:37:21.792323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3586, pipe: [1:7556556188843917995:9514]
2025-10-02T09:37:21.841948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.842366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.842374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.842388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917995:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.842536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.842581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843917995:9514]
2025-10-02T09:37:21.842607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.842611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:21.842687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0
2025-10-02T09:37:21.842828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3587 sessionId: src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0 is DEAD
2025-10-02T09:37:21.842978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:21.842990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Write session will restart in 0.007624s
2025-10-02T09:37:21.843016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Write session: Do CDS request
2025-10-02T09:37:21.843021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.851205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.851300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.851311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3588
2025-10-02T09:37:21.851412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.851436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.851444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.851447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.851793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3588 sessionId:  describe result for acl check
2025-10-02T09:37:21.851825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.851830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.851832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.851836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.851856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.852292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.853297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.853395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.853401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.853408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.853432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.853455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768329914:9877]
2025-10-02T09:37:21.853802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.853959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.853981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.853989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:21.854154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.854185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.854189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.854190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.854190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.854191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.854191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.854192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.854193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.854193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.854193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.854194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.854195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.854197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.854204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.854206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.854208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.854210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.854212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.854214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.854216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.854218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.854220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.854222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.854223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.854227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.854232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.854235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.854238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.854240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.854243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.854246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.854249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.854251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.854253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.854255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.854258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.854260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.854264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.854266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.854268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.854270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.854274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.854276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.854278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.854280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.854283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.854285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.854287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.854304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.859144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:21.859155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:21.859161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843918139:9303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:21.859167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:21.861712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:21.863244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:21.863252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:21.863254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:21.863256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:21.863259Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3587 [2:7556556188768329914:9877]
2025-10-02T09:37:21.863268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:21.863278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:21.863280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.863281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.863283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.863291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:21.863298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:21.863303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:21.863336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.863341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.863342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.863343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:21.863345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:21.863383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:21.863389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.863394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.863399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.863408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:21.863422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843917998:2446], now have 1 active actors on pipe
2025-10-02T09:37:21.863428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843918179:9303], now have 1 active actors on pipe
2025-10-02T09:37:21.863431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.863432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.863433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.863441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:21.863448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:21.863453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:21.863455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:21.863456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:21.863458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:21.863460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:21.863474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.863479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:21.863480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:21.863489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3587
2025-10-02T09:37:21.863493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3587
2025-10-02T09:37:21.863522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.863528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.863543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:21.863550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:21.863552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:21.863553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:21.863561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:21.863569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:21.863577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.863697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.863702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.863710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:21.863777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3588 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0
2025-10-02T09:37:21.864086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751b7e3d-c9a1bd12-b494372b-dcce068a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:21.866532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Write session: try to update token
2025-10-02T09:37:21.866547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:21.872763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:21.872774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:21.872776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:21.872777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:21.872782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.872785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.872789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768329909:9877]
2025-10-02T09:37:21.872822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:21.872825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.872827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:21.872827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:21.872831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:21.872833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:21.872944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:21.879271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3588 sessionId: src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:21.881574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:21.942578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556188843918189:9514]
2025-10-02T09:37:21.942769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3587, pipe: [1:7556556188843918189:9514]
2025-10-02T09:37:21.983398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:21.983600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:21.983608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:21.983621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843918189:9514], now have 1 active actors on pipe
2025-10-02T09:37:21.983801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:21.983832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556188843918189:9514]
2025-10-02T09:37:21.983860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:21.983863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:21.983934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3588 reason: error at write: Disconnected sessionId: src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0
2025-10-02T09:37:21.983955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:21.984085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3588 sessionId: src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0 is DEAD
2025-10-02T09:37:21.984234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:21.984248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Write session will restart in 0.009209s
2025-10-02T09:37:21.984280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Write session: Do CDS request
2025-10-02T09:37:21.984286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:21.992386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:21.993791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:21.993889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:21.993895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:21.993901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:21.993925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:21.993947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556188768330094:9875]
2025-10-02T09:37:21.994295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:21.994337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.994321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:21.994332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3589
2025-10-02T09:37:21.994463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:21.994485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:21.994494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:21.994518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:21.994524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:21.994531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:21.994665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:21.994691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.994695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.994695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.994696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.994697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.994697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.994698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.994698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.994699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.994699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.994700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.994700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.994703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.994710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.994712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.994714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.994716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.994718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.994720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.994722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.994724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.994726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.994728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.994730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.994734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.994738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:21.994741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.994744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:21.994746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.994748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:21.994750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.994753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:21.994755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.994758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:21.994760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.994762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:21.994764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.994767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:21.994769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.994772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:21.994774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.994777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:21.994779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.994785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:21.994787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.994790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:21.994792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.994795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:21.994811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:21.994868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3589 sessionId:  describe result for acl check
2025-10-02T09:37:21.994895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:21.994900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:21.994901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:21.994906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:21.995315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:21.996764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.001666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.001675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.001678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556188843918339:9337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.001684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.002133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.003629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.003639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.003641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.003642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.003646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3588 [2:7556556188768330094:9875]
2025-10-02T09:37:22.003653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.003662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.003664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.003666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.003667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.003675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.003683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.003686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.003715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.003720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.003721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.003723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.003724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.003759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.003764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.003769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.003775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.003783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.003796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885673:9337], now have 1 active actors on pipe
2025-10-02T09:37:22.003802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556188843918194:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.003805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.003806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.003807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.003815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.003826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.003829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.003830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.003831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.003837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.003838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.003852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.003845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3588
2025-10-02T09:37:22.003859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.003849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3588
2025-10-02T09:37:22.003865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.003882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.003887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.003902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.003908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.003910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.003912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.003917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.003923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.003930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.004042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.004047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.004055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.004117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3589 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0
2025-10-02T09:37:22.004340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3411ee-719925a1-1aa87df-34b9ea33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.006708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Write session: try to update token
2025-10-02T09:37:22.006723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.012825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.012833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.012834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.012835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.012839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.012842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.012843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556188768330089:9875]
2025-10-02T09:37:22.012861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.012866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.012866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.012867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.012869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.012872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.012978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.018936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3589 sessionId: src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.021201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.083873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138885683:9514]
2025-10-02T09:37:22.084040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3588, pipe: [1:7556556193138885683:9514]
2025-10-02T09:37:22.122077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.122318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.122328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.122340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885683:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.122499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.122546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.122572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138885683:9514]
2025-10-02T09:37:22.122593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:22.122680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3589 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0
2025-10-02T09:37:22.122838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3589 sessionId: src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0 is DEAD
2025-10-02T09:37:22.122982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:22.122993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Write session will restart in 0.005251s
2025-10-02T09:37:22.123013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Write session: Do CDS request
2025-10-02T09:37:22.123018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.129182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.129265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.129274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3590
2025-10-02T09:37:22.129359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.129381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.129388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.129391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.129756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3590 sessionId:  describe result for acl check
2025-10-02T09:37:22.129786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.129791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.129792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.129796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.130205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.131451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.131923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.132932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.133033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.133039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.133071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.133096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063297572:9868]
2025-10-02T09:37:22.133438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.133607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.133629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.133804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.133831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.133835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.133835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.133836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.133836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.133837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.133837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.133838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.133838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.133839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.133839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.133840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.133842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.133849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.133851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.133853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.133855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.133857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.133859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.133861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.133863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.133865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.133867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.133869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.133872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.133876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.133880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.133883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.133885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.133888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.133890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.133893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.133895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.133897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.133899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.133902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.133905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.133908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.133910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.133913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.133916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.133919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.133921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.133925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.133927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.133930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.133932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.133935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.133935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.133945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.133952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.133948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138885777:9323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.133953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.141370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.142922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.142931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.142932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.142934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.142938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3589 [2:7556556193063297572:9868]
2025-10-02T09:37:22.142944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.142953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.142958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.142960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.142961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.142970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.142973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.142981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.143016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.143021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.143022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.143023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.143025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.143063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.143068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.143074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.143079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.143090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.143105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885684:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.143110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885864:9323], now have 1 active actors on pipe
2025-10-02T09:37:22.143114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.143118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.143120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.143127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.143138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.143141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.143143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.143145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.143148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.143149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.143165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.143169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.143151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3589
2025-10-02T09:37:22.143168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3589
2025-10-02T09:37:22.143181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.143199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.143204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.143222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8389798-577355df-56ec6f25-2f0f9e38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.143229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.143232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.143237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.143243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.143255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.143267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.143383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.143388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.143396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.143462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3590 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8389798-577355df-56ec6f25-2f0f9e38_0
2025-10-02T09:37:22.143724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5497eb-8e2b4fa8-b7ebdfa5-70fa10ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8389798-577355df-56ec6f25-2f0f9e38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.146500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Write session: try to update token
2025-10-02T09:37:22.146512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.152373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.152387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.152388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.152389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.152394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.152397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.152399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063297567:9868]
2025-10-02T09:37:22.152412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.152415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.152417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.152418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.152421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.152422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.152544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.158767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3590 sessionId: src_id|d8389798-577355df-56ec6f25-2f0f9e38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.161017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.222636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138885875:9514]
2025-10-02T09:37:22.222790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3589, pipe: [1:7556556193138885875:9514]
2025-10-02T09:37:22.264072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.264373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.264382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.264394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885875:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.264539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.264576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:22.264586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:22.264609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138885875:9514]
2025-10-02T09:37:22.264631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.264651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3590 reason: error at write: Disconnected sessionId: src_id|d8389798-577355df-56ec6f25-2f0f9e38_0
2025-10-02T09:37:22.264814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3590 sessionId: src_id|d8389798-577355df-56ec6f25-2f0f9e38_0 is DEAD
2025-10-02T09:37:22.264976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:22.264984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Write session will restart in 0.008185s
2025-10-02T09:37:22.265004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Write session: Do CDS request
2025-10-02T09:37:22.265009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.273699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.274186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.274271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.274282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3591
2025-10-02T09:37:22.274405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.274427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.274435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.274437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.274782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3591 sessionId:  describe result for acl check
2025-10-02T09:37:22.274812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.274817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.274821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.274825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.275109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.275215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.275221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.275228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.275248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.275255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.275279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063297786:9843]
2025-10-02T09:37:22.275627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.275792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.275813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.275987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.276018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.276021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.276022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.276023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.276023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.276023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.276024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.276024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.276025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.276025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.276026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.276027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.276029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.276036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.276038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.276040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.276042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.276044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.276046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.276048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.276050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.276052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.276054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.276056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.276059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.276063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.276066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.276069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.276071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.276074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.276079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.276081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.276084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.276086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.276089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.276092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.276094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.276096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.276099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.276102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.276106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.276109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.276111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.276113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.276116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.276118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.276120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.276137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.276871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.281875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.281885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.281888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138886021:9338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.281894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.283467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.285018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.285028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.285030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.285031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.285035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3590 [2:7556556193063297786:9843]
2025-10-02T09:37:22.285043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.285052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.285054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.285055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.285057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.285065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.285072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.285076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.285107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.285112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.285113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.285115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.285116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.285151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.285156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.285162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.285167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.285179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.285192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886063:9338], now have 1 active actors on pipe
2025-10-02T09:37:22.285198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138885876:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.285202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.285203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.285204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.285211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.285222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.285224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.285226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.285227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.285232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.285234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.285247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.285252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.285257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.285239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3590
2025-10-02T09:37:22.285260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3590
2025-10-02T09:37:22.285269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.285274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.285292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.285299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.285301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.285302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.285307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.285315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.285322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.285428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.285433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.285440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.285502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3591 partition: 0 MaxSeqNo: 36 sessionId: src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0
2025-10-02T09:37:22.285712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8389798-577355df-56ec6f25-2f0f9e38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.288249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Write session: try to update token
2025-10-02T09:37:22.288261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.294266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.294277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.294278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.294280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.294283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.294286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.294287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063297781:9843]
2025-10-02T09:37:22.294306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.294311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.294313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.294312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.294315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.294318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.294445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.301191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3591 sessionId: src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.303389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.364973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138886092:9514]
2025-10-02T09:37:22.365152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3590, pipe: [1:7556556193138886092:9514]
2025-10-02T09:37:22.404771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.405054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.405063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.405076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886092:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.405234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:22.405270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.405243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:22.405257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138886092:9514]
2025-10-02T09:37:22.405274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.405294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3591 reason: error at write: Disconnected sessionId: src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0
2025-10-02T09:37:22.405429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3591 sessionId: src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0 is DEAD
2025-10-02T09:37:22.405547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:22.405555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Write session will restart in 0.007093s
2025-10-02T09:37:22.405569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Write session: Do CDS request
2025-10-02T09:37:22.405573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.413166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.413189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.413198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3592
2025-10-02T09:37:22.413333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.413354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.413362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.413364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.413705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3592 sessionId:  describe result for acl check
2025-10-02T09:37:22.413726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.413731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.413732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.413736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.414124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.414319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.415806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.415943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.415952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.415958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.415986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.416008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063297988:9837]
2025-10-02T09:37:22.416135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.416357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.416512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.416534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.416712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.416746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.416750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.416751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.416752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.416752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.416753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.416753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.416754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.416754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.416755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.416756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.416756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.416759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.416765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.416768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.416770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.416771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.416773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.416775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.416777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.416779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.416781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.416783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.416785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.416789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.416793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.416796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.416811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.416815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.416819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.416822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.416827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.416830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.416832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.416834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.416837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.416839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.416842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.416844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.416847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.416849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.416851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.416853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.416856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.416860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.416863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.416865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.416868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.416883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.421152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.421162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.421165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138886248:9364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.421172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.424242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.425782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.425793Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.425795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.425797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.425801Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3591 [2:7556556193063297988:9837]
2025-10-02T09:37:22.425810Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.425820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.425825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.425827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.425828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.425836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.425840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.425845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.425876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.425880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.425881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.425883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.425885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.425920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.425924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.425931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.425940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.425948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.425962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886105:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.425967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886290:9364], now have 1 active actors on pipe
2025-10-02T09:37:22.425971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.425973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.425974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.425981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.425993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.425994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.425996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.425997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.426002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.426004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.426017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.426022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.426025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.426008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3591
2025-10-02T09:37:22.426012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3591
2025-10-02T09:37:22.426042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.426047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.426065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78e22508-fcaa124b-1702852f-624464eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.426071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.426073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.426075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.426080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.426086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.426093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.426227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.426232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.426240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.426299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3592 partition: 0 MaxSeqNo: 36 sessionId: src_id|78e22508-fcaa124b-1702852f-624464eb_0
2025-10-02T09:37:22.426553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7de9-e613b6ad-c45e39f-13747ea7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78e22508-fcaa124b-1702852f-624464eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.428851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Write session: try to update token
2025-10-02T09:37:22.428864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.435009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.435020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.435022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.435022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.435026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.435029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.435031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063297983:9837]
2025-10-02T09:37:22.435051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.435058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.435059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.435064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.435068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.435070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.435260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.441428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3592 sessionId: src_id|78e22508-fcaa124b-1702852f-624464eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.443661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.505255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138886298:9514]
2025-10-02T09:37:22.505444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3591, pipe: [1:7556556193138886298:9514]
2025-10-02T09:37:22.546357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.546668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.546677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.546691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886298:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.546831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.546854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.546886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138886298:9514]
2025-10-02T09:37:22.546902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:22.546977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3592 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78e22508-fcaa124b-1702852f-624464eb_0
2025-10-02T09:37:22.547140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3592 sessionId: src_id|78e22508-fcaa124b-1702852f-624464eb_0 is DEAD
2025-10-02T09:37:22.547328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:22.547339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Write session will restart in 0.007261s
2025-10-02T09:37:22.547364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Write session: Do CDS request
2025-10-02T09:37:22.547369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.555183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.555283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.555292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3593
2025-10-02T09:37:22.555388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.555410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.555417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.555420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.555756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3593 sessionId:  describe result for acl check
2025-10-02T09:37:22.555785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.555790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.555792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.555795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.556107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.556205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.557473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.557584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.557591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.557597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.557624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.557651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063298175:9832]
2025-10-02T09:37:22.558001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.558071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.558158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.558181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.558357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.558385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.558389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.558390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.558390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.558391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.558391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.558392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.558392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.558393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.558393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.558394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.558394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.558397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.558404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.558406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.558408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.558410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.558412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.558414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.558416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.558418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.558420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.558422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.558424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.558427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.558431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.558435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.558438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.558440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.558443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.558445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.558447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.558450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.558452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.558454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.558457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.558460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.558465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.558467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.558470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.558473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.558475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.558477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.558480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.558482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.558484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.558487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.558489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.558506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.562280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.562291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.562293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138886444:9383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.562299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.565927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.567502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.567512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.567513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.567515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.567520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3592 [2:7556556193063298175:9832]
2025-10-02T09:37:22.567530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.567542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.567547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.567549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.567550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.567558Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.567564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.567568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.567600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.567604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.567605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.567607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.567609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.567647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.567651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.567658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.567663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.567673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.567685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.567689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.567691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.567695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.567703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886485:9383], now have 1 active actors on pipe
2025-10-02T09:37:22.567703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.567705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.567706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.567709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886299:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.567713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.567721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.567722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.567735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.567743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.567751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.567759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3592
2025-10-02T09:37:22.567761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3592
2025-10-02T09:37:22.567792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.567797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.567811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41706792-d71915f5-564f2ef8-1676f001_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.567818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.567821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.567822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.567826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.567833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.567842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.567970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.567974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.567982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.568048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3593 partition: 0 MaxSeqNo: 36 sessionId: src_id|41706792-d71915f5-564f2ef8-1676f001_0
2025-10-02T09:37:22.568292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e22508-fcaa124b-1702852f-624464eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41706792-d71915f5-564f2ef8-1676f001_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.570636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Write session: try to update token
2025-10-02T09:37:22.570652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.576761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.576772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.576773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.576774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.576779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.576781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.576783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063298170:9832]
2025-10-02T09:37:22.576814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.576816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.576819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.576820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.576821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.576821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.576935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.582667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3593 sessionId: src_id|41706792-d71915f5-564f2ef8-1676f001_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.584887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.647106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138886492:9514]
2025-10-02T09:37:22.647338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3592, pipe: [1:7556556193138886492:9514]
2025-10-02T09:37:22.690283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.690543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.690552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.690567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886492:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.690877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:22.690886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:22.690904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138886492:9514]
2025-10-02T09:37:22.690934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.690948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3593 reason: error at write: Disconnected sessionId: src_id|41706792-d71915f5-564f2ef8-1676f001_0
2025-10-02T09:37:22.691081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.691111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3593 sessionId: src_id|41706792-d71915f5-564f2ef8-1676f001_0 is DEAD
2025-10-02T09:37:22.691269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:22.691280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Write session will restart in 0.006933s
2025-10-02T09:37:22.691300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Write session: Do CDS request
2025-10-02T09:37:22.691306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.699148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.699231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.699241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3594
2025-10-02T09:37:22.699339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.699361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.699369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.699372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.699706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3594 sessionId:  describe result for acl check
2025-10-02T09:37:22.699735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.699741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.699742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.699747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.700094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.700156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.701605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.701730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.701737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.701743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.701774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.701802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063298361:9826]
2025-10-02T09:37:22.701898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.702147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.702306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.702330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.702509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.702538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.702542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.702542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.702543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.702543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.702544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.702544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.702545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.702545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.702546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.702546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.702547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.702550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.702556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.702559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.702561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.702563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.702565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.702567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.702569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.702571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.702573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.702575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.702577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.702580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.702584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.702588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.702590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.702592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.702595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.702597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.702600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.702602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.702605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.702607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.702609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.702611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.702614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.702616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.702619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.702622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.702624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.702627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.702629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.702632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.702634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.702636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.702639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.702657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.706468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.706477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.706479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138886640:9390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.706484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.710067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.711575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.711586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.711587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.711589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.711593Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3593 [2:7556556193063298361:9826]
2025-10-02T09:37:22.711603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.711614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.711619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.711621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.711622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.711632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.711637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.711641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.711678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.711682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.711683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.711685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.711687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.711726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.711731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.711737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.711742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.711751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.711766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886494:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.711771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886681:9390], now have 1 active actors on pipe
2025-10-02T09:37:22.711774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.711775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.711776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.711783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.711791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.711798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.711798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.711800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.711801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.711802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.711796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3593
2025-10-02T09:37:22.711817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.711822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.711823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.711803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3593
2025-10-02T09:37:22.711840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.711845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.711863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.711870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.711872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.711873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.711879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.711888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.711935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.712038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.712042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.712050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.712104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3594 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0
2025-10-02T09:37:22.712329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41706792-d71915f5-564f2ef8-1676f001_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.714699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Write session: try to update token
2025-10-02T09:37:22.714714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.720926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.720937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.720938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.720939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.720943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.720946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.720948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063298356:9826]
2025-10-02T09:37:22.720969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.720971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.720973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.720974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.720975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.720975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.721085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.726824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3594 sessionId: src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.729025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.790982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138886688:9514]
2025-10-02T09:37:22.791527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3593, pipe: [1:7556556193138886688:9514]
2025-10-02T09:37:22.831754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.832025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.832037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.832053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886688:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.832183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.832212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138886688:9514]
2025-10-02T09:37:22.832237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.832247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:22.832337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0
2025-10-02T09:37:22.832507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3594 sessionId: src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0 is DEAD
2025-10-02T09:37:22.832664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:22.832673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Write session will restart in 0.009845s
2025-10-02T09:37:22.832697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Write session: Do CDS request
2025-10-02T09:37:22.832705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.841056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.842353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.842457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.842464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.842470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.842496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.842571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063298548:9823]
2025-10-02T09:37:22.842986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.843157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.843190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.843210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.843295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.843306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3595
2025-10-02T09:37:22.843390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.843402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.843425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.843421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.843430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.843432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.843426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.843426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.843427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.843427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.843428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.843428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.843429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.843429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.843430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.843430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.843431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.843434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.843440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.843442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.843445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.843447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.843449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.843451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.843452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.843454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.843457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.843459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.843461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.843466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.843470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.843473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.843476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.843478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.843481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.843483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.843486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.843488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.843491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.843493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.843495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.843498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.843500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.843502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.843505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.843509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.843512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.843514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.843517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.843519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.843522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.843525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.843528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.843543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.843786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3595 sessionId:  describe result for acl check
2025-10-02T09:37:22.843817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.843821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.843825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.843828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.844245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.845653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.849880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.849888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.849891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138886844:9401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.849895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.851076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.852580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.852592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.852593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.852595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.852598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3594 [2:7556556193063298548:9823]
2025-10-02T09:37:22.852605Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.852615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.852617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.852618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.852619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.852628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.852636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.852640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.852671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.852675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.852676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.852678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.852680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.852714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.852719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.852725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.852731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.852740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.852755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886690:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.852760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886878:9401], now have 1 active actors on pipe
2025-10-02T09:37:22.852763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.852764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.852765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.852773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.852782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.852786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.852788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.852789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.852792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.852793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.852794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3594
2025-10-02T09:37:22.852818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3594
2025-10-02T09:37:22.852821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.852826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.852828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.852842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.852845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.852865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.852872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.852874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.852875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.852879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.852885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.852900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.853016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.853021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.853029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.853093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3595 partition: 0 MaxSeqNo: 36 sessionId: src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0
2025-10-02T09:37:22.853313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3aa1c9-d27a82de-3d25592e-f3be5d34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.855629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Write session: try to update token
2025-10-02T09:37:22.855640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:22.861772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:22.861782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:22.861784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:22.861785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:22.861788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.861790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.861792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063298543:9823]
2025-10-02T09:37:22.861809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:22.861812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:22.861815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:22.861815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.861817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:22.861817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:22.861943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:22.867269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3595 sessionId: src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:22.869391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:22.932269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556193138886885:9514]
2025-10-02T09:37:22.932439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3594, pipe: [1:7556556193138886885:9514]
2025-10-02T09:37:22.971006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:22.971299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.971310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.971323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886885:9514], now have 1 active actors on pipe
2025-10-02T09:37:22.971442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:22.971513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:22.971525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:22.971552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556193138886885:9514]
2025-10-02T09:37:22.971582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:22.971596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3595 reason: error at write: Disconnected sessionId: src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0
2025-10-02T09:37:22.971748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3595 sessionId: src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0 is DEAD
2025-10-02T09:37:22.971880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:22.971891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Write session will restart in 0.008653s
2025-10-02T09:37:22.971913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Write session: Do CDS request
2025-10-02T09:37:22.971919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:22.980380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:22.981168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.981262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:22.981272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3596
2025-10-02T09:37:22.981371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:22.981394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:22.981401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:22.981404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:22.981723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3596 sessionId:  describe result for acl check
2025-10-02T09:37:22.981751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:22.981756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:22.981758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:22.981762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:22.981927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:22.982088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:22.982095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:22.982101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:22.982130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:22.982154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556193063298736:9821]
2025-10-02T09:37:22.982168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:22.982534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:22.982702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:22.982725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:22.982908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:22.982948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.982953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.982954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.982955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.982955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.982956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.982957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.982958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.982958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.982959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.982960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.982960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.982964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.982973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.982976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.982979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.982982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.982985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.982988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.982991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.982995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.982999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.983002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.983006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.983011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.983017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:22.983023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.983027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:22.983033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.983038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:22.983041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.983046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:22.983049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.983053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:22.983056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.983060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:22.983065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.983070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:22.983075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.983079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:22.983087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.983092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:22.983095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.983098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.983101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.983103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.983105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.983107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.983123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:22.983907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:22.988840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:22.988849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:22.988851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556193138887041:9428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:22.988856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:22.990447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:22.991925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:22.991937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:22.991938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:22.991940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:22.991943Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3595 [2:7556556193063298736:9821]
2025-10-02T09:37:22.991950Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:22.991959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:22.991961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.991962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.991963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.991971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:22.991974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:22.991978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:22.992005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.992011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.992012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.992014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:22.992015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:22.992050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:22.992054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:22.992061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:22.992066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:22.992073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:22.992086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138886891:2446], now have 1 active actors on pipe
2025-10-02T09:37:22.992091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556193138887079:9428], now have 1 active actors on pipe
2025-10-02T09:37:22.992095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:22.992097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:22.992098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:22.992106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:22.992113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:22.992118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:22.992120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:22.992121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:22.992123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:22.992125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:22.992138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:22.992143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:22.992144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:22.992140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3595
2025-10-02T09:37:22.992145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3595
2025-10-02T09:37:22.992181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.992187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.992202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d014cb52-8302a233-285cfe79-1014dea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:22.992209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:22.992211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:22.992212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:22.992217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:22.992224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:22.992231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.992342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:22.992347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:22.992354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:22.992412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3596 partition: 0 MaxSeqNo: 36 sessionId: src_id|d014cb52-8302a233-285cfe79-1014dea7_0
2025-10-02T09:37:22.992617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729aa8d0-59c39bf9-a5b01016-319ca25b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d014cb52-8302a233-285cfe79-1014dea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:22.994920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Write session: try to update token
2025-10-02T09:37:22.994933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.001097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.001108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.001109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.001110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.001113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:23.001115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:23.001117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556193063298731:9821]
2025-10-02T09:37:23.001136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.001139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.001140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.001150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.001153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.001156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.001255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.007301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3596 sessionId: src_id|d014cb52-8302a233-285cfe79-1014dea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.009580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.071543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433854386:9514]
2025-10-02T09:37:23.071755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3595, pipe: [1:7556556197433854386:9514]
2025-10-02T09:37:23.110390Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.110636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.110647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.110661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854386:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.110826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.110862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.110899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433854386:9514]
2025-10-02T09:37:23.110905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.110980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3596 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d014cb52-8302a233-285cfe79-1014dea7_0
2025-10-02T09:37:23.111120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3596 sessionId: src_id|d014cb52-8302a233-285cfe79-1014dea7_0 is DEAD
2025-10-02T09:37:23.111243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.111254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Write session will restart in 0.005529s
2025-10-02T09:37:23.111274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Write session: Do CDS request
2025-10-02T09:37:23.111279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.118139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.118229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.118240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3597
2025-10-02T09:37:23.118321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.118343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.118351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.118353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.118694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3597 sessionId:  describe result for acl check
2025-10-02T09:37:23.118729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.118735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.118736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.118740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.119091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.120262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.120869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.121724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.121891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.121898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.121904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.121933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.121957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358266220:9805]
2025-10-02T09:37:23.122311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.122486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.122510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.122602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.122612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.122614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433854492:9429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.122618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.122688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.122727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.122733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.122734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.122735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.122736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.122737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.122738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.122738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.122739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.122740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.122741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.122745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.122754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.122757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.122760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.122763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.122766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.122770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.122773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.122776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.122781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.122784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.122787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.122792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.122800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.122806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.122810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.122815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.122819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.122824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.122828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.122833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.122837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.122842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.122850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.122853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.122859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.122862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.122866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.122871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.122875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.122880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.122884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.122888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.122894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.122899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.122902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.122919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.130228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.131686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.131696Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.131697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.131699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.131702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3596 [2:7556556197358266220:9805]
2025-10-02T09:37:23.131709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.131719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.131722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.131724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.131725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.131733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.131740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.131744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.131773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.131777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.131778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.131780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.131781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.131815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.131820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.131827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.131832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.131841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.131856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854387:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.131861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854574:9429], now have 1 active actors on pipe
2025-10-02T09:37:23.131864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.131866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.131867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.131875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.131883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.131893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.131897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.131897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.131899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.131900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.131910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.131918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.131930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.131936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.131937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.131911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3596
2025-10-02T09:37:23.131921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3596
2025-10-02T09:37:23.131954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.131961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.131963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.131964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.131969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.131974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.131983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.132108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.132113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.132120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.132187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3597 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0
2025-10-02T09:37:23.132450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb52-8302a233-285cfe79-1014dea7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.134737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Write session: try to update token
2025-10-02T09:37:23.134753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.140894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.140903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.140904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.140905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.140908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.140910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.140912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358266215:9805]
2025-10-02T09:37:23.140930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.140931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.140932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.140933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.140933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.140935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.141042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.146646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3597 sessionId: src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.148905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.211314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433854585:9514]
2025-10-02T09:37:23.211557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3596, pipe: [1:7556556197433854585:9514]
2025-10-02T09:37:23.250014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.250265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.250278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.250293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854585:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.250441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.250431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:23.250442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:23.250441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433854585:9514]
2025-10-02T09:37:23.250469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.250491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3597 reason: error at write: Disconnected sessionId: src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0
2025-10-02T09:37:23.250638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3597 sessionId: src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0 is DEAD
2025-10-02T09:37:23.250799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:23.250810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Write session will restart in 0.008420s
2025-10-02T09:37:23.250834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Write session: Do CDS request
2025-10-02T09:37:23.250840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.259951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.260166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.260263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.260273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3598
2025-10-02T09:37:23.260407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.260430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.260437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.260440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.260772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3598 sessionId:  describe result for acl check
2025-10-02T09:37:23.260814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.260819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.260820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.260824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.261252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.261430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.261598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.261608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.261617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.261661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.261695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358266425:9810]
2025-10-02T09:37:23.262232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.262434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.262473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.262755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.262800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.262806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.262807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.262807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.262809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.262810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.262811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.262812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.262812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.262813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.262814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.262815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.262820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.262829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.262832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.262836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.262840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.262843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.262847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.262852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.262855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.262858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.262862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.262865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.262872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.262881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.262888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.262895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.262898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.262904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.262906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.262912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.262917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.262925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.262928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.262934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.262940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.262947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.262950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.262956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.262961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.262966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.262969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.262973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.262978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.262982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.262985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.262991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.262998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.263020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.267791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.267802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.267804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433854737:9440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.267809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.270410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.272037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.272054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.272056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.272059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.272064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3597 [2:7556556197358266425:9810]
2025-10-02T09:37:23.272074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.272090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.272093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.272095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.272096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.272107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.272116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.272121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.272164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.272170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.272171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.272174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.272178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.272227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.272234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.272245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.272260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.272278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.272269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3597
2025-10-02T09:37:23.272280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3597
2025-10-02T09:37:23.272296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854777:9440], now have 1 active actors on pipe
2025-10-02T09:37:23.272303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854586:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.272308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.272312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.272314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.272323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.272331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.272336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.272337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.272338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.272352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.272358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.272374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.272381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.272403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.272413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.272419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.272428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.272437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.272441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.272443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.272450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.272462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.272492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.272631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.272640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.272653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.272718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3598 partition: 0 MaxSeqNo: 36 sessionId: src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0
2025-10-02T09:37:23.272958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4989220-fd1c7ed0-ab2262d1-39544ed4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.275233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Write session: try to update token
2025-10-02T09:37:23.275244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.281632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.281643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.281644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.281645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.281649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.281651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.281652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358266420:9810]
2025-10-02T09:37:23.281671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.281672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.281673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.281674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.281675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.281675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.281816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.286881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3598 sessionId: src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.289052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.350552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433854809:9514]
2025-10-02T09:37:23.350705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3597, pipe: [1:7556556197433854809:9514]
2025-10-02T09:37:23.389875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.390161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.390173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.390187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854809:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.390334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.390359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433854809:9514]
2025-10-02T09:37:23.390363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.390390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.390468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0
2025-10-02T09:37:23.390633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3598 sessionId: src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0 is DEAD
2025-10-02T09:37:23.390790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.390803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Write session will restart in 0.007013s
2025-10-02T09:37:23.390824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Write session: Do CDS request
2025-10-02T09:37:23.390830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.399192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.399490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.399809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.399821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3599
2025-10-02T09:37:23.399912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.399935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.399943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.399947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.400298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3599 sessionId:  describe result for acl check
2025-10-02T09:37:23.400329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.400337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.400338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.400342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.400673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.400949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.401089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.401097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.401103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.401132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.401158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358266650:9792]
2025-10-02T09:37:23.401517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.401666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.401689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.401866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.401895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.401899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.401901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.401902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.401902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.401903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.401903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.401904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.401904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.401905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.401907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.401913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.401915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.401918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.401919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.401921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.401923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.401925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.401927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.401929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.401931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.401933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.401937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.401940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.401944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.401946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.401949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.401951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.401953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.401956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.401958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.401961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.401963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.401965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.401968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.401970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.401972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.401976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.401978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.401981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.401984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.401987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.401990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.401992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.401994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.401997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.402013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.402234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.406804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.406814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.406816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433854962:9479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.406821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.409391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.410910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.410921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.410923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.410924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.410928Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3598 [2:7556556197358266650:9792]
2025-10-02T09:37:23.410936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.410946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.410948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.410951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.410954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.410962Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.410965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.410970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.411000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.411005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.411006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.411009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.411010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.411046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.411050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.411056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.411061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.411069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.411080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855013:9479], now have 1 active actors on pipe
2025-10-02T09:37:23.411085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433854810:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.411089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.411090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.411091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.411098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.411107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.411109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.411111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.411112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.411117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.411119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.411135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.411126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3598
2025-10-02T09:37:23.411141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.411149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.411141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3598
2025-10-02T09:37:23.411158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.411161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.411187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15208767-67f8fb09-ccc66976-52131dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.411193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.411196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.411197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.411203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.411208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.411215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.411339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.411345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.411352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.411422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3599 partition: 0 MaxSeqNo: 36 sessionId: src_id|15208767-67f8fb09-ccc66976-52131dc0_0
2025-10-02T09:37:23.411662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745257a9-77abc8b3-3cbd1455-11ea2689_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15208767-67f8fb09-ccc66976-52131dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.413924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Write session: try to update token
2025-10-02T09:37:23.413938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.420334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.420345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.420346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.420347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.420350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.420352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.420354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358266645:9792]
2025-10-02T09:37:23.420372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.420375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.420376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.420381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.420384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.420386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.420598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.425777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3599 sessionId: src_id|15208767-67f8fb09-ccc66976-52131dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.427970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.490370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433855021:9514]
2025-10-02T09:37:23.490568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3598, pipe: [1:7556556197433855021:9514]
2025-10-02T09:37:23.528156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.528384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.528396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.528409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855021:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.528526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.528727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433855021:9514]
2025-10-02T09:37:23.528760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.528835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.528894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15208767-67f8fb09-ccc66976-52131dc0_0
2025-10-02T09:37:23.529034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3599 sessionId: src_id|15208767-67f8fb09-ccc66976-52131dc0_0 is DEAD
2025-10-02T09:37:23.529177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.529190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Write session will restart in 0.008422s
2025-10-02T09:37:23.529209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Write session: Do CDS request
2025-10-02T09:37:23.529215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.538160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.538271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.538283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3600
2025-10-02T09:37:23.538379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.538403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.538411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.538414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.538429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.538763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3600 sessionId:  describe result for acl check
2025-10-02T09:37:23.538791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.538797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.538798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.538802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.539141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.539897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.539999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.540007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.540015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.540045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.540069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358266844:9777]
2025-10-02T09:37:23.540406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.540531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.540551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.540573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.540744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.540772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.540776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.540777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.540777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.540778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.540778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.540779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.540779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.540780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.540780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.540781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.540781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.540784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.540790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.540792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.540794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.540796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.540798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.540811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.540813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.540815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.540817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.540819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.540821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.540824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.540828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.540831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.540834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.540837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.540840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.540842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.540844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.540847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.540849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.540851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.540854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.540857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.540860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.540862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.540865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.540867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.540869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.540871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.540874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.540876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.540878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.540880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.540882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.540899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.545667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.545679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.545680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433855176:9490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.545685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.548233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.549625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.549636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.549637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.549639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.549642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3599 [2:7556556197358266844:9777]
2025-10-02T09:37:23.549649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.549660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.549675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.549677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.549678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.549690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.549697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.549702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.549741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.549747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.549748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.549751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.549752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.549790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.549795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.549801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.549806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.549814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.549828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855023:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.549833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855215:9490], now have 1 active actors on pipe
2025-10-02T09:37:23.549837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.549838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.549839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.549846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.549854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.549858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.549860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.549861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.549863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.549864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.549877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.549882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.549872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3599
2025-10-02T09:37:23.549892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3599
2025-10-02T09:37:23.549893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.549942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.549948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.549968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0feabe-18464d-75ccd261-2d9f1525_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.549975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.549977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.549978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.549982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.549987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.549995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.550112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.550116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.550124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.550191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3600 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0feabe-18464d-75ccd261-2d9f1525_0
2025-10-02T09:37:23.550449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15208767-67f8fb09-ccc66976-52131dc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0feabe-18464d-75ccd261-2d9f1525_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.552732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Write session: try to update token
2025-10-02T09:37:23.552746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.558811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.558820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.558821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.558822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.558826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.558828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.558830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358266839:9777]
2025-10-02T09:37:23.558848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.558851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.558851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.558856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.558856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.558858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.559030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.564696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3600 sessionId: src_id|a0feabe-18464d-75ccd261-2d9f1525_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.566875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.629126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433855223:9514]
2025-10-02T09:37:23.629333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3599, pipe: [1:7556556197433855223:9514]
2025-10-02T09:37:23.667209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.667448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.667459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.667472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855223:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.667595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.667637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.667649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.667680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433855223:9514]
2025-10-02T09:37:23.667708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3600 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0feabe-18464d-75ccd261-2d9f1525_0
2025-10-02T09:37:23.667839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3600 sessionId: src_id|a0feabe-18464d-75ccd261-2d9f1525_0 is DEAD
2025-10-02T09:37:23.667989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.668000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Write session will restart in 0.008353s
2025-10-02T09:37:23.668019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Write session: Do CDS request
2025-10-02T09:37:23.668027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.676730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.677220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.677319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.677330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3601
2025-10-02T09:37:23.677424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.677447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.677454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.677457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.677811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3601 sessionId:  describe result for acl check
2025-10-02T09:37:23.677840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.677846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.677849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.677853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.678169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.678272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.678279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.678285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.678303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.678312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.678337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358267037:9787]
2025-10-02T09:37:23.678682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.678847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.678880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.679139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.679175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.679189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.679190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.679190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.679190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.679191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.679191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.679192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.679192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.679193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.679194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.679194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.679197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.679203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.679205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.679207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.679209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.679211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.679213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.679215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.679217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.679220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.679222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.679223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.679227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.679232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.679235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.679238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.679241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.679244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.679246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.679248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.679250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.679253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.679255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.679258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.679261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.679264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.679266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.679268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.679270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.679273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.679275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.679277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.679279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.679283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.679285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.679287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.679305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.679815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.685027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.685038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.685040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433855379:9491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.685045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.686581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.688023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.688033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.688034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.688036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.688039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3600 [2:7556556197358267037:9787]
2025-10-02T09:37:23.688046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.688056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.688057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.688058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.688059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.688068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.688073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.688077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.688106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.688111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.688112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.688114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.688115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.688150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.688155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.688161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.688166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.688175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.688185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855225:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.688190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855418:9491], now have 1 active actors on pipe
2025-10-02T09:37:23.688194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.688196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.688197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.688205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.688212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.688218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.688220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.688221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.688222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.688224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.688215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3600
2025-10-02T09:37:23.688237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.688233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3600
2025-10-02T09:37:23.688239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.688248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.688257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.688259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.688274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.688281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.688283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.688285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.688289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.688294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.688302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.688442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.688452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.688468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.688545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3601 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0
2025-10-02T09:37:23.688758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0feabe-18464d-75ccd261-2d9f1525_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.691002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Write session: try to update token
2025-10-02T09:37:23.691014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.697215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.697226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.697227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.697228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.697232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.697234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.697236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358267032:9787]
2025-10-02T09:37:23.697254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.697258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.697259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.697258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.697261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.697263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.697416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.702578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3601 sessionId: src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.704794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.767874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556197433855426:9514]
2025-10-02T09:37:23.768129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3600, pipe: [1:7556556197433855426:9514]
2025-10-02T09:37:23.807989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.808277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.808288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.808303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855426:9514], now have 1 active actors on pipe
2025-10-02T09:37:23.808448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.808487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.808488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433855426:9514]
2025-10-02T09:37:23.808513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.808523Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:37:23.808595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0
2025-10-02T09:37:23.808668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3601 sessionId: src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0 is DEAD
2025-10-02T09:37:23.808684Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 36 consumer shared/user session shared/user_1_36_12331362819099053869_v1 is DEAD
2025-10-02T09:37:23.808819Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:37:23.808824Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556137304297347:9522] disconnected; active server actors: 1
2025-10-02T09:37:23.808833Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556137304297347:9522] client user disconnected session shared/user_1_36_12331362819099053869_v1
2025-10-02T09:37:23.808863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.808872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Write session will restart in 0.006393s
2025-10-02T09:37:23.808892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Write session: Do CDS request
2025-10-02T09:37:23.808897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.808952Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:23.808956Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:23.808962Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007258s
2025-10-02T09:37:23.816127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.816286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.816297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3602
2025-10-02T09:37:23.816393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.816416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.816424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.816427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.816790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3602 sessionId:  describe result for acl check
2025-10-02T09:37:23.816842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.816843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.816844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.816847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.817013Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:37:23.817100Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:37:23.817105Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 37
2025-10-02T09:37:23.817191Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 37 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:23.817191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.817232Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:23.817300Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 auth for : user
2025-10-02T09:37:23.817384Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 Handle describe topics response
2025-10-02T09:37:23.817400Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 auth is DEAD
2025-10-02T09:37:23.817407Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:37:23.817593Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:37:23.817659Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:23.817662Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556197433855592:9506] connected; active server actors: 1
2025-10-02T09:37:23.817674Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556197433855592:9506] session shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:23.817678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:37:23.817683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:37:23.817691Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_37_10987558573187239452_v1" (Sender=[1:7556556197433855563:9506], Pipe=[1:7556556197433855592:9506], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:23.817693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:37:23.817700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:37:23.817704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_37_10987558573187239452_v1" (Sender=[1:7556556197433855563:9506], Pipe=[1:7556556197433855592:9506], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:23.817713Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_37_10987558573187239452_v1" sender [1:7556556197433855563:9506] lock partition 0 for ReadingSession "shared/user_1_37_10987558573187239452_v1" (Sender=[1:7556556197433855563:9506], Pipe=[1:7556556197433855592:9506], Partitions=[], ActiveFamilyCount=1) generation 1 step 37
2025-10-02T09:37:23.817718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:37:23.817720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000019s
2025-10-02T09:37:23.817853Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 37 Session: "shared/user_1_37_10987558573187239452_v1" ClientId: "user" PipeClient { RawX1: 7556556197433855592 RawX2: 4503603922347298 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:37:23.817872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:37:23.818298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.818382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.819749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.819862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.819868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.819873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.819901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.819927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358267231:9785]
2025-10-02T09:37:23.820324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.820438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.820448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.820452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433855544:9502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.820455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.820476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.820500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.820675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.820706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.820710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.820710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.820711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.820711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.820712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.820712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.820713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.820713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.820714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.820714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.820715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.820718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.820724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.820726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.820728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.820730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.820732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.820734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.820735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.820737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.820739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.820741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.820743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.820747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.820751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.820755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.820759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.820761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.820764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.820766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.820768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.820771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.820773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.820775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.820777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.820779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.820782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.820784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.820786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.820789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.820792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.820796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.820799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.820814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.820819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.820821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.820824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.820840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.828165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.829673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.829684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.829685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.829687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.829691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3601 [2:7556556197358267231:9785]
2025-10-02T09:37:23.829697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.829706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.829710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.829711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.829712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.829720Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.829724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.829729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.829757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.829763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.829764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.829766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.829768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.829804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.829808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.829816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.829821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.829830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.829841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855604:9529], now have 1 active actors on pipe
2025-10-02T09:37:23.829846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855627:9502], now have 1 active actors on pipe
2025-10-02T09:37:23.829847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855427:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.829850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.829852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.829853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.829860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.829867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.829874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.829877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.829878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.829883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.829884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.829891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.829893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.829890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3601
2025-10-02T09:37:23.829895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3601, pipe: [1:7556556197433855604:9529]
2025-10-02T09:37:23.829907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.829919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.829914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3601
2025-10-02T09:37:23.829922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.829930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_37_10987558573187239452_v1 on pipe: [1:7556556197433855604:9529]
2025-10-02T09:37:23.829940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.829942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.829942Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_37_10987558573187239452_v1:1 with generation 3601
2025-10-02T09:37:23.829953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.829956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.829957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.829967Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:23.829969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.829989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.829997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:37:23.830000Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:37:23.833642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:37:23.833655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:37:23.833658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.833660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.833661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.833666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.833671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.833674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:37:23.833679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:37:23.833690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.833759Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397843829 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:37:23.833771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:37:23.833793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.833789Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 sending to client partition status
2025-10-02T09:37:23.833798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.833805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.833863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3602 partition: 0 MaxSeqNo: 36 sessionId: src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0
2025-10-02T09:37:23.834068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3db9b0a-6530fec2-81b0536a-f25b39ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.836324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Write session: try to update token
2025-10-02T09:37:23.836336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.838921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:23.838930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.838934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.838955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:23.838960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:23.839147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:23.839272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:23.839388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:23.839504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:23.839667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:23.839689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:23.847018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.847029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.847030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.847031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.847035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.847037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.847039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358267226:9785]
2025-10-02T09:37:23.847056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.847056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.847058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.847059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.847060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.847060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.847163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.848344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3602 sessionId: src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.850526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:23.954850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:23.955147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.955158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.955285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:23.955299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:23.955323Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:23.955328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556197433855604:9529]
2025-10-02T09:37:23.955332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:23.955353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:23.955405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0
2025-10-02T09:37:23.955529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3602 sessionId: src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0 is DEAD
2025-10-02T09:37:23.955654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:23.955663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Write session will restart in 0.005674s
2025-10-02T09:37:23.955682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Write session: Do CDS request
2025-10-02T09:37:23.955686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:23.962146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.962264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:23.962275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3603
2025-10-02T09:37:23.962404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:23.962427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:23.962434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:23.962437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:23.962799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3603 sessionId:  describe result for acl check
2025-10-02T09:37:23.962825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:23.962830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:23.962832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:23.962838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:23.963277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:23.965073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:23.965144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:23.966521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:23.966619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:23.966625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:23.966631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:23.966655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:23.966680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556197358267428:9783]
2025-10-02T09:37:23.966928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:23.966937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:23.966939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556197433855730:9545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:23.966943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:23.967017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:23.967188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:23.967210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:23.967384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:23.967412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.967416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.967417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.967417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.967418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.967418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.967419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.967420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.967420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.967421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.967421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.967422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.967424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.967431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.967433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.967435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.967437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.967439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.967441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.967442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.967444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.967446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.967448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.967450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.967454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.967458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:23.967461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.967463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:23.967466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.967469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:23.967471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.967474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:23.967476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.967478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:23.967480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.967483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:23.967486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.967489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:23.967491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.967494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:23.967496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.967500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:23.967504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.967507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.967509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.967511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.967515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.967517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.967534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:23.974843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:23.976456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:23.976467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:23.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:23.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:23.976474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3602 [2:7556556197358267428:9783]
2025-10-02T09:37:23.976483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:23.976493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:23.976496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.976497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.976498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.976507Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:23.976511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:23.976515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:23.976545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.976550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.976551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.976552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:23.976554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:23.976587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:23.976592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.976599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:23.976604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:23.976612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:23.976623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855644:2446], now have 1 active actors on pipe
2025-10-02T09:37:23.976628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556197433855833:9545], now have 1 active actors on pipe
2025-10-02T09:37:23.976631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.976633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.976634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.976642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:23.976649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:23.976656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:23.976659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:23.976659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:23.976660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:23.976660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:23.976673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.976678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:23.976679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:23.976666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3602
2025-10-02T09:37:23.976699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3602
2025-10-02T09:37:23.976717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.976722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.976735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b009f9c0-7162833c-91e50282-fde90b55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:23.976740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:23.976743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:23.976744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:23.976749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:23.976754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:23.976761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.976915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:23.976919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:23.976927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:23.977006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3603 partition: 0 MaxSeqNo: 36 sessionId: src_id|b009f9c0-7162833c-91e50282-fde90b55_0
2025-10-02T09:37:23.977299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da68d43-e52ab068-675fa4b8-99fe66bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b009f9c0-7162833c-91e50282-fde90b55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:23.979545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Write session: try to update token
2025-10-02T09:37:23.979557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:23.985864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:23.985875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:23.985877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:23.985878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:23.985882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.985884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.985886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556197358267423:9783]
2025-10-02T09:37:23.985904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:23.985908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:23.985909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:23.985910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:23.985913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:23.985915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:23.986031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:23.991325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3603 sessionId: src_id|b009f9c0-7162833c-91e50282-fde90b55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:23.993440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.055604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728823146:9529]
2025-10-02T09:37:24.055817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3602, pipe: [1:7556556201728823146:9529]
2025-10-02T09:37:24.094587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.094803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.094813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.094828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823146:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.094941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:24.094997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.095001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728823146:9529]
2025-10-02T09:37:24.095018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.095085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3603 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b009f9c0-7162833c-91e50282-fde90b55_0
2025-10-02T09:37:24.095211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3603 sessionId: src_id|b009f9c0-7162833c-91e50282-fde90b55_0 is DEAD
2025-10-02T09:37:24.095353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:24.095365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Write session will restart in 0.005251s
2025-10-02T09:37:24.095388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Write session: Do CDS request
2025-10-02T09:37:24.095394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.101144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.101223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.101233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3604
2025-10-02T09:37:24.101351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.101374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.101382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.101385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.101787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3604 sessionId:  describe result for acl check
2025-10-02T09:37:24.101817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.101822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.101823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.101827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.102262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.104125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.105420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.106911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.107010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.107017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.107023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.107048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.107070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653234921:9781]
2025-10-02T09:37:24.107078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.107087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.107089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728823185:9546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.107093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.107416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.107574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.107595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.107769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.107809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.107813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.107814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.107815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.107816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.107816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.107817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.107818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.107819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.107820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.107820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.107821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.107825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.107835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.107838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.107840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.107842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.107844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.107846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.107848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.107850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.107852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.107854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.107855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.107859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.107864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.107867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.107869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.107872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.107874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.107876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.107879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.107881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.107884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.107886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.107889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.107891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.107893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.107895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.107898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.107900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.107903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.107905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.107908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.107910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.107913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.107915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.107917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.107935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.115262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.116580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.116590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.116591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.116593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.116597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3603 [2:7556556201653234921:9781]
2025-10-02T09:37:24.116603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.116613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.116614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.116615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.116616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.116625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.116631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.116635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.116664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.116668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.116670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.116671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.116673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.116709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.116714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.116720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.116725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.116734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.116748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823147:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.116753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823340:9546], now have 1 active actors on pipe
2025-10-02T09:37:24.116756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.116758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.116759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.116766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.116774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.116779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.116781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.116782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.116783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.116784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.116796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.116817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.116818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.116810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3603
2025-10-02T09:37:24.116835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3603
2025-10-02T09:37:24.116845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.116851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.116868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.116876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.116879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.116880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.116887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.116893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.116904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.117016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.117021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.117029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.117097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3604 partition: 0 MaxSeqNo: 36 sessionId: src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0
2025-10-02T09:37:24.117344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b009f9c0-7162833c-91e50282-fde90b55_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.119593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Write session: try to update token
2025-10-02T09:37:24.119606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.125607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:24.125618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.125621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.125640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:24.125641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:24.125780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:24.125895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.126007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.126120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.126280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:24.126302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:24.131419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3604 sessionId: src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.133628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.133893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.133908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.133918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.133919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.133921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.133923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.133927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.133930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.133932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653234915:9781]
2025-10-02T09:37:24.133949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.133956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.133958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.133958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.133961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.133962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.134072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.195363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728823352:9529]
2025-10-02T09:37:24.195553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3603, pipe: [1:7556556201728823352:9529]
2025-10-02T09:37:24.241883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.242238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:24.242267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823352:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.242357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.242389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.242422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728823352:9529]
2025-10-02T09:37:24.242448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:24.242455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:24.242515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3604 reason: error at write: Disconnected sessionId: src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0
2025-10-02T09:37:24.242630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3604 sessionId: src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0 is DEAD
2025-10-02T09:37:24.242928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:24.242940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Write session will restart in 0.009513s
2025-10-02T09:37:24.242961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Write session: Do CDS request
2025-10-02T09:37:24.242966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.252161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.253066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.253164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.253175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3605
2025-10-02T09:37:24.253263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.253284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.253291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.253294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.253595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.253649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3605 sessionId:  describe result for acl check
2025-10-02T09:37:24.253675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.253680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.253682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.253686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.253691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.253698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.253704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.253728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.253750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653235119:9779]
2025-10-02T09:37:24.254090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.254122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.254257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.254279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.254453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.254481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.254485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.254486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.254486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.254487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.254487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.254488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.254488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.254489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.254489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.254490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.254490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.254493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.254499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.254502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.254504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.254506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.254508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.254510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.254512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.254513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.254515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.254517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.254519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.254523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.254527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.254530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.254533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.254535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.254537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.254540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.254542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.254545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.254547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.254550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.254553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.254555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.254558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.254560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.254562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.254564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.254567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.254569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.254575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.254577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.254580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.254582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.254585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.254602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.255817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.259870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.259881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.259883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728823512:9556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.259888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.261915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.263494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.263503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.263504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.263506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.263509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3604 [2:7556556201653235119:9779]
2025-10-02T09:37:24.263516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.263525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.263527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.263528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.263529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.263538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.263542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.263546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.263583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.263587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.263588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.263590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.263592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.263627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.263632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.263639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.263645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.263653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.263666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823551:9556], now have 1 active actors on pipe
2025-10-02T09:37:24.263671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823353:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.263675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.263676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.263677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.263682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.263689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.263697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.263701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.263715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.263708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3604
2025-10-02T09:37:24.263724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3604
2025-10-02T09:37:24.263719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.263729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.263732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.263733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.263737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.263753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.263756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.263772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.263779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.263781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.263782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.263787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.263792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.263799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.263904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.263909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.263916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.263989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3605 partition: 0 MaxSeqNo: 36 sessionId: src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0
2025-10-02T09:37:24.264215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874a1c35-725dc1c1-8c4364a7-3c8237f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.266995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Write session: try to update token
2025-10-02T09:37:24.267007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.272931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.272944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.272945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.272947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.272951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.272953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.272956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653235113:9779]
2025-10-02T09:37:24.272976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.272979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.272980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.272983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.272984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.272986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.273099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.278510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3605 sessionId: src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.280856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.342795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728823563:9529]
2025-10-02T09:37:24.342942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3604, pipe: [1:7556556201728823563:9529]
2025-10-02T09:37:24.389092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.389376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.389387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.389402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823563:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.389506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:24.389556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.389562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.389593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728823563:9529]
2025-10-02T09:37:24.389640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3605 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0
2025-10-02T09:37:24.389794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3605 sessionId: src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0 is DEAD
2025-10-02T09:37:24.389930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:24.389939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Write session will restart in 0.006830s
2025-10-02T09:37:24.389957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Write session: Do CDS request
2025-10-02T09:37:24.389961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.398169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.398322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.398331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3606
2025-10-02T09:37:24.398423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.398444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.398451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.398453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.398776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3606 sessionId:  describe result for acl check
2025-10-02T09:37:24.398798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.398802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.398804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.398808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.399049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.399209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.400458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.400558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.400565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.400570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.400596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.400618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653235364:9754]
2025-10-02T09:37:24.400899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.400981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.401152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.401182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.401365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.401396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.401400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.401400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.401401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.401401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.401402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.401402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.401403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.401404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.401404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.401405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.401405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.401408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.401414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.401417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.401419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.401421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.401423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.401425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.401427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.401429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.401431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.401433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.401435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.401440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.401444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.401447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.401450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.401452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.401455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.401457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.401461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.401466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.401469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.401471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.401475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.401480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.401483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.401485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.401487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.401490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.401492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.401494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.401497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.401499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.401503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.401505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.401508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.401526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.405341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.405352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.405354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728823742:9594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.405359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.408867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.410330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.410342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.410343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.410345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.410348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3605 [2:7556556201653235364:9754]
2025-10-02T09:37:24.410359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.410369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.410374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.410375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.410376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.410385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.410389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.410393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.410423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.410428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.410429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.410431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.410433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.410468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.410475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.410481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.410486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.410495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.410506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823797:9594], now have 1 active actors on pipe
2025-10-02T09:37:24.410510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823584:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.410513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.410515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.410516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.410523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.410530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.410535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.410537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.410538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.410542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.410543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.410553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.410555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.410556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.410590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.410596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.410571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3605
2025-10-02T09:37:24.410609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2606cda-4003e290-80c4ec15-770fbb89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.410612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.410614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.410615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.410620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.410625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.410632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.410704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3605
2025-10-02T09:37:24.410750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.410760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.410780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.410868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3606 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2606cda-4003e290-80c4ec15-770fbb89_0
2025-10-02T09:37:24.411122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b566e16d-142c9cb9-e9b8f8ff-6b191283_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2606cda-4003e290-80c4ec15-770fbb89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.413634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Write session: try to update token
2025-10-02T09:37:24.413648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.419373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:24.419385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.419389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.419409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:24.419409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:24.419535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:24.419655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.419764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.419869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.420013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:24.420035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:24.425886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3606 sessionId: src_id|b2606cda-4003e290-80c4ec15-770fbb89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.427726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.427737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.427738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.427739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.427743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.427745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.427749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653235359:9754]
2025-10-02T09:37:24.427766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.427768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.427768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.427771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.427771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.427772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.427894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.428017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.489914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728823805:9529]
2025-10-02T09:37:24.490124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3605, pipe: [1:7556556201728823805:9529]
2025-10-02T09:37:24.535627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.535895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.535905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.535920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823805:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.536038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:24.536089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728823805:9529]
2025-10-02T09:37:24.536114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.536116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.536182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3606 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2606cda-4003e290-80c4ec15-770fbb89_0
2025-10-02T09:37:24.536344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3606 sessionId: src_id|b2606cda-4003e290-80c4ec15-770fbb89_0 is DEAD
2025-10-02T09:37:24.536508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:24.536520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Write session will restart in 0.007657s
2025-10-02T09:37:24.536539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Write session: Do CDS request
2025-10-02T09:37:24.536545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.545185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.545290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.545302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3607
2025-10-02T09:37:24.545398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.545424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.545433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.545436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.545450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.545771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3607 sessionId:  describe result for acl check
2025-10-02T09:37:24.545802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.545808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.545809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.545812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.546156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.546941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.547066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.547072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.547078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.547107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.547133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653235565:9753]
2025-10-02T09:37:24.547615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.547751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.547909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.547933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.548243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.548278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.548283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.548283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.548284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.548285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.548285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.548286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.548287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.548287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.548288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.548289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.548289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.548292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.548299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.548301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.548303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.548305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.548307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.548309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.548311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.548313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.548315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.548317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.548319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.548323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.548327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.548330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.548333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.548335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.548338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.548340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.548343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.548346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.548348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.548351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.548353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.548356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.548359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.548361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.548364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.548366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.548369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.548374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.548376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.548381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.548384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.548386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.548404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.552301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.552310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.552312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728823967:9607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.552316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.555824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.557280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.557291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.557292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.557293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.557296Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3606 [2:7556556201653235565:9753]
2025-10-02T09:37:24.557303Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.557313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.557314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.557316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.557317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.557325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.557328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.557332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.557362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.557367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.557368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.557371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.557373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.557409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.557413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.557420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.557425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.557433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.557445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824007:9607], now have 1 active actors on pipe
2025-10-02T09:37:24.557450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728823807:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.557453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.557455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.557456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.557463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.557472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.557475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.557477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.557480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.557483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.557484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.557499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.557504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.557509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.557502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3606
2025-10-02T09:37:24.557512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3606
2025-10-02T09:37:24.557533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.557538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.557553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.557559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.557561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.557562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.557567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.557572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.557579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.557677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.557682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.557689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.557751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3607 partition: 0 MaxSeqNo: 36 sessionId: src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0
2025-10-02T09:37:24.557981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2606cda-4003e290-80c4ec15-770fbb89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.560270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Write session: try to update token
2025-10-02T09:37:24.560283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.566462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.566473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.566474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.566476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.566479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.566481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.566483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653235560:9753]
2025-10-02T09:37:24.566503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.566507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.566508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.566569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.566577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.566579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.566623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.572001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3607 sessionId: src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.574184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.636215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728824014:9529]
2025-10-02T09:37:24.636431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3606, pipe: [1:7556556201728824014:9529]
2025-10-02T09:37:24.675554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.675855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.675864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.675876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824014:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.675996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:24.676020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728824014:9529]
2025-10-02T09:37:24.676024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:24.676028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:24.676047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.676078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3607 reason: error at write: Disconnected sessionId: src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0
2025-10-02T09:37:24.676209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3607 sessionId: src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0 is DEAD
2025-10-02T09:37:24.676379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:24.676390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Write session will restart in 0.008787s
2025-10-02T09:37:24.676414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Write session: Do CDS request
2025-10-02T09:37:24.676420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.685701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.686207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.686287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.686297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3608
2025-10-02T09:37:24.686397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.686420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.686428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.686431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.686780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3608 sessionId:  describe result for acl check
2025-10-02T09:37:24.686809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.686815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.686816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.686819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.687113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.687164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.687215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.687222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.687228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.687252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.687275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653235765:9751]
2025-10-02T09:37:24.687611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.687769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.687791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.687964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.687992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.687996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.687997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.687997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.687998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.687998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.687999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.688000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.688000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.688001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.688001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.688002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.688005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.688011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.688013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.688015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.688017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.688019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.688021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.688023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.688025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.688027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.688029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.688031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.688035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.688039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.688042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.688045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.688047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.688050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.688052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.688055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.688058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.688060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.688062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.688065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.688067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.688070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.688072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.688074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.688077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.688079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.688081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.688084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.688086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.688089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.688093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.688095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.688111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.688941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.693964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.693974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.693976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728824178:9618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.693981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.695622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.697195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.697207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.697209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.697211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.697215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3607 [2:7556556201653235765:9751]
2025-10-02T09:37:24.697223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.697233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.697236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.697238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.697239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.697249Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.697255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.697259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.697291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.697296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.697298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.697299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.697301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.697337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.697342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.697350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.697355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.697363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.697378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824217:9618], now have 1 active actors on pipe
2025-10-02T09:37:24.697384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824016:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.697388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.697389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.697390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.697398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.697407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.697410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.697411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.697413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.697416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.697418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.697417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3607
2025-10-02T09:37:24.697436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.697425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3607
2025-10-02T09:37:24.697441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.697443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.697451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.697454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.697483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.697490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.697492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.697493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.697499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.697505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.697517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.697625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.697630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.697638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.697699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3608 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0
2025-10-02T09:37:24.697924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ce7f4-6137a6de-7a5cdab6-582f8abc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.700169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Write session: try to update token
2025-10-02T09:37:24.700179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.706509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.706520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.706521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.706522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.706526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.706528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.706530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653235760:9751]
2025-10-02T09:37:24.706550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.706551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.706554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.706556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.706556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.706557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.706685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.712217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3608 sessionId: src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.714424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.775985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728824224:9529]
2025-10-02T09:37:24.776176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3607, pipe: [1:7556556201728824224:9529]
2025-10-02T09:37:24.816399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.816627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.816635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.816647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824224:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.816769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:24.816872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728824224:9529]
2025-10-02T09:37:24.816885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.816906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.816962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3608 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0
2025-10-02T09:37:24.817098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3608 sessionId: src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0 is DEAD
2025-10-02T09:37:24.817265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:24.817278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Write session will restart in 0.009605s
2025-10-02T09:37:24.817298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Write session: Do CDS request
2025-10-02T09:37:24.817304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.827602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.828144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.828261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.828273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3609
2025-10-02T09:37:24.828386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.828409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.828415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.828418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.828742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3609 sessionId:  describe result for acl check
2025-10-02T09:37:24.828769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.828775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.828775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.828778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.829090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.829168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.829235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.829243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.829250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.829279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.829304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653235966:9744]
2025-10-02T09:37:24.829647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.829834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.829857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.830055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.830091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.830096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.830096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.830097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.830097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.830098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.830099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.830099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.830100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.830100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.830101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.830102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.830104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.830110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.830112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.830115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.830118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.830120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.830122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.830124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.830126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.830128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.830130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.830132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.830136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.830140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.830143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.830146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.830148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.830150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.830152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.830155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.830158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.830161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.830163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.830165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.830168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.830170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.830172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.830175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.830178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.830181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.830182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.830185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.830187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.830189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.830191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.830194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.830210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.830729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.835174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.835192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.835195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728824389:9625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.835199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.837885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.839489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.839500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.839501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.839503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.839507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3608 [2:7556556201653235966:9744]
2025-10-02T09:37:24.839513Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.839523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.839527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.839528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.839529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.839538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.839547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.839552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.839584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.839588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.839589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.839591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.839592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.839630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.839635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.839641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.839647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.839655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.839669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824427:9625], now have 1 active actors on pipe
2025-10-02T09:37:24.839675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824225:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.839678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.839679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.839680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.839688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.839699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.839705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.839708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.839708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.839709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.839710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.839724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.839729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.839731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.839720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3608
2025-10-02T09:37:24.839730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3608
2025-10-02T09:37:24.839762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.839767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.839781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.839787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.839791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.839792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.839797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.839802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.839813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.839942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.839947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.839954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.840030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3609 partition: 0 MaxSeqNo: 36 sessionId: src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0
2025-10-02T09:37:24.840286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dba6c6-2ea567d6-1e1dc439-f64374f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.842564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Write session: try to update token
2025-10-02T09:37:24.842578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.853326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:24.853337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.853341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.853362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:24.853365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:24.853506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:24.853623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.853739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.853855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.854010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:24.854039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:24.854705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3609 sessionId: src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:24.857054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:24.857901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.857914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.857924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:24.857925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.857926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:24.857928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:24.857931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.857933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.857935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653235960:9744]
2025-10-02T09:37:24.857956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:24.857959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:24.857962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.857963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:24.857964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:24.857966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:24.858088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:24.917300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556201728824435:9529]
2025-10-02T09:37:24.917525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3608, pipe: [1:7556556201728824435:9529]
2025-10-02T09:37:24.967853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:24.968055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:24.968079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824435:9529], now have 1 active actors on pipe
2025-10-02T09:37:24.968167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:24.968184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:24.968216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556201728824435:9529]
2025-10-02T09:37:24.968269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:24.968276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:24.968333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3609 reason: error at write: Disconnected sessionId: src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0
2025-10-02T09:37:24.968460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3609 sessionId: src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0 is DEAD
2025-10-02T09:37:24.968601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:24.968612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Write session will restart in 0.007433s
2025-10-02T09:37:24.968632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Write session: Do CDS request
2025-10-02T09:37:24.968637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:24.977117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.977222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:24.977232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3610
2025-10-02T09:37:24.977316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:24.977338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:24.977345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:24.977348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:24.977657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3610 sessionId:  describe result for acl check
2025-10-02T09:37:24.977693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:24.977700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:24.977701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:24.977705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:24.977914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:24.978051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:24.979376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:24.979471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:24.979478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:24.979484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:24.979509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:24.979532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556201653236167:9739]
2025-10-02T09:37:24.979788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:24.979873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:24.980022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:24.980046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:24.980232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:24.980265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.980269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.980270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.980270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.980271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.980271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.980272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.980272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.980273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.980273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.980274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.980274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.980277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.980283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.980285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.980287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.980289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.980291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.980293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.980295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.980297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.980299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.980301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.980303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.980307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.980311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:24.980314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.980317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:24.980319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.980322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:24.980324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.980327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:24.980330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.980332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:24.980334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.980337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:24.980339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.980341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:24.980344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.980347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:24.980350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.980352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:24.980354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.980357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.980363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.980366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.980368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.980370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.980388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:24.984340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:24.984351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:24.984353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556201728824604:9649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:24.984357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:24.988052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:24.989571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:24.989583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:24.989584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:24.989586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:24.989591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3609 [2:7556556201653236167:9739]
2025-10-02T09:37:24.989598Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:24.989608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:24.989614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.989615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.989616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.989626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:24.989631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:24.989635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:24.989663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.989668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.989669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.989671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:24.989672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:24.989709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:24.989713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:24.989720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:24.989729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:24.989737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:24.989752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824644:9649], now have 1 active actors on pipe
2025-10-02T09:37:24.989757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556201728824441:2446], now have 1 active actors on pipe
2025-10-02T09:37:24.989761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:24.989762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:24.989764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:24.989772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:24.989780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:24.989783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:24.989785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:24.989786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:24.989789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:24.989791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:24.989777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3609
2025-10-02T09:37:24.989808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:24.989816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:24.989820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:24.989824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3609
2025-10-02T09:37:24.989840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.989846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.989859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:24.989866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:24.989870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:24.989872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:24.989877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:24.989882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:24.989892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.990001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:24.990006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:24.990013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:24.990073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3610 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0
2025-10-02T09:37:24.990271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f7e64b-2efa76d5-44a4b05e-566970c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:24.992482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Write session: try to update token
2025-10-02T09:37:24.992493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:24.999093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:24.999104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:24.999109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:24.999132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:24.999139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:24.999276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:24.999390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.999501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.999616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:24.999786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:24.999808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:25.004526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3610 sessionId: src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.006828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.007017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.007024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.007037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:25.007070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:25.007873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.007885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.007888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.007889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.007893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:25.007895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:25.007896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556201653236162:9739]
2025-10-02T09:37:25.007914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.007917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.007919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.007920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.007921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.007922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.008048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.068351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023791951:9529]
2025-10-02T09:37:25.068562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3609, pipe: [1:7556556206023791951:9529]
2025-10-02T09:37:25.120141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.127194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.127212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.127349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.127408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.127465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.127521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.127562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.127568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.127621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.127674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.127732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.127783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.127819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.127824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.127876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.127928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.127977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.128031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.128072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.128076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.128125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.128178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.128228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.128278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.128313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.128319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.128371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.128422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.128477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.128535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.128579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.128584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.128643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.128692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.128745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.128794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.128843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.128849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.128909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.128963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.129019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.129074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.129115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.129119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.129176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.129230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.129285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.129340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.129399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.129404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.129461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.129511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.129566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.129617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.129672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.129677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.129733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:25.129782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:25.129833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:25.129883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:25.129919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:25.129924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:25.129957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023791951:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.130132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.130157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023791951:9529]
2025-10-02T09:37:25.130177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:25.130179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:25.130200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3610 reason: error at write: Disconnected sessionId: src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0
2025-10-02T09:37:25.130337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3610 sessionId: src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0 is DEAD
2025-10-02T09:37:25.130474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:25.130486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Write session will restart in 0.009747s
2025-10-02T09:37:25.130505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Write session: Do CDS request
2025-10-02T09:37:25.130511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.130669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.140358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.141104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.141207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.141218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3611
2025-10-02T09:37:25.141337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.141362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.141367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.141371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.141682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3611 sessionId:  describe result for acl check
2025-10-02T09:37:25.141709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.141714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.141715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.141718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.141785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.141887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.141894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.141900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.141926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.141951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948203667:9734]
2025-10-02T09:37:25.142057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.142293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.142461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.142483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.142659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.142689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.142693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.142693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.142694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.142694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.142695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.142695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.142696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.142696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.142697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.142697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.142698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.142701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.142707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.142709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.142711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.142713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.142715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.142717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.142719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.142721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.142723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.142725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.142727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.142730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.142734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.142737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.142740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.142742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.142745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.142746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.142749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.142751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.142754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.142756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.142759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.142761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.142764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.142766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.142769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.142771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.142775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.142777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.142779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.142782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.142784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.142787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.142790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.142805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.144199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.148755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.148764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.148767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023792118:9651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.148771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.150516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.152179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.152190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.152191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.152193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.152197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3610 [2:7556556205948203667:9734]
2025-10-02T09:37:25.152206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.152217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.152218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.152220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.152221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.152231Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.152234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.152238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.152271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.152276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.152277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.152279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.152281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.152316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.152321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.152327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.152332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.152340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.152355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023791952:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.152362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.152363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.152364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.152371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.152376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792155:9651], now have 1 active actors on pipe
2025-10-02T09:37:25.152381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.152385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.152388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.152389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.152389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.152391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.152406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.152412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.152414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.152430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3610
2025-10-02T09:37:25.152511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3610
2025-10-02T09:37:25.152553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.152559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.152573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.152581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.152583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.152584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.152589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.152598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.152605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.152720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.152724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.152732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.152792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3611 partition: 0 MaxSeqNo: 36 sessionId: src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0
2025-10-02T09:37:25.153058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e52ca5-9a5ed209-577ca96f-300f619a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.155289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Write session: try to update token
2025-10-02T09:37:25.155301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.161696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.161707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.161708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.161709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.161712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.161714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.161718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948203661:9734]
2025-10-02T09:37:25.161738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.161741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.161744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.161744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.161745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.161746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.161939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.167125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3611 sessionId: src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.169308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.230140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023792164:9529]
2025-10-02T09:37:25.230344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3610, pipe: [1:7556556206023792164:9529]
2025-10-02T09:37:25.274293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.274716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.274726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.274739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792164:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.274892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.274929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.274957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023792164:9529]
2025-10-02T09:37:25.274968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:25.275027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0
2025-10-02T09:37:25.275170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3611 sessionId: src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0 is DEAD
2025-10-02T09:37:25.275339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:25.275350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Write session will restart in 0.006599s
2025-10-02T09:37:25.275387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Write session: Do CDS request
2025-10-02T09:37:25.275393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.283141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.283268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.283280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3612
2025-10-02T09:37:25.283377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.283401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.283409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.283412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.283716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3612 sessionId:  describe result for acl check
2025-10-02T09:37:25.283743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.283750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.283751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.283754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.284105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.284578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.286025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.286037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.286131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.286137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.286143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.286166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.286191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948203872:9719]
2025-10-02T09:37:25.286531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.286705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.286728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.286902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.286930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.286933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.286934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.286935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.286935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.286936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.286936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.286937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.286937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.286938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.286938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.286939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.286942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.286948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.286950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.286952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.286954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.286956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.286958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.286960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.286962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.286965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.286967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.286968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.286972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.286976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.286979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.286982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.286984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.286987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.286989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.286992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.286994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.286997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.286999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.287002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.287004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.287007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.287009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.287012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.287016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.287018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.287021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.287024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.287026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.287030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.287032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.287034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.287050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.290832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.290843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.290845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023792328:9657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.290848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.294430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.295905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.295917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.295918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.295920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.295924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3611 [2:7556556205948203872:9719]
2025-10-02T09:37:25.295930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.295941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.295942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.295944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.295945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.295954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.295961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.295965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.295994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.295999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.296000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.296002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.296003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.296040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.296045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.296052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.296057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.296067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.296082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792165:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.296088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792369:9657], now have 1 active actors on pipe
2025-10-02T09:37:25.296092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.296093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.296095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.296102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.296113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.296122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.296112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3611
2025-10-02T09:37:25.296126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.296127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.296136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3611
2025-10-02T09:37:25.296129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.296131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.296146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.296147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.296150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.296157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.296159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.296180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.296188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.296189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.296190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.296197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.296202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.296213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.296326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.296331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.296338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.296401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3612 partition: 0 MaxSeqNo: 36 sessionId: src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0
2025-10-02T09:37:25.296599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8182120-9b9ecfec-e7c7b6ee-32d0499f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.298879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Write session: try to update token
2025-10-02T09:37:25.298891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.305269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.305281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.305282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.305283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.305287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.305290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.305291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948203867:9719]
2025-10-02T09:37:25.305311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.305314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.305315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.305316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.305320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.305322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.305436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.313355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3612 sessionId: src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.315718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.375001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023792393:9529]
2025-10-02T09:37:25.375173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3611, pipe: [1:7556556206023792393:9529]
2025-10-02T09:37:25.417907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.418107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.418116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.418129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792393:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.418309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.418300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023792393:9529]
2025-10-02T09:37:25.418357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.418367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:25.418417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3612 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0
2025-10-02T09:37:25.418562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3612 sessionId: src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0 is DEAD
2025-10-02T09:37:25.418715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:25.418727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Write session will restart in 0.005745s
2025-10-02T09:37:25.418750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Write session: Do CDS request
2025-10-02T09:37:25.418755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.425157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.425252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.425265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3613
2025-10-02T09:37:25.425363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.425387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.425394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.425398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.426110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3613 sessionId:  describe result for acl check
2025-10-02T09:37:25.426138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.426143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.426146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.426150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.426552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.428271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.428596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.429764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.429966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.429974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.429982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.430019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.430045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948204128:9713]
2025-10-02T09:37:25.430389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.430565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.430589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.430680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.430690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.430692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023792524:9689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.430696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.430766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.430798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.430802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.430803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.430803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.430804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.430805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.430805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.430806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.430806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.430807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.430807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.430808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.430810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.430817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.430819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.430821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.430823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.430825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.430827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.430829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.430831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.430833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.430834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.430836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.430840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.430844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.430848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.430851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.430854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.430856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.430859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.430861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.430864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.430866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.430868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.430871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.430873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.430876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.430878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.430881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.430883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.430886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.430888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.430890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.430893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.430895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.430899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.430902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.430918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.438291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.439925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.439938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.439939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.439941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.439945Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3612 [2:7556556205948204128:9713]
2025-10-02T09:37:25.439956Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.439965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.439967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.439968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.439969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.439978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.439985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.439989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.440019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.440023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.440025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.440027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.440028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.440064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.440068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.440074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.440079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.440090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.440104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792619:9689], now have 1 active actors on pipe
2025-10-02T09:37:25.440109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792415:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.440112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.440113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.440115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.440122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.440131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.440140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.440142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.440143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.440148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.440150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.440156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.440158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.440170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.440153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3612
2025-10-02T09:37:25.440156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3612
2025-10-02T09:37:25.440192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.440197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.440210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1759ed02-881c26e-3161b12f-a7237097_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.440217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.440220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.440221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.440226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.440234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.440245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.440361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.440366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.440373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.440439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3613 partition: 0 MaxSeqNo: 36 sessionId: src_id|1759ed02-881c26e-3161b12f-a7237097_0
2025-10-02T09:37:25.440666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f37c99-64cce182-31be5d8f-e9171ff6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1759ed02-881c26e-3161b12f-a7237097_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.442880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Write session: try to update token
2025-10-02T09:37:25.442893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.453113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:25.453122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.453125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.453145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:25.453150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:25.453281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:25.453408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:25.453532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:25.453650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:25.453825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:25.453848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:25.457143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3613 sessionId: src_id|1759ed02-881c26e-3161b12f-a7237097_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.457670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.457679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.457680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.457681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.457684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.457687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.457689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948204122:9713]
2025-10-02T09:37:25.457707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.457710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.457711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.457714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.457716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.457718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.457829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.459401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.518375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023792629:9529]
2025-10-02T09:37:25.518529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3612, pipe: [1:7556556206023792629:9529]
2025-10-02T09:37:25.566631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.566827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.566836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.566849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792629:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.566990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.567038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:25.567062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023792629:9529]
2025-10-02T09:37:25.567088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.567101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1759ed02-881c26e-3161b12f-a7237097_0
2025-10-02T09:37:25.567240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3613 sessionId: src_id|1759ed02-881c26e-3161b12f-a7237097_0 is DEAD
2025-10-02T09:37:25.567376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:25.567387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Write session will restart in 0.006763s
2025-10-02T09:37:25.567406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Write session: Do CDS request
2025-10-02T09:37:25.567412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.575135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.575251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.575263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3614
2025-10-02T09:37:25.575368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.575391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.575399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.575405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.575778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3614 sessionId:  describe result for acl check
2025-10-02T09:37:25.575804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.575809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.575810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.575815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.576234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.577136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.577732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.578518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.578634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.578640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.578646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.578675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.578798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948204332:9708]
2025-10-02T09:37:25.579159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.579329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.579354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.579534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.579565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.579569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.579570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.579570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.579571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.579571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.579572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.579572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.579573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.579574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.579574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.579575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.579578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.579584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.579586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.579588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.579590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.579592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.579594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.579596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.579598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.579601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.579603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.579604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.579608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.579612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.579616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.579618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.579622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.579624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.579627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.579630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.579632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.579634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.579629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.579637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.579640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.579639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.579642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023792772:9693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.579642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.579645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.579644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.579647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.579650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.579652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.579654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.579657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.579659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.579662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.579664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.579666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.579668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.579685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.587014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.588491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.588504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.588506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.588508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.588511Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3613 [2:7556556205948204332:9708]
2025-10-02T09:37:25.588518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.588529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.588535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.588536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.588537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.588547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.588550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.588554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.588588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.588593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.588594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.588597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.588598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.588635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.588639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.588646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.588653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.588666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.588686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792835:9693], now have 1 active actors on pipe
2025-10-02T09:37:25.588693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792630:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.588699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.588700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.588702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.588712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.588723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.588732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.588736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.588709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3613
2025-10-02T09:37:25.588736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.588739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.588741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.588741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3613
2025-10-02T09:37:25.588757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.588759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.588769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.588777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.588789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.588795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.588798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.588813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.588814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.588820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.588826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.588843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.588971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.588976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.588984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.589049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3614 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0
2025-10-02T09:37:25.589431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1759ed02-881c26e-3161b12f-a7237097_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.591688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Write session: try to update token
2025-10-02T09:37:25.591701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.597911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.597926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.597927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.597929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.597935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.597938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.597941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948204327:9708]
2025-10-02T09:37:25.597966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.597967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.597970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.597971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.597974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.597976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.598095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.604046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3614 sessionId: src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.606307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.667393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023792844:9529]
2025-10-02T09:37:25.667579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3613, pipe: [1:7556556206023792844:9529]
2025-10-02T09:37:25.708393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.708707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.708716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.708730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792844:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.708910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.708980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:25.708985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023792844:9529]
2025-10-02T09:37:25.708991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:25.709000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.709059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3614 reason: error at write: Disconnected sessionId: src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0
2025-10-02T09:37:25.709210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3614 sessionId: src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0 is DEAD
2025-10-02T09:37:25.709367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:25.709378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Write session will restart in 0.007111s
2025-10-02T09:37:25.709401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Write session: Do CDS request
2025-10-02T09:37:25.709407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.717126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.717226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.717235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3615
2025-10-02T09:37:25.717343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.717365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.717373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.717377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.717736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3615 sessionId:  describe result for acl check
2025-10-02T09:37:25.717760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.717765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.717767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.717771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.718219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.719185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.719548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.720630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.720737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.720743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.720749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.720776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.720817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948204540:9703]
2025-10-02T09:37:25.721198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.721399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.721425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.721499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.721508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.721510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023792981:9702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.721515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.721640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.721682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.721686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.721687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.721687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.721688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.721689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.721689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.721690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.721690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.721691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.721691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.721692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.721695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.721702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.721704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.721706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.721708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.721710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.721712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.721714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.721716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.721720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.721722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.721724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.721728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.721732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.721736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.721738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.721741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.721743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.721745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.721748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.721751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.721753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.721756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.721758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.721760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.721763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.721765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.721769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.721771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.721774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.721776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.721779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.721781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.721784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.721786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.721788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.721807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.729523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.731217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.731228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.731230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.731233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.731237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3614 [2:7556556205948204540:9703]
2025-10-02T09:37:25.731244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.731256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.731263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.731266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.731267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.731279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.731287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.731291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.731323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.731328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.731330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.731332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.731333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.731370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.731375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.731382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.731387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.731395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.731409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023792846:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.731414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793052:9702], now have 1 active actors on pipe
2025-10-02T09:37:25.731418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.731419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.731420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.731427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.731436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.731440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.731443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.731444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.731447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.731448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.731461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.731466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.731456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3614
2025-10-02T09:37:25.731463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3614
2025-10-02T09:37:25.731480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.731491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.731495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.731512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84da02e0-9da93371-1e048178-7c90b45a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.731519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.731522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.731523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.731528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.731536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.731544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.731666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.731672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.731680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.731739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3615 partition: 0 MaxSeqNo: 36 sessionId: src_id|84da02e0-9da93371-1e048178-7c90b45a_0
2025-10-02T09:37:25.731958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5208b94-e3dfeeff-5ab12383-292d2006_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84da02e0-9da93371-1e048178-7c90b45a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.734234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Write session: try to update token
2025-10-02T09:37:25.734248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.740990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.741002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.741004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.741006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.741012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.741015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.741018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948204534:9703]
2025-10-02T09:37:25.741044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.741045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.741047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.741049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.741049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.741051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.741251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.745903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3615 sessionId: src_id|84da02e0-9da93371-1e048178-7c90b45a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.748127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.809184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023793061:9529]
2025-10-02T09:37:25.809380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3614, pipe: [1:7556556206023793061:9529]
2025-10-02T09:37:25.852976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.853307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.853318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.853342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793061:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.853472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.853483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023793061:9529]
2025-10-02T09:37:25.853508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.853511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:25.853514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:25.853575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3615 reason: error at write: Disconnected sessionId: src_id|84da02e0-9da93371-1e048178-7c90b45a_0
2025-10-02T09:37:25.853732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3615 sessionId: src_id|84da02e0-9da93371-1e048178-7c90b45a_0 is DEAD
2025-10-02T09:37:25.853863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:25.853871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Write session will restart in 0.006423s
2025-10-02T09:37:25.853890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Write session: Do CDS request
2025-10-02T09:37:25.853895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:25.861156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.861280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:25.861292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3616
2025-10-02T09:37:25.861410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:25.861433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:25.861441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:25.861445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:25.861791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3616 sessionId:  describe result for acl check
2025-10-02T09:37:25.861822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:25.861827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:25.861829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:25.861833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:25.862309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:25.863371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:25.864140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:25.864883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:25.865007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:25.865013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:25.865020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:25.865048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:25.865073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556205948204747:9690]
2025-10-02T09:37:25.865468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:25.865657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:25.865685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:25.865862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:25.865870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:25.865873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556206023793194:9715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:25.865877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:25.865917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:25.865957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.865963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.865964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.865965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.865966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.865967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.865968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.865969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.865970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.865971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.865972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.865973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.865977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.865986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.865990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.865994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.865997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.866000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.866004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.866007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.866011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.866014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.866018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.866021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.866027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.866037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:25.866046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.866055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:25.866058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.866065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:25.866069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.866077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:25.866081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.866087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:25.866091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.866099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:25.866103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.866111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:25.866114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.866120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:25.866125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.866132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:25.866134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.866137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.866140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.866144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.866146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.866149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.866168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:25.873873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:25.875557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:25.875568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:25.875570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:25.875572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:25.875575Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3615 [2:7556556205948204747:9690]
2025-10-02T09:37:25.875585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:25.875595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:25.875596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.875598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.875599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.875608Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:25.875614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:25.875618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:25.875648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.875653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.875654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.875656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:25.875657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:25.875704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:25.875709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.875716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:25.875722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:25.875733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:25.875746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793270:9715], now have 1 active actors on pipe
2025-10-02T09:37:25.875751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793063:2446], now have 1 active actors on pipe
2025-10-02T09:37:25.875754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.875757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.875758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.875765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:25.875775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:25.875778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:25.875780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:25.875781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:25.875784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:25.875786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:25.875798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.875803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:25.875785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3615
2025-10-02T09:37:25.875788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3615
2025-10-02T09:37:25.875814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:25.875823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.875825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.875841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f7d12d1-d27e8429-81297657-5c429d91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:25.875849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:25.875851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:25.875852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:25.875856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:25.875863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:25.875871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.875992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.876001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.876010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:25.876078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3616 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f7d12d1-d27e8429-81297657-5c429d91_0
2025-10-02T09:37:25.876314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84da02e0-9da93371-1e048178-7c90b45a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f7d12d1-d27e8429-81297657-5c429d91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:25.878553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Write session: try to update token
2025-10-02T09:37:25.878567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:25.885322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:25.885335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:25.885337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:25.885338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:25.885342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.885345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.885347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556205948204742:9690]
2025-10-02T09:37:25.885367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:25.885368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:25.885370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:25.885370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:25.885371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:25.885372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:25.885511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:25.890686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3616 sessionId: src_id|3f7d12d1-d27e8429-81297657-5c429d91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:25.893116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:25.953599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556206023793282:9529]
2025-10-02T09:37:25.953769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3615, pipe: [1:7556556206023793282:9529]
2025-10-02T09:37:25.996575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:25.996808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:25.996818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:25.996831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793282:9529], now have 1 active actors on pipe
2025-10-02T09:37:25.996977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:25.997084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556206023793282:9529]
2025-10-02T09:37:25.997091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:25.997120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:25.997197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f7d12d1-d27e8429-81297657-5c429d91_0
2025-10-02T09:37:25.997359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3616 sessionId: src_id|3f7d12d1-d27e8429-81297657-5c429d91_0 is DEAD
2025-10-02T09:37:25.997511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:25.997523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Write session will restart in 0.007683s
2025-10-02T09:37:25.997545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Write session: Do CDS request
2025-10-02T09:37:25.997551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.006183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.006281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.006293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3617
2025-10-02T09:37:26.006405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.006429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.006436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.006439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.006782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3617 sessionId:  describe result for acl check
2025-10-02T09:37:26.006811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.006819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.006820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.006824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.007312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.007308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.008816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.008827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.008914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.008920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.008925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.008950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.008977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243172251:9698]
2025-10-02T09:37:26.009319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.009470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.009491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.009663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.009693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.009697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.009698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.009698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.009699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.009700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.009700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.009701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.009701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.009702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.009702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.009703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.009706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.009712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.009714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.009717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.009719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.009721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.009723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.009725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.009726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.009729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.009731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.009732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.009736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.009741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.009744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.009747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.009749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.009752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.009754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.009756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.009759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.009761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.009763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.009766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.009768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.009771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.009773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.009776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.009778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.009781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.009787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.009789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.009792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.009794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.009796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.009799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.009815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.013591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.013601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.013603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318760752:9731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.013608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.017157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.018678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.018688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.018689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.018691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.018694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3616 [2:7556556210243172251:9698]
2025-10-02T09:37:26.018700Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.018710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.018711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.018713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.018714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.018723Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.018729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.018733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.018764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.018768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.018769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.018771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.018772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.018808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.018813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.018820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.018826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.018836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.018851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318760794:9731], now have 1 active actors on pipe
2025-10-02T09:37:26.018856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556206023793287:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.018860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.018861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.018862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.018869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.018879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.018881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.018883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.018884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.018888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.018889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.018886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3616
2025-10-02T09:37:26.018889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3616
2025-10-02T09:37:26.018903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.018908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.018920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.018930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.018932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.018949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.018956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.018958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.018959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.018964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.018969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.018976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.019067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.019072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.019079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.019136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3617 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0
2025-10-02T09:37:26.019642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7d12d1-d27e8429-81297657-5c429d91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.021864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Write session: try to update token
2025-10-02T09:37:26.021876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.027897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.027908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.027909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.027910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.027914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.027916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.027918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243172246:9698]
2025-10-02T09:37:26.027937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.027939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.027941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.027943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.027944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.027945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.028048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.033568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3617 sessionId: src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.035828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.097450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318760804:9529]
2025-10-02T09:37:26.097603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3616, pipe: [1:7556556210318760804:9529]
2025-10-02T09:37:26.136621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.136896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.136907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.136920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318760804:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.137125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:26.137128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.137141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:26.137182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318760804:9529]
2025-10-02T09:37:26.137227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3617 reason: error at write: Disconnected sessionId: src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0
2025-10-02T09:37:26.137331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.137425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3617 sessionId: src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0 is DEAD
2025-10-02T09:37:26.137565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:26.137575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Write session will restart in 0.008300s
2025-10-02T09:37:26.137594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Write session: Do CDS request
2025-10-02T09:37:26.137601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.146899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.147153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.147284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.147295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3618
2025-10-02T09:37:26.147409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.147433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.147442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.147445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.147802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3618 sessionId:  describe result for acl check
2025-10-02T09:37:26.147828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.147833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.147836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.147841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.148272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.148296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.148394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.148401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.148406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.148430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.148455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243172462:9701]
2025-10-02T09:37:26.148793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.148947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.148970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.149146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.149176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.149179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.149180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.149181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.149181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.149182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.149182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.149183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.149184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.149184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.149185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.149185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.149188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.149195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.149197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.149200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.149202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.149204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.149206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.149208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.149209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.149212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.149214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.149215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.149219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.149223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.149227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.149231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.149234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.149236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.149238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.149241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.149243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.149246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.149248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.149251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.149254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.149256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.149263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.149265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.149268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.149270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.149273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.149276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.149279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.149281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.149284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.149310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.149575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.154095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.154107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.154111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318760977:9734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.154119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.156612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.158089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.158099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.158100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.158102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.158106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3617 [2:7556556210243172462:9701]
2025-10-02T09:37:26.158233Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.158246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.158250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.158252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.158253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.158262Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.158266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.158270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.158300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.158304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.158305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.158307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.158308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.158346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.158351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.158357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.158362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.158374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.158388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318760805:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.158393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761016:9734], now have 1 active actors on pipe
2025-10-02T09:37:26.158397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.158398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.158399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.158407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.158417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.158419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.158422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.158423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.158427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.158429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.158430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3617
2025-10-02T09:37:26.158431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3617
2025-10-02T09:37:26.158443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.158448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.158456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.158467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.158471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.158486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.158493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.158494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.158495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.158501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.158507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.158513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.158622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.158627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.158634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.158696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3618 partition: 0 MaxSeqNo: 36 sessionId: src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0
2025-10-02T09:37:26.158934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b3f1b2-39b5b42c-b0a5a475-6bd70e39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.161251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Write session: try to update token
2025-10-02T09:37:26.161264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.167418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.167428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.167429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.167430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.167433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.167436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.167438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243172457:9701]
2025-10-02T09:37:26.167457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.167458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.167461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.167461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.167462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.167463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.167576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.173070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3618 sessionId: src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.175417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.237237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318761024:9529]
2025-10-02T09:37:26.237440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3617, pipe: [1:7556556210318761024:9529]
2025-10-02T09:37:26.276402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.276618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.276628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.276642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761024:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.276827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:26.276846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:26.276873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318761024:9529]
2025-10-02T09:37:26.276903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.276952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3618 reason: error at write: Disconnected sessionId: src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0
2025-10-02T09:37:26.277003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.277104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3618 sessionId: src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0 is DEAD
2025-10-02T09:37:26.277248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:26.277259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Write session will restart in 0.005484s
2025-10-02T09:37:26.277279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Write session: Do CDS request
2025-10-02T09:37:26.277284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.284183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.284279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.284288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3619
2025-10-02T09:37:26.284370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.284392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.284396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.284399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.284711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3619 sessionId:  describe result for acl check
2025-10-02T09:37:26.284734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.284739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.284741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.284744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.285207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.287023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.287114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.288545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.288644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.288650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.288656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.288680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.288704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243172676:9691]
2025-10-02T09:37:26.288740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.288750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.288752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318761119:9744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.288756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.289060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.289213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.289236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.289416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.289447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.289451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.289452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.289452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.289453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.289453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.289454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.289454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.289455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.289455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.289456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.289457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.289459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.289466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.289468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.289470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.289472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.289474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.289475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.289477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.289479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.289481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.289484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.289486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.289489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.289493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.289497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.289500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.289502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.289505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.289507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.289509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.289511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.289514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.289516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.289519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.289521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.289524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.289525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.289528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.289532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.289534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.289536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.289539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.289541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.289544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.289546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.289548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.289565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.296849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.298305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.298315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.298316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.298318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.298321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3618 [2:7556556210243172676:9691]
2025-10-02T09:37:26.298328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.298337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.298342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.298343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.298344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.298353Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.298356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.298360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.298389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.298393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.298394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.298396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.298398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.298434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.298438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.298444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.298449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.298459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.298473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761233:9744], now have 1 active actors on pipe
2025-10-02T09:37:26.298478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761025:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.298482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.298487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.298488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.298496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.298506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.298506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.298508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.298510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.298513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.298517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.298530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.298535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.298538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.298536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3618
2025-10-02T09:37:26.298548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3618
2025-10-02T09:37:26.298565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.298571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.298590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.298598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.298600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.298602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.298608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.298618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.298628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.298740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.298744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.298751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.298812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3619 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0
2025-10-02T09:37:26.299049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ebbfc1-c961936-7a066cc9-86b58c85_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.301342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Write session: try to update token
2025-10-02T09:37:26.301357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.307433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.307442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.307444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.307445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.307448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.307450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.307452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243172670:9691]
2025-10-02T09:37:26.307470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.307470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.307472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.307472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.307473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.307474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.307591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.313304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3619 sessionId: src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.315653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.377000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318761247:9529]
2025-10-02T09:37:26.377179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3618, pipe: [1:7556556210318761247:9529]
2025-10-02T09:37:26.423104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.423297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.423309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.423322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761247:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.423440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.423476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:26.423487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:26.423542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3619 reason: error at write: Disconnected sessionId: src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0
2025-10-02T09:37:26.423704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3619 sessionId: src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0 is DEAD
2025-10-02T09:37:26.423837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:26.423848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Write session will restart in 0.005625s
2025-10-02T09:37:26.423863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318761247:9529]
2025-10-02T09:37:26.423878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Write session: Do CDS request
2025-10-02T09:37:26.423887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.423882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.430105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.430278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.430289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3620
2025-10-02T09:37:26.430389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.430410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.430416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.430419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.430721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3620 sessionId:  describe result for acl check
2025-10-02T09:37:26.430744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.430748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.430749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.430753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.431224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.433080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.433586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.435027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.435129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.435135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.435141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.435164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.435185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243172938:9671]
2025-10-02T09:37:26.435435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.435445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.435447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318761364:9778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.435451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.435537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.435681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.435704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.435904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.435939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.435943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.435944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.435945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.435945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.435946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.435946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.435947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.435948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.435948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.435949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.435949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.435953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.435959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.435961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.435963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.435965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.435967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.435969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.435971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.435973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.435975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.435977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.435979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.435983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.435987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.435991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.435994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.435996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.435999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.436001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.436004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.436006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.436008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.436010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.436013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.436015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.436018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.436020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.436023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.436025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.436031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.436033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.436036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.436038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.436041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.436043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.436045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.436066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.443392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.444927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.444936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.444937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.444939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.444942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3619 [2:7556556210243172938:9671]
2025-10-02T09:37:26.444953Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.444962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.444963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.444964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.444965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.444974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.444979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.444983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.445014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.445019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.445020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.445022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.445023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.445060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.445065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.445071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.445076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.445084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.445098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761490:9778], now have 1 active actors on pipe
2025-10-02T09:37:26.445103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761273:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.445107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.445108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.445109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.445116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.445126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.445137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.445137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.445139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.445140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.445141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.445154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.445158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.445160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.445163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3619
2025-10-02T09:37:26.445165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3619
2025-10-02T09:37:26.445196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.445201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.445218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.445225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.445227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.445228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.445233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.445239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.445248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.445372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.445376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.445384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.445448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3620 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0
2025-10-02T09:37:26.445696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad8bff1-b6057261-18aac189-b2cb82c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.447922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Write session: try to update token
2025-10-02T09:37:26.447934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.454102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.454113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.454114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.454115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.454118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.454121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.454122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243172933:9671]
2025-10-02T09:37:26.454141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.454142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.454144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.454144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.454145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.454146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.454253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.459674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3620 sessionId: src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.461972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.523945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318761502:9529]
2025-10-02T09:37:26.524121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3619, pipe: [1:7556556210318761502:9529]
2025-10-02T09:37:26.564553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.564922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.564934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.564946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761502:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.565087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.565175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318761502:9529]
2025-10-02T09:37:26.565213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.565313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:26.565389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3620 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0
2025-10-02T09:37:26.565559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3620 sessionId: src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0 is DEAD
2025-10-02T09:37:26.565694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:26.565703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Write session will restart in 0.008434s
2025-10-02T09:37:26.565722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Write session: Do CDS request
2025-10-02T09:37:26.565726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.575087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.575217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.575227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3621
2025-10-02T09:37:26.575305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.575327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.575337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.575339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.575367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.575660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3621 sessionId:  describe result for acl check
2025-10-02T09:37:26.575688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.575693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.575695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.575698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.576119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.576826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.576954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.576960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.576966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.576995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.577021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243173150:9666]
2025-10-02T09:37:26.577366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.577528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.577549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.577741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.577745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.577782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.577785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.577786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.577786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.577787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.577787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.577788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.577788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.577789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.577789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.577790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.577790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.577793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.577799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.577802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.577804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.577805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.577807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.577809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.577811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.577813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.577815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.577817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.577819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.577824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.577828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.577831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.577833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.577835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.577838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.577841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.577843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.577846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.577848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.577852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.577854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.577857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.577860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.577862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.577865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.577867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.577869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.577871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.577874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.577878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.577880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.577883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.577885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.577902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.582657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.582667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.582670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318761677:9791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.582675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.585230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.586723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.586734Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.586735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.586737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.586740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3620 [2:7556556210243173150:9666]
2025-10-02T09:37:26.586747Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.586757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.586760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.586762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.586764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.586773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.586777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.586781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.586818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.586823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.586825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.586827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.586829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.586867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.586872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.586878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.586883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.586891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.586905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761717:9791], now have 1 active actors on pipe
2025-10-02T09:37:26.586910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761503:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.586915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.586916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.586917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.586926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.586936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.586938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.586940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.586941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.586943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.586945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.586958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.586963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.586964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.586957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3620
2025-10-02T09:37:26.586964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3620
2025-10-02T09:37:26.587011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.587016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.587031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.587037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.587039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.587040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.587045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.587050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.587060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.587175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.587180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.587188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.587259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3621 partition: 0 MaxSeqNo: 36 sessionId: src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0
2025-10-02T09:37:26.587490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c568ca-cb766c68-fd8b6bee-8fb74c2a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.589746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Write session: try to update token
2025-10-02T09:37:26.589759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.595790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:26.595800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.595804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.595823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:26.595825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:26.595962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:26.596080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:26.596194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:26.596312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:26.596477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:26.596498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:26.601703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3621 sessionId: src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.603986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.604202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.604214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.604224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.604225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.604226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.604227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.604230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.604232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.604234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243173144:9666]
2025-10-02T09:37:26.604253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.604256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.604259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.604260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.604261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.604263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.604425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.665286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318761727:9529]
2025-10-02T09:37:26.665504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3620, pipe: [1:7556556210318761727:9529]
2025-10-02T09:37:26.713321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.713580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:26.713607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761727:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.713697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:26.713779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318761727:9529]
2025-10-02T09:37:26.713807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.713808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:26.713810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:26.713878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3621 reason: error at write: Disconnected sessionId: src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0
2025-10-02T09:37:26.714014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3621 sessionId: src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0 is DEAD
2025-10-02T09:37:26.714147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:26.714158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Write session will restart in 0.007851s
2025-10-02T09:37:26.714178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Write session: Do CDS request
2025-10-02T09:37:26.714188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.723161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.723269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.723281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3622
2025-10-02T09:37:26.723377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.723400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.723408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.723411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.723771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3622 sessionId:  describe result for acl check
2025-10-02T09:37:26.723777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.723802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.723807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.723809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.723814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.724269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.725221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.725322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.725328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.725335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.725359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.725382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243173364:9664]
2025-10-02T09:37:26.725729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.725727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.725881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.725902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.726075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.726103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.726107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.726107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.726108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.726108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.726109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.726109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.726110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.726110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.726111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.726112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.726112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.726115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.726122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.726125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.726127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.726129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.726131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.726132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.726134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.726136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.726139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.726141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.726142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.726146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.726150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.726153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.726155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.726157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.726160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.726162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.726165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.726167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.726170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.726172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.726174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.726177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.726180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.726182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.726184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.726188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.726191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.726193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.726195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.726197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.726200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.726202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.726204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.726224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.729970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.729980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.729985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318761904:9798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.729991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.733598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.734965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.734976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.734977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.734979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.734983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3621 [2:7556556210243173364:9664]
2025-10-02T09:37:26.734989Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.734999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.735005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.735007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.735008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.735018Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.735022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.735026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.735058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.735063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.735064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.735066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.735067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.735103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.735108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.735114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.735119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.735129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.735143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761943:9798], now have 1 active actors on pipe
2025-10-02T09:37:26.735149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761729:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.735152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.735153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.735154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.735162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.735173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.735175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.735177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.735178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.735183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.735184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.735208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.735217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.735205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3621
2025-10-02T09:37:26.735208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3621
2025-10-02T09:37:26.735222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.735237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.735239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.735255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.735263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.735265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.735266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.735272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.735280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.735287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.735394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.735399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.735406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.735469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3622 partition: 0 MaxSeqNo: 36 sessionId: src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0
2025-10-02T09:37:26.735726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52359c53-7161ff04-68c04ca3-b5932e5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.738039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Write session: try to update token
2025-10-02T09:37:26.738052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.744415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.744426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.744427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.744428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.744431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.744433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.744435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243173359:9664]
2025-10-02T09:37:26.744453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.744456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.744457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.744457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.744459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.744461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.744568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.750176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3622 sessionId: src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.752471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.813760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318761950:9529]
2025-10-02T09:37:26.813977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3621, pipe: [1:7556556210318761950:9529]
2025-10-02T09:37:26.855231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.855571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.855583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.855597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761950:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.855738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.855775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318761950:9529]
2025-10-02T09:37:26.855781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:26.855785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:26.855803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.855869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3622 reason: error at write: Disconnected sessionId: src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0
2025-10-02T09:37:26.856041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3622 sessionId: src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0 is DEAD
2025-10-02T09:37:26.856161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:26.856170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Write session will restart in 0.006834s
2025-10-02T09:37:26.856189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Write session: Do CDS request
2025-10-02T09:37:26.856194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:26.864149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.864237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:26.864246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3623
2025-10-02T09:37:26.864351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:26.864373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:26.864381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:26.864384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:26.864683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3623 sessionId:  describe result for acl check
2025-10-02T09:37:26.864709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:26.864714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:26.864715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:26.864719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:26.865143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:26.866001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:26.867034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:26.867358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:26.867467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:26.867474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:26.867479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:26.867505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:26.867527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556210243173578:9662]
2025-10-02T09:37:26.867872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:26.868024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:26.868047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:26.868226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:26.868254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.868258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.868259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.868259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.868260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.868260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.868261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.868261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.868262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.868263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.868263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.868264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.868266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.868273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.868275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.868277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.868279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.868282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.868283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.868285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.868287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.868290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.868292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.868294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.868297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.868302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:26.868305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.868308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:26.868310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.868313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:26.868315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.868318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:26.868320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.868323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:26.868325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.868327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:26.868329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.868332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:26.868334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.868337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:26.868339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.868343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:26.868345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.868348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.868350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.868352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.868354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.868357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.868373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:26.871311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:26.871320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:26.871323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556210318762106:9797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:26.871328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:26.875921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:26.877453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:26.877465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:26.877466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:26.877468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:26.877472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3622 [2:7556556210243173578:9662]
2025-10-02T09:37:26.877478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:26.877489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:26.877492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.877493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.877494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.877503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:26.877509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:26.877513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:26.877542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.877547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.877548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.877550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:26.877551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:26.877588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:26.877592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.877599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:26.877605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:26.877613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:26.877629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318762169:9797], now have 1 active actors on pipe
2025-10-02T09:37:26.877634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318761953:2446], now have 1 active actors on pipe
2025-10-02T09:37:26.877638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.877639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.877640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.877649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:26.877659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:26.877660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:26.877663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:26.877664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:26.877669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:26.877670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:26.877684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.877692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:26.877676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3622
2025-10-02T09:37:26.877678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3622
2025-10-02T09:37:26.877696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:26.877797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.877805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.877830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b87854b-4f135658-ba955936-bde83ad3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:26.877837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:26.877839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:26.877840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:26.877846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:26.877852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:26.877861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.877972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.877977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.877984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:26.878040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3623 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b87854b-4f135658-ba955936-bde83ad3_0
2025-10-02T09:37:26.878250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f9b87f-8e343f48-66f7e144-b248c2ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b87854b-4f135658-ba955936-bde83ad3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:26.880502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Write session: try to update token
2025-10-02T09:37:26.880516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:26.886782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:26.886793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:26.886794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:26.886795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:26.886799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.886802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.886804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556210243173573:9662]
2025-10-02T09:37:26.886821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:26.886824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:26.886824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:26.886825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:26.886826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:26.886828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:26.886941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:26.892181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3623 sessionId: src_id|1b87854b-4f135658-ba955936-bde83ad3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:26.894556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:26.956090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556210318762179:9529]
2025-10-02T09:37:26.956263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3622, pipe: [1:7556556210318762179:9529]
2025-10-02T09:37:26.994946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:26.995240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:26.995252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:26.995265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318762179:9529], now have 1 active actors on pipe
2025-10-02T09:37:26.995383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:26.995474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:26.995477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556210318762179:9529]
2025-10-02T09:37:26.995506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:26.995566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b87854b-4f135658-ba955936-bde83ad3_0
2025-10-02T09:37:26.995708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3623 sessionId: src_id|1b87854b-4f135658-ba955936-bde83ad3_0 is DEAD
2025-10-02T09:37:26.995839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:26.995851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Write session will restart in 0.007056s
2025-10-02T09:37:26.995869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Write session: Do CDS request
2025-10-02T09:37:26.995874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.004112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.004215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.004224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3624
2025-10-02T09:37:27.004316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.004338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.004346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.004349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.004668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3624 sessionId:  describe result for acl check
2025-10-02T09:37:27.004696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.004701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.004702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.004706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.005154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.005569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.006867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.007051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.007154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.007161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.007166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.007191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.007221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538141089:9657]
2025-10-02T09:37:27.007567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.007730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.007753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.007928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.007958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.007961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.007962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.007962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.007963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.007964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.007964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.007965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.007965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.007966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.007966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.007967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.007970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.007976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.007978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.007980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.007982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.007984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.007986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.007988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.007990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.007993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.007995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.007996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.008000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.008004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.008007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.008010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.008012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.008014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.008017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.008019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.008021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.008028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.008030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.008032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.008035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.008037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.008040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.008042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.008046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.008049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.008052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.008054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.008057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.008059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.008063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.008065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.008081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.011890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.011899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.011901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613729656:9817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.011906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.015364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.016937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.016946Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.016947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.016949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.016952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3623 [2:7556556214538141089:9657]
2025-10-02T09:37:27.016959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.016969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.016974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.016975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.016976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.016985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.016988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.016992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.017025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.017029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.017030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.017032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.017033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.017067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.017071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.017078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.017083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.017090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.017104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729697:9817], now have 1 active actors on pipe
2025-10-02T09:37:27.017109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556210318762184:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.017112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.017113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.017115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.017122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.017132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.017134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.017136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.017137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.017141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.017142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.017146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3623
2025-10-02T09:37:27.017155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.017150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3623
2025-10-02T09:37:27.017159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.017171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.017178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.017179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.017197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5c3da41-6c64383a-72915015-5e889407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.017203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.017205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.017206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.017212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.017220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.017229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.017336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.017341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.017348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.017405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3624 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5c3da41-6c64383a-72915015-5e889407_0
2025-10-02T09:37:27.017626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b87854b-4f135658-ba955936-bde83ad3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5c3da41-6c64383a-72915015-5e889407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.019907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Write session: try to update token
2025-10-02T09:37:27.019920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.026105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.026116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.026117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.026118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.026122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.026124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.026125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538141084:9657]
2025-10-02T09:37:27.026144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.026146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.026148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.026149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.026150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.026152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.026249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.031860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3624 sessionId: src_id|e5c3da41-6c64383a-72915015-5e889407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.034138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.095851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613729708:9529]
2025-10-02T09:37:27.096026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3623, pipe: [1:7556556214613729708:9529]
2025-10-02T09:37:27.135600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.135921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.135933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.135946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729708:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.136087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.136146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.136174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613729708:9529]
2025-10-02T09:37:27.136207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:27.136289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5c3da41-6c64383a-72915015-5e889407_0
2025-10-02T09:37:27.136429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3624 sessionId: src_id|e5c3da41-6c64383a-72915015-5e889407_0 is DEAD
2025-10-02T09:37:27.136590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:27.136603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Write session will restart in 0.007957s
2025-10-02T09:37:27.136627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Write session: Do CDS request
2025-10-02T09:37:27.136633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.145227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.145348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.145360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3625
2025-10-02T09:37:27.145489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.145516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.145524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.145528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.145890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3625 sessionId:  describe result for acl check
2025-10-02T09:37:27.145923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.145928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.145929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.145934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.146378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.146377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.147824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.147971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.147979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.147985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.148016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.148037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538141307:9655]
2025-10-02T09:37:27.148090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.148377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.148540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.148561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.148736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.148763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.148766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.148767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.148767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.148768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.148768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.148769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.148770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.148770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.148771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.148771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.148772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.148774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.148780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.148782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.148785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.148787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.148789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.148791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.148793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.148795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.148797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.148799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.148811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.148816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.148820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.148823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.148826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.148828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.148831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.148833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.148836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.148838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.148841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.148843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.148845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.148847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.148850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.148852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.148854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.148858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.148860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.148862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.148865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.148867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.148870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.148872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.148874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.148890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.152696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.152705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.152708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613729886:9823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.152713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.156197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.157667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.157677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.157678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.157680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.157684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3624 [2:7556556214538141307:9655]
2025-10-02T09:37:27.157690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.157699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.157701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.157703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.157704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.157713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.157715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.157724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.157752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.157757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.157759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.157761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.157762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.157798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.157803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.157809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.157815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.157822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.157836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729927:9823], now have 1 active actors on pipe
2025-10-02T09:37:27.157841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729709:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.157845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.157846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.157847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.157855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.157865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.157869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.157871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.157872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.157874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.157875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.157888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.157892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.157894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.157902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3624
2025-10-02T09:37:27.157903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3624
2025-10-02T09:37:27.157932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.157937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.157955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.157962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.157964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.157965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.157970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.157978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.157985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.158110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.158114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.158122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.158180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3625 partition: 0 MaxSeqNo: 36 sessionId: src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0
2025-10-02T09:37:27.158398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c3da41-6c64383a-72915015-5e889407_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.160630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Write session: try to update token
2025-10-02T09:37:27.160643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.166849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.166859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.166860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.166861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.166865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.166868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.166870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538141301:9655]
2025-10-02T09:37:27.166887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.166893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.166894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.166894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.166896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.166899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.167015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.172402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3625 sessionId: src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.174739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.236164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613729935:9529]
2025-10-02T09:37:27.236364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3624, pipe: [1:7556556214613729935:9529]
2025-10-02T09:37:27.276221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.276501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.276511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.276526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729935:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.276692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.276744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:27.276755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:27.276766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.276839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3625 reason: error at write: Disconnected sessionId: src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0
2025-10-02T09:37:27.276859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613729935:9529]
2025-10-02T09:37:27.276999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3625 sessionId: src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0 is DEAD
2025-10-02T09:37:27.277141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:27.277152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Write session will restart in 0.008643s
2025-10-02T09:37:27.277171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Write session: Do CDS request
2025-10-02T09:37:27.277176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.287022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.287170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.287267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.287276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3626
2025-10-02T09:37:27.287367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.287390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.287398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.287402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.287754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3626 sessionId:  describe result for acl check
2025-10-02T09:37:27.287787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.287792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.287794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.287799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.288232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.288526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.288635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.288641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.288647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.288673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.288697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538141527:9649]
2025-10-02T09:37:27.289051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.289218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.289241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.289436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.289472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.289476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.289477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.289477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.289478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.289479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.289479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.289480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.289480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.289481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.289482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.289482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.289485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.289492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.289494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.289496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.289498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.289500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.289502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.289504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.289506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.289509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.289511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.289513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.289517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.289521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.289525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.289528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.289530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.289532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.289534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.289537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.289539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.289542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.289544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.289547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.289549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.289551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.289554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.289556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.289559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.289565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.289567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.289569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.289572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.289575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.289577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.289581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.289598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.289873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.294325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.294334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.294337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613730115:9844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.294342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.296938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.298422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.298433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.298435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.298437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.298440Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3625 [2:7556556214538141527:9649]
2025-10-02T09:37:27.298450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.298460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.298464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.298466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.298467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.298476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.298479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.298486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.298515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.298520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.298521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.298523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.298524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.298560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.298565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.298572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.298577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.298586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.298601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730155:9844], now have 1 active actors on pipe
2025-10-02T09:37:27.298606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613729936:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.298609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.298611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.298612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.298618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.298627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.298631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.298633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.298634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.298637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.298639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.298652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.298660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.298648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3625
2025-10-02T09:37:27.298651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3625
2025-10-02T09:37:27.298672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.298678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.298680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.298695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e243d482-e50a627-ea523045-b594b599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.298702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.298704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.298705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.298710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.298717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.298724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.298844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.298848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.298856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.298919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3626 partition: 0 MaxSeqNo: 36 sessionId: src_id|e243d482-e50a627-ea523045-b594b599_0
2025-10-02T09:37:27.299122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56b986d-653e1611-f1c16e19-7f2f6ecb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e243d482-e50a627-ea523045-b594b599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.301381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Write session: try to update token
2025-10-02T09:37:27.301394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.307574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.307585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.307586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.307587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.307591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.307593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.307595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538141521:9649]
2025-10-02T09:37:27.307613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.307613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.307615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.307617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.307619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.307620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.307740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.313388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3626 sessionId: src_id|e243d482-e50a627-ea523045-b594b599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.315724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.376977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613730165:9529]
2025-10-02T09:37:27.377169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3625, pipe: [1:7556556214613730165:9529]
2025-10-02T09:37:27.420518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.421128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.421140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.421155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730165:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.421312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.421292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613730165:9529]
2025-10-02T09:37:27.421334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:27.421338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:27.421398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3626 reason: error at write: Disconnected sessionId: src_id|e243d482-e50a627-ea523045-b594b599_0
2025-10-02T09:37:27.421536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3626 sessionId: src_id|e243d482-e50a627-ea523045-b594b599_0 is DEAD
2025-10-02T09:37:27.421666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:27.421672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Write session will restart in 0.007441s
2025-10-02T09:37:27.421692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Write session: Do CDS request
2025-10-02T09:37:27.421702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.421736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.430136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.430244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.430254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3627
2025-10-02T09:37:27.430362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.430385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.430392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.430396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.430710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3627 sessionId:  describe result for acl check
2025-10-02T09:37:27.430737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.430742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.430743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.430747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.431128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.432604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.433503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.433752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.433887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.433894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.433902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.433939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.433969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538141789:9638]
2025-10-02T09:37:27.434313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.434473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.434505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.434662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.434671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.434673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613730349:9846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.434677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.434690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.434718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.434721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.434722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.434722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.434723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.434723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.434725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.434725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.434726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.434727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.434729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.434735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.434737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.434739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.434741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.434743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.434745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.434747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.434748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.434750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.434752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.434754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.434758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.434762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.434765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.434768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.434770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.434773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.434775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.434778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.434780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.434782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.434784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.434787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.434789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.434792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.434794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.434796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.434799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.434801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.434803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.434806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.434808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.434811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.434813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.434816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.434834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.442163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.443607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.443620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.443621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.443623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.443626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3626 [2:7556556214538141789:9638]
2025-10-02T09:37:27.443633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.443642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.443643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.443645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.443646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.443654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.443657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.443661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.443690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.443698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.443699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.443700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.443701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.443738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.443743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.443749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.443756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.443764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.443777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730178:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.443782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730407:9846], now have 1 active actors on pipe
2025-10-02T09:37:27.443785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.443786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.443787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.443796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.443803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.443810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.443812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.443813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.443813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.443815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.443829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.443834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.443835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.443841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3626
2025-10-02T09:37:27.443872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3626
2025-10-02T09:37:27.443910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.443915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.443928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.443935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.443937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.443938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.443943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.443950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.443958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.444073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.444078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.444085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.444152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3627 partition: 0 MaxSeqNo: 36 sessionId: src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0
2025-10-02T09:37:27.444389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e243d482-e50a627-ea523045-b594b599_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.446669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Write session: try to update token
2025-10-02T09:37:27.446682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.452830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.452838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.452840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.452840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.452844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.452846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.452848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538141783:9638]
2025-10-02T09:37:27.452868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.452871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.452872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.452873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.452873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.452875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.452979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.458373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3627 sessionId: src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.460733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.521322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613730427:9529]
2025-10-02T09:37:27.521474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3626, pipe: [1:7556556214613730427:9529]
2025-10-02T09:37:27.561921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.562159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.562171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.562185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730427:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.562332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.562389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613730427:9529]
2025-10-02T09:37:27.562412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.562428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:27.562509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3627 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0
2025-10-02T09:37:27.562663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3627 sessionId: src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0 is DEAD
2025-10-02T09:37:27.562799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:27.562805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Write session will restart in 0.006975s
2025-10-02T09:37:27.562825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Write session: Do CDS request
2025-10-02T09:37:27.562830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.571130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.571248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.571256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3628
2025-10-02T09:37:27.571843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.571866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.571873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.571877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.572189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3628 sessionId:  describe result for acl check
2025-10-02T09:37:27.572217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.572222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.572223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.572228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.572645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.572962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.574109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.574477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.574625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.574632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.574638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.574669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.574696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538142015:9625]
2025-10-02T09:37:27.575049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.575223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.575247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.575421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.575452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.575456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.575457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.575457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.575458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.575458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.575459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.575459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.575460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.575460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.575461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.575462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.575464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.575471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.575473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.575475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.575477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.575479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.575481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.575483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.575485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.575487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.575489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.575491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.575495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.575499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.575503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.575506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.575508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.575511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.575513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.575516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.575518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.575520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.575522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.575525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.575527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.575530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.575532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.575534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.575536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.575539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.575541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.575543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.575546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.575548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.575550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.575553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.575571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.576163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.576172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.576174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613730607:9876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.576179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.582935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.584421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.584430Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.584431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.584433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.584437Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3627 [2:7556556214538142015:9625]
2025-10-02T09:37:27.584445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.584455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.584461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.584462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.584463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.584472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.584479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.584483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.584513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.584518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.584519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.584521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.584523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.584562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.584566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.584573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.584578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.584590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.584604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730428:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.584609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730648:9876], now have 1 active actors on pipe
2025-10-02T09:37:27.584614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.584618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.584620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.584627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.584637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.584641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.584643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.584645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.584647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.584649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.584642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3627
2025-10-02T09:37:27.584647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3627
2025-10-02T09:37:27.584663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.584668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.584670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.584681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.584686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.584712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a214917-158b4168-c1be8527-5e12e760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.584719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.584721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.584722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.584727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.584732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.584741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.584866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.584871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.584878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.584941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3628 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a214917-158b4168-c1be8527-5e12e760_0
2025-10-02T09:37:27.585149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e16567-8353b5ee-8d7fa723-1f4e0387_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a214917-158b4168-c1be8527-5e12e760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.587401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Write session: try to update token
2025-10-02T09:37:27.587415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.593697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.593708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.593709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.593710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.593715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.593717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.593719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538142009:9625]
2025-10-02T09:37:27.593738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.593740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.593741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.593742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.593743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.593744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.593854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.599274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3628 sessionId: src_id|5a214917-158b4168-c1be8527-5e12e760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.601600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.662670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613730656:9529]
2025-10-02T09:37:27.662870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3627, pipe: [1:7556556214613730656:9529]
2025-10-02T09:37:27.703111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.703387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.703398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.703413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730656:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.703538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.703567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613730656:9529]
2025-10-02T09:37:27.703593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.703594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:27.703680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a214917-158b4168-c1be8527-5e12e760_0
2025-10-02T09:37:27.703831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3628 sessionId: src_id|5a214917-158b4168-c1be8527-5e12e760_0 is DEAD
2025-10-02T09:37:27.703955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:27.703965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Write session will restart in 0.007197s
2025-10-02T09:37:27.703983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Write session: Do CDS request
2025-10-02T09:37:27.703989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.712148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.712215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.712225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3629
2025-10-02T09:37:27.712314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.712342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.712348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.712351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.712655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3629 sessionId:  describe result for acl check
2025-10-02T09:37:27.712682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.712687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.712688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.712693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.713100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.714231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.714826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.715768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.715869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.715876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.715882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.715908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.715930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538142236:9622]
2025-10-02T09:37:27.716273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.716443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.716465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.716649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.716675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.716679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.716680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.716680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.716681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.716681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.716682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.716682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.716683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.716683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.716684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.716684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.716687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.716693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.716696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.716698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.716699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.716702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.716703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.716705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.716707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.716709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.716711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.716713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.716717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.716716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.716725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.716728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613730803:9888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.716721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.716731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.716724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.716727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.716729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.716732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.716734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.716736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.716739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.716741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.716743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.716746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.716748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.716750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.716753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.716755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.716759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.716761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.716763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.716766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.716768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.716771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.716774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.716776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.716792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.724126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.725713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.725723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.725724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.725726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.725729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3628 [2:7556556214538142236:9622]
2025-10-02T09:37:27.725736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.725749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.725754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.725755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.725757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.725765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.725768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.725772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.725801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.725807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.725808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.725810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.725811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.725847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.725853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.725859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.725866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.725877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.725891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730878:9888], now have 1 active actors on pipe
2025-10-02T09:37:27.725896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730658:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.725899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.725901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.725902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.725909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.725916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.725922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.725924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.725925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.725926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.725928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.725942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.725946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.725948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.725948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3628
2025-10-02T09:37:27.725950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3628
2025-10-02T09:37:27.725989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.725994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.726010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.726016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.726018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.726019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.726024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.726030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.726040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.726158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.726163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.726170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.726228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3629 partition: 0 MaxSeqNo: 36 sessionId: src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0
2025-10-02T09:37:27.726470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a214917-158b4168-c1be8527-5e12e760_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.728673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Write session: try to update token
2025-10-02T09:37:27.728685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.734891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.734901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.734902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.734903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.734906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.734908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.734910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538142230:9622]
2025-10-02T09:37:27.734928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.734930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.734932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.734933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.734934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.734934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.735051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.740538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3629 sessionId: src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.742827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.803939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613730887:9529]
2025-10-02T09:37:27.804123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3628, pipe: [1:7556556214613730887:9529]
2025-10-02T09:37:27.844458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.844717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.844728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.844741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730887:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.844903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.844956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:27.844982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613730887:9529]
2025-10-02T09:37:27.845005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.845048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3629 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0
2025-10-02T09:37:27.845189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3629 sessionId: src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0 is DEAD
2025-10-02T09:37:27.845334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:27.845345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Write session will restart in 0.006290s
2025-10-02T09:37:27.845367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Write session: Do CDS request
2025-10-02T09:37:27.845373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:27.852162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.852229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:27.852239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3630
2025-10-02T09:37:27.852324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:27.852353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:27.852361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:27.852363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:27.852695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3630 sessionId:  describe result for acl check
2025-10-02T09:37:27.852723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:27.852728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:27.852730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:27.852733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:27.853170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:27.854913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:27.855752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:27.857229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:27.857353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:27.857359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:27.857365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:27.857346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:27.857355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:27.857358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556214613730976:9900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:27.857363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:27.857393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:27.857418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556214538142458:9620]
2025-10-02T09:37:27.857760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:27.857921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:27.857942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:27.858119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:27.858149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.858153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.858153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.858154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.858155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.858155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.858156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.858156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.858157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.858157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.858158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.858158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.858161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.858168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.858170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.858172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.858174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.858176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.858178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.858180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.858182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.858184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.858186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.858188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.858192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.858196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:27.858200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.858203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:27.858205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.858208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:27.858210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.858213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:27.858215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.858218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:27.858220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.858223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:27.858225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.858228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:27.858230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.858233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:27.858235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.858238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:27.858240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.858242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.858244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.858247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.858249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.858252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.858269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:27.865563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:27.867072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:27.867084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:27.867085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:27.867087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:27.867090Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3629 [2:7556556214538142458:9620]
2025-10-02T09:37:27.867099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:27.867109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:27.867114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.867115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.867116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.867125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:27.867128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:27.867132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:27.867164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.867169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.867170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.867172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:27.867173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:27.867220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:27.867225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.867231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:27.867239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:27.867250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:27.867263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.867267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.867269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.867274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:27.867281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:27.867282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:27.867284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:27.867285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:27.867292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:27.867293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:27.867300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613730889:2446], now have 1 active actors on pipe
2025-10-02T09:37:27.867305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613731108:9900], now have 1 active actors on pipe
2025-10-02T09:37:27.867317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.867324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:27.867334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:27.867343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3629
2025-10-02T09:37:27.867353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3629
2025-10-02T09:37:27.867394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.867399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.867413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:27.867420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:27.867422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:27.867423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:27.867428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:27.867436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:27.867446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.867586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.867591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.867598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:27.867659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3630 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0
2025-10-02T09:37:27.867897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2511e1bc-4e4d8770-fce99fc6-7bd52ee4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:27.870154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Write session: try to update token
2025-10-02T09:37:27.870167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:27.876094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:27.876105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.876110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.876129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:27.876134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:27.876269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:27.876384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:27.876495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:27.876614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:27.876786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:27.876824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:27.882165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3630 sessionId: src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:27.884468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:27.884480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:27.884481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:27.884482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:27.884486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.884489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.884491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556214538142452:9620]
2025-10-02T09:37:27.884509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:27.884490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:27.884512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:27.884513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:27.884515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:27.884515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:27.884517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:27.884633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:27.945282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556214613731122:9529]
2025-10-02T09:37:27.945504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3629, pipe: [1:7556556214613731122:9529]
2025-10-02T09:37:27.997580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:27.997863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:27.997873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:27.997890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613731122:9529], now have 1 active actors on pipe
2025-10-02T09:37:27.998094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:27.998080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:27.998087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:27.998091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:27.998136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556214613731122:9529]
2025-10-02T09:37:27.998165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3630 reason: error at write: Disconnected sessionId: src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0
2025-10-02T09:37:27.998321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3630 sessionId: src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0 is DEAD
2025-10-02T09:37:27.998464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:27.998475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Write session will restart in 0.009701s
2025-10-02T09:37:27.998492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Write session: Do CDS request
2025-10-02T09:37:27.998497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.008642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.009197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.009291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.009303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3631
2025-10-02T09:37:28.009445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.009469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.009477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.009480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.009834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3631 sessionId:  describe result for acl check
2025-10-02T09:37:28.009859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.009864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.009866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.009870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.010145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.010252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.010258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.010264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.010293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.010319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833109976:9616]
2025-10-02T09:37:28.010316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.010654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.010810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.010831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.011004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.011030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.011034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.011035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.011035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.011036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.011036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.011037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.011037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.011038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.011038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.011039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.011039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.011042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.011048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.011050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.011052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.011054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.011056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.011058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.011060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.011062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.011064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.011066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.011068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.011071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.011075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.011079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.011081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.011084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.011086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.011088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.011091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.011094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.011096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.011098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.011101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.011103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.011106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.011108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.011111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.011113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.011116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.011118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.011121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.011123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.011125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.011127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.011130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.011146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.011777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.016873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.016885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.016887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908698609:9929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.016894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.018478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.020069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.020079Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.020080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.020082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.020086Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3630 [2:7556556218833109976:9616]
2025-10-02T09:37:28.020093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.020103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.020108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.020110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.020111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.020121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.020127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.020131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.020159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.020164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.020165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.020166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.020168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.020204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.020210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.020216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.020222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.020230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.020242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556214613731127:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.020244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698648:9929], now have 1 active actors on pipe
2025-10-02T09:37:28.020247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.020248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.020250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.020257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.020264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.020269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.020271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.020272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.020275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.020277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.020290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.020283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3630
2025-10-02T09:37:28.020298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.020291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3630
2025-10-02T09:37:28.020301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.020320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.020326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.020339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.020346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.020348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.020353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.020358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.020363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.020373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.020486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.020490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.020498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.020562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3631 partition: 0 MaxSeqNo: 36 sessionId: src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0
2025-10-02T09:37:28.020834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad7103d-a2e7d7f-c2efd1d6-ef5b91d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.023084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Write session: try to update token
2025-10-02T09:37:28.023096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.029352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.029364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.029366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.029367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.029370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.029372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.029376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833109970:9616]
2025-10-02T09:37:28.029397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.029398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.029401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.029403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.029405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.029405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.029511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.034804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3631 sessionId: src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.037218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.098345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908698658:9529]
2025-10-02T09:37:28.098524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3630, pipe: [1:7556556218908698658:9529]
2025-10-02T09:37:28.137956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.138242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.138253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.138267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698658:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.138391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:28.138449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908698658:9529]
2025-10-02T09:37:28.138481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.138574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:28.138658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3631 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0
2025-10-02T09:37:28.138822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3631 sessionId: src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0 is DEAD
2025-10-02T09:37:28.138968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:28.138980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Write session will restart in 0.009718s
2025-10-02T09:37:28.139003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Write session: Do CDS request
2025-10-02T09:37:28.139009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.149274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.150303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.150315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3632
2025-10-02T09:37:28.150397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.150640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.150663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.150667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.150670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.150843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.150948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.150955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.150960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.150986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.151014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833110200:9614]
2025-10-02T09:37:28.151011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3632 sessionId:  describe result for acl check
2025-10-02T09:37:28.151041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.151046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.151047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.151051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.151368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.151480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.151529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.151551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.151729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.151756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.151760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.151760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.151761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.151762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.151762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.151763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.151763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.151763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.151764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.151764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.151765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.151768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.151774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.151776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.151778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.151780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.151782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.151784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.151786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.151788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.151790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.151792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.151794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.151798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.151802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.151805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.151808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.151810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.151813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.151815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.151818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.151820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.151823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.151825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.151828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.151832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.151834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.151836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.151842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.151844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.151847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.151849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.151852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.151856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.151859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.151861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.151863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.151882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.153116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.157112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.157123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.157126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908698846:9930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.157132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.159191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.160680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.160691Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.160692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.160694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.160697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3631 [2:7556556218833110200:9614]
2025-10-02T09:37:28.160706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.160714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.160719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.160720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.160721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.160731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.160736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.160740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.160771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.160776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.160777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.160779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.160780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.160825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.160830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.160836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.160841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.160852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.160867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698884:9930], now have 1 active actors on pipe
2025-10-02T09:37:28.160872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698659:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.160876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.160878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.160879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.160887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.160897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.160901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.160903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.160904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.160908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.160910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.160923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.160931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.160931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.160923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3631
2025-10-02T09:37:28.160939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3631
2025-10-02T09:37:28.160958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.160965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.160982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.160991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.160997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.160999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.161007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.161017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.161028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.161146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.161150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.161158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.161219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3632 partition: 0 MaxSeqNo: 36 sessionId: src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0
2025-10-02T09:37:28.161449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51846a40-5924c165-93b6d1ad-d2181eb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.163683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Write session: try to update token
2025-10-02T09:37:28.163696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.169761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:28.169772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.169776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.169796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:28.169797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:28.169989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:28.170107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.170222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.170387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.170622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:28.170643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:28.175791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3632 sessionId: src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.178096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.178106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.178107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.178108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.178111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.178113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.178115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833110194:9614]
2025-10-02T09:37:28.178134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.178137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.178138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.178142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.178144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.178146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.178135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.178256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.238661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908698892:9529]
2025-10-02T09:37:28.238901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3631, pipe: [1:7556556218908698892:9529]
2025-10-02T09:37:28.287599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.287856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.287867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.287883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698892:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.288077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.288083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:28.288085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:28.288087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:28.288138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908698892:9529]
2025-10-02T09:37:28.288159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3632 reason: error at write: Disconnected sessionId: src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0
2025-10-02T09:37:28.288314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3632 sessionId: src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0 is DEAD
2025-10-02T09:37:28.288452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:28.288464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Write session will restart in 0.005765s
2025-10-02T09:37:28.288483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Write session: Do CDS request
2025-10-02T09:37:28.288489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.295167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.295280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.295291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3633
2025-10-02T09:37:28.295400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.295424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.295431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.295433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.295802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3633 sessionId:  describe result for acl check
2025-10-02T09:37:28.295831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.295836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.295837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.295841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.296291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.298268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.298716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.300222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.300325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.300331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.300338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.300362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.300388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833110427:9612]
2025-10-02T09:37:28.300388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.300396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.300399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908698988:9949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.300403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.300726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.300901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.300923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.301097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.301126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.301129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.301130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.301131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.301131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.301132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.301132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.301133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.301133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.301134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.301134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.301135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.301138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.301144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.301146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.301148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.301150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.301152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.301154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.301156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.301158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.301160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.301162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.301164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.301167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.301171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.301174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.301177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.301179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.301182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.301184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.301187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.301189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.301191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.301194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.301197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.301201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.301203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.301205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.301208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.301212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.301214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.301217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.301221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.301223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.301226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.301231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.301233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.301249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.308603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.310118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.310128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.310129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.310131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.310134Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3632 [2:7556556218833110427:9612]
2025-10-02T09:37:28.310143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.310153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.310154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.310156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.310157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.310166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.310173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.310177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.310208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.310212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.310213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.310215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.310217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.310253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.310257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.310263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.310269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.310277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.310291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699115:9949], now have 1 active actors on pipe
2025-10-02T09:37:28.310296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908698893:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.310299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.310300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.310301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.310308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.310317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.310321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.310323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.310324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.310326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.310328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.310339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.310344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.310345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.310352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3632
2025-10-02T09:37:28.310351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3632
2025-10-02T09:37:28.310412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.310417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.310434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.310442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.310444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.310447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.310452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.310459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.310467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.310589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.310594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.310601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.310659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3633 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0
2025-10-02T09:37:28.310908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3afd5b7c-eb3d2c08-d4e05eb5-d65c2634_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.313191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Write session: try to update token
2025-10-02T09:37:28.313206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.319225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:28.319237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.319241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.319261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:28.319264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:28.319393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:28.319505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.319616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.319732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:28.319935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:28.319958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:28.324956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3633 sessionId: src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.327271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.327528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.327540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.327549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.327550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.327551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.327552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.327555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.327557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.327559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833110421:9612]
2025-10-02T09:37:28.327576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.327581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.327584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.327585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.327586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.327586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.327695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.388149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908699129:9529]
2025-10-02T09:37:28.388349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3632, pipe: [1:7556556218908699129:9529]
2025-10-02T09:37:28.436734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.437040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:28.437067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699129:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.437150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:28.437204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908699129:9529]
2025-10-02T09:37:28.437234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.437238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:28.437241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:28.437298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3633 reason: error at write: Disconnected sessionId: src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0
2025-10-02T09:37:28.437418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3633 sessionId: src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0 is DEAD
2025-10-02T09:37:28.437558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:28.437567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Write session will restart in 0.009256s
2025-10-02T09:37:28.437585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Write session: Do CDS request
2025-10-02T09:37:28.437594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.448155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.448264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.448274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3634
2025-10-02T09:37:28.448393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.448416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.448423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.448426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.448775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3634 sessionId:  describe result for acl check
2025-10-02T09:37:28.448815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.448820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.448821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.448826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.449214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.450146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.450413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.450474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.450548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.450557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.450566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.450611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.450643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833110680:9599]
2025-10-02T09:37:28.451173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.451374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.451413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.451698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.451756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.451762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.451763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.451764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.451765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.451766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.451767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.451768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.451769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.451770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.451771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.451772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.451777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.451786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.451789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.451797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.451803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.451807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.451814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.451817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.451821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.451825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.451828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.451832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.451840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.451848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.451855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.451862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.451866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.451870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.451876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.451880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.451888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.451893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.451901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.451906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.451915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.451922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.451927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.451932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.451938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.451942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.451948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.451952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.451959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.451964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.451971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.451976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.452013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.453855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.453867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.453870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908699329:9965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.453875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.459523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.461188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.461204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.461206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.461209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.461213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3633 [2:7556556218833110680:9599]
2025-10-02T09:37:28.461223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.461238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.461242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.461244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.461245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.461257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.461265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.461271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.461318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.461324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.461326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.461329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.461331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.461378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.461384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.461396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.461411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.461433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.461452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699142:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.461460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699368:9965], now have 1 active actors on pipe
2025-10-02T09:37:28.461465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.461469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.461471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.461457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3633
2025-10-02T09:37:28.461463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3633
2025-10-02T09:37:28.461481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.461495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.461495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.461499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.461500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.461513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.461519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.461549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.461556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.461567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.461577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.461588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.461601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.461611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.461615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.461617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.461623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.461634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.461653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.461815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.461823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.461834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.461902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3634 partition: 0 MaxSeqNo: 36 sessionId: src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0
2025-10-02T09:37:28.462155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c236741-1b4bf9c3-b642c1dc-77a5459e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.464392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Write session: try to update token
2025-10-02T09:37:28.464405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.470681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.470694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.470695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.470695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.470699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.470701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.470702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833110675:9599]
2025-10-02T09:37:28.470721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.470725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.470727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.470727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.470728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.470729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.470847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.476258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3634 sessionId: src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.478401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.537133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908699399:9529]
2025-10-02T09:37:28.537301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3633, pipe: [1:7556556218908699399:9529]
2025-10-02T09:37:28.578785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.579233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.579246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.579259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699399:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.579373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:28.579470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.579474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908699399:9529]
2025-10-02T09:37:28.579511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:28.579592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0
2025-10-02T09:37:28.579753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3634 sessionId: src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0 is DEAD
2025-10-02T09:37:28.579918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:28.579931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Write session will restart in 0.009450s
2025-10-02T09:37:28.579951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Write session: Do CDS request
2025-10-02T09:37:28.579958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.590151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.590159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.590240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.590250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3635
2025-10-02T09:37:28.590338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.590360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.590367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.590370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.590680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3635 sessionId:  describe result for acl check
2025-10-02T09:37:28.590703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.590708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.590710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.590714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.591128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.591730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.591844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.591851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.591856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.591889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.592015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833110929:9585]
2025-10-02T09:37:28.592377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.592541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.592575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.592768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.592816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.592820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.592821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.592821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.592822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.592822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.592823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.592824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.592824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.592825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.592825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.592826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.592828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.592835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.592837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.592839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.592841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.592843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.592845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.592847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.592849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.592852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.592854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.592856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.592860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.592864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.592867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.592870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.592874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.592876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.592878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.592881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.592884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.592886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.592890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.592896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.592899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.592904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.592912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.592916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.592919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.592923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.592931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.592935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.592942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.592949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.592951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.592953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.592972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.592973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.597971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.597980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.597982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908699589:9983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.597987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.600453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.601920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.601930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.601931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.601933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.601937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3634 [2:7556556218833110929:9585]
2025-10-02T09:37:28.601947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.601956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.601961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.601962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.601963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.601971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.601977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.601981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.602013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.602018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.602019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.602021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.602022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.602060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.602065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.602072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.602077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.602085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.602096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699628:9983], now have 1 active actors on pipe
2025-10-02T09:37:28.602102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699400:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.602106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.602107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.602108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.602116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.602123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.602128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.602130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.602131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.602134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.602136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.602149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.602153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.602155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.602148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3634
2025-10-02T09:37:28.602151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3634
2025-10-02T09:37:28.602196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.602202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.602220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.602228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.602232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.602237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.602244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.602252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.602265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.602378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.602382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.602390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.602458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3635 partition: 0 MaxSeqNo: 36 sessionId: src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0
2025-10-02T09:37:28.602693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fc8e0e-4a3f8abe-62dba8cf-2380a406_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.604954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Write session: try to update token
2025-10-02T09:37:28.604966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.611143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.611155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.611156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.611157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.611160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.611162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.611164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833110923:9585]
2025-10-02T09:37:28.611184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.611184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.611186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.611188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.611189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.611191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.611311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.616585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3635 sessionId: src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.618867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.679457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908699636:9529]
2025-10-02T09:37:28.679672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3634, pipe: [1:7556556218908699636:9529]
2025-10-02T09:37:28.723541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.723895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.723906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.723919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699636:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.724147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:28.724148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908699636:9529]
2025-10-02T09:37:28.724159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:28.724180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.724233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3635 reason: error at write: Disconnected sessionId: src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0
2025-10-02T09:37:28.724390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3635 sessionId: src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0 is DEAD
2025-10-02T09:37:28.724525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:28.724536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Write session will restart in 0.009403s
2025-10-02T09:37:28.724555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Write session: Do CDS request
2025-10-02T09:37:28.724561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.724607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:28.735165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.735234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.735243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3636
2025-10-02T09:37:28.735336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.735358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.735366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.735369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.735697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3636 sessionId:  describe result for acl check
2025-10-02T09:37:28.735723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.735727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.735728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.735732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.736155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.737861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.738159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.739755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.739846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.739855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.739858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908699776:9992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.739862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.739911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.739918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.739924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.739959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.739983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833111157:9571]
2025-10-02T09:37:28.740329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.740500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.740524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.740700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.740729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.740733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.740733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.740734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.740735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.740735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.740736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.740736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.740737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.740737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.740738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.740738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.740741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.740747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.740749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.740751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.740753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.740755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.740757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.740759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.740761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.740763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.740765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.740767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.740772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.740776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.740779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.740782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.740784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.740787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.740789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.740792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.740794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.740796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.740798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.740812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.740815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.740817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.740819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.740822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.740825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.740828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.740830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.740833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.740835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.740837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.740840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.740842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.740858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.748193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.749728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.749741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.749742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.749744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.749748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3635 [2:7556556218833111157:9571]
2025-10-02T09:37:28.749755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.749765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.749770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.749772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.749773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.749782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.749788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.749792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.749824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.749828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.749829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.749831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.749833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.749870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.749875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.749881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.749887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.749895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.749910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699637:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.749916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699861:9992], now have 1 active actors on pipe
2025-10-02T09:37:28.749919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.749920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.749921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.749928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.749937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.749942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.749944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.749945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.749948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.749949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.749962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.749967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.749968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.749992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3635
2025-10-02T09:37:28.749992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3635
2025-10-02T09:37:28.750036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.750043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.750057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.750064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.750066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.750068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.750073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.750078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.750085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.750212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.750217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.750225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.750294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3636 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0
2025-10-02T09:37:28.750563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57fa0f74-2ff0328f-6fc090a4-44bf3346_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.752880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Write session: try to update token
2025-10-02T09:37:28.752892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.759051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.759064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.759065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.759066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.759072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.759075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.759077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833111152:9571]
2025-10-02T09:37:28.759096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.759099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.759099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.759100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.759101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.759105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.759229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.764948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3636 sessionId: src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.767285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.824358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908699873:9529]
2025-10-02T09:37:28.824623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3635, pipe: [1:7556556218908699873:9529]
2025-10-02T09:37:28.871383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:28.871657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.871669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.871682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699873:9529], now have 1 active actors on pipe
2025-10-02T09:37:28.871817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:28.871897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:28.871907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908699873:9529]
2025-10-02T09:37:28.871936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:28.871996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3636 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0
2025-10-02T09:37:28.872156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3636 sessionId: src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0 is DEAD
2025-10-02T09:37:28.872313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:28.872324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Write session will restart in 0.005437s
2025-10-02T09:37:28.872348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Write session: Do CDS request
2025-10-02T09:37:28.872354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:28.879139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.879204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:28.879222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3637
2025-10-02T09:37:28.879297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:28.879319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:28.879326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:28.879328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:28.879681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3637 sessionId:  describe result for acl check
2025-10-02T09:37:28.879713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:28.879718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:28.879719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:28.879723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:28.880150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:28.882150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:28.883971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:28.885440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:28.885536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:28.885548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:28.885555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:28.885561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:28.885545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:28.885547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556218908699944:9995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:28.885552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:28.885586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:28.885614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556218833111386:9581]
2025-10-02T09:37:28.885962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:28.886125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:28.886146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:28.886319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:28.886349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.886353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.886353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.886354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.886354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.886355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.886355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.886356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.886356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.886357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.886358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.886358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.886361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.886368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.886370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.886372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.886374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.886376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.886378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.886380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.886382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.886384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.886386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.886388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.886392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.886396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:28.886400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.886403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:28.886407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.886410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:28.886412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.886414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:28.886419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.886422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:28.886424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.886427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:28.886429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.886432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:28.886433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.886436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:28.886438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.886441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:28.886444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.886447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.886449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.886451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.886453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.886456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.886473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:28.893765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:28.895218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:28.895229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:28.895230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:28.895232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:28.895236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3636 [2:7556556218833111386:9581]
2025-10-02T09:37:28.895244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:28.895254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:28.895255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.895257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.895258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.895266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:28.895269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:28.895273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:28.895301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.895307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.895308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.895310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:28.895312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:28.895347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:28.895353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.895359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:28.895364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:28.895372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:28.895386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908700101:9995], now have 1 active actors on pipe
2025-10-02T09:37:28.895391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908699875:2446], now have 1 active actors on pipe
2025-10-02T09:37:28.895396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.895397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.895398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.895405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:28.895412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:28.895422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:28.895423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:28.895424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:28.895430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:28.895432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:28.895438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.895440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:28.895442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:28.895456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3636
2025-10-02T09:37:28.895462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3636
2025-10-02T09:37:28.895520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.895526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.895542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f579f5f-8c070894-9febb523-320c0ba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:28.895549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:28.895551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:28.895552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:28.895556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:28.895563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:28.895572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.895692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:28.895697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:28.895704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:28.895765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3637 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f579f5f-8c070894-9febb523-320c0ba1_0
2025-10-02T09:37:28.895987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b3ef0c-1cd562aa-152e9dfb-5ca6bb11_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f579f5f-8c070894-9febb523-320c0ba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:28.898304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Write session: try to update token
2025-10-02T09:37:28.898322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:28.904383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:28.904393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:28.904394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:28.904395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:28.904398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.904400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.904404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556218833111381:9581]
2025-10-02T09:37:28.904423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:28.904426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:28.904427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:28.904427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:28.904430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:28.904432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:28.904578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:28.910675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3637 sessionId: src_id|3f579f5f-8c070894-9febb523-320c0ba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:28.912977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:28.971823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556218908700117:9529]
2025-10-02T09:37:28.972019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3636, pipe: [1:7556556218908700117:9529]
2025-10-02T09:37:29.014697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.014965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.014978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.014992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556218908700117:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.015139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.015180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556218908700117:9529]
2025-10-02T09:37:29.015202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.015231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.015359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f579f5f-8c070894-9febb523-320c0ba1_0
2025-10-02T09:37:29.015512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3637 sessionId: src_id|3f579f5f-8c070894-9febb523-320c0ba1_0 is DEAD
2025-10-02T09:37:29.015654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.015666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Write session will restart in 0.008489s
2025-10-02T09:37:29.015686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Write session: Do CDS request
2025-10-02T09:37:29.015691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.025086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.025200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.025208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3638
2025-10-02T09:37:29.025294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.025316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.025323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.025326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.025680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3638 sessionId:  describe result for acl check
2025-10-02T09:37:29.025703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.025708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.025709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.025713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.026126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.027305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.027646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.028728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.028929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.028937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.028944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.028982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.029009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128078912:9579]
2025-10-02T09:37:29.029380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.029535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.029548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.029551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203667573:10003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.029555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.029567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.029591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.029779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.029807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.029810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.029810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.029811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.029811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.029812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.029812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.029813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.029813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.029814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.029814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.029815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.029818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.029824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.029826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.029828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.029830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.029832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.029834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.029836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.029839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.029841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.029842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.029845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.029848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.029852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.029856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.029859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.029861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.029864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.029866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.029869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.029872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.029875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.029877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.029879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.029881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.029884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.029886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.029888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.029891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.029893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.029896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.029898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.029900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.029903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.029905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.029907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.029924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.037330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.038949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.038963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.038966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.038969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.038974Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3637 [2:7556556223128078912:9579]
2025-10-02T09:37:29.038985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.039001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.039007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.039008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.039010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.039020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.039024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.039028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.039062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.039068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.039069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.039071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.039072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.039112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.039117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.039123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.039130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.039140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.039153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667415:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.039158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667647:10003], now have 1 active actors on pipe
2025-10-02T09:37:29.039162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.039164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.039166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.039173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.039181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.039186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.039188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.039188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.039190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.039190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.039217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.039222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.039226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.039234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3637
2025-10-02T09:37:29.039241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3637
2025-10-02T09:37:29.039301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.039307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.039322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1470892-210c4195-9612ae55-ff8aeddd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.039329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.039332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.039335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.039340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.039346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.039356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.039472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.039476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.039484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.039543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3638 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1470892-210c4195-9612ae55-ff8aeddd_0
2025-10-02T09:37:29.039759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f579f5f-8c070894-9febb523-320c0ba1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1470892-210c4195-9612ae55-ff8aeddd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.042020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Write session: try to update token
2025-10-02T09:37:29.042034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.048856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.048867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.048868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.048869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.048872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.048875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.048877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128078907:9579]
2025-10-02T09:37:29.048897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.048900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.048901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.048902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.048905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.048907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.049008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.053693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3638 sessionId: src_id|b1470892-210c4195-9612ae55-ff8aeddd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.055931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.115226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203667656:9529]
2025-10-02T09:37:29.115445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3637, pipe: [1:7556556223203667656:9529]
2025-10-02T09:37:29.161743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.162054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.162063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.162091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667656:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.162241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.162302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203667656:9529]
2025-10-02T09:37:29.162339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.162411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.162418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3638 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1470892-210c4195-9612ae55-ff8aeddd_0
2025-10-02T09:37:29.162575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3638 sessionId: src_id|b1470892-210c4195-9612ae55-ff8aeddd_0 is DEAD
2025-10-02T09:37:29.162778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.162790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Write session will restart in 0.005697s
2025-10-02T09:37:29.162810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Write session: Do CDS request
2025-10-02T09:37:29.162816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.169098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.169179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.169187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3639
2025-10-02T09:37:29.169271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.169292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.169300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.169304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.169617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3639 sessionId:  describe result for acl check
2025-10-02T09:37:29.169645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.169650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.169651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.169655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.170082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.172439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.173698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.175146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.175268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.175276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.175282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.175313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.175324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.175333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.175335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203667722:10018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.175340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128079144:9577]
2025-10-02T09:37:29.175339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.175701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.175873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.175900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.176099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.176132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.176136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.176137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.176138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.176138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.176139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.176139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.176140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.176140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.176141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.176141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.176142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.176145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.176151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.176153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.176156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.176157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.176159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.176161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.176163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.176165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.176167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.176169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.176171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.176175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.176178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.176182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.176184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.176186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.176189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.176191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.176194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.176196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.176199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.176201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.176204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.176206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.176209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.176210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.176215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.176217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.176220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.176222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.176225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.176227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.176229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.176232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.176234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.176253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.183570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.185151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.185162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.185164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.185166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.185170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3638 [2:7556556223128079144:9577]
2025-10-02T09:37:29.185178Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.185188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.185193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.185195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.185196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.185205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.185208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.185212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.185244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.185249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.185250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.185252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.185254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.185299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.185305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.185312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.185318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.185329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.185343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667657:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.185349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667886:10018], now have 1 active actors on pipe
2025-10-02T09:37:29.185353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.185354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.185355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.185363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.185374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.185380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.185382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.185384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.185385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.185387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.185386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3638
2025-10-02T09:37:29.185387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3638
2025-10-02T09:37:29.185399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.185404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.185409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.185427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.185432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.185449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.185456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.185458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.185459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.185464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.185470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.185479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.185596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.185602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.185610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.185671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3639 partition: 0 MaxSeqNo: 36 sessionId: src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0
2025-10-02T09:37:29.185893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1470892-210c4195-9612ae55-ff8aeddd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.188724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Write session: try to update token
2025-10-02T09:37:29.188736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.195373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.195390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.195392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.195394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.195406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.195409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.195414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128079138:9577]
2025-10-02T09:37:29.195441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.195451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.195451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.195453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.195461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.195464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.195640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.201642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3639 sessionId: src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.204084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.262654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203667897:9529]
2025-10-02T09:37:29.262827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3638, pipe: [1:7556556223203667897:9529]
2025-10-02T09:37:29.305836Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.306125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.306135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.306149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667897:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.306295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.306354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.306368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203667897:9529]
2025-10-02T09:37:29.306398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.306483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0
2025-10-02T09:37:29.306624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3639 sessionId: src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0 is DEAD
2025-10-02T09:37:29.306736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.306746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Write session will restart in 0.006095s
2025-10-02T09:37:29.306765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Write session: Do CDS request
2025-10-02T09:37:29.306771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.314205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.314305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.314315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3640
2025-10-02T09:37:29.314433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.314457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.314466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.314469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.314805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3640 sessionId:  describe result for acl check
2025-10-02T09:37:29.314831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.314836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.314838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.314842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.315289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.317115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.317699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.319272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.319365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.319373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.319376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203668006:10027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.319380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.319382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.319388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.319394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.319421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.319447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128079376:9576]
2025-10-02T09:37:29.319792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.319959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.319983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.320250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.320287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.320291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.320291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.320292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.320292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.320293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.320293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.320294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.320294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.320295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.320295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.320296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.320298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.320305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.320307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.320309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.320311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.320313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.320315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.320317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.320319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.320322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.320324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.320326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.320330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.320334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.320338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.320341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.320343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.320346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.320348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.320351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.320353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.320356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.320359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.320361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.320364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.320366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.320368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.320371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.320373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.320376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.320378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.320380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.320383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.320386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.320388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.320391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.320407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.327764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.329333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.329344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.329345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.329347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.329351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3639 [2:7556556223128079376:9576]
2025-10-02T09:37:29.329359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.329368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.329374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.329375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.329376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.329385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.329388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.329394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.329425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.329430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.329431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.329433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.329434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.329472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.329477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.329483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.329488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.329501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.329514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.329519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.329520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.329525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.329531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.329533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668127:10027], now have 1 active actors on pipe
2025-10-02T09:37:29.329535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203667898:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.329538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.329540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.329540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.329548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.329549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.329563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.329570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.329577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.329578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3639
2025-10-02T09:37:29.329579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3639
2025-10-02T09:37:29.329638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.329643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.329660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|860443fa-79737b09-debc1e45-9d912deb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.329667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.329669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.329671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.329675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.329683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.329691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.329816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.329821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.329828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.329891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3640 partition: 0 MaxSeqNo: 36 sessionId: src_id|860443fa-79737b09-debc1e45-9d912deb_0
2025-10-02T09:37:29.330158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbaa2a7-2f2f2605-2f6cfb44-350cb5de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|860443fa-79737b09-debc1e45-9d912deb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.333272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Write session: try to update token
2025-10-02T09:37:29.333289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.338942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:29.338960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.338967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.339000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:29.339004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:29.339208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:29.339382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.339545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.339714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.339970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:29.340012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:29.346027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3640 sessionId: src_id|860443fa-79737b09-debc1e45-9d912deb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.347559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.347571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.347572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.347573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.347579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.347581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.347584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128079370:9576]
2025-10-02T09:37:29.347608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.347612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.347616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.347617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.347623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.347625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.347729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.348513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.406505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203668141:9529]
2025-10-02T09:37:29.406693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3639, pipe: [1:7556556223203668141:9529]
2025-10-02T09:37:29.456526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.456822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.456832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.456845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668141:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.457015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.457054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.457061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:29.457065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:29.457115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203668141:9529]
2025-10-02T09:37:29.457145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3640 reason: error at write: Disconnected sessionId: src_id|860443fa-79737b09-debc1e45-9d912deb_0
2025-10-02T09:37:29.457296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3640 sessionId: src_id|860443fa-79737b09-debc1e45-9d912deb_0 is DEAD
2025-10-02T09:37:29.457459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:29.457471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Write session will restart in 0.008539s
2025-10-02T09:37:29.457493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Write session: Do CDS request
2025-10-02T09:37:29.457499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.467231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.467322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.467335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3641
2025-10-02T09:37:29.467456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.467480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.467489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.467492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.467842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3641 sessionId:  describe result for acl check
2025-10-02T09:37:29.467873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.467878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.467880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.467884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.468305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.468859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.470062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.470408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.470512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.470520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.470526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.470554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.470579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128079636:9568]
2025-10-02T09:37:29.470933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.471100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.471123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.471309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.471338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.471342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.471343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.471343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.471344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.471344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.471345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.471345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.471346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.471346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.471347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.471347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.471350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.471356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.471358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.471360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.471362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.471364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.471366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.471368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.471370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.471372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.471374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.471376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.471380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.471384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.471389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.471392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.471396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.471399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.471401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.471403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.471405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.471408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.471411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.471414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.471416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.471418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.471420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.471422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.471425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.471427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.471429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.471433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.471435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.471437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.471439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.471442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.471458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.471870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.471883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.471886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203668346:10053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.471891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.478790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.480296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.480307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.480308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.480310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.480314Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3640 [2:7556556223128079636:9568]
2025-10-02T09:37:29.480321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.480332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.480333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.480335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.480337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.480349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.480355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.480360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.480392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.480397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.480398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.480400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.480401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.480434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.480439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.480446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.480452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.480463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.480477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668388:10053], now have 1 active actors on pipe
2025-10-02T09:37:29.480482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668154:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.480485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.480487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.480488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.480495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.480503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.480508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.480510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.480510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.480513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.480515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.480528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.480533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.480534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.480550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3640
2025-10-02T09:37:29.480559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3640
2025-10-02T09:37:29.480598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.480603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.480617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32736d3-35960e3-a0fb8598-fb187aff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.480624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.480626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.480627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.480632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.480640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.480648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.480778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.480783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.480790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.480865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3641 partition: 0 MaxSeqNo: 36 sessionId: src_id|32736d3-35960e3-a0fb8598-fb187aff_0
2025-10-02T09:37:29.481152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860443fa-79737b09-debc1e45-9d912deb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32736d3-35960e3-a0fb8598-fb187aff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.483928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Write session: try to update token
2025-10-02T09:37:29.483938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.490397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.490416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.490418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.490420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.490427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.490432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.490435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128079623:9568]
2025-10-02T09:37:29.490475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.490475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.490478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.490480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.490486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.490489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.490675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.496837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3641 sessionId: src_id|32736d3-35960e3-a0fb8598-fb187aff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.499174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.557525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203668418:9529]
2025-10-02T09:37:29.557746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3640, pipe: [1:7556556223203668418:9529]
2025-10-02T09:37:29.601738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.602028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.602038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.602051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668418:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.602177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.602240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.602259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203668418:9529]
2025-10-02T09:37:29.602285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.602335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3641 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32736d3-35960e3-a0fb8598-fb187aff_0
2025-10-02T09:37:29.602492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3641 sessionId: src_id|32736d3-35960e3-a0fb8598-fb187aff_0 is DEAD
2025-10-02T09:37:29.602954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.602966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Write session will restart in 0.008774s
2025-10-02T09:37:29.602982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Write session: Do CDS request
2025-10-02T09:37:29.602986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.613144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.613382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.613944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.613960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3642
2025-10-02T09:37:29.614143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.614176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.614184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.614187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.614532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3642 sessionId:  describe result for acl check
2025-10-02T09:37:29.614565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.614570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.614572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.614577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.614905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.615030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.615093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.615102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.615109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.615141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.615165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128079893:9549]
2025-10-02T09:37:29.615527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.615694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.615718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.615916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.615961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.615966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.615966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.615967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.615967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.615968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.615968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.615969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.615970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.615970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.615971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.615971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.615974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.615980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.615982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.615985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.615987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.615989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.615991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.615993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.615995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.615998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.616000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.616002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.616006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.616010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.616013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.616016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.616018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.616021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.616023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.616026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.616028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.616031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.616033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.616037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.616039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.616041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.616043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.616046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.616048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.616050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.616052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.616054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.616057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.616059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.616062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.616065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.616083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.616572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.620855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.620864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.620867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203668616:10071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.620874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.623434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.624945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.624956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.624957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.624959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.624963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3641 [2:7556556223128079893:9549]
2025-10-02T09:37:29.624970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.624981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.624983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.624985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.624986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.624996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.625002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.625007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.625038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.625043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.625044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.625046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.625047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.625089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.625094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.625100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.625105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.625113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.625127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668654:10071], now have 1 active actors on pipe
2025-10-02T09:37:29.625133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668419:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.625137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.625138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.625139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.625146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.625156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.625158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.625161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.625161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.625167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.625169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.625183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.625191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.625182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3641
2025-10-02T09:37:29.625186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3641
2025-10-02T09:37:29.625205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.625247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.625252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.625269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.625276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.625278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.625279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.625284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.625292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.625299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.625421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.625426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.625433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.625497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3642 partition: 0 MaxSeqNo: 36 sessionId: src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0
2025-10-02T09:37:29.625775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32736d3-35960e3-a0fb8598-fb187aff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.628557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Write session: try to update token
2025-10-02T09:37:29.628565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.634228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:29.634242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.634247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.634268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:29.634268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:29.634413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:29.634532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.634645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.634762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:29.634940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:29.634965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:29.640152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3642 sessionId: src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.642653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.642684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.642698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.642699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.642701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.642708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.642711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.642713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128079887:9549]
2025-10-02T09:37:29.642732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.642736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.642737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.642737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.642740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.642743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.642877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.702467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203668663:9529]
2025-10-02T09:37:29.702648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3641, pipe: [1:7556556223203668663:9529]
2025-10-02T09:37:29.757964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.758300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.758311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.758324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668663:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.758495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.758557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.758562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203668663:9529]
2025-10-02T09:37:29.758588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.758659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0
2025-10-02T09:37:29.758832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3642 sessionId: src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0 is DEAD
2025-10-02T09:37:29.759001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.759011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Write session will restart in 0.006069s
2025-10-02T09:37:29.759030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Write session: Do CDS request
2025-10-02T09:37:29.759035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.766137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.766231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.766243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3643
2025-10-02T09:37:29.766369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.766393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.766401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.766404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.766812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3643 sessionId:  describe result for acl check
2025-10-02T09:37:29.766844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.766846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.766848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.766853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.767303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.769227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.769852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.771479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.771566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.771575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.771578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203668772:10090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.771581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.771628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.771637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.771645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.771685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.771716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128080129:9547]
2025-10-02T09:37:29.772161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.772377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.772604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.772654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.772660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.772661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.772662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.772663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.772664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.772664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.772665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.772666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.772667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.772668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.772669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.772673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.772683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.772687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.772690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.772694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.772697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.772701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.772704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.772707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.772711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.772715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.772720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.772726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.772730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.772735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.772738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.772741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.772748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.772751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.772758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.772763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.772768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.772772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.772775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.772781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.772785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.772790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.772794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.772811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.772816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.772821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.772826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.772831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.772835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.772841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.772845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.772880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.780354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.781880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.781892Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.781893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.781896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.781899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3642 [2:7556556223128080129:9547]
2025-10-02T09:37:29.781908Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.781921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.781926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.781928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.781929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.781939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.781942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.781948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.781982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.781987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.781988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.781990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.781991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.782089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.782094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.782101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.782107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.782120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.782132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668667:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.782138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668899:10090], now have 1 active actors on pipe
2025-10-02T09:37:29.782141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.782143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.782144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.782149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.782131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3642
2025-10-02T09:37:29.782139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3642
2025-10-02T09:37:29.782156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.782164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.782167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.782167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.782168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.782169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.782204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.782210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.782218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.782226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.782238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.782246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.782250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.782252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.782254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.782260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.782272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.782290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.782371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.782376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.782384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.782450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3643 partition: 0 MaxSeqNo: 36 sessionId: src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0
2025-10-02T09:37:29.782720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d603-cf3ab599-eecc6068-d02a5d5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.785512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Write session: try to update token
2025-10-02T09:37:29.785525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.791450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.791466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.791468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.791470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.791476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.791480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.791483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128080123:9547]
2025-10-02T09:37:29.791510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.791511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.791515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.791516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.791517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.791517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.791635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.797573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3643 sessionId: src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.800051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:29.858614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556223203668914:9529]
2025-10-02T09:37:29.858789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3642, pipe: [1:7556556223203668914:9529]
2025-10-02T09:37:29.902076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:29.902386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.902394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.902408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668914:9529], now have 1 active actors on pipe
2025-10-02T09:37:29.902542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:29.902589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:29.902626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556223203668914:9529]
2025-10-02T09:37:29.902639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:29.902723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3643 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0
2025-10-02T09:37:29.902881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3643 sessionId: src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0 is DEAD
2025-10-02T09:37:29.903024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:29.903037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Write session will restart in 0.005017s
2025-10-02T09:37:29.903052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Write session: Do CDS request
2025-10-02T09:37:29.903056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:29.909058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.909163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:29.909171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3644
2025-10-02T09:37:29.909279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:29.909300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:29.909307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:29.909310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:29.909621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3644 sessionId:  describe result for acl check
2025-10-02T09:37:29.909644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:29.909649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:29.909651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:29.909654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:29.910069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:29.912072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:29.914223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:29.914233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:29.914236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556223203668958:10105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:29.914241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:29.914485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:29.916001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:29.916111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:29.916117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:29.916123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:29.916150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:29.916175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556223128080365:9541]
2025-10-02T09:37:29.916520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:29.916685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:29.916713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:29.916902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:29.916934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.916938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.916939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.916939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.916940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.916941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.916941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.916942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.916942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.916943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.916944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.916944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.916947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.916953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.916955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.916958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.916959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.916961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.916963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.916965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.916967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.916969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.916971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.916973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.916977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.916981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:29.916984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.916987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:29.916989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.916992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:29.916994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.916997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:29.916999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.917001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:29.917003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.917006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:29.917008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.917011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:29.917014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.917016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:29.917019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.917021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:29.917023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.917026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.917028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.917030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.917032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.917035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.917053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:29.924393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:29.925932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:29.925945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:29.925947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:29.925949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:29.925952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3643 [2:7556556223128080365:9541]
2025-10-02T09:37:29.925959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:29.925969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:29.925974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.925976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.925977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.925986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:29.925992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:29.925996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:29.926029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.926033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.926034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.926036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:29.926037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:29.926072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:29.926077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.926084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:29.926093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:29.926101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:29.926115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203668915:2446], now have 1 active actors on pipe
2025-10-02T09:37:29.926121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556223203669146:10105], now have 1 active actors on pipe
2025-10-02T09:37:29.926125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.926131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.926133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.926143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:29.926153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:29.926157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:29.926161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:29.926162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:29.926167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:29.926169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:29.926183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.926188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:29.926172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3643
2025-10-02T09:37:29.926177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3643
2025-10-02T09:37:29.926200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:29.926209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.926211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.926227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:29.926236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:29.926241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:29.926242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:29.926248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:29.926253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:29.926260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.926383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:29.926388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:29.926395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:29.926466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3644 partition: 0 MaxSeqNo: 36 sessionId: src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0
2025-10-02T09:37:29.926708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefac22a-1bba4c9-e9d13683-1e81b342_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:29.929444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Write session: try to update token
2025-10-02T09:37:29.929455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:29.935283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:29.935299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:29.935300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:29.935301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:29.935306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.935308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.935311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556223128080360:9541]
2025-10-02T09:37:29.935331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:29.935333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:29.935334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:29.935336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:29.935336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:29.935338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:29.935517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:29.940957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3644 sessionId: src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:29.943401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.002976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498636460:9529]
2025-10-02T09:37:30.003177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3643, pipe: [1:7556556227498636460:9529]
2025-10-02T09:37:30.051465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.051753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.051764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.051778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636460:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.051977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.052010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498636460:9529]
2025-10-02T09:37:30.052037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.052048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:30.052132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0
2025-10-02T09:37:30.052275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3644 sessionId: src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0 is DEAD
2025-10-02T09:37:30.052417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:30.052430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Write session will restart in 0.007218s
2025-10-02T09:37:30.052449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Write session: Do CDS request
2025-10-02T09:37:30.052453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.060146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.060258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.060269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3645
2025-10-02T09:37:30.060415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.060440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.060444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.060447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.060818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3645 sessionId:  describe result for acl check
2025-10-02T09:37:30.060847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.060852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.060854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.060860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.061286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.062956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.063233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.064742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.064855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.064864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.064869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498636591:10113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.064874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.064932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.064940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.064948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.064982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.065006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423047897:9545]
2025-10-02T09:37:30.065353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.065513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.065535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.065730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.065761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.065765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.065766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.065766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.065767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.065767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.065768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.065769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.065769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.065770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.065770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.065771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.065774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.065781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.065783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.065785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.065787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.065789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.065791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.065793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.065795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.065797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.065799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.065801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.065805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.065809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.065812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.065814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.065817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.065819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.065821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.065824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.065829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.065834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.065836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.065839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.065841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.065844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.065850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.065852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.065856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.065858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.065861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.065865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.065869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.065873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.065875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.065892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.073283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.074910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.074923Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.074925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.074927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.074931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3644 [2:7556556227423047897:9545]
2025-10-02T09:37:30.074939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.074949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.074955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.074956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.074957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.074967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.074971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.074979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.075013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.075018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.075019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.075021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.075023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.075065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.075070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.075077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.075082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.075091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.075107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636698:10113], now have 1 active actors on pipe
2025-10-02T09:37:30.075113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636465:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.075117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.075119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.075120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.075128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.075138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.075140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.075142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.075143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.075149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.075150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.075165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.075172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.075177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.075173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3644
2025-10-02T09:37:30.075180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3644
2025-10-02T09:37:30.075210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.075228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.075246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.075254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.075258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.075259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.075265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.075273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.075287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.075423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.075429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.075436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.075504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3645 partition: 0 MaxSeqNo: 36 sessionId: src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0
2025-10-02T09:37:30.075816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292a7435-a24884f1-6b7d4f18-f7af8931_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.078612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Write session: try to update token
2025-10-02T09:37:30.078625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.084516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:30.084531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.084537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.084566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:30.084568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:30.084708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:30.084843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.084967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.085086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.085261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:30.085288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:30.090728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3645 sessionId: src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.093099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.093114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.093115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.093117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.093123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.093127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.093129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423047892:9545]
2025-10-02T09:37:30.093151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.093155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.093158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.093158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.093160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.093160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.093273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.093288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.152001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498636709:9529]
2025-10-02T09:37:30.152181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3644, pipe: [1:7556556227498636709:9529]
2025-10-02T09:37:30.206979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.207252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.207262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.207276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636709:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.207440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.207491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.207496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:30.207500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:30.207553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498636709:9529]
2025-10-02T09:37:30.207584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3645 reason: error at write: Disconnected sessionId: src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0
2025-10-02T09:37:30.207753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3645 sessionId: src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0 is DEAD
2025-10-02T09:37:30.207870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:30.207882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Write session will restart in 0.005943s
2025-10-02T09:37:30.207902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Write session: Do CDS request
2025-10-02T09:37:30.207908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.215163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.215296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.215307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3646
2025-10-02T09:37:30.215439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.215463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.215470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.215472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.215804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3646 sessionId:  describe result for acl check
2025-10-02T09:37:30.215829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.215831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.215832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.215836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.216285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.218348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.219633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.221329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.221462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.221470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.221477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.221509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.221520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.221532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.221534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498636808:10125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.221540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.221539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423048137:9536]
2025-10-02T09:37:30.221910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.222098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.222124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.222306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.222337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.222341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.222342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.222343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.222343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.222344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.222345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.222345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.222346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.222346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.222347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.222348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.222351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.222357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.222359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.222362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.222364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.222366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.222368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.222370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.222372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.222374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.222376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.222378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.222382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.222388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.222391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.222394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.222397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.222400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.222402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.222404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.222407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.222410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.222414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.222416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.222419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.222425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.222427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.222430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.222434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.222437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.222439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.222445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.222450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.222453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.222455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.222457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.222478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.229846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.231494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.231507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.231508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.231510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.231513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3645 [2:7556556227423048137:9536]
2025-10-02T09:37:30.231524Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.231535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.231540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.231542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.231543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.231553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.231556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.231561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.231596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.231601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.231602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.231605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.231607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.231648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.231655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.231662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.231667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.231676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.231689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636711:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.231695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636946:10125], now have 1 active actors on pipe
2025-10-02T09:37:30.231699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.231701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.231702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.231710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.231721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.231728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.231732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.231733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.231740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.231741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.231749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.231755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.231756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.231765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3645
2025-10-02T09:37:30.231773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3645
2025-10-02T09:37:30.231843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.231848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.231864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a026d3f-23605c7a-5b96fba1-27751435_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.231872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.231874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.231875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.231881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.231890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.231900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.232035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.232040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.232048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.232124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3646 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a026d3f-23605c7a-5b96fba1-27751435_0
2025-10-02T09:37:30.232466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d6a4c5-b1bab2a6-ef9904c7-d928f46a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a026d3f-23605c7a-5b96fba1-27751435_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.235082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Write session: try to update token
2025-10-02T09:37:30.235100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.240779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:30.240795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.240816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.240844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:30.240847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:30.240985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:30.241113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.241233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.241354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:30.241536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:30.241565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:30.247713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3646 sessionId: src_id|9a026d3f-23605c7a-5b96fba1-27751435_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.249372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.249385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.249386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.249388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.249393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.249395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.249397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423048132:9536]
2025-10-02T09:37:30.249418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.249422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.249423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.249423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.249426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.249429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.249533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.250173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.307656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498636957:9529]
2025-10-02T09:37:30.307865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3645, pipe: [1:7556556227498636957:9529]
2025-10-02T09:37:30.363652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.364079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.364089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.364102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636957:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.364259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.364269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498636957:9529]
2025-10-02T09:37:30.364304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:30.364311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:30.364385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3646 reason: error at write: Disconnected sessionId: src_id|9a026d3f-23605c7a-5b96fba1-27751435_0
2025-10-02T09:37:30.364532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3646 sessionId: src_id|9a026d3f-23605c7a-5b96fba1-27751435_0 is DEAD
2025-10-02T09:37:30.364654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:30.364664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Write session will restart in 0.005962s
2025-10-02T09:37:30.364679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Write session: Do CDS request
2025-10-02T09:37:30.364687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.364714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.371145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.371256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.371266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3647
2025-10-02T09:37:30.371370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.371400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.371414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.371423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.371870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3647 sessionId:  describe result for acl check
2025-10-02T09:37:30.371901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.371906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.371909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.371913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.372398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.374621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.376526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.376535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.376538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498637015:10134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.376542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.376796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.378325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.378434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.378441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.378446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.378474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.378502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423048389:9534]
2025-10-02T09:37:30.378851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.379024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.379050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.379255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.379287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.379291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.379292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.379292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.379293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.379293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.379294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.379294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.379295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.379295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.379296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.379296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.379299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.379306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.379308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.379310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.379312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.379315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.379317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.379319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.379321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.379323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.379325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.379327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.379331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.379335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.379338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.379342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.379345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.379349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.379351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.379354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.379356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.379359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.379361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.379363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.379365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.379368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.379370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.379373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.379375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.379378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.379380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.379383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.379385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.379387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.379389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.379392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.379413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.387034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.388683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.388696Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.388697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.388699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.388703Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3646 [2:7556556227423048389:9534]
2025-10-02T09:37:30.388709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.388719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.388721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.388722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.388723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.388733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.388739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.388744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.388778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.388783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.388785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.388787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.388788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.388848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.388855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.388864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.388877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.388895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.388911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637197:10134], now have 1 active actors on pipe
2025-10-02T09:37:30.388916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498636962:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.388920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.388921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.388922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.388929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.388937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.388946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.388947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.388949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.388954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.388955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.388966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.388972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.388976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.388953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3646
2025-10-02T09:37:30.388959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3646
2025-10-02T09:37:30.389000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.389007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.389026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.389037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.389043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.389045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.389051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.389062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.389075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.389224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.389231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.389241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.389313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3647 partition: 0 MaxSeqNo: 36 sessionId: src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0
2025-10-02T09:37:30.389595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a026d3f-23605c7a-5b96fba1-27751435_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.391871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Write session: try to update token
2025-10-02T09:37:30.391888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.398216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.398232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.398233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.398235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.398240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.398242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.398244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423048384:9534]
2025-10-02T09:37:30.398265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.398269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.398270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.398272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.398272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.398274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.398399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.404031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3647 sessionId: src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.406388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.464308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498637221:9529]
2025-10-02T09:37:30.464508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3646, pipe: [1:7556556227498637221:9529]
2025-10-02T09:37:30.509470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.509673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.509683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.509694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637221:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.509839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.509847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:30.509860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:30.509882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498637221:9529]
2025-10-02T09:37:30.509906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.509933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3647 reason: error at write: Disconnected sessionId: src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0
2025-10-02T09:37:30.510105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3647 sessionId: src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0 is DEAD
2025-10-02T09:37:30.510251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:30.510261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Write session will restart in 0.008550s
2025-10-02T09:37:30.510282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Write session: Do CDS request
2025-10-02T09:37:30.510287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.520170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.520249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.520259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3648
2025-10-02T09:37:30.520344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.520366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.520372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.520375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.520730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3648 sessionId:  describe result for acl check
2025-10-02T09:37:30.520755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.520760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.520762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.520765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.521202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.522216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.523020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.523945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.524070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.524077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.524084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.524114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.524141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423048658:9521]
2025-10-02T09:37:30.524508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.524690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.524721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.524920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.524953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.524957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.524958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.524958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.524959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.524960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.524960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.524961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.524962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.524962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.524963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.524963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.524967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.524972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.524975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.524977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.524979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.524981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.524983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.524985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.524987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.524989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.524991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.524994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.524997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.525002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.525006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.525009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.525012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.525015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.525017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.525020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.525023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.525025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.525027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.525030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.525033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.525036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.525038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.525040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.525043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.525045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.525047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.525050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.525052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.525055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.525057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.525059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.525076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.525169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.525178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.525181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498637411:10157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.525185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.532472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.533978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.533993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.533994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.533997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.534001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3647 [2:7556556227423048658:9521]
2025-10-02T09:37:30.534009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.534019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.534024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.534026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.534027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.534038Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.534044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.534049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.534086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.534090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.534091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.534093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.534095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.534141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.534147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.534157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.534170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.534187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.534202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637223:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.534207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637467:10157], now have 1 active actors on pipe
2025-10-02T09:37:30.534211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.534212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.534213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.534221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.534231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.534238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.534240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.534241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.534242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.534244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.534259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.534265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.534251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3647
2025-10-02T09:37:30.534270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.534284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3647
2025-10-02T09:37:30.534285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.534292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.534320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.534329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.534335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.534337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.534344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.534354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.534373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.534533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.534539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.534549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.534631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3648 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0
2025-10-02T09:37:30.534881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52927ef-62ec9366-d539fcc2-6ccd01c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.537205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Write session: try to update token
2025-10-02T09:37:30.537220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.543422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.543433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.543434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.543435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.543440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.543442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.543444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423048637:9521]
2025-10-02T09:37:30.543464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.543467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.543468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.543469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.543472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.543474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.543577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.548947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3648 sessionId: src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.551159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.610260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498637493:9529]
2025-10-02T09:37:30.610431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3647, pipe: [1:7556556227498637493:9529]
2025-10-02T09:37:30.655396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.655803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.655813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.655825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637493:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.656012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.656064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498637493:9529]
2025-10-02T09:37:30.656096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.656756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:30.656852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0
2025-10-02T09:37:30.657012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3648 sessionId: src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0 is DEAD
2025-10-02T09:37:30.657158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:30.657169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Write session will restart in 0.006876s
2025-10-02T09:37:30.657189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Write session: Do CDS request
2025-10-02T09:37:30.657194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.665165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.665246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.665256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3649
2025-10-02T09:37:30.665392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.665417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.665424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.665428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.665784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3649 sessionId:  describe result for acl check
2025-10-02T09:37:30.665814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.665815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.665816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.665820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.666248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.667959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.668560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.669575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.669704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.669712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.669718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.669746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.669777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423048906:9514]
2025-10-02T09:37:30.670392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.670463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.670473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.670475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498637636:10196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.670480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.670571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.670601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.670893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.670926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.670930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.670931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.670931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.670932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.670933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.670933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.670934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.670934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.670935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.670936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.670936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.670939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.670946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.670948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.670950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.670952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.670954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.670956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.670958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.670960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.670963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.670965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.670967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.670971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.670975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.670979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.670982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.670984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.670987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.670989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.670992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.670995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.670997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.670999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.671002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.671006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.671009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.671011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.671014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.671016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.671019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.671021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.671024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.671028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.671031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.671033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.671036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.671053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.678493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.680162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.680175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.680176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.680178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.680182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3648 [2:7556556227423048906:9514]
2025-10-02T09:37:30.680192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.680206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.680207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.680209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.680210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.680219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.680224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.680231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.680263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.680268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.680269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.680270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.680272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.680321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.680328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.680337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.680348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.680365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.680380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637734:10196], now have 1 active actors on pipe
2025-10-02T09:37:30.680385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637494:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.680389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.680390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.680391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.680398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.680406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.680413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.680415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.680416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.680416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.680418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.680432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.680419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3648
2025-10-02T09:37:30.680423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3648
2025-10-02T09:37:30.680438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.680446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.680456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.680459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.680488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.680499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.680502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.680503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.680510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.680521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.680541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.680661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.680668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.680678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.680752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3649 partition: 0 MaxSeqNo: 36 sessionId: src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0
2025-10-02T09:37:30.681048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a66afee-63c5654c-f314e3bd-2b385a88_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.683813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Write session: try to update token
2025-10-02T09:37:30.683824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.689643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.689658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.689660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.689661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.689665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.689668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.689670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423048901:9514]
2025-10-02T09:37:30.689691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.689693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.689696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.689697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.689698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.689699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.689819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.696003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3649 sessionId: src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.698379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.756157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498637744:9529]
2025-10-02T09:37:30.756363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3648, pipe: [1:7556556227498637744:9529]
2025-10-02T09:37:30.801265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.801503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.801512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.801525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637744:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.801725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.801783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.801800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498637744:9529]
2025-10-02T09:37:30.801840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:30.801942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3649 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0
2025-10-02T09:37:30.802167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3649 sessionId: src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0 is DEAD
2025-10-02T09:37:30.802304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:30.802315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Write session will restart in 0.007111s
2025-10-02T09:37:30.802329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Write session: Do CDS request
2025-10-02T09:37:30.802335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.810121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.810241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.810254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3650
2025-10-02T09:37:30.810381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.810405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.810413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.810416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.810777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3650 sessionId:  describe result for acl check
2025-10-02T09:37:30.810808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.810878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.810884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.810888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.811353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.813278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.814171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.815678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.815788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.815795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.815801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.815828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.815852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423049148:9507]
2025-10-02T09:37:30.815880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.815889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.815891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498637844:10198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.815896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.816225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.816401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.816427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.816612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.816644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.816648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.816649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.816649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.816650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.816650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.816651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.816651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.816652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.816652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.816653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.816653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.816656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.816663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.816665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.816667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.816669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.816671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.816673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.816675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.816677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.816679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.816681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.816683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.816686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.816690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.816694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.816697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.816699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.816701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.816704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.816706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.816709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.816711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.816713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.816716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.816718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.816721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.816723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.816726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.816728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.816731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.816733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.816735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.816738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.816740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.816742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.816745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.816765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.824274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.825963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.825976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.825978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.825981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.825984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3649 [2:7556556227423049148:9507]
2025-10-02T09:37:30.825992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.826003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.826008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.826009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.826010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.826020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.826023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.826028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.826066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.826071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.826072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.826074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.826076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.826117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.826124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.826134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.826145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.826162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.826179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637984:10198], now have 1 active actors on pipe
2025-10-02T09:37:30.826188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.826190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.826192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.826202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.826213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637745:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.826217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.826219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.826220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.826221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.826228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.826229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.826245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.826253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.826258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.826278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3649
2025-10-02T09:37:30.826317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3649
2025-10-02T09:37:30.826318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.826328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.826348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d170c96-75ca06af-25b691a7-3140c04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.826359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.826364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.826366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.826373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.826381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.826392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.826531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.826537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.826548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.826618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3650 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d170c96-75ca06af-25b691a7-3140c04_0
2025-10-02T09:37:30.826904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60587b0-60d66af-42c97302-4b9ff8d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d170c96-75ca06af-25b691a7-3140c04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.829648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Write session: try to update token
2025-10-02T09:37:30.829661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.835522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.835538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.835539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.835541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.835547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.835550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.835552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423049143:9507]
2025-10-02T09:37:30.835574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.835581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.835581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.835582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.835585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.835588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.835699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.841991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3650 sessionId: src_id|8d170c96-75ca06af-25b691a7-3140c04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.844444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:30.902061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556227498637996:9529]
2025-10-02T09:37:30.902250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3649, pipe: [1:7556556227498637996:9529]
2025-10-02T09:37:30.946173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:30.946530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.946539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.946551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498637996:9529], now have 1 active actors on pipe
2025-10-02T09:37:30.946722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556227498637996:9529]
2025-10-02T09:37:30.946749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:30.946750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:30.946754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:30.946787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:30.946834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3650 reason: error at write: Disconnected sessionId: src_id|8d170c96-75ca06af-25b691a7-3140c04_0
2025-10-02T09:37:30.947000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3650 sessionId: src_id|8d170c96-75ca06af-25b691a7-3140c04_0 is DEAD
2025-10-02T09:37:30.947142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:30.947153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Write session will restart in 0.005311s
2025-10-02T09:37:30.947168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Write session: Do CDS request
2025-10-02T09:37:30.947172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:30.953158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.953275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:30.953286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3651
2025-10-02T09:37:30.953411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:30.953441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:30.953452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:30.953456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:30.953860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3651 sessionId:  describe result for acl check
2025-10-02T09:37:30.953888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:30.953893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:30.953894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:30.953898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:30.954332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:30.956275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:30.958277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:30.958286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:30.958289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556227498638068:10207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:30.958293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:30.960261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:30.960552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:30.960704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:30.960711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:30.960718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:30.960749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:30.960775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556227423049392:9504]
2025-10-02T09:37:30.961136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:30.961303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:30.961330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:30.961531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:30.961566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.961570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.961570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.961571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.961572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.961572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.961573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.961574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.961574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.961575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.961575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.961576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.961579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.961586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.961588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.961590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.961592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.961594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.961596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.961599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.961600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.961603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.961605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.961608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.961612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.961616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:30.961620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.961622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:30.961625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.961627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:30.961629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.961632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:30.961634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.961637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:30.961639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.961641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:30.961644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.961646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:30.961649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.961652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:30.961654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.961656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:30.961658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.961660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.961662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.961667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.961669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.961672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.961689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:30.969030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:30.970523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:30.970535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:30.970536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:30.970538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:30.970542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3650 [2:7556556227423049392:9504]
2025-10-02T09:37:30.970550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:30.970561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:30.970566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.970568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.970569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.970578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:30.970584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:30.970588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:30.970618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.970623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.970624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.970626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:30.970627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:30.970671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:30.970677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.970687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:30.970700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:30.970718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:30.970734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498638248:10207], now have 1 active actors on pipe
2025-10-02T09:37:30.970740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556227498638000:2446], now have 1 active actors on pipe
2025-10-02T09:37:30.970743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.970745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.970746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.970753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:30.970765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:30.970766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:30.970768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:30.970770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:30.970776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:30.970777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:30.970792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.970798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:30.970800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:30.970785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3650
2025-10-02T09:37:30.970785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3650
2025-10-02T09:37:30.970821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.970827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.970852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:30.970862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:30.970867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:30.970868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:30.970875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:30.970884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:30.970903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.971039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:30.971046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:30.971056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:30.971138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3651 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0
2025-10-02T09:37:30.971430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d170c96-75ca06af-25b691a7-3140c04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:30.974168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Write session: try to update token
2025-10-02T09:37:30.974179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:30.979907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:30.979923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:30.979925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:30.979926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:30.979931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.979933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.979935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556227423049387:9504]
2025-10-02T09:37:30.979957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:30.979959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:30.979960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:30.979962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:30.979964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:30.979964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:30.980093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:30.985831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3651 sessionId: src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:30.988329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.046961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793605563:9529]
2025-10-02T09:37:31.047182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3650, pipe: [1:7556556231793605563:9529]
2025-10-02T09:37:31.091573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.091885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.091895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.091908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793605563:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.092095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.092132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793605563:9529]
2025-10-02T09:37:31.092143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.092163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:31.092242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0
2025-10-02T09:37:31.092402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3651 sessionId: src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0 is DEAD
2025-10-02T09:37:31.092554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:31.092565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Write session will restart in 0.008351s
2025-10-02T09:37:31.092585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Write session: Do CDS request
2025-10-02T09:37:31.092589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.102116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.102244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.102256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3652
2025-10-02T09:37:31.102385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.102408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.102416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.102419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.102761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3652 sessionId:  describe result for acl check
2025-10-02T09:37:31.102790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.102792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.102793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.102798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.103241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.103915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.104904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.105576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.105680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.105686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.105692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.105723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.105753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718016931:9502]
2025-10-02T09:37:31.106108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.106302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.106327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.106523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.106558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.106562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.106563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.106563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.106564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.106564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.106565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.106566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.106566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.106567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.106567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.106568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.106570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.106577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.106579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.106581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.106583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.106585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.106587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.106589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.106590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.106593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.106595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.106596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.106600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.106604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.106607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.106610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.106613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.106616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.106618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.106621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.106623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.106626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.106628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.106631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.106633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.106636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.106638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.106641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.106643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.106646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.106648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.106651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.106653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.106660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.106662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.106665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.106685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.106689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.106699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.106702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793605757:10239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.106707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.114057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.115561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.115576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.115577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.115579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.115583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3651 [2:7556556231718016931:9502]
2025-10-02T09:37:31.115590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.115603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.115607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.115609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.115610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.115619Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.115625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.115629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.115664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.115668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.115669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.115671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.115672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.115709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.115714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.115720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.115729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.115741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.115755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793605564:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.115761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793605807:10239], now have 1 active actors on pipe
2025-10-02T09:37:31.115764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.115765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.115767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.115774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.115786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.115788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.115790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.115792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.115796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.115798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.115813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.115817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.115804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3651
2025-10-02T09:37:31.115806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3651
2025-10-02T09:37:31.115828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.115841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.115844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.115860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.115867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.115869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.115870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.115876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.115881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.115891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.116002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.116006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.116014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.116079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3652 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0
2025-10-02T09:37:31.116314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a65ca8b-6ef850c5-858f9ec3-2bb77c9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.119072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Write session: try to update token
2025-10-02T09:37:31.119083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.125064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.125081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.125082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.125083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.125088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.125091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.125093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718016925:9502]
2025-10-02T09:37:31.125116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.125123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.125123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.125124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.125126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.125128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.125242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.131706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3652 sessionId: src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.134074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.192351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793605817:9529]
2025-10-02T09:37:31.192500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3651, pipe: [1:7556556231793605817:9529]
2025-10-02T09:37:31.236171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.236640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.236652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.236664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793605817:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.236883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.236862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.236906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:31.236908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793605817:9529]
2025-10-02T09:37:31.236910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:31.236977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3652 reason: error at write: Disconnected sessionId: src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0
2025-10-02T09:37:31.237127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3652 sessionId: src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0 is DEAD
2025-10-02T09:37:31.237245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:31.237256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Write session will restart in 0.006195s
2025-10-02T09:37:31.237272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Write session: Do CDS request
2025-10-02T09:37:31.237276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.244157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.244244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.244253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3653
2025-10-02T09:37:31.244354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.244376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.244383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.244386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.244822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3653 sessionId:  describe result for acl check
2025-10-02T09:37:31.244853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.244858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.244860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.244867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.245293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.246928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.248868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.250355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.250442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.250451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.250454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793605896:10229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.250458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.250466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.250473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.250479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.250506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.250529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718017177:9495]
2025-10-02T09:37:31.250947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.251109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.251140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.251330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.251361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.251365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.251365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.251366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.251366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.251367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.251368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.251369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.251370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.251371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.251372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.251373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.251377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.251386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.251389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.251392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.251396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.251399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.251403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.251409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.251411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.251413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.251415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.251417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.251421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.251424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.251431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.251434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.251439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.251442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.251445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.251448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.251450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.251458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.251463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.251466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.251468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.251471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.251476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.251479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.251481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.251483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.251487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.251490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.251492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.251495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.251497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.251499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.251516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.258883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.260398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.260409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.260410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.260412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.260417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3652 [2:7556556231718017177:9495]
2025-10-02T09:37:31.260424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.260437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.260442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.260444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.260445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.260454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.260460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.260465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.260496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.260500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.260501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.260503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.260505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.260542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.260546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.260553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.260560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.260571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.260586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606060:10229], now have 1 active actors on pipe
2025-10-02T09:37:31.260593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793605818:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.260598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.260603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.260605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.260615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.260627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.260628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.260635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.260636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.260636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.260637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.260649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.260651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.260668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.260647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3652
2025-10-02T09:37:31.260663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3652
2025-10-02T09:37:31.260786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.260793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.260826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.260833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.260837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.260839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.260845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.260852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.260860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.261006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.261013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.261022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.261086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3653 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0
2025-10-02T09:37:31.261498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2760a0-a1ec0bc-ea03feff-dc1f9096_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.264243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Write session: try to update token
2025-10-02T09:37:31.264253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.269856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.269872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.269873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.269875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.269879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.269881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.269883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718017171:9495]
2025-10-02T09:37:31.269904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.269908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.269908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.269909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.269910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.269912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.270031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.276203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3653 sessionId: src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.278573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.337253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793606071:9529]
2025-10-02T09:37:31.337443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3652, pipe: [1:7556556231793606071:9529]
2025-10-02T09:37:31.381336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.381678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.381692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.381709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606071:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.381835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.381856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793606071:9529]
2025-10-02T09:37:31.381886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:31.381890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.381956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3653 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0
2025-10-02T09:37:31.382103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3653 sessionId: src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0 is DEAD
2025-10-02T09:37:31.382255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:31.382267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Write session will restart in 0.008125s
2025-10-02T09:37:31.382288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Write session: Do CDS request
2025-10-02T09:37:31.382292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.391104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.391252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.391262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3654
2025-10-02T09:37:31.391377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.391399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.391403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.391408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.391749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3654 sessionId:  describe result for acl check
2025-10-02T09:37:31.391781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.391786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.391787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.391794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.392220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.393595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.394079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.395206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.395331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.395338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.395344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.395372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.395413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718017435:9482]
2025-10-02T09:37:31.395789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.395958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.395987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.396011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.396021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.396023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793606231:5269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.396028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.396196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.396234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.396238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.396238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.396239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.396240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.396240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.396241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.396241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.396242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.396242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.396243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.396243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.396246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.396253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.396255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.396257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.396259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.396261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.396263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.396267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.396270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.396274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.396277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.396280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.396286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.396293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.396297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.396300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.396304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.396306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.396308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.396316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.396318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.396321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.396323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.396326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.396328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.396331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.396333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.396339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.396341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.396344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.396347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.396350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.396353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.396357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.396359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.396361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.396378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.403745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.405412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.405425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.405426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.405428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.405432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3653 [2:7556556231718017435:9482]
2025-10-02T09:37:31.405440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.405449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.405454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.405456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.405457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.405466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.405469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.405473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.405513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.405519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.405520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.405522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.405523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.405562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.405567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.405573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.405579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.405587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.405600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606319:5269], now have 1 active actors on pipe
2025-10-02T09:37:31.405606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606075:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.405609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.405611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.405612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.405619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.405629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.405634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.405636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.405637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.405638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.405640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.405652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.405657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.405658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.405668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3653
2025-10-02T09:37:31.405672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3653
2025-10-02T09:37:31.405737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.405746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.405770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2fa99d3-720d43f-f03d9457-89c9566_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.405778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.405780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.405781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.405786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.405793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.405803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.405921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.405928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.405936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.406004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3654 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2fa99d3-720d43f-f03d9457-89c9566_0
2025-10-02T09:37:31.406277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7002e0-7d23ce24-b4a8e34a-8e785af8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2fa99d3-720d43f-f03d9457-89c9566_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.409006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Write session: try to update token
2025-10-02T09:37:31.409017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.414807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.414824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.414826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.414828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.414834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.414836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.414838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718017429:9482]
2025-10-02T09:37:31.414862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.414869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.414871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.414872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.414873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.414875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.414995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.420771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3654 sessionId: src_id|b2fa99d3-720d43f-f03d9457-89c9566_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.423168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.482149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793606342:9529]
2025-10-02T09:37:31.482353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3653, pipe: [1:7556556231793606342:9529]
2025-10-02T09:37:31.526030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.526361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.526372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.526383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606342:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.526514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.526554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:31.526566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:31.526592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793606342:9529]
2025-10-02T09:37:31.526626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.526646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3654 reason: error at write: Disconnected sessionId: src_id|b2fa99d3-720d43f-f03d9457-89c9566_0
2025-10-02T09:37:31.526817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3654 sessionId: src_id|b2fa99d3-720d43f-f03d9457-89c9566_0 is DEAD
2025-10-02T09:37:31.526984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:31.526998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Write session will restart in 0.007834s
2025-10-02T09:37:31.527017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Write session: Do CDS request
2025-10-02T09:37:31.527023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.536160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.536283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.536293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3655
2025-10-02T09:37:31.536405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.536428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.536436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.536439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.536787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3655 sessionId:  describe result for acl check
2025-10-02T09:37:31.536829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.536836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.536837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.536841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.537260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.538211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.539059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.539747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.539851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.539858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.539864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.539894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.539923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718017697:9483]
2025-10-02T09:37:31.540272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.540434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.540459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.540647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.540679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.540682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.540683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.540684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.540684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.540685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.540685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.540686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.540686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.540687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.540687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.540688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.540691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.540697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.540699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.540701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.540703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.540705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.540707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.540709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.540711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.540713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.540715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.540717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.540720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.540724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.540728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.540731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.540733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.540736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.540738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.540741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.540743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.540746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.540748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.540750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.540752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.540755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.540757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.540760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.540762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.540765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.540767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.540769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.540771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.540774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.540776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.540779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.540794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.540921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.540930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.540932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793606530:5252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.540937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.548153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.549685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.549699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.549701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.549705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.549710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3654 [2:7556556231718017697:9483]
2025-10-02T09:37:31.549718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.549731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.549735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.549738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.549739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.549747Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.549751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.549756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.549786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.549791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.549792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.549794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.549795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.549831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.549836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.549843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.549848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.549856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.549871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606344:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.549876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606591:5252], now have 1 active actors on pipe
2025-10-02T09:37:31.549880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.549885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.549887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.549894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.549904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.549908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.549909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.549910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.549915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.549916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.549929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.549936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.549941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.549958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3654
2025-10-02T09:37:31.549966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3654
2025-10-02T09:37:31.549996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.550001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.550016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.550022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.550024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.550025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.550030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.550038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.550048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.550187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.550194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.550202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.550268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3655 partition: 0 MaxSeqNo: 36 sessionId: src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0
2025-10-02T09:37:31.550543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fa99d3-720d43f-f03d9457-89c9566_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.553459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Write session: try to update token
2025-10-02T09:37:31.553469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.558874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:31.558889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.558893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.558918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:31.558936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:31.559067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:31.559198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:31.559338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:31.559465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:31.559625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:31.559650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:31.566065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3655 sessionId: src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.567249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.567262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.567264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.567266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.567270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.567272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.567275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718017692:9483]
2025-10-02T09:37:31.567295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.567302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.567302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.567304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.567305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.567307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.567427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.568216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.626549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793606623:9529]
2025-10-02T09:37:31.626791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3654, pipe: [1:7556556231793606623:9529]
2025-10-02T09:37:31.679587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.680012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.680023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.680036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606623:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.680191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.680221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793606623:9529]
2025-10-02T09:37:31.680246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:31.680249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.680333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0
2025-10-02T09:37:31.680495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3655 sessionId: src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0 is DEAD
2025-10-02T09:37:31.680635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:31.680647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Write session will restart in 0.008281s
2025-10-02T09:37:31.680671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Write session: Do CDS request
2025-10-02T09:37:31.680677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.690228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.690275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.690287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3656
2025-10-02T09:37:31.690445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.690469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.690477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.690481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.690823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3656 sessionId:  describe result for acl check
2025-10-02T09:37:31.690863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.690868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.690869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.690873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.691308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.692756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.693142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.694407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.694519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.694526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.694532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.694561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.694585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718017968:9466]
2025-10-02T09:37:31.694935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.695004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.695015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.695017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793606787:5224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.695021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.695097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.695119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.695338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.695378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.695382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.695383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.695384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.695384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.695385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.695386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.695386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.695387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.695387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.695388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.695388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.695391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.695398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.695401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.695403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.695405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.695407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.695409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.695411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.695413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.695417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.695419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.695421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.695426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.695430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.695433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.695436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.695439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.695442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.695444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.695447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.695451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.695454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.695456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.695459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.695461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.695464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.695466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.695469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.695472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.695474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.695481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.695484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.695486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.695489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.695491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.695493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.695511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.702859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.704389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.704402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.704403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.704406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.704409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3655 [2:7556556231718017968:9466]
2025-10-02T09:37:31.704416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.704425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.704431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.704432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.704433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.704442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.704445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.704449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.704481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.704486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.704487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.704489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.704490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.704526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.704531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.704537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.704542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.704552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.704565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606625:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.704570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606872:5224], now have 1 active actors on pipe
2025-10-02T09:37:31.704574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.704575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.704576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.704583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.704591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.704597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.704599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.704600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.704601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.704602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.704615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.704620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.704622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.704644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3655
2025-10-02T09:37:31.704680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3655
2025-10-02T09:37:31.704708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.704713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.704728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80cced67-b98495aa-8460ed2e-d9641728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.704734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.704737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.704738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.704743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.704752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.704760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.704879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.704884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.704891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.704955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3656 partition: 0 MaxSeqNo: 36 sessionId: src_id|80cced67-b98495aa-8460ed2e-d9641728_0
2025-10-02T09:37:31.705208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cff56-ac34fa77-28fbcae8-5ed3ba20_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80cced67-b98495aa-8460ed2e-d9641728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.707824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Write session: try to update token
2025-10-02T09:37:31.707839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.713782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.713794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.713795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.713796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.713799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.713802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.713804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718017963:9466]
2025-10-02T09:37:31.713824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.713829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.713832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.713832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.713833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.713834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.713947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.720429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3656 sessionId: src_id|80cced67-b98495aa-8460ed2e-d9641728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.722834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.780175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793606881:9529]
2025-10-02T09:37:31.780373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3655, pipe: [1:7556556231793606881:9529]
2025-10-02T09:37:31.826604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.826860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.826867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.826885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606881:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.827092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.827113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.827136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793606881:9529]
2025-10-02T09:37:31.827140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:31.827143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:31.827209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3656 reason: error at write: Disconnected sessionId: src_id|80cced67-b98495aa-8460ed2e-d9641728_0
2025-10-02T09:37:31.827395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3656 sessionId: src_id|80cced67-b98495aa-8460ed2e-d9641728_0 is DEAD
2025-10-02T09:37:31.827560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:31.827573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Write session will restart in 0.006572s
2025-10-02T09:37:31.827594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Write session: Do CDS request
2025-10-02T09:37:31.827600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.835235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.835273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.835285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3657
2025-10-02T09:37:31.835473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.835496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.835503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.835506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.835901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3657 sessionId:  describe result for acl check
2025-10-02T09:37:31.835932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.835938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.835939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.835943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.836383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.838462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.839450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.840965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.841124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.841132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.841138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.841169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.841194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718018216:9458]
2025-10-02T09:37:31.841211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.841223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.841231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793606983:5193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.841242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.841538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.841700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.841726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.841911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.841941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.841945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.841946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.841946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.841947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.841947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.841948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.841948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.841949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.841949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.841950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.841950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.841953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.841960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.841962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.841964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.841966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.841968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.841970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.841972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.841974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.841978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.841980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.841984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.841988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.841992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.841995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.841999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.842003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.842006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.842008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.842011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.842013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.842016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.842018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.842021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.842023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.842025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.842028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.842032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.842039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.842043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.842047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.842053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.842057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.842062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.842090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.849416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.850877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.850891Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.850892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.850895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.850899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3656 [2:7556556231718018216:9458]
2025-10-02T09:37:31.850906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.850916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.850921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.850923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.850924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.850933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.850936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.850941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.850974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.850979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.850980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.850982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.850983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.851142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.851148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.851155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.851136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3656
2025-10-02T09:37:31.851161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.851171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.851184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793607127:5193], now have 1 active actors on pipe
2025-10-02T09:37:31.851174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3656
2025-10-02T09:37:31.851190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793606882:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.851200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.851205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.851216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.851220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.851233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.851243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.851257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.851257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.851259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.851260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.851267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.851269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.851278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.851285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.851288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.851289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.851293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.851298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.851315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.851323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.851329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.851331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.851428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.851433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.851442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.851497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3657 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0
2025-10-02T09:37:31.851768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80cced67-b98495aa-8460ed2e-d9641728_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:31.854199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Write session: try to update token
2025-10-02T09:37:31.854216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:31.860295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:31.860307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:31.860309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:31.860310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:31.860314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.860316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.860319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718018211:9458]
2025-10-02T09:37:31.860337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:31.860340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.860341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:31.860342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:31.860345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:31.860347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:31.860449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:31.866627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3657 sessionId: src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:31.868929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:31.927118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556231793607140:9529]
2025-10-02T09:37:31.927398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3656, pipe: [1:7556556231793607140:9529]
2025-10-02T09:37:31.972583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:31.972948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.972958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.972970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793607140:9529], now have 1 active actors on pipe
2025-10-02T09:37:31.973096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:31.973137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:31.973178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556231793607140:9529]
2025-10-02T09:37:31.973191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:31.973270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3657 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0
2025-10-02T09:37:31.973440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3657 sessionId: src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0 is DEAD
2025-10-02T09:37:31.973964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:31.973979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Write session will restart in 0.009754s
2025-10-02T09:37:31.974008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Write session: Do CDS request
2025-10-02T09:37:31.974015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:31.985151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:31.985224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.985259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:31.985270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3658
2025-10-02T09:37:31.985446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:31.985469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:31.985474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:31.985477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:31.985810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3658 sessionId:  describe result for acl check
2025-10-02T09:37:31.985833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:31.985837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:31.985839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:31.985843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:31.986283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:31.986713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:31.986825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:31.986832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:31.986838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:31.986867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:31.986893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556231718018466:9452]
2025-10-02T09:37:31.987550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:31.987711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:31.987748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:31.988031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:31.988061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.988066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.988067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.988067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.988068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.988069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.988070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.988070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.988071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.988071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.988075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.988082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.988084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.988086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.988088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.988091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.988093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.988095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.988097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.988099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.988101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.988103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.988109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.988113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:31.988117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.988119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:31.988122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.988125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:31.988127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.988130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:31.988132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.988135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:31.988137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.988128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:31.988139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:31.988145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.988148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:31.988151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.988154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:31.988158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.988161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:31.988166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.988169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.988171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.988174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.988176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.988179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.988198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:31.992944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:31.992955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:31.992958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556231793607361:5182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:31.992964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:31.995548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:31.997149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:31.997162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:31.997163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:31.997165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:31.997170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3657 [2:7556556231718018466:9452]
2025-10-02T09:37:31.997176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:31.997186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:31.997187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.997189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.997190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.997199Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:31.997203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:31.997207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:31.997237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.997244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.997245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.997246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:31.997248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:31.997291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:31.997298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:31.997306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:31.997319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:31.997335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:31.997353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793607399:5182], now have 1 active actors on pipe
2025-10-02T09:37:31.997359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556231793607148:2446], now have 1 active actors on pipe
2025-10-02T09:37:31.997363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:31.997364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:31.997365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:31.997373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:31.997383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:31.997386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:31.997388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:31.997390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:31.997390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:31.997386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3657
2025-10-02T09:37:31.997390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3657
2025-10-02T09:37:31.997391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:31.997406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:31.997411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:31.997412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:31.997438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.997449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.997471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|380332d1-44d56452-5d966c4e-494bd29b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:31.997481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:31.997488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:31.997490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:31.997496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:31.997506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:31.997519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.997661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:31.997667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:31.997677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:31.997749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3658 partition: 0 MaxSeqNo: 36 sessionId: src_id|380332d1-44d56452-5d966c4e-494bd29b_0
2025-10-02T09:37:31.997985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a6eeab-7b178a6e-8ba050df-d196fefe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|380332d1-44d56452-5d966c4e-494bd29b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.000708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Write session: try to update token
2025-10-02T09:37:32.000718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.006659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.006675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.006677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.006678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.006683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:32.006685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:32.006688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556231718018461:9452]
2025-10-02T09:37:32.006708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.006712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.006713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.006752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.006774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.006779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.006831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.012148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3658 sessionId: src_id|380332d1-44d56452-5d966c4e-494bd29b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.014574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.073533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088574706:9529]
2025-10-02T09:37:32.073757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3657, pipe: [1:7556556236088574706:9529]
2025-10-02T09:37:32.118764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.119096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.119105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.119119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088574706:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.119305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:32.119325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088574706:9529]
2025-10-02T09:37:32.119346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:32.119350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:32.119355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.119435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3658 reason: error at write: Disconnected sessionId: src_id|380332d1-44d56452-5d966c4e-494bd29b_0
2025-10-02T09:37:32.119595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3658 sessionId: src_id|380332d1-44d56452-5d966c4e-494bd29b_0 is DEAD
2025-10-02T09:37:32.119751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:32.119761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Write session will restart in 0.006160s
2025-10-02T09:37:32.119778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Write session: Do CDS request
2025-10-02T09:37:32.119782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.127206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.127395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.127407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3659
2025-10-02T09:37:32.127527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.127552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.127561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.127564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.127922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3659 sessionId:  describe result for acl check
2025-10-02T09:37:32.127952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.127957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.127959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.127963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.128408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.130711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.131526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.133163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.133283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.133290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.133296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.133323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.133349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012986014:9456]
2025-10-02T09:37:32.133425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.133434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.133436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088574802:5163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.133442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.133699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.133861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.133886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.134065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.134095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.134099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.134100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.134100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.134101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.134101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.134102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.134104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.134104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.134105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.134115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.134117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.134119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.134121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.134123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.134125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.134127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.134129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.134131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.134132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.134134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.134138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.134142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.134145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.134148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.134150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.134153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.134155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.134158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.134160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.134163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.134166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.134169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.134171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.134174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.134176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.134178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.134182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.134184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.134186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.134189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.134191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.134193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.134195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.134197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.134216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.141567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.143144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.143156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.143157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.143159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.143163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3658 [2:7556556236012986014:9456]
2025-10-02T09:37:32.143170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.143181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.143187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.143189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.143190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.143199Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.143202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.143211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.143259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.143264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.143266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.143268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.143269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.143309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.143314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.143321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.143326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.143335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.143349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088574955:5163], now have 1 active actors on pipe
2025-10-02T09:37:32.143355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088574707:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.143358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.143360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.143361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.143368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.143379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.143382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.143384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.143385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.143390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.143391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.143406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.143413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.143419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.143418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3658
2025-10-02T09:37:32.143423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3658
2025-10-02T09:37:32.143475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.143481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.143497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.143504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.143506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.143507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.143512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.143521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.143528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.143662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.143667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.143674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.143740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3659 partition: 0 MaxSeqNo: 36 sessionId: src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0
2025-10-02T09:37:32.143999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|380332d1-44d56452-5d966c4e-494bd29b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.146701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Write session: try to update token
2025-10-02T09:37:32.146713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.152627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.152641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.152642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.152644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.152649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.152654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.152656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012986009:9456]
2025-10-02T09:37:32.152677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.152685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.152686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.152689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.152694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.152697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.152823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.157986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3659 sessionId: src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.160408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.219464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088574967:9529]
2025-10-02T09:37:32.219692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3658, pipe: [1:7556556236088574967:9529]
2025-10-02T09:37:32.265216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.265595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.265605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.265617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088574967:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.265772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:32.265787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:32.265799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:32.265804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088574967:9529]
2025-10-02T09:37:32.265828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.265868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3659 reason: error at write: Disconnected sessionId: src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0
2025-10-02T09:37:32.266019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3659 sessionId: src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0 is DEAD
2025-10-02T09:37:32.266169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:32.266181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Write session will restart in 0.007099s
2025-10-02T09:37:32.266210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Write session: Do CDS request
2025-10-02T09:37:32.266215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.274101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.274206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.274215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3660
2025-10-02T09:37:32.274331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.274352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.274360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.274362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.274709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3660 sessionId:  describe result for acl check
2025-10-02T09:37:32.274738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.274743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.274744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.274749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.275199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.277180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.278572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.280138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.280242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.280249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.280254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.280285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.280314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012986268:9450]
2025-10-02T09:37:32.280363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.280375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.280378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088575064:5155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.280383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.280688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.280906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.280936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.281136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.281169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.281173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.281174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.281174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.281175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.281176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.281176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.281177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.281177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.281178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.281179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.281179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.281182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.281189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.281191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.281193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.281195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.281197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.281199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.281201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.281202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.281205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.281207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.281209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.281212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.281216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.281219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.281222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.281224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.281227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.281229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.281231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.281234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.281236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.281239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.281241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.281244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.281246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.281249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.281252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.281254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.281256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.281259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.281261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.281264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.281270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.281273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.281275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.281292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.288686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.290149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.290163Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.290164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.290166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.290169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3659 [2:7556556236012986268:9450]
2025-10-02T09:37:32.290176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.290186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.290191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.290192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.290194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.290202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.290208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.290214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.290257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.290262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.290264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.290267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.290269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.290409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3659
2025-10-02T09:37:32.290417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3659
2025-10-02T09:37:32.290442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.290449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.290456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.290462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.290472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.290488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088574968:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.290493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575217:5155], now have 1 active actors on pipe
2025-10-02T09:37:32.290505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.290510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.290521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.290527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.290528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.290539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.290553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.290558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.290560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.290561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.290564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.290566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.290576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.290583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.290585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.290590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.290596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.290603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.290628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.290638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.290648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.290649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.290781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.290791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.290803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.290877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3660 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0
2025-10-02T09:37:32.291099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3234ee58-d5f2594f-4ded510a-76efda9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.293876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Write session: try to update token
2025-10-02T09:37:32.293886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.299562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:32.299576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.299581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.299603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:32.299611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:32.299751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:32.299877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.299986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.300104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.300266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:32.300292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:32.305358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3660 sessionId: src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.307794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.308086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.308102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.308112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.308113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.308114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.308115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.308120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.308123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.308125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012986263:9450]
2025-10-02T09:37:32.308148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.308150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.308153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.308154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.308157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.308160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.308271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.365867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088575231:9529]
2025-10-02T09:37:32.366026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3659, pipe: [1:7556556236088575231:9529]
2025-10-02T09:37:32.419540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.419842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:32.419866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575231:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.419956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:32.420018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.420051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:32.420058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:32.420062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088575231:9529]
2025-10-02T09:37:32.420116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3660 reason: error at write: Disconnected sessionId: src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0
2025-10-02T09:37:32.420239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3660 sessionId: src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0 is DEAD
2025-10-02T09:37:32.420354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:32.420365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Write session will restart in 0.008962s
2025-10-02T09:37:32.420385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Write session: Do CDS request
2025-10-02T09:37:32.420393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.430201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.430344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.430356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3661
2025-10-02T09:37:32.430472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.430503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.430511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.430514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.430815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3661 sessionId:  describe result for acl check
2025-10-02T09:37:32.430839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.430844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.430846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.430850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.431139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.431926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.432664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.433558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.433678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.433685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.433691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.433720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.433747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012986535:9444]
2025-10-02T09:37:32.434133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.434327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.434329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.434336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.434338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088575452:5117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.434343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.434359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.434586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.434621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.434625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.434626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.434627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.434627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.434628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.434628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.434629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.434629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.434630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.434631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.434631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.434634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.434641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.434644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.434648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.434652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.434655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.434658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.434662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.434666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.434669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.434672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.434674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.434678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.434683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.434686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.434690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.434693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.434697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.434699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.434702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.434704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.434707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.434709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.434716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.434718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.434721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.434726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.434729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.434733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.434735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.434738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.434740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.434743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.434745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.434747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.434764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.442279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.443910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.443922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.443923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.443925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.443929Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3660 [2:7556556236012986535:9444]
2025-10-02T09:37:32.443939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.443954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.443955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.443957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.443958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.443967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.443973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.443978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.444012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.444018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.444018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.444020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.444022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.444063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.444068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.444075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.444080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.444093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.444107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575495:5117], now have 1 active actors on pipe
2025-10-02T09:37:32.444113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575232:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.444117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.444119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.444121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.444133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.444147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.444154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.444157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.444158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.444159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.444161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.444176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.444182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.444183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.444178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3660
2025-10-02T09:37:32.444186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3660
2025-10-02T09:37:32.444226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.444233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.444250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.444257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.444260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.444261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.444267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.444273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.444283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.444421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.444429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.444439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.444509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3661 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0
2025-10-02T09:37:32.444759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b769dd9-71fcade6-b56ca037-3ae1dc03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.447248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Write session: try to update token
2025-10-02T09:37:32.447262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.453267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:32.453280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.453283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.453304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:32.453308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:32.453452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:32.453571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.453691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.453808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:32.453973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:32.453997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:32.459389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3661 sessionId: src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.461644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.461757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.461772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.461773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.461775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.461779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.461782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.461787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012986530:9444]
2025-10-02T09:37:32.461809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.461818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.461820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.461821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.461824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.461833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.461840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.461841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.461964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.519971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088575505:9529]
2025-10-02T09:37:32.520181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3660, pipe: [1:7556556236088575505:9529]
2025-10-02T09:37:32.573739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.574237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575505:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.574392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:32.574427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:32.574432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.574439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:32.574478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088575505:9529]
2025-10-02T09:37:32.574513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3661 reason: error at write: Disconnected sessionId: src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0
2025-10-02T09:37:32.574674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3661 sessionId: src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0 is DEAD
2025-10-02T09:37:32.574819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:32.574830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Write session will restart in 0.006278s
2025-10-02T09:37:32.574850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Write session: Do CDS request
2025-10-02T09:37:32.574855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.582115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.582199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.582206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3662
2025-10-02T09:37:32.582282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.582302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.582309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.582311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.582637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3662 sessionId:  describe result for acl check
2025-10-02T09:37:32.582666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.582671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.582672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.582677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.583085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.584924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.587090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.588770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.588922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.588932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.588896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.588905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.588912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.588940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.588934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088575597:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.588962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012986817:9422]
2025-10-02T09:37:32.588939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.589337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.589519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.589555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.589757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.589794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.589799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.589800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.589801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.589802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.589803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.589804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.589804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.589805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.589806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.589807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.589807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.589810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.589817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.589819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.589821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.589823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.589825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.589827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.589828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.589830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.589832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.589834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.589836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.589840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.589844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.589847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.589850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.589852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.589855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.589857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.589859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.589861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.589864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.589866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.589869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.589871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.589874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.589876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.589879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.589881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.589883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.589885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.589888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.589890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.589893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.589895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.589899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.589915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.597382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.599103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.599116Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.599117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.599119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.599123Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3661 [2:7556556236012986817:9422]
2025-10-02T09:37:32.599132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.599142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.599147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.599149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.599150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.599160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.599163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.599167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.599198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.599203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.599204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.599206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.599207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.599261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.599268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.599279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.599289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.599299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.599313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575760:5104], now have 1 active actors on pipe
2025-10-02T09:37:32.599319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575506:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.599322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.599323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.599325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.599332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.599341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.599345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.599347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.599348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.599352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.599354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.599368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.599355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3661
2025-10-02T09:37:32.599380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3661
2025-10-02T09:37:32.599373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.599374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.599388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.599390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.599411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.599418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.599420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.599421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.599426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.599433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.599445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.599545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.599554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.599562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.599630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3662 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0
2025-10-02T09:37:32.599954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b0ac25-934d9c09-88fc3b12-72aa11a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.602348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Write session: try to update token
2025-10-02T09:37:32.602364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.608411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.608426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.608427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.608428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.608433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.608435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.608437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012986812:9422]
2025-10-02T09:37:32.608458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.608460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.608463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.608464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.608465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.608466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.608587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.614945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3662 sessionId: src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.617231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.674624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088575790:9529]
2025-10-02T09:37:32.674838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3661, pipe: [1:7556556236088575790:9529]
2025-10-02T09:37:32.719760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.720004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.720012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.720025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575790:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.720169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:32.720267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.720278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088575790:9529]
2025-10-02T09:37:32.720312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:32.720393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3662 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0
2025-10-02T09:37:32.720559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3662 sessionId: src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0 is DEAD
2025-10-02T09:37:32.720709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:32.720722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Write session will restart in 0.007932s
2025-10-02T09:37:32.720748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Write session: Do CDS request
2025-10-02T09:37:32.720754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.730239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.730968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.730979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3663
2025-10-02T09:37:32.731101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.731127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.731134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.731138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.731525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3663 sessionId:  describe result for acl check
2025-10-02T09:37:32.731555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.731559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.731561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.731565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.731983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.733840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.734787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.735024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.735178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.735186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.735194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.735245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.735271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012987079:9425]
2025-10-02T09:37:32.735633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.735796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.735821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.736016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.736052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.736046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.736056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.736055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.736057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.736057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088575974:5064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.736062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.736057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.736058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.736058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.736059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.736059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.736060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.736060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.736061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.736062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.736064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.736071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.736073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.736075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.736077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.736079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.736081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.736083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.736085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.736089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.736090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.736092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.736096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.736101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.736105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.736107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.736109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.736112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.736114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.736117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.736119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.736122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.736124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.736127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.736129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.736132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.736134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.736137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.736140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.736143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.736145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.736148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.736150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.736152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.736154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.736157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.736174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.743524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.745065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.745076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.745077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.745080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.745083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3662 [2:7556556236012987079:9425]
2025-10-02T09:37:32.745093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.745105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.745110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.745111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.745113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.745122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.745125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.745129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.745158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.745163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.745164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.745168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.745169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.745216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.745221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.745228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.745233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.745244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.745259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088576046:5064], now have 1 active actors on pipe
2025-10-02T09:37:32.745265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088575792:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.745268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.745270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.745271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.745278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.745288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.745291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.745293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.745294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.745299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.745301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.745314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.745322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.745312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3662
2025-10-02T09:37:32.745313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3662
2025-10-02T09:37:32.745328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.745341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.745347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.745366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.745373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.745375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.745376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.745381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.745388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.745396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.745511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.745516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.745524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.745592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3663 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0
2025-10-02T09:37:32.745852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e13a7d8-1e530961-db88890f-fb2caa1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.748295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Write session: try to update token
2025-10-02T09:37:32.748311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.754453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.754465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.754466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.754470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.754473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.754477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.754478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012987074:9425]
2025-10-02T09:37:32.754499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.754500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.754503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.754505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.754505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.754506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.754619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.760909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3663 sessionId: src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.763163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.820511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088576055:9529]
2025-10-02T09:37:32.820747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3662, pipe: [1:7556556236088576055:9529]
2025-10-02T09:37:32.866926Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:32.867274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.867283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.867298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088576055:9529], now have 1 active actors on pipe
2025-10-02T09:37:32.867480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:32.867491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088576055:9529]
2025-10-02T09:37:32.867492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:32.867522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:32.867559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3663 reason: error at write: Disconnected sessionId: src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0
2025-10-02T09:37:32.867549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:32.867725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3663 sessionId: src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0 is DEAD
2025-10-02T09:37:32.867863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:32.867876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Write session will restart in 0.008987s
2025-10-02T09:37:32.867897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Write session: Do CDS request
2025-10-02T09:37:32.867903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:32.878138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.878195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:32.878206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3664
2025-10-02T09:37:32.878294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:32.878318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:32.878326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:32.878329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:32.878705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3664 sessionId:  describe result for acl check
2025-10-02T09:37:32.878735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:32.878741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:32.878742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:32.878746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:32.879170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:32.880446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:32.880924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:32.882066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:32.882174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:32.882180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:32.882186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:32.882212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:32.882239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556236012987335:9421]
2025-10-02T09:37:32.882589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:32.882759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:32.882786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:32.882817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:32.882828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:32.882830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556236088576237:5053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:32.882834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:32.882998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:32.883032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.883036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.883037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.883037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.883038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.883038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.883039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.883040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.883040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.883041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.883041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.883042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.883045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.883052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.883054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.883056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.883058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.883060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.883062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.883064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.883066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.883069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.883071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.883073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.883077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.883081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:32.883084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.883088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:32.883090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.883093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:32.883095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.883097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:32.883100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.883102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:32.883104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.883107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:32.883110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.883113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:32.883115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.883118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:32.883124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.883127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:32.883129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.883131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.883137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.883140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.883143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.883147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.883165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:32.890660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:32.892287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:32.892300Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:32.892301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:32.892303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:32.892307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3663 [2:7556556236012987335:9421]
2025-10-02T09:37:32.892313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:32.892324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:32.892328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.892330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.892331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.892340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:32.892344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:32.892348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:32.892384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.892388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.892390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.892392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:32.892393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:32.892435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:32.892441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.892451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:32.892464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:32.892481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:32.892498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088576312:5053], now have 1 active actors on pipe
2025-10-02T09:37:32.892504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088576057:2446], now have 1 active actors on pipe
2025-10-02T09:37:32.892507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.892510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.892511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.892519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:32.892530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:32.892531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:32.892533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:32.892534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:32.892541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:32.892542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:32.892536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3663
2025-10-02T09:37:32.892558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.892538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3663
2025-10-02T09:37:32.892564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:32.892565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:32.892578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.892584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.892616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:32.892625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:32.892632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:32.892634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:32.892640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:32.892647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:32.892664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.892763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:32.892769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:32.892779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:32.892858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3664 partition: 0 MaxSeqNo: 36 sessionId: src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0
2025-10-02T09:37:32.893105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f86c0a3-ed2cf4fc-8663b8b9-2a5e44d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:32.895464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Write session: try to update token
2025-10-02T09:37:32.895478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:32.901637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:32.901648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:32.901650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:32.901651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:32.901654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.901656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.901658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556236012987330:9421]
2025-10-02T09:37:32.901678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:32.901679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:32.901683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:32.901684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:32.901684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:32.901685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:32.901793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:32.907619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3664 sessionId: src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:32.909841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:32.967481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556236088576328:9529]
2025-10-02T09:37:32.967632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3663, pipe: [1:7556556236088576328:9529]
2025-10-02T09:37:33.011833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.012191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.012203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.012218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556236088576328:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.012370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:33.012385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556236088576328:9529]
2025-10-02T09:37:33.012411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.012412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:33.012416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:33.012487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3664 reason: error at write: Disconnected sessionId: src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0
2025-10-02T09:37:33.012636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3664 sessionId: src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0 is DEAD
2025-10-02T09:37:33.012758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:33.012768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Write session will restart in 0.005000s
2025-10-02T09:37:33.012789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Write session: Do CDS request
2025-10-02T09:37:33.012794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.019112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.019243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.019253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3665
2025-10-02T09:37:33.019359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.019383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.019391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.019395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.019728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3665 sessionId:  describe result for acl check
2025-10-02T09:37:33.019753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.019758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.019760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.019763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.020196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.022294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.024107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.024117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.024122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383543696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.024128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.026050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.026280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.026397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.026404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.026412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.026447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.026543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307954889:9418]
2025-10-02T09:37:33.026892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.027049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.027072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.027265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.027295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.027299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.027299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.027300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.027300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.027301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.027301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.027302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.027302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.027303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.027303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.027304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.027307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.027314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.027316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.027319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.027322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.027325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.027329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.027332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.027335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.027338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.027341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.027343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.027348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.027354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.027359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.027367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.027370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.027375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.027382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.027388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.027391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.027397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.027399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.027402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.027404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.027407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.027411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.027415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.027417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.027420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.027424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.027426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.027428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.027434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.027436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.027438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.027454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.034800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.036251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.036264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.036265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.036267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.036270Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3664 [2:7556556240307954889:9418]
2025-10-02T09:37:33.036277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.036286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.036288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.036289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.036290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.036299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.036302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.036306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.036337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.036342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.036343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.036345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.036347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.036386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.036390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.036396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.036402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.036410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.036423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383543626:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.036429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383543877:5037], now have 1 active actors on pipe
2025-10-02T09:37:33.036432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.036434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.036435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.036443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.036453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.036455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.036457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.036459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.036463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.036464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.036478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.036484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.036489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.036515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3664
2025-10-02T09:37:33.036517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3664
2025-10-02T09:37:33.036556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.036561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.036576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.036583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.036585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.036588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.036593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.036602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.036608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.036738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.036743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.036750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.036831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3665 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0
2025-10-02T09:37:33.037109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524259b-27f7e9b9-23c2bdfd-fe39a810_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.039386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Write session: try to update token
2025-10-02T09:37:33.039399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.045499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.045513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.045514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.045515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.045520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.045523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.045524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307954883:9418]
2025-10-02T09:37:33.045543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.045546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.045546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.045547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.045549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.045550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.045657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.051164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3665 sessionId: src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.053551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.112368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383543893:9529]
2025-10-02T09:37:33.112547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3664, pipe: [1:7556556240383543893:9529]
2025-10-02T09:37:33.154805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.155125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.155138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.155152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383543893:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.155319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:33.155400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383543893:9529]
2025-10-02T09:37:33.155401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:33.155437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.155501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3665 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0
2025-10-02T09:37:33.155679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3665 sessionId: src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0 is DEAD
2025-10-02T09:37:33.155829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:33.155843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Write session will restart in 0.007349s
2025-10-02T09:37:33.155862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Write session: Do CDS request
2025-10-02T09:37:33.155867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.164212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.164232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.164242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3666
2025-10-02T09:37:33.164376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.164400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.164408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.164411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.164780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3666 sessionId:  describe result for acl check
2025-10-02T09:37:33.164819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.164823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.164824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.164828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.165249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.167436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.168852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.170343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.170447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.170453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.170459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.170485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.170509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307955147:9413]
2025-10-02T09:37:33.170600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.170609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.170612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383543993:5020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.170617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.170856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.171015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.171037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.171215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.171254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.171258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.171259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.171260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.171260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.171261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.171261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.171262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.171262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.171263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.171264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.171264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.171267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.171274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.171276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.171278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.171280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.171282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.171284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.171286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.171288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.171291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.171293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.171295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.171300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.171303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.171307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.171309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.171311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.171314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.171316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.171319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.171321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.171324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.171326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.171329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.171331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.171333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.171335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.171338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.171342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.171345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.171347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.171351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.171355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.171358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.171360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.171363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.171380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.180398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.180410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.180411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.180413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.180417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3665 [2:7556556240307955147:9413]
2025-10-02T09:37:33.180426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.180435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.180440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.180442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.180443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.180452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.180455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.180459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.180490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.180495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.180496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.180498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.180499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.180535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.180540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.180546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.180552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.180563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.180577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544149:5020], now have 1 active actors on pipe
2025-10-02T09:37:33.180582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383543894:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.180586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.180587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.180588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.180596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.180606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.180609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.180611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.180612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.180615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.180617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.180630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.180638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.180645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.180641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3665
2025-10-02T09:37:33.180649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3665
2025-10-02T09:37:33.180662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.180667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.180684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.180691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.180694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.180695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.180699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.180706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.180713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.180843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.180848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.180856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.180924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3666 partition: 0 MaxSeqNo: 36 sessionId: src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0
2025-10-02T09:37:33.181209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b8f02b-160984c3-20b66502-9d888fdf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.183458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Write session: try to update token
2025-10-02T09:37:33.183473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.189511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:33.189522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.189525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.189544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:33.189548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:33.189687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:33.189804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.189921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.190038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.190187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:33.190206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:33.195474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3666 sessionId: src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.197726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.197927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.197939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.197948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.197950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.197951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.197951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.197955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.197957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.197959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307955142:9413]
2025-10-02T09:37:33.197979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.197981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.197984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.197985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.197986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.197988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.198087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.255751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383544161:9529]
2025-10-02T09:37:33.256001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3665, pipe: [1:7556556240383544161:9529]
2025-10-02T09:37:33.309697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.309897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:33.309923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544161:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.310021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:33.310071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383544161:9529]
2025-10-02T09:37:33.310101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.310120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:33.310122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:33.310180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3666 reason: error at write: Disconnected sessionId: src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0
2025-10-02T09:37:33.310308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3666 sessionId: src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0 is DEAD
2025-10-02T09:37:33.310444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:33.310454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Write session will restart in 0.007582s
2025-10-02T09:37:33.310474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Write session: Do CDS request
2025-10-02T09:37:33.310483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.319175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.319263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.319272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3667
2025-10-02T09:37:33.319358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.319381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.319388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.319391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.319821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3667 sessionId:  describe result for acl check
2025-10-02T09:37:33.319851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.319858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.319860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.319864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.320285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.322058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.323686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.325331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.325448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.325455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.325461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.325486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.325493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.325503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.325505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383544269:5006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.325512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307955406:9409]
2025-10-02T09:37:33.325511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.325859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.326032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.326054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.326227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.326256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.326260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.326260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.326261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.326261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.326262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.326262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.326263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.326264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.326264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.326265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.326265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.326268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.326275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.326277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.326279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.326281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.326283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.326285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.326287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.326289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.326291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.326293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.326295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.326299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.326303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.326306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.326309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.326312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.326315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.326317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.326320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.326322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.326325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.326327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.326329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.326333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.326335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.326337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.326340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.326346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.326349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.326351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.326353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.326357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.326362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.326364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.326367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.326383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.333858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.335429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.335438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.335439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.335441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.335445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3666 [2:7556556240307955406:9409]
2025-10-02T09:37:33.335453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.335463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.335468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.335469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.335470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.335479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.335482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.335487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.335520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.335525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.335526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.335528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.335530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.335565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.335569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.335576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.335584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.335595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.335609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544418:5006], now have 1 active actors on pipe
2025-10-02T09:37:33.335614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544162:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.335618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.335619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.335621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.335629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.335639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.335643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.335645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.335646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.335650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.335652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.335665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.335667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.335668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.335660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3666
2025-10-02T09:37:33.335664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3666
2025-10-02T09:37:33.335705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.335711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.335727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.335734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.335736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.335737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.335742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.335749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.335756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.335879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.335884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.335891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.335960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3667 partition: 0 MaxSeqNo: 36 sessionId: src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0
2025-10-02T09:37:33.336221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377325bc-2e9aa74f-4403e853-54aacb5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.338474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Write session: try to update token
2025-10-02T09:37:33.338486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.344990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.345001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.345002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.345003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.345006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.345009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.345010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307955401:9409]
2025-10-02T09:37:33.345029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.345032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.345033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.345033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.345036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.345038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.345134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.349934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3667 sessionId: src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.352227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.410361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383544432:9529]
2025-10-02T09:37:33.410552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3666, pipe: [1:7556556240383544432:9529]
2025-10-02T09:37:33.456691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.457005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.457016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.457043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544432:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.457185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:33.457243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.457271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:33.457299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383544432:9529]
2025-10-02T09:37:33.457360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0
2025-10-02T09:37:33.457505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3667 sessionId: src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0 is DEAD
2025-10-02T09:37:33.457636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:33.457648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Write session will restart in 0.008042s
2025-10-02T09:37:33.457667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Write session: Do CDS request
2025-10-02T09:37:33.457673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.467219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.467273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.467286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3668
2025-10-02T09:37:33.467425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.467448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.467456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.467459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.467929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3668 sessionId:  describe result for acl check
2025-10-02T09:37:33.467962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.467967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.467969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.467973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.468393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.469601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.469633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.471130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.471267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.471274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.471280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.471318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.471343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307955680:9404]
2025-10-02T09:37:33.471690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.471706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.471709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383544622:5000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.471714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.471735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.471905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.471931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.472120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.472158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.472163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.472164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.472165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.472166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.472167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.472168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.472169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.472170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.472170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.472171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.472172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.472175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.472181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.472183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.472185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.472187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.472189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.472191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.472193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.472195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.472197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.472199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.472201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.472206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.472210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.472214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.472217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.472219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.472222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.472224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.472227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.472229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.472232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.472234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.472236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.472238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.472241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.472243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.472246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.472248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.472251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.472253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.472255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.472258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.472260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.472262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.472265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.472281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.479639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.481164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.481175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.481177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.481179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.481184Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3667 [2:7556556240307955680:9404]
2025-10-02T09:37:33.481191Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.481201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.481205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.481207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.481208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.481217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.481223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.481227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.481260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.481264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.481265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.481267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.481269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.481421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3667
2025-10-02T09:37:33.481425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3667
2025-10-02T09:37:33.481469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.481476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.481484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.481489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.481501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.481516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544445:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.481521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544702:5000], now have 1 active actors on pipe
2025-10-02T09:37:33.481534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.481541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.481556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.481562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.481564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.481575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.481587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.481591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.481593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.481594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.481604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.481608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.481621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.481628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.481630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.481631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.481636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.481643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.481662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.481669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.481676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.481677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.481781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.481786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.481794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.481863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3668 partition: 0 MaxSeqNo: 36 sessionId: src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0
2025-10-02T09:37:33.482111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e82c549-b5ca5295-8666a7b3-2385b4b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.485062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Write session: try to update token
2025-10-02T09:37:33.485072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.490833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:33.490844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.490849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.490872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:33.490872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:33.491006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:33.491121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.491258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.491374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.491548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:33.491573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:33.497227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3668 sessionId: src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.499502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.499513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.499514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.499516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.499520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.499523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.499525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307955675:9404]
2025-10-02T09:37:33.499545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.499549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.499549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.499550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.499552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.499554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.499675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.499721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.557318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383544714:9529]
2025-10-02T09:37:33.557525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3667, pipe: [1:7556556240383544714:9529]
2025-10-02T09:37:33.611941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.612153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.612161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.612173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544714:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.612278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:33.612319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383544714:9529]
2025-10-02T09:37:33.612339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.612349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:33.612422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0
2025-10-02T09:37:33.612580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3668 sessionId: src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0 is DEAD
2025-10-02T09:37:33.612715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:33.612725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Write session will restart in 0.008145s
2025-10-02T09:37:33.612745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Write session: Do CDS request
2025-10-02T09:37:33.612749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.622224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.622353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.622368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3669
2025-10-02T09:37:33.622481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.622504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.622512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.622516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.622857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3669 sessionId:  describe result for acl check
2025-10-02T09:37:33.622896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.622898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.622900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.622907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.623342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.624915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.625622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.627482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.627509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.627519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.627521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383544880:4978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.627527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.627601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.627608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.627614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.627642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.627767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307955970:9388]
2025-10-02T09:37:33.628143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.628378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.628408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.628599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.628630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.628634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.628635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.628635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.628636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.628637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.628637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.628638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.628638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.628639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.628639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.628639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.628642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.628648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.628650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.628652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.628654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.628657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.628659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.628660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.628663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.628665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.628667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.628669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.628673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.628677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.628680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.628684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.628686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.628689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.628691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.628693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.628696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.628702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.628705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.628708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.628713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.628716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.628719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.628721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.628723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.628726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.628728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.628731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.628736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.628742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.628744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.628747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.628766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.636300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.637973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.637981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.637982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.637984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.637988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3668 [2:7556556240307955970:9388]
2025-10-02T09:37:33.637996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.638005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.638010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.638011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.638012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.638020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.638024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.638027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.638058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.638063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.638064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.638065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.638067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.638108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.638114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.638123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.638137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.638154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.638173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544718:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.638180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383544984:4978], now have 1 active actors on pipe
2025-10-02T09:37:33.638183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.638184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.638185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.638193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.638203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.638206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.638208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.638209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.638214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.638215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.638227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.638236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.638225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3668
2025-10-02T09:37:33.638236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.638262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3668
2025-10-02T09:37:33.638281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.638288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.638304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.638313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.638319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.638321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.638327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.638338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.638351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.638464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.638470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.638480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.638546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3669 partition: 0 MaxSeqNo: 36 sessionId: src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0
2025-10-02T09:37:33.638838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d199b7b5-bc8d712c-fa1dae29-c5948711_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.641758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Write session: try to update token
2025-10-02T09:37:33.641769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.647245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:33.647256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.647260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.647282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:33.647283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:33.647426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:33.647547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.647672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.647791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.647971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:33.647995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:33.653444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3669 sessionId: src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.655501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.655641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.655652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.655663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.655664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.655665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.655666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.655670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.655672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.655674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307955965:9388]
2025-10-02T09:37:33.655698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.655699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.655704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.655705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.655706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.655707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.655826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.712428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383545006:9529]
2025-10-02T09:37:33.712648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3668, pipe: [1:7556556240383545006:9529]
2025-10-02T09:37:33.769405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.769636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:33.769659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545006:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.769768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:33.769826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383545006:9529]
2025-10-02T09:37:33.769838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:33.769840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:33.769864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.769890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3669 reason: error at write: Disconnected sessionId: src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0
2025-10-02T09:37:33.769988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3669 sessionId: src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0 is DEAD
2025-10-02T09:37:33.770109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:33.770118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Write session will restart in 0.006874s
2025-10-02T09:37:33.770133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Write session: Do CDS request
2025-10-02T09:37:33.770137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.778130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.778245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.778254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3670
2025-10-02T09:37:33.778387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.778406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.778413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.778415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.778805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3670 sessionId:  describe result for acl check
2025-10-02T09:37:33.778842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.778846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.778848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.778852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.779292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.781482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.783098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.784629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.784733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.784739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.784746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.784772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.784796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307956239:9379]
2025-10-02T09:37:33.784780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.784791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.784794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383545095:4940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.784826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.785174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.785348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.785372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.785549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.785582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.785587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.785588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.785589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.785590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.785591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.785592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.785593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.785594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.785595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.785596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.785597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.785601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.785609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.785611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.785613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.785615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.785617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.785620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.785622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.785623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.785626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.785628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.785630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.785633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.785638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.785642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.785649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.785651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.785654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.785659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.785662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.785664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.785670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.785672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.785675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.785677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.785680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.785685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.785688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.785690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.785696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.785699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.785701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.785704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.785707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.785712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.785715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.785731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.793085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.794711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.794722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.794723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.794725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.794728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3669 [2:7556556240307956239:9379]
2025-10-02T09:37:33.794739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.794748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.794753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.794754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.794755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.794765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.794767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.794771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.794812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.794818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.794820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.794822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.794824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.794863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.794867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.794874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.794879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.794890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.794904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545007:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.794909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545267:4940], now have 1 active actors on pipe
2025-10-02T09:37:33.794912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.794916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.794918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.794925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.794935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.794936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.794938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.794939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.794945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.794947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.794961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.794966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.794967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.794942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3669
2025-10-02T09:37:33.794981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3669
2025-10-02T09:37:33.795026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.795031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.795044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b903f774-830b68b2-fde503e3-1e313d6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.795054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.795060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.795062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.795069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.795082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.795093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.795202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.795206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.795214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.795276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3670 partition: 0 MaxSeqNo: 36 sessionId: src_id|b903f774-830b68b2-fde503e3-1e313d6c_0
2025-10-02T09:37:33.795467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288eacb7-36a0ca07-dc268e5f-d0bf4317_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b903f774-830b68b2-fde503e3-1e313d6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.798359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Write session: try to update token
2025-10-02T09:37:33.798371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.804162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:33.804176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.804183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.804213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:33.804216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:33.804420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:33.804592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.804762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.804949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:33.805175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:33.805215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:33.810680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3670 sessionId: src_id|b903f774-830b68b2-fde503e3-1e313d6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.812565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.812583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.812584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.812585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.812590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.812593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.812595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307956234:9379]
2025-10-02T09:37:33.812618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.812622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.812623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.812623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.812627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.812630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.812707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:33.812738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.870108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556240383545279:9529]
2025-10-02T09:37:33.870250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3669, pipe: [1:7556556240383545279:9529]
2025-10-02T09:37:33.923554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:33.924040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.924049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.924064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545279:9529], now have 1 active actors on pipe
2025-10-02T09:37:33.924247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:33.924283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:33.924260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:33.924303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3670 reason: error at write: Disconnected sessionId: src_id|b903f774-830b68b2-fde503e3-1e313d6c_0
2025-10-02T09:37:33.924310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556240383545279:9529]
2025-10-02T09:37:33.924333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:33.924452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3670 sessionId: src_id|b903f774-830b68b2-fde503e3-1e313d6c_0 is DEAD
2025-10-02T09:37:33.924591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:33.924601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Write session will restart in 0.006567s
2025-10-02T09:37:33.924621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Write session: Do CDS request
2025-10-02T09:37:33.924625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:33.932127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.932205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:33.932215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3671
2025-10-02T09:37:33.932385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:33.932407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:33.932412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:33.932414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:33.932840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3671 sessionId:  describe result for acl check
2025-10-02T09:37:33.932876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:33.932881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:33.932882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:33.932886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:33.933323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:33.935484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:33.936496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:33.938162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:33.938261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:33.938268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:33.938274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:33.938303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:33.938325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556240307956501:9377]
2025-10-02T09:37:33.938389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:33.938399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:33.938401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556240383545381:4931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:33.938406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:33.938667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:33.938834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:33.938856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:33.939140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:33.939179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.939183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.939184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.939184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.939185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.939185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.939186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.939186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.939187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.939187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.939188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.939188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.939191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.939198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.939200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.939202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.939204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.939206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.939207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.939209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.939211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.939214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.939216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.939218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.939223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.939227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:33.939231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.939244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:33.939247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.939249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:33.939251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.939254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:33.939256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.939259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:33.939261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.939264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:33.939266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.939269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:33.939271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.939273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:33.939275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.939278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:33.939280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.939283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.939285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.939288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.939290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.939293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.939309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:33.946584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:33.948045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:33.948057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:33.948058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:33.948060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:33.948064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3670 [2:7556556240307956501:9377]
2025-10-02T09:37:33.948071Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:33.948080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:33.948085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.948086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.948088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.948096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:33.948103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:33.948107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:33.948137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.948141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.948142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.948144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:33.948146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:33.948182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:33.948187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.948193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:33.948198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:33.948208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:33.948223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545538:4931], now have 1 active actors on pipe
2025-10-02T09:37:33.948228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556240383545280:2446], now have 1 active actors on pipe
2025-10-02T09:37:33.948231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.948232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.948234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.948241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:33.948249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:33.948254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:33.948256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:33.948257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:33.948259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:33.948261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:33.948274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.948278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:33.948271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3670
2025-10-02T09:37:33.948293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:33.948278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3670
2025-10-02T09:37:33.948297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.948299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.948316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|928c553b-4b5c666e-b299f0b-774c343e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:33.948322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:33.948324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:33.948325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:33.948329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:33.948339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:33.948347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.948441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:33.948447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:33.948456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:33.948512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3671 partition: 0 MaxSeqNo: 36 sessionId: src_id|928c553b-4b5c666e-b299f0b-774c343e_0
2025-10-02T09:37:33.948707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b903f774-830b68b2-fde503e3-1e313d6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|928c553b-4b5c666e-b299f0b-774c343e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:33.951527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Write session: try to update token
2025-10-02T09:37:33.951540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:33.957933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:33.957950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:33.957952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:33.957954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:33.957961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.957965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.957969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556240307956496:9377]
2025-10-02T09:37:33.958000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:33.958004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:33.958008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:33.958009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:33.958010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:33.958011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:33.958172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:33.964276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3671 sessionId: src_id|928c553b-4b5c666e-b299f0b-774c343e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:33.966349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.024218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678512854:9529]
2025-10-02T09:37:34.024385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3670, pipe: [1:7556556244678512854:9529]
2025-10-02T09:37:34.069489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.069963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.069972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.069984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678512854:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.070147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.070149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.070193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678512854:9529]
2025-10-02T09:37:34.070194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.070198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.070277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3671 reason: error at write: Disconnected sessionId: src_id|928c553b-4b5c666e-b299f0b-774c343e_0
2025-10-02T09:37:34.070430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3671 sessionId: src_id|928c553b-4b5c666e-b299f0b-774c343e_0 is DEAD
2025-10-02T09:37:34.070557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.070569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Write session will restart in 0.008603s
2025-10-02T09:37:34.070588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Write session: Do CDS request
2025-10-02T09:37:34.070592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.080170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.080283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.080292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3672
2025-10-02T09:37:34.080413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.080435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.080441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.080443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.080744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3672 sessionId:  describe result for acl check
2025-10-02T09:37:34.080766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.080772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.080774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.080777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.081153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.083316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.085633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.085641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.085644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678512956:4915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.085650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.085948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.088395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.088501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.088507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.088513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.088541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.088563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602924062:9365]
2025-10-02T09:37:34.088916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.089105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.089127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.089305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.089335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.089339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.089340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.089340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.089341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.089342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.089342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.089343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.089343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.089344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.089344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.089345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.089347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.089354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.089356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.089358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.089360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.089362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.089364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.089366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.089368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.089370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.089372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.089374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.089378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.089382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.089385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.089388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.089391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.089393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.089395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.089398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.089400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.089404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.089406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.089408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.089410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.089413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.089415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.089417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.089420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.089422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.089424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.089427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.089429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.089432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.089436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.089438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.089456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.096834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.098215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.098226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.098227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.098229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.098232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3671 [2:7556556244602924062:9365]
2025-10-02T09:37:34.098239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.098249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.098254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.098256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.098257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.098266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.098270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.098275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.098315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.098319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.098321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.098322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.098324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.098401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.098405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.098412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.098417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.098429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.098444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513116:4915], now have 1 active actors on pipe
2025-10-02T09:37:34.098449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678512858:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.098453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.098454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.098455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.098465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.098478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.098479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.098481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.098482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.098487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.098489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.098461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3671
2025-10-02T09:37:34.098488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3671
2025-10-02T09:37:34.098512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.098517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.098525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.098533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.098536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.098549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.098556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.098558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.098559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.098564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.098572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.098585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.098706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.098711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.098718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.098781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3672 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0
2025-10-02T09:37:34.098992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928c553b-4b5c666e-b299f0b-774c343e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.101779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Write session: try to update token
2025-10-02T09:37:34.101789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.108406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.108424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.108427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.108429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.108438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.108443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.108447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602924057:9365]
2025-10-02T09:37:34.108474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.108481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.108482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.108484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.108486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.108488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.108649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.114427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3672 sessionId: src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.116602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.170150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678513129:9529]
2025-10-02T09:37:34.170369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3671, pipe: [1:7556556244678513129:9529]
2025-10-02T09:37:34.219120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.219656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.219667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.219679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513129:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.219858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.219868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.219915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3672 reason: error at write: Disconnected sessionId: src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0
2025-10-02T09:37:34.219938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678513129:9529]
2025-10-02T09:37:34.219972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.220053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3672 sessionId: src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0 is DEAD
2025-10-02T09:37:34.220101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.220175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.220185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Write session will restart in 0.005493s
2025-10-02T09:37:34.220204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Write session: Do CDS request
2025-10-02T09:37:34.220209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.227100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.227203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.227213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3673
2025-10-02T09:37:34.227301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.227323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.227331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.227334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.227718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3673 sessionId:  describe result for acl check
2025-10-02T09:37:34.227754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.227759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.227761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.227765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.228114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.230955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.233582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.233591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.233593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678513162:4914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.233598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.236780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.238523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.238626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.238633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.238638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.238664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.238689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602924329:9358]
2025-10-02T09:37:34.239033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.239226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.239263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.239456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.239496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.239500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.239500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.239501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.239501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.239502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.239502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.239503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.239503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.239504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.239504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.239505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.239508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.239514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.239516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.239518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.239520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.239522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.239524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.239526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.239528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.239530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.239532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.239534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.239538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.239542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.239545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.239548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.239550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.239553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.239555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.239558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.239560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.239562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.239564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.239566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.239569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.239571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.239573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.239576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.239578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.239581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.239587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.239590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.239592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.239595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.239597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.239599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.239617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.247014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.248529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.248541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.248542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.248544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.248547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3672 [2:7556556244602924329:9358]
2025-10-02T09:37:34.248555Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.248564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.248570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.248571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.248572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.248582Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.248585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.248589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.248624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.248629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.248630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.248632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.248634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.248671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.248676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.248682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.248689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.248704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.248722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513311:4914], now have 1 active actors on pipe
2025-10-02T09:37:34.248729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513131:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.248734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.248738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.248740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.248750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.248764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.248765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.248770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.248771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.248776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.248778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.248795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.248818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.248827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.248825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3672
2025-10-02T09:37:34.248827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3672
2025-10-02T09:37:34.248865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.248872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.248892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.248902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.248904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.248906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.248913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.248921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.248934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.249039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.249046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.249055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.249111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3673 partition: 0 MaxSeqNo: 36 sessionId: src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0
2025-10-02T09:37:34.249319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98645b-223f6877-afa8adcd-c45ec3a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.251987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Write session: try to update token
2025-10-02T09:37:34.251997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.257999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.258012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.258013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.258014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.258019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.258022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.258024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602924324:9358]
2025-10-02T09:37:34.258048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.258051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.258053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.258061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.258065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.258068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.258175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.263285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3673 sessionId: src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.266271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.320179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678513404:9529]
2025-10-02T09:37:34.320423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3672, pipe: [1:7556556244678513404:9529]
2025-10-02T09:37:34.370164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.370366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.370375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.370388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513404:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.370542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678513404:9529]
2025-10-02T09:37:34.370561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.370540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.370586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.370600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.370674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3673 reason: error at write: Disconnected sessionId: src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0
2025-10-02T09:37:34.370846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3673 sessionId: src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0 is DEAD
2025-10-02T09:37:34.370969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.370973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Write session will restart in 0.006796s
2025-10-02T09:37:34.370987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Write session: Do CDS request
2025-10-02T09:37:34.370991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.379118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.379221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.379229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3674
2025-10-02T09:37:34.379314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.379335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.379341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.379344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.379767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3674 sessionId:  describe result for acl check
2025-10-02T09:37:34.379808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.379815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.379816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.379821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.380272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.382760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.384278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.385970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.386109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.386118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.386127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.386170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.386159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.386200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602924606:9350]
2025-10-02T09:37:34.386176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.386179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678513510:4861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.386184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.386618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.386836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.386865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.387069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.387104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.387109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.387109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.387110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.387111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.387111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.387112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.387112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.387113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.387114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.387114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.387115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.387118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.387125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.387128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.387131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.387133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.387135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.387138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.387140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.387145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.387148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.387150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.387154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.387159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.387163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.387166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.387169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.387172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.387175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.387178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.387180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.387183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.387186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.387188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.387191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.387194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.387197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.387200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.387203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.387206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.387209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.387212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.387214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.387217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.387220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.387223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.387263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.395759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.397338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.397351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.397352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.397354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.397358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3673 [2:7556556244602924606:9350]
2025-10-02T09:37:34.397366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.397377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.397378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.397380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.397381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.397391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.397398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.397404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.397437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.397442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.397444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.397446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.397447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.397487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.397492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.397499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.397508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.397528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.397548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513671:4861], now have 1 active actors on pipe
2025-10-02T09:37:34.397556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513408:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.397561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.397567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.397569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.397581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.397592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.397594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.397596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.397598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.397609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.397614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.397631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.397638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.397639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.397618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3673
2025-10-02T09:37:34.397651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.397657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.397651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3673
2025-10-02T09:37:34.397689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.397697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.397700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.397701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.397706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.397714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.397731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.397835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.397842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.397854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.397928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3674 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0
2025-10-02T09:37:34.398175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19570f9-1c81317e-7f840bde-cbd07ff2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.401143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Write session: try to update token
2025-10-02T09:37:34.401154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.407345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.407357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.407358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.407359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.407363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.407366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.407369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602924601:9350]
2025-10-02T09:37:34.407391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.407393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.407394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.407395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.407395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.407397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.407508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.413209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3674 sessionId: src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.415318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.470715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678513694:9529]
2025-10-02T09:37:34.470894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3673, pipe: [1:7556556244678513694:9529]
2025-10-02T09:37:34.522844Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.523429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.523440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.523453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513694:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.523597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.523640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.523649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.523695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3674 reason: error at write: Disconnected sessionId: src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0
2025-10-02T09:37:34.523697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.523742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678513694:9529]
2025-10-02T09:37:34.523837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3674 sessionId: src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0 is DEAD
2025-10-02T09:37:34.523999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.524007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Write session will restart in 0.006562s
2025-10-02T09:37:34.524027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Write session: Do CDS request
2025-10-02T09:37:34.524031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.531136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.531213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.531222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3675
2025-10-02T09:37:34.531305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.531326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.531332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.531335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.531718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3675 sessionId:  describe result for acl check
2025-10-02T09:37:34.531758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.531766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.531767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.531771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.532194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.534720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.536602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.536611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.536614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678513766:4833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.536619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.536909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.538591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.538706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.538713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.538718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.538745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.538768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602924876:9346]
2025-10-02T09:37:34.539126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.539319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.539353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.539539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.539572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.539576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.539577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.539577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.539578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.539578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.539579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.539579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.539580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.539580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.539581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.539582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.539585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.539591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.539593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.539595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.539597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.539599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.539601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.539603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.539605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.539608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.539609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.539611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.539615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.539619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.539623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.539626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.539629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.539632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.539634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.539637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.539639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.539642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.539644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.539647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.539649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.539653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.539655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.539659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.539662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.539664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.539666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.539669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.539673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.539676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.539677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.539680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.539698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.547318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.548891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.548901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.548902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.548904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.548907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3674 [2:7556556244602924876:9346]
2025-10-02T09:37:34.548915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.548926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.548931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.548934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.548934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.548944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.548948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.548953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.548990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.548995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.548995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.548998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.548999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.549047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.549054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.549063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.549073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.549090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.549111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513696:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.549113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513959:4833], now have 1 active actors on pipe
2025-10-02T09:37:34.549117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.549118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.549119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.549125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.549135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.549137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.549110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3674
2025-10-02T09:37:34.549139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.549140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.549146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.549148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.549161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3674
2025-10-02T09:37:34.549172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.549179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.549180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.549196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.549204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.549392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.549402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.549404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.549405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.549411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.549417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.549436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.549558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.549565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.549576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.549627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3675 partition: 0 MaxSeqNo: 36 sessionId: src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0
2025-10-02T09:37:34.549871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6e2c3-be222441-8cc5fe4b-1aef76_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.552748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Write session: try to update token
2025-10-02T09:37:34.552759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.558660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.558676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.558678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.558679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.558685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.558687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.558689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602924871:9346]
2025-10-02T09:37:34.558714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.558718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.558719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.558726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.558730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.558732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.558842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.565237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3675 sessionId: src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.567304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.624001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678513971:9529]
2025-10-02T09:37:34.624171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3674, pipe: [1:7556556244678513971:9529]
2025-10-02T09:37:34.672644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.672967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.672975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.672988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513971:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.673167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.673207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.673220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.673293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3675 reason: error at write: Disconnected sessionId: src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0
2025-10-02T09:37:34.673454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3675 sessionId: src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0 is DEAD
2025-10-02T09:37:34.673583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.673595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Write session will restart in 0.005276s
2025-10-02T09:37:34.673609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Write session: Do CDS request
2025-10-02T09:37:34.673613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.673641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.673686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678513971:9529]
2025-10-02T09:37:34.680148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.680222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.680234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3676
2025-10-02T09:37:34.680352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.680373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.680380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.680383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.680665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3676 sessionId:  describe result for acl check
2025-10-02T09:37:34.680687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.680693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.680694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.680697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.681012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.683038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.685451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.685462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.685465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678514054:4824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.685470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.686152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.687722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.687820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.687826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.687832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.687858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.687881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602925179:9324]
2025-10-02T09:37:34.688232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.688398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.688419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.688592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.688620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.688624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.688626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.688626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.688627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.688627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.688628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.688628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.688629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.688629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.688632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.688638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.688641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.688643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.688645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.688647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.688649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.688650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.688652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.688654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.688656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.688658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.688661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.688665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.688669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.688672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.688674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.688676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.688678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.688681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.688683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.688686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.688688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.688691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.688693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.688696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.688698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.688700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.688702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.688705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.688707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.688710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.688712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.688714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.688716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.688718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.696023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.697629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.697639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.697640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.697642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.697646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3675 [2:7556556244602925179:9324]
2025-10-02T09:37:34.697652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.697662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.697665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.697666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.697667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.697676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.697682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.697686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.697714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.697719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.697720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.697722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.697723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.697758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.697764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.697771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.697776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.697784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.697795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514256:4824], now have 1 active actors on pipe
2025-10-02T09:37:34.697798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678513985:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.697802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.697804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.697805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.697812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.697822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.697824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.697827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.697828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.697833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.697834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.697848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.697853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.697854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.697825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3675
2025-10-02T09:37:34.697863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.697868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.697856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3675
2025-10-02T09:37:34.697891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.697899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.697901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.697902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.697906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.697911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.697920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.698003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.698012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.698027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.698089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3676 partition: 0 MaxSeqNo: 36 sessionId: src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0
2025-10-02T09:37:34.698304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dacdd6a-6628a869-e9411719-3c3ce789_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.701022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Write session: try to update token
2025-10-02T09:37:34.701032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.707048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.707061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.707062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.707064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.707068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.707071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.707073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602925174:9324]
2025-10-02T09:37:34.707094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.707097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.707098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.707100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.707100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.707102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.707212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.712449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3676 sessionId: src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.714916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.773802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678514270:9529]
2025-10-02T09:37:34.773978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3675, pipe: [1:7556556244678514270:9529]
2025-10-02T09:37:34.824212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.824451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.824460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.824473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514270:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.824644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:34.824657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:34.824716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678514270:9529]
2025-10-02T09:37:34.824741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3676 reason: error at write: Disconnected sessionId: src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0
2025-10-02T09:37:34.824747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.824822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.824896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3676 sessionId: src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0 is DEAD
2025-10-02T09:37:34.825035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:34.825046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Write session will restart in 0.005409s
2025-10-02T09:37:34.825064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Write session: Do CDS request
2025-10-02T09:37:34.825069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.831110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.831188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.831198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3677
2025-10-02T09:37:34.831280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.831300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.831303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.831311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.831700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3677 sessionId:  describe result for acl check
2025-10-02T09:37:34.831737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.831742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.831744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.831748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.832188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.834339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.836975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.836985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.836987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678514310:4803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.836993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.838089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.839725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.839823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.839830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.839836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.839861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.839882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602925448:9317]
2025-10-02T09:37:34.840232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.840401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.840424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.840598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.840628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.840631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.840632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.840633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.840633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.840634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.840634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.840635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.840635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.840636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.840636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.840636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.840639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.840646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.840648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.840650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.840652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.840654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.840656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.840658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.840660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.840662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.840664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.840666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.840670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.840674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.840677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.840680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.840682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.840685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.840687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.840690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.840692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.840695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.840698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.840701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.840703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.840706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.840708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.840711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.840713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.840716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.840718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.840721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.840724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.840730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.840733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.840735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.840754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.848508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.849993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.850004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.850005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.850008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.850012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3676 [2:7556556244602925448:9317]
2025-10-02T09:37:34.850022Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.850034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.850035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.850037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.850038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.850048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.850051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.850055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.850302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.850310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.850311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.850313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.850315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.850357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.850362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.850370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.850376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.850387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.850404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514271:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.850409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514530:4803], now have 1 active actors on pipe
2025-10-02T09:37:34.850413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.850414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.850415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.850423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.850435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.850435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.850437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.850438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.850445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.850447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.850467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.850434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3676
2025-10-02T09:37:34.850473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.850459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3676
2025-10-02T09:37:34.850474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.850486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.850488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.850507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.850515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.850517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.850520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.850525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.850531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.850543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.850633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.850638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.850652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.850708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3677 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0
2025-10-02T09:37:34.850961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49aec7c-ab8a4cf6-472c3038-968fbaa0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.853816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Write session: try to update token
2025-10-02T09:37:34.853828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:34.860002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:34.860015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:34.860017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:34.860018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:34.860023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.860026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.860028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602925443:9317]
2025-10-02T09:37:34.860051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:34.860052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:34.860055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:34.860057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:34.860062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.860063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:34.860187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:34.866224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3677 sessionId: src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:34.868297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:34.924842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556244678514549:9529]
2025-10-02T09:37:34.925030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3676, pipe: [1:7556556244678514549:9529]
2025-10-02T09:37:34.971272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:34.971491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.971500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.971512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514549:9529], now have 1 active actors on pipe
2025-10-02T09:37:34.971638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:34.971682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556244678514549:9529]
2025-10-02T09:37:34.971707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:34.971760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:34.971853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3677 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0
2025-10-02T09:37:34.972032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3677 sessionId: src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0 is DEAD
2025-10-02T09:37:34.972170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:34.972181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Write session will restart in 0.008647s
2025-10-02T09:37:34.972198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Write session: Do CDS request
2025-10-02T09:37:34.972203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:34.982143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.982213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:34.982223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3678
2025-10-02T09:37:34.982311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:34.982334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:34.982341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:34.982344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:34.982708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3678 sessionId:  describe result for acl check
2025-10-02T09:37:34.982746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:34.982751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:34.982753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:34.982759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:34.983269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:34.984629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:34.984710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:34.986379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:34.986491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:34.986498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:34.986504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:34.986530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:34.986555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556244602925718:9315]
2025-10-02T09:37:34.986749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:34.986762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:34.986765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556244678514729:4785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:34.986770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:34.987019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:34.987181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:34.987203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:34.987395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:34.987426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.987430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.987431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.987431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.987432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.987433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.987433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.987433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.987434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.987434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.987435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.987436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.987439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.987445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.987447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.987449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.987451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.987453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.987455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.987457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.987459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.987461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.987463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.987464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.987468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.987472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:34.987475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.987479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:34.987481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.987485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:34.987487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.987489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:34.987492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.987494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:34.987496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.987498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:34.987500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.987503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:34.987505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.987507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:34.987509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.987512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:34.987514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.987516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.987519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.987521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.987523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.987526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.987544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:34.994921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:34.996332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:34.996342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:34.996343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:34.996346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:34.996349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3677 [2:7556556244602925718:9315]
2025-10-02T09:37:34.996356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:34.996366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:34.996371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.996372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.996373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.996383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:34.996385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:34.996393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:34.996426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.996430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.996431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.996433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:34.996435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:34.996472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:34.996476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:34.996483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:34.996488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:34.996500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:34.996515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514821:4785], now have 1 active actors on pipe
2025-10-02T09:37:34.996521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556244678514555:2446], now have 1 active actors on pipe
2025-10-02T09:37:34.996525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:34.996529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:34.996530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:34.996537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:34.996547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:34.996541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3677
2025-10-02T09:37:34.996568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3677
2025-10-02T09:37:34.996557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:34.996559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:34.996561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:34.996562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:34.996562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:34.996586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.996590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.996597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:34.996605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:34.996617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:34.996623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:34.996627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:34.996630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:34.996631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:34.996636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:34.996644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:34.996828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.996944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:34.996950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:34.996957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:34.997013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3678 partition: 0 MaxSeqNo: 36 sessionId: src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0
2025-10-02T09:37:34.997205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46f72a-f00f78d1-25b604c2-ad55f8c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:34.999907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Write session: try to update token
2025-10-02T09:37:34.999916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.005849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.005862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.005863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.005864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.005869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:35.005872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:35.005874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556244602925712:9315]
2025-10-02T09:37:35.005895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.005896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.005898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.005899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.005899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.005903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.006045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.011548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3678 sessionId: src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.013584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.071796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973482132:9529]
2025-10-02T09:37:35.071974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3677, pipe: [1:7556556248973482132:9529]
2025-10-02T09:37:35.117372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.117764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.117773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.117785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482132:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.117913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.117935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973482132:9529]
2025-10-02T09:37:35.117962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:35.117978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.118015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3678 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0
2025-10-02T09:37:35.118150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3678 sessionId: src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0 is DEAD
2025-10-02T09:37:35.118272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:35.118280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Write session will restart in 0.009879s
2025-10-02T09:37:35.118298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Write session: Do CDS request
2025-10-02T09:37:35.118302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.129140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.129294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.129304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3679
2025-10-02T09:37:35.129374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.129396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.129399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.129401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.129776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3679 sessionId:  describe result for acl check
2025-10-02T09:37:35.129815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.129820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.129822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.129826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.130276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.131058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.131790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.132695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.132855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.132863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.132870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.132903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.132929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897893285:9314]
2025-10-02T09:37:35.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.133451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.133474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.133586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.133597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.133599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973482360:4781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.133604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.133656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.133684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.133688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.133689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.133689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.133690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.133690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.133691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.133691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.133692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.133693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.133693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.133694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.133696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.133703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.133705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.133707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.133709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.133711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.133713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.133715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.133717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.133719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.133721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.133723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.133727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.133730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.133734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.133737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.133739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.133742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.133745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.133748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.133750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.133753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.133755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.133758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.133760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.133763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.133765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.133768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.133772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.133775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.133777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.133782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.133784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.133787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.133792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.133796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.133813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.141348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.142938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.142948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.142950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.142952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.142955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3678 [2:7556556248897893285:9314]
2025-10-02T09:37:35.142965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.142975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.142979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.142981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.142982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.142992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.142998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.143002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.143034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.143039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.143040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.143042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.143043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.143080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.143085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.143091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.143096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.143108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.143122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482403:4781], now have 1 active actors on pipe
2025-10-02T09:37:35.143127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482133:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.143131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.143132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.143133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.143141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.143152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.143154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.143158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.143159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.143163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.143164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.143181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.143185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.143166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3678
2025-10-02T09:37:35.143195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.143186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3678
2025-10-02T09:37:35.143217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.143222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.143249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.143256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.143258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.143260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.143265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.143272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.143279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.143382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.143389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.143414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.143481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3679 partition: 0 MaxSeqNo: 36 sessionId: src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0
2025-10-02T09:37:35.143677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60873dc-dc847a38-e7894e11-c1a5705a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.146512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Write session: try to update token
2025-10-02T09:37:35.146524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.152745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.152757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.152758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.152760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.152764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.152767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.152770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897893280:9314]
2025-10-02T09:37:35.152793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.152798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.152810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.152814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.152815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.152816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.152926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.158839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3679 sessionId: src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.160987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.218209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973482413:9529]
2025-10-02T09:37:35.218353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3678, pipe: [1:7556556248973482413:9529]
2025-10-02T09:37:35.263618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.263996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.264007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.264023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482413:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.264160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.264203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973482413:9529]
2025-10-02T09:37:35.264236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.264256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:35.264339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3679 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0
2025-10-02T09:37:35.264490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3679 sessionId: src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0 is DEAD
2025-10-02T09:37:35.264615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:35.264627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Write session will restart in 0.005668s
2025-10-02T09:37:35.264643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Write session: Do CDS request
2025-10-02T09:37:35.264647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.271155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.271257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.271269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3680
2025-10-02T09:37:35.271340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.271361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.271367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.271370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.271779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3680 sessionId:  describe result for acl check
2025-10-02T09:37:35.271811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.271815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.271816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.271821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.272305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.274505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.276766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.276778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.276780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973482468:4769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.276785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.277992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.279629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.279819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.279828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.279836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.279873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.279896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897893560:9311]
2025-10-02T09:37:35.280283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.280460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.280484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.280679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.280711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.280715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.280716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.280716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.280717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.280717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.280718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.280718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.280719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.280719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.280720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.280720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.280724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.280730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.280732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.280734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.280736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.280738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.280740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.280742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.280744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.280746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.280748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.280750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.280753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.280757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.280761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.280764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.280766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.280769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.280771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.280773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.280776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.280778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.280780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.280783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.280785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.280788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.280790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.280792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.280795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.280799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.280811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.280814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.280816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.280819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.280821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.280824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.280843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.288235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.289705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.289715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.289716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.289718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.289721Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3679 [2:7556556248897893560:9311]
2025-10-02T09:37:35.289729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.289739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.289744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.289745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.289746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.289755Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.289757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.289761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.289792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.289797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.289798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.289800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.289801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.289837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.289841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.289848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.289854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.289865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.289879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482672:4769], now have 1 active actors on pipe
2025-10-02T09:37:35.289884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482414:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.289888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.289889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.289890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.289897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.289908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.289910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.289912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.289913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.289918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.289920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.289934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.289912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3679
2025-10-02T09:37:35.289944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3679
2025-10-02T09:37:35.289939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.289940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.289949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.289950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.289974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.289980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.289982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.289984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.289988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.289994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.290007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.290089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.290094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.290101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.290154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3680 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0
2025-10-02T09:37:35.290364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47821b59-f582a5c7-7806b80a-2ae76ee8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.293046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Write session: try to update token
2025-10-02T09:37:35.293055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.299285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.299298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.299299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.299300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.299306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.299308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.299310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897893555:9311]
2025-10-02T09:37:35.299330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.299334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.299334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.299335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.299337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.299339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.299480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.304299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3680 sessionId: src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.306259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.354895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:37:35.354922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-02T09:37:35.364133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973482699:9529]
2025-10-02T09:37:35.364281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3679, pipe: [1:7556556248973482699:9529]
2025-10-02T09:37:35.410758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.411078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.411090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.411138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482699:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.411274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.411361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:35.411368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.411382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-02T09:37:35.411423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973482699:9529]
2025-10-02T09:37:35.411461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3680 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0
2025-10-02T09:37:35.411627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3680 sessionId: src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0 is DEAD
2025-10-02T09:37:35.411775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:35.411785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Write session will restart in 0.008524s
2025-10-02T09:37:35.411802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Write session: Do CDS request
2025-10-02T09:37:35.411807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.421129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.421234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.421245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3681
2025-10-02T09:37:35.421366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.421389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.421393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.421396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.421714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3681 sessionId:  describe result for acl check
2025-10-02T09:37:35.421737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.421741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.421743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.421746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.422173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.424564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.425585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.427155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.427340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.427348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.427355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.427378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.427387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.427387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.427389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973482811:4750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.427394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.427413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897893844:9307]
2025-10-02T09:37:35.427761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.427918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.427939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.428115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.428143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.428146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.428147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.428148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.428148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.428149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.428149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.428150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.428150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.428151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.428151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.428161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.428163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.428165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.428167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.428169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.428171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.428173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.428174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.428176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.428178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.428180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.428184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.428188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.428192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.428195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.428197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.428199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.428201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.428204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.428207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.428209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.428212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.428215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.428217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.428220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.428221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.428224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.428227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.428229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.428232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.428234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.428236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.428241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.428243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.428245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.428266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.435628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.437260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.437271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.437272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.437274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.437277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3680 [2:7556556248897893844:9307]
2025-10-02T09:37:35.437284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.437293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.437298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.437300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.437301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.437310Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.437313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.437317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.437350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.437354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.437355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.437357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.437359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.437396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.437401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.437407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.437412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.437423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.437436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.437440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.437441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.437446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.437453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482970:4750], now have 1 active actors on pipe
2025-10-02T09:37:35.437453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.437456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.437457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.437459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482700:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.437463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.437470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.437472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.437485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.437493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.437490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3680
2025-10-02T09:37:35.437504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3680
2025-10-02T09:37:35.437506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.437529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.437534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.437560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.437567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.437573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.437574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.437580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.437588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.437617Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:37:35.437634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.437743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.437748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.437756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.437769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 25 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:37:35.437795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:37:35.437811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3681 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0
2025-10-02T09:37:35.438072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0c7e9e-f0e58d20-f846d3a4-d3e7ec1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.440865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Write session: try to update token
2025-10-02T09:37:35.440876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.446665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.446677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.446678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.446679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.446683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.446685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.446687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897893839:9307]
2025-10-02T09:37:35.446709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.446715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.446717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.446718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.446719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.446722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.446837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.452552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3681 sessionId: src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.454892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.511582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973482997:9529]
2025-10-02T09:37:35.511812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3680, pipe: [1:7556556248973482997:9529]
2025-10-02T09:37:35.556021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.556362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.556371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.556383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973482997:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.556621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:35.556624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973482997:9529]
2025-10-02T09:37:35.556636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:35.556654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.556671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:37:35.556706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3681 reason: error at write: Disconnected sessionId: src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0
2025-10-02T09:37:35.556894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3681 sessionId: src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0 is DEAD
2025-10-02T09:37:35.557015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:35.557026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Write session will restart in 0.005000s
2025-10-02T09:37:35.557046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Write session: Do CDS request
2025-10-02T09:37:35.557051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.557100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.563115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.563219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.563227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3682
2025-10-02T09:37:35.563343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.563366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.563373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.563376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.563742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3682 sessionId:  describe result for acl check
2025-10-02T09:37:35.563773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.563778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.563779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.563784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.564205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.566328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.569089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.569099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.569102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973483044:4732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.569108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.570164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.571681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.571789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.571796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.571803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.571831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.571856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897894122:9299]
2025-10-02T09:37:35.572203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.572372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.572393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.572574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.572605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.572606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.572607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.572607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.572608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.572608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.572609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.572609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.572611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.572611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.572614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.572620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.572623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.572625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.572627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.572628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.572630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.572632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.572634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.572636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.572638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.572640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.572644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.572648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.572651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.572654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.572656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.572658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.572660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.572663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.572665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.572667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.572669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.572672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.572674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.572677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.572679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.572682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.572684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.572687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.572689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.572691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.572693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.572696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.572698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.572700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.572719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.580118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.581573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.581584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.581585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.581587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.581590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3681 [2:7556556248897894122:9299]
2025-10-02T09:37:35.581597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.581607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.581608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.581610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.581611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.581620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.581624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.581629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.581660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.581665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.581667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.581669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.581670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.581706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.581710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.581717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.581722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.581732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.581747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483001:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.581752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483269:4732], now have 1 active actors on pipe
2025-10-02T09:37:35.581756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.581757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.581758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.581766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.581776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.581782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.581785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.581786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.581787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.581788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.581801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.581806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.581807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.581817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3681
2025-10-02T09:37:35.581817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3681
2025-10-02T09:37:35.581979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.581987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.582028Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:37:35.582052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.582061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.582068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.582070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.582076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.582082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.582096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.582183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 26 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:37:35.582207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:37:35.582203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.582208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.582216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.582260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3682 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0
2025-10-02T09:37:35.582511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a46f4e-9b940614-ed5f52cb-bee6d3ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.585195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Write session: try to update token
2025-10-02T09:37:35.585206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.591035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.591047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.591048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.591049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.591054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.591058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.591061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897894117:9299]
2025-10-02T09:37:35.591082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.591085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.591085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.591086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.591088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.591091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.591197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.596630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3682 sessionId: src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.598934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.657012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973483286:9529]
2025-10-02T09:37:35.657192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3681, pipe: [1:7556556248973483286:9529]
2025-10-02T09:37:35.709124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.709425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.709435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.709450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483286:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.709554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.709644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973483286:9529]
2025-10-02T09:37:35.709668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.709695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:35.709751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3682 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0
2025-10-02T09:37:35.709897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3682 sessionId: src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0 is DEAD
2025-10-02T09:37:35.710026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:35.710036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Write session will restart in 0.008118s
2025-10-02T09:37:35.710051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Write session: Do CDS request
2025-10-02T09:37:35.710055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.719109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.719226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.719239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3683
2025-10-02T09:37:35.719373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.719395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.719402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.719405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.719781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3683 sessionId:  describe result for acl check
2025-10-02T09:37:35.719810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.719815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.719817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.719820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.720203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.722494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.723802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.725603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.725718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.725725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.725733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.725762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.725788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897894433:9259]
2025-10-02T09:37:35.725862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.725870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.725873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973483432:4691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.725877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.726273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.726465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.726491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.726712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.726752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.726757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.726758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.726758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.726759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.726759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.726760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.726761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.726761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.726762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.726763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.726763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.726767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.726774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.726777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.726779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.726781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.726784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.726786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.726789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.726791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.726793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.726796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.726798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.726804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.726808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.726812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.726816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.726818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.726821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.726824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.726827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.726830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.726833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.726835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.726838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.726841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.726844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.726846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.726850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.726857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.726860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.726862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.726865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.726867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.726871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.726876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.726879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.726899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.735675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.737152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.737164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.737165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.737167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.737172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3682 [2:7556556248897894433:9259]
2025-10-02T09:37:35.737178Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.737190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.737196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.737197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.737199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.737208Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.737211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.737215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.737249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.737253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.737255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.737258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.737259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.737298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.737303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.737311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.737317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.737330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.737345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483316:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.737351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483584:4691], now have 1 active actors on pipe
2025-10-02T09:37:35.737355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.737356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.737357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.737366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.737378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.737383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.737385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.737386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.737389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.737391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.737406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.737412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.737418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.737412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3682
2025-10-02T09:37:35.737424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3682
2025-10-02T09:37:35.737453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.737459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.737474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.737481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.737483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.737484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.737489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.737495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.737506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.737642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.737646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.737654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.737724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3683 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0
2025-10-02T09:37:35.737993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6ece52-62e788e2-55a7ab5b-ec4ba37b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.740725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Write session: try to update token
2025-10-02T09:37:35.740735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.747197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.747209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.747210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.747211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.747217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.747219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.747221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897894428:9259]
2025-10-02T09:37:35.747250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.747256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.747257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.747269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.747280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.747282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.747370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.752243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3683 sessionId: src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.754502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.809574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973483595:9529]
2025-10-02T09:37:35.809769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3682, pipe: [1:7556556248973483595:9529]
2025-10-02T09:37:35.860474Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:35.860758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.860769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.860807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483595:9529], now have 1 active actors on pipe
2025-10-02T09:37:35.860967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:35.861178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:35.861179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:35.861240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973483595:9529]
2025-10-02T09:37:35.861275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3683 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0
2025-10-02T09:37:35.861469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3683 sessionId: src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0 is DEAD
2025-10-02T09:37:35.861619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:35.861628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Write session will restart in 0.009509s
2025-10-02T09:37:35.861645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Write session: Do CDS request
2025-10-02T09:37:35.861649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:35.872139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.872266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:35.872277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3684
2025-10-02T09:37:35.872400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:35.872423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:35.872431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:35.872434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:35.872792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3684 sessionId:  describe result for acl check
2025-10-02T09:37:35.872842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:35.872848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:35.872850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:35.872853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:35.873280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:35.874664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:35.875119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:35.876370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:35.876558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:35.876566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:35.876573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:35.876607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:35.876630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556248897894709:9257]
2025-10-02T09:37:35.876998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:35.877035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:35.877044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:35.877046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556248973483797:4682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:35.877051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:35.877159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:35.877182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:35.877366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:35.877395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.877399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.877400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.877401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.877402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.877402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.877403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.877403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.877404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.877404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.877405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.877406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.877408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.877415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.877417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.877419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.877421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.877423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.877425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.877427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.877429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.877431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.877433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.877435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.877440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.877445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:35.877448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.877452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:35.877454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.877457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:35.877459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.877462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:35.877464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.877471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:35.877473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.877476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:35.877478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.877481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:35.877483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.877486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:35.877489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.877493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:35.877495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.877498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.877500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.877503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.877506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.877509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.877527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:35.885154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:35.886647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:35.886658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:35.886659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:35.886661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:35.886665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3683 [2:7556556248897894709:9257]
2025-10-02T09:37:35.886672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:35.886682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:35.886687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.886689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.886690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.886698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:35.886702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:35.886709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:35.886738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.886743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.886744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.886746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:35.886748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:35.886787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:35.886794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.886801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:35.886806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:35.886814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:35.886825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483597:2446], now have 1 active actors on pipe
2025-10-02T09:37:35.886827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483872:4682], now have 1 active actors on pipe
2025-10-02T09:37:35.886831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.886832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.886833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.886841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:35.886848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:35.886854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:35.886856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:35.886857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:35.886859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:35.886860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:35.886873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.886875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:35.886876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:35.886893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3683
2025-10-02T09:37:35.886901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3683
2025-10-02T09:37:35.886949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.886954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.886970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:35.886974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:35.886979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:35.886981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:35.886986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:35.886991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:35.886998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.887156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:35.887160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:35.887168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:35.887233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3684 partition: 0 MaxSeqNo: 36 sessionId: src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0
2025-10-02T09:37:35.887501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8c1f7c-79acaa83-db698552-fee79cc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:35.890250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Write session: try to update token
2025-10-02T09:37:35.890261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:35.896184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:35.896197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:35.896198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:35.896199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:35.896204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.896208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.896210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556248897894704:9257]
2025-10-02T09:37:35.896232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:35.896239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:35.896242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:35.896243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:35.896245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:35.896246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:35.896360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:35.901717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3684 sessionId: src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:35.903991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:35.961662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556248973483884:9529]
2025-10-02T09:37:35.961832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3683, pipe: [1:7556556248973483884:9529]
2025-10-02T09:37:36.006843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.007097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.007108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.007122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556248973483884:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.007251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.007297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556248973483884:9529]
2025-10-02T09:37:36.007320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.007330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:36.007417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3684 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0
2025-10-02T09:37:36.007566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3684 sessionId: src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0 is DEAD
2025-10-02T09:37:36.007675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:36.007686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Write session will restart in 0.006641s
2025-10-02T09:37:36.007709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Write session: Do CDS request
2025-10-02T09:37:36.007713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.015086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.015218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.015226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3685
2025-10-02T09:37:36.015327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.015349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.015352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.015355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.015676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3685 sessionId:  describe result for acl check
2025-10-02T09:37:36.015706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.015711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.015713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.015717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.016118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.018480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.020578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.020587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.020590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268451251:4650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.020595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.021503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.023134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.023315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.023322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.023329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.023361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.023387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192862282:9254]
2025-10-02T09:37:36.023740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.023909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.023931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.024117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.024146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.024149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.024150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.024151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.024151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.024152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.024152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.024153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.024153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.024154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.024154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.024155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.024158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.024164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.024167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.024169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.024170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.024172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.024174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.024176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.024178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.024181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.024183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.024184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.024188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.024192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.024195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.024198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.024201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.024203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.024206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.024208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.024211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.024214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.024216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.024219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.024221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.024223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.024225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.024228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.024230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.024233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.024236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.024239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.024241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.024243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.024247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.024249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.024267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.031899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.033397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.033409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.033410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.033412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.033416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3684 [2:7556556253192862282:9254]
2025-10-02T09:37:36.033424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.033434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.033439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.033441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.033442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.033451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.033458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.033462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.033494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.033499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.033500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.033502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.033504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.033544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.033548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.033555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.033561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.033572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.033587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451183:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.033592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451455:4650], now have 1 active actors on pipe
2025-10-02T09:37:36.033596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.033601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.033602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.033610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.033619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.033621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.033623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.033625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.033630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.033631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.033678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3684
2025-10-02T09:37:36.033686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3684
2025-10-02T09:37:36.033743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.033752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.033759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.033776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.033781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.033802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.033809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.033811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.033812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.033817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.033826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.033841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.033953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.033958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.033966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.034051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3685 partition: 0 MaxSeqNo: 36 sessionId: src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0
2025-10-02T09:37:36.034325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1048d2e0-92a6d87d-a804a0ce-2f6b14c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.037087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Write session: try to update token
2025-10-02T09:37:36.037098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.043363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.043375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.043376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.043378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.043382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.043385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.043388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192862277:9254]
2025-10-02T09:37:36.043411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.043411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.043414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.043416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.043421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.043423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.043539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.048791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3685 sessionId: src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.051078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.107571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268451472:9529]
2025-10-02T09:37:36.107799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3684, pipe: [1:7556556253268451472:9529]
2025-10-02T09:37:36.155570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.155964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.155978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.155992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451472:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.156221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.156235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268451472:9529]
2025-10-02T09:37:36.156269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:36.156271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:36.156339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3685 reason: error at write: Disconnected sessionId: src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0
2025-10-02T09:37:36.156416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.156514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3685 sessionId: src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0 is DEAD
2025-10-02T09:37:36.156657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:36.156668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Write session will restart in 0.007498s
2025-10-02T09:37:36.156688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Write session: Do CDS request
2025-10-02T09:37:36.156691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.165135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.165237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.165250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3686
2025-10-02T09:37:36.165376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.165399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.165408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.165411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.165817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3686 sessionId:  describe result for acl check
2025-10-02T09:37:36.165848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.165853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.165854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.165858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.166280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.168593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.170109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.171726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.171875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.171884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.171886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268451581:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.171891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.171917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.171925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.171932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.171965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.171991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192862561:9243]
2025-10-02T09:37:36.172345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.172504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.172525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.172704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.172734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.172738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.172739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.172739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.172740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.172741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.172741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.172742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.172742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.172743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.172744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.172744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.172747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.172753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.172756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.172758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.172760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.172762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.172764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.172766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.172768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.172770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.172772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.172774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.172778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.172782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.172785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.172788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.172790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.172793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.172795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.172798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.172814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.172819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.172821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.172825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.172828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.172836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.172839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.172845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.172854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.172858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.172861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.172869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.172873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.172877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.172880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.172888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.172905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.180317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.181909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.181920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.181921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.181923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.181926Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3685 [2:7556556253192862561:9243]
2025-10-02T09:37:36.181934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.181944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.181947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.181949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.181950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.181960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.181964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.181969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.182001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.182006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.182007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.182009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.182011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.182049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.182054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.182061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.182067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.182077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.182092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451748:4646], now have 1 active actors on pipe
2025-10-02T09:37:36.182098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451473:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.182102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.182103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.182104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.182112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.182122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.182125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.182127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.182128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.182132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.182134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.182149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.182154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.182138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3685
2025-10-02T09:37:36.182165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.182143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3685
2025-10-02T09:37:36.182173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.182176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.182196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.182203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.182206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.182207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.182211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.182218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.182227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.182318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.182323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.182331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.182390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3686 partition: 0 MaxSeqNo: 36 sessionId: src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0
2025-10-02T09:37:36.182640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b225c66c-8ae63714-7e31b672-8d06feaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.185344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Write session: try to update token
2025-10-02T09:37:36.185356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.191293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.191304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.191305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.191306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.191310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.191313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.191315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192862556:9243]
2025-10-02T09:37:36.191335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.191339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.191341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.191342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.191343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.191343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.191461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.196648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3686 sessionId: src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.198932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.256584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268451761:9529]
2025-10-02T09:37:36.256839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3685, pipe: [1:7556556253268451761:9529]
2025-10-02T09:37:36.303444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.303699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.303708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.303720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451761:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.303849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.303939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.303999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268451761:9529]
2025-10-02T09:37:36.304027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:36.304109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0
2025-10-02T09:37:36.304265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3686 sessionId: src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0 is DEAD
2025-10-02T09:37:36.304384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:36.304405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Write session will restart in 0.009662s
2025-10-02T09:37:36.304422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Write session: Do CDS request
2025-10-02T09:37:36.304426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.315126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.315267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.315280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3687
2025-10-02T09:37:36.315412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.315438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.315445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.315448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.315757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3687 sessionId:  describe result for acl check
2025-10-02T09:37:36.315784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.315789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.315791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.315794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.316230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.317213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.318054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.318776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.318950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.318958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.318965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.318997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.319021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192862840:9250]
2025-10-02T09:37:36.319384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.319570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.319592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.319775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.319808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.319809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.319809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.319810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.319810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.319811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.319811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.319812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.319812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.319813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.319813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.319816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.319823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.319825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.319827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.319829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.319831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.319833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.319835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.319837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.319839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.319841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.319847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.319851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.319854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.319860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.319862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.319865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.319867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.319872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.319874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.319877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.319879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.319882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.319884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.319887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.319890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.319893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.319895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.319898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.319900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.319903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.319905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.319908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.319925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.321861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.321872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.321875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268451976:4640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.321880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.327519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.329160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.329171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.329172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.329174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.329178Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3686 [2:7556556253192862840:9250]
2025-10-02T09:37:36.329184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.329193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.329194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.329196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.329197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.329206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.329209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.329213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.329244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.329249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.329250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.329252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.329253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.329289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.329294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.329301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.329306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.329317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.329332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452042:4640], now have 1 active actors on pipe
2025-10-02T09:37:36.329339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268451762:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.329342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.329343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.329345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.329352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.329360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.329366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.329368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.329369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.329371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.329372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.329386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.329395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.329389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3686
2025-10-02T09:37:36.329392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3686
2025-10-02T09:37:36.329400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.329415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.329417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.329433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.329438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.329440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.329441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.329446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.329451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.329461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.329596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.329601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.329608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.329668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3687 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0
2025-10-02T09:37:36.329939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251ccc88-e9f2abf4-7c7a2f4c-776164da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.332594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Write session: try to update token
2025-10-02T09:37:36.332604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.338603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.338616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.338618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.338619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.338623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.338626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.338627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192862835:9250]
2025-10-02T09:37:36.338649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.338652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.338653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.338660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.338664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.338666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.338763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.344680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3687 sessionId: src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.346981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.404007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268452052:9529]
2025-10-02T09:37:36.404180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3686, pipe: [1:7556556253268452052:9529]
2025-10-02T09:37:36.446873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.447110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.447120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.447131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452052:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.447261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.447238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.447260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:36.447265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:36.447288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268452052:9529]
2025-10-02T09:37:36.447330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3687 reason: error at write: Disconnected sessionId: src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0
2025-10-02T09:37:36.447484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3687 sessionId: src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0 is DEAD
2025-10-02T09:37:36.447626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:36.447637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Write session will restart in 0.006392s
2025-10-02T09:37:36.447654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Write session: Do CDS request
2025-10-02T09:37:36.447658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.455126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.455261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.455269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3688
2025-10-02T09:37:36.455403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.455424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.455431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.455434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.455752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3688 sessionId:  describe result for acl check
2025-10-02T09:37:36.455773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.455778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.455780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.455783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.456138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.458195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.460282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.460291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.460293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268452140:4597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.460297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.461162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.462835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.463035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.463044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.463052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.463090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.463114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192863135:9248]
2025-10-02T09:37:36.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.463645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.463670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.463852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.463880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.463884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.463885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.463885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.463886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.463886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.463887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.463888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.463888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.463889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.463889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.463893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.463899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.463902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.463903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.463905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.463907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.463909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.463911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.463913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.463916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.463918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.463920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.463927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.463930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.463933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.463937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.463940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.463945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.463947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.463950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.463956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.463958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.463961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.463967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.463970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.463972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.463975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.463977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.463982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.463984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.463987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.463989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.463992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.464011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.471584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.473054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.473064Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.473065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.473067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.473070Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3687 [2:7556556253192863135:9248]
2025-10-02T09:37:36.473077Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.473087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.473092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.473094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.473095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.473104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.473111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.473115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.473148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.473153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.473154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.473156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.473157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.473192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.473197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.473203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.473212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.473223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.473237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452065:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.473242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452339:4597], now have 1 active actors on pipe
2025-10-02T09:37:36.473246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.473247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.473248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.473256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.473266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.473269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.473271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.473272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.473273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.473275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.473288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.473292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.473294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.473300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3687
2025-10-02T09:37:36.473301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3687
2025-10-02T09:37:36.473328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.473333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.473347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.473354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.473357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.473358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.473363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.473370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.473379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.473497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.473502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.473510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.473575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3688 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0
2025-10-02T09:37:36.473819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e821df4-59dc40d8-26ef44c1-fa2dc55d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.476606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Write session: try to update token
2025-10-02T09:37:36.476616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.486472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:36.486487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.486494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.486521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:36.486530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:36.486657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:36.486785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:36.486900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:36.487014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:36.487186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:36.487211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:36.491311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.491320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.491321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.491322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.491512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.491519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.491522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192863130:9248]
2025-10-02T09:37:36.491541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.491543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.491544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.491545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.491546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.491549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.491551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3688 sessionId: src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.491678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.493849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.547370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268452354:9529]
2025-10-02T09:37:36.547568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3687, pipe: [1:7556556253268452354:9529]
2025-10-02T09:37:36.607070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.607376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.607386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.607400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452354:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.607605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.607614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.607625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:36.607630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:36.607666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268452354:9529]
2025-10-02T09:37:36.607696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3688 reason: error at write: Disconnected sessionId: src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0
2025-10-02T09:37:36.607810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3688 sessionId: src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0 is DEAD
2025-10-02T09:37:36.607937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:36.607946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Write session will restart in 0.007839s
2025-10-02T09:37:36.607963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Write session: Do CDS request
2025-10-02T09:37:36.607970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.617125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.617243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.617255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3689
2025-10-02T09:37:36.617355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.617378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.617385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.617388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.617744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3689 sessionId:  describe result for acl check
2025-10-02T09:37:36.617774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.617780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.617781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.617785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.618215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.621055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.623585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.623594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.623597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268452434:4569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.623601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.625211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.627595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.627710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.627718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.627724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.627751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.627776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192863416:9246]
2025-10-02T09:37:36.628134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.628330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.628354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.628634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.628672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.628676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.628676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.628677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.628678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.628678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.628679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.628679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.628680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.628680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.628681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.628681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.628684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.628691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.628694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.628696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.628698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.628700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.628702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.628704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.628706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.628709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.628710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.628712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.628716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.628721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.628724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.628727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.628729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.628731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.628733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.628736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.628738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.628741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.628743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.628746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.628749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.628752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.628754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.628757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.628760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.628763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.628765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.628768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.628770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.628772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.628774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.628777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.628792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.636522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.638003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.638014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.638015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.638017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.638020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3688 [2:7556556253192863416:9246]
2025-10-02T09:37:36.638027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.638038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.638043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.638045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.638046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.638055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.638058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.638062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.638094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.638098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.638100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.638101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.638103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.638140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.638145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.638152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.638157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.638166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.638180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452618:4569], now have 1 active actors on pipe
2025-10-02T09:37:36.638186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452358:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.638189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.638191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.638192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.638199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.638209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.638210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.638212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.638213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.638219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.638221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.638234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.638241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.638244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.638245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3688
2025-10-02T09:37:36.638269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3688
2025-10-02T09:37:36.638283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.638289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.638306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.638312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.638315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.638316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.638321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.638327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.638337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.638454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.638459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.638467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.638855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3689 partition: 0 MaxSeqNo: 36 sessionId: src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0
2025-10-02T09:37:36.639134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5de0dc-ba8edbd9-4afbca26-c3d5d5f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.641818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Write session: try to update token
2025-10-02T09:37:36.641829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.647777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.647788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.647789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.647790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.647795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.647799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.647801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192863411:9246]
2025-10-02T09:37:36.647822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.647825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.647825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.647826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.647827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.647829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.647948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.654144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3689 sessionId: src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.656279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.707621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268452648:9529]
2025-10-02T09:37:36.707768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3688, pipe: [1:7556556253268452648:9529]
2025-10-02T09:37:36.757393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.757697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.757705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.757718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452648:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.757847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.757870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.757899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:36.757903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:36.757919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268452648:9529]
2025-10-02T09:37:36.757971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3689 reason: error at write: Disconnected sessionId: src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0
2025-10-02T09:37:36.758144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3689 sessionId: src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0 is DEAD
2025-10-02T09:37:36.758282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:36.758292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Write session will restart in 0.005747s
2025-10-02T09:37:36.758311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Write session: Do CDS request
2025-10-02T09:37:36.758315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.765088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.765208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.765218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3690
2025-10-02T09:37:36.765326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.765349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.765356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.765360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.765708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3690 sessionId:  describe result for acl check
2025-10-02T09:37:36.765731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.765736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.765737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.765742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.766141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.768299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.771290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.771299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.771302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268452699:4537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.771308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.775962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.778275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.778395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.778402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.778407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.778435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.778468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192863734:9223]
2025-10-02T09:37:36.778815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.778986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.779009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.779183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.779212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.779216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.779216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.779217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.779217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.779218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.779219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.779219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.779220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.779220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.779221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.779221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.779224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.779230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.779232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.779234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.779236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.779238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.779240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.779242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.779244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.779256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.779258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.779260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.779265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.779271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.779276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.779284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.779288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.779295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.779304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.779310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.779317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.779323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.779329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.779332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.779334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.779337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.779341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.779344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.779346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.779349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.779351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.779354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.779356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.779361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.779363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.779366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.779383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.786775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.788355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.788365Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.788366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.788368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.788372Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3689 [2:7556556253192863734:9223]
2025-10-02T09:37:36.788378Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.788386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.788389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.788390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.788391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.788400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.788403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.788408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.788437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.788441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.788442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.788444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.788446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.788483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.788487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.788494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.788500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.788511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.788524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452832:4537], now have 1 active actors on pipe
2025-10-02T09:37:36.788529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452671:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.788533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.788534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.788535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.788542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.788551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.788555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.788558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.788559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.788560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.788561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.788574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.788579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.788580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.788585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3689
2025-10-02T09:37:36.788590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3689
2025-10-02T09:37:36.788626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.788631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.788645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.788652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.788654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.788655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.788660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.788665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.788675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.788797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.788816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.788823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.788895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3690 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0
2025-10-02T09:37:36.789177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249f2a03-e130bab8-672ad1d5-b80f646e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.791900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Write session: try to update token
2025-10-02T09:37:36.791910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.797724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.797737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.797738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.797739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.797745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.797748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.797750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192863728:9223]
2025-10-02T09:37:36.797771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.797773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.797775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.797774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.797777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.797779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.797903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.803450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3690 sessionId: src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.805721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:36.858147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556253268452962:9529]
2025-10-02T09:37:36.858355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3689, pipe: [1:7556556253268452962:9529]
2025-10-02T09:37:36.908570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:36.908783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.908793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.908818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452962:9529], now have 1 active actors on pipe
2025-10-02T09:37:36.908967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:36.909011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:36.909014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556253268452962:9529]
2025-10-02T09:37:36.909014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:36.909096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3690 reason: error at write: Disconnected sessionId: src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0
2025-10-02T09:37:36.909249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3690 sessionId: src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0 is DEAD
2025-10-02T09:37:36.909367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:36.909374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Write session will restart in 0.005404s
2025-10-02T09:37:36.909393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Write session: Do CDS request
2025-10-02T09:37:36.909398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:36.909560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:36.916196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.916269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:36.916279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3691
2025-10-02T09:37:36.916394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:36.916418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:36.916425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:36.916428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:36.916766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3691 sessionId:  describe result for acl check
2025-10-02T09:37:36.916793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:36.916797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:36.916813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:36.916819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:36.917254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:36.919759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:36.922108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:36.922117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:36.922119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556253268453020:4509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:36.922123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:36.922980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:36.924661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:36.924759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:36.924765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:36.924771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:36.924796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:36.924829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556253192864017:9221]
2025-10-02T09:37:36.925173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:36.925331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:36.925353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:36.925527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:36.925557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.925561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.925561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.925562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.925562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.925563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.925563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.925564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.925564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.925565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.925565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.925565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.925568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.925575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.925577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.925579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.925581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.925584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.925586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.925588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.925590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.925592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.925594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.925596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.925600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.925604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:36.925607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.925610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:36.925612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.925615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:36.925617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.925620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:36.925622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.925625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:36.925627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.925630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:36.925632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.925635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:36.925637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.925639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:36.925641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.925644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:36.925647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.925650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.925652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.925654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.925658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.925661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.925678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:36.932988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:36.934531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:36.934541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:36.934542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:36.934544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:36.934547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3690 [2:7556556253192864017:9221]
2025-10-02T09:37:36.934554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:36.934563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:36.934564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.934565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.934566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.934575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:36.934577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:36.934581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:36.934612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.934617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.934618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.934620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:36.934621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:36.934655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:36.934661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.934668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:36.934673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:36.934681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:36.934693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268453239:4509], now have 1 active actors on pipe
2025-10-02T09:37:36.934695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556253268452963:2446], now have 1 active actors on pipe
2025-10-02T09:37:36.934699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.934700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.934701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.934709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:36.934716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:36.934722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:36.934724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:36.934725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:36.934726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:36.934726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:36.934738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.934744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:36.934745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:36.934766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3690
2025-10-02T09:37:36.934768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3690
2025-10-02T09:37:36.934799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.934804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.934820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|911137b4-6696d92b-6c9b4266-a621821c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:36.934827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:36.934829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:36.934830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:36.934835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:36.934842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:36.934853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.934969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:36.934973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:36.934981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:36.935042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3691 partition: 0 MaxSeqNo: 36 sessionId: src_id|911137b4-6696d92b-6c9b4266-a621821c_0
2025-10-02T09:37:36.935323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2cc36e9-85302236-c0c0fedd-1e74a9c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|911137b4-6696d92b-6c9b4266-a621821c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:36.938015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Write session: try to update token
2025-10-02T09:37:36.938025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:36.943850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:36.943859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:36.943860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:36.943861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:36.943866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.943868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.943871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556253192864012:9221]
2025-10-02T09:37:36.943892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:36.943892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:36.943894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:36.943896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:36.943896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:36.943897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:36.944057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:36.949668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3691 sessionId: src_id|911137b4-6696d92b-6c9b4266-a621821c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:36.951934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.009205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563420555:9529]
2025-10-02T09:37:37.009376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3690, pipe: [1:7556556257563420555:9529]
2025-10-02T09:37:37.052758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.052982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.052993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.053007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563420555:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.053133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.053186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.053188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:37.053239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563420555:9529]
2025-10-02T09:37:37.053269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3691 reason: status is not ok: tablet will be restarted right now sessionId: src_id|911137b4-6696d92b-6c9b4266-a621821c_0
2025-10-02T09:37:37.053435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3691 sessionId: src_id|911137b4-6696d92b-6c9b4266-a621821c_0 is DEAD
2025-10-02T09:37:37.053587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:37.053598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Write session will restart in 0.009052s
2025-10-02T09:37:37.053620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Write session: Do CDS request
2025-10-02T09:37:37.053625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.064193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.064283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.064294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3692
2025-10-02T09:37:37.064414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.064439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.064446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.064450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.064844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3692 sessionId:  describe result for acl check
2025-10-02T09:37:37.064878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.064883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.064884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.064888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.065340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.067171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.069134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.069261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.069269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.069272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563420728:4511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.069276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.069359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.069549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.069557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.069564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.069598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.069623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487831597:9215]
2025-10-02T09:37:37.069977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.070134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.070157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.070340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.070373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.070377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.070377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.070378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.070378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.070379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.070379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.070380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.070380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.070381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.070381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.070382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.070385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.070391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.070394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.070396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.070398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.070400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.070402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.070404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.070405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.070408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.070410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.070411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.070416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.070420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.070423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.070426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.070430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.070433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.070435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.070438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.070440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.070443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.070448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.070451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.070453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.070456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.070458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.070461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.070464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.070470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.070472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.070475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.070480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.070483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.070485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.070492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.070509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.078038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.079434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.079444Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.079446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.079448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.079451Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3691 [2:7556556257487831597:9215]
2025-10-02T09:37:37.079459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.079469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.079474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.079476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.079477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.079487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.079494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.079499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.079534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.079539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.079540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.079542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.079544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.079579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.079584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.079591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.079596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.079608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.079623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563420841:4511], now have 1 active actors on pipe
2025-10-02T09:37:37.079628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563420560:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.079632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.079633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.079634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.079642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.079652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.079656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.079658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.079659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.079663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.079665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.079658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3691
2025-10-02T09:37:37.079661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3691
2025-10-02T09:37:37.079679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.079684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.079687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.079705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.079709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.079726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.079733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.079735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.079736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.079742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.079748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.079759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.079883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.079888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.079895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.079955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3692 partition: 0 MaxSeqNo: 36 sessionId: src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0
2025-10-02T09:37:37.080175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911137b4-6696d92b-6c9b4266-a621821c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.082708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Write session: try to update token
2025-10-02T09:37:37.082725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.088898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.088908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.088909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.088909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.088913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.088916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.088918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487831591:9215]
2025-10-02T09:37:37.088937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.088943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.088944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.088946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.088948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.088950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.089157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.094744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3692 sessionId: src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.097006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.153601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563420852:9529]
2025-10-02T09:37:37.153797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3691, pipe: [1:7556556257563420852:9529]
2025-10-02T09:37:37.198227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.198537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.198546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.198559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563420852:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.198681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.198731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:37.198745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:37.198759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563420852:9529]
2025-10-02T09:37:37.198781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.198826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3692 reason: error at write: Disconnected sessionId: src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0
2025-10-02T09:37:37.198978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3692 sessionId: src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0 is DEAD
2025-10-02T09:37:37.199109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:37.199119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Write session will restart in 0.005964s
2025-10-02T09:37:37.199138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Write session: Do CDS request
2025-10-02T09:37:37.199143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.206149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.206222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.206230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3693
2025-10-02T09:37:37.206320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.206345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.206353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.206357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.206799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3693 sessionId:  describe result for acl check
2025-10-02T09:37:37.206828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.206833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.206834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.206838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.207276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.209288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.211494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.211502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.211505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563420922:4494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.211509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.212715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.214302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.214404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.214410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.214416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.214442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.214465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487831884:9216]
2025-10-02T09:37:37.214810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.214974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.214997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.215174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.215204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.215207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.215208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.215209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.215209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.215210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.215210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.215211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.215211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.215212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.215212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.215213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.215215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.215222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.215224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.215226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.215228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.215230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.215232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.215234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.215236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.215238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.215240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.215242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.215246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.215258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.215261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.215264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.215266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.215269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.215271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.215274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.215276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.215279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.215281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.215284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.215286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.215289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.215291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.215294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.215296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.215299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.215302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.215304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.215310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.215312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.215314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.215317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.215334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.222886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.224691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.224703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.224705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.224707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.224711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3692 [2:7556556257487831884:9216]
2025-10-02T09:37:37.224717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.224727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.224728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.224730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.224731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.224740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.224743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.224751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.224782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.224787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.224788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.224790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.224791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.224839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.224845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.224851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.224857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.224865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.224881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421124:4494], now have 1 active actors on pipe
2025-10-02T09:37:37.224886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563420854:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.224890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.224892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.224893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.224901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.224912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.224918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.224919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.224920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.224923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.224924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.224915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3692
2025-10-02T09:37:37.224917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3692
2025-10-02T09:37:37.224948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.224953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.224961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.224967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.224975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.224987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.224993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.224995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.224996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.225001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.225008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.225020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.225134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.225139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.225147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.225210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3693 partition: 0 MaxSeqNo: 36 sessionId: src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0
2025-10-02T09:37:37.225458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690a571b-dd6a154b-32b13f38-e1e09c5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.228241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Write session: try to update token
2025-10-02T09:37:37.228252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.234428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.234442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.234444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.234445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.234449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.234452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.234454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487831879:9216]
2025-10-02T09:37:37.234475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.234479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.234482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.234482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.234485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.234487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.234594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.240313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3693 sessionId: src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.242608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.298991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563421147:9529]
2025-10-02T09:37:37.299170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3692, pipe: [1:7556556257563421147:9529]
2025-10-02T09:37:37.345417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.345730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.345739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.345751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421147:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.345865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.345883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.345907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:37.345930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563421147:9529]
2025-10-02T09:37:37.345991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3693 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0
2025-10-02T09:37:37.346170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3693 sessionId: src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0 is DEAD
2025-10-02T09:37:37.346294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:37.346305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Write session will restart in 0.009776s
2025-10-02T09:37:37.346323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Write session: Do CDS request
2025-10-02T09:37:37.346328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.357160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.357290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.357304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3694
2025-10-02T09:37:37.357410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.357433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.357441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.357445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.357849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3694 sessionId:  describe result for acl check
2025-10-02T09:37:37.357877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.357881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.357883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.357887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.358292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.360400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.363000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.363009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.363012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563421264:4482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.363017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.363608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.366218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.366341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.366348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.366353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.366383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.366535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487832181:9211]
2025-10-02T09:37:37.366885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.367070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.367093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.367309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.367313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.367314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.367314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.367315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.367316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.367316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.367317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.367317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.367317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.367318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.367318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.367321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.367328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.367330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.367332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.367334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.367336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.367338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.367340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.367342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.367344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.367346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.367348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.367353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.367356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.367360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.367363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.367365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.367369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.367371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.367374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.367377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.367380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.367383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.367386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.367390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.367393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.367395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.367398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.367400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.367403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.367405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.367411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.367413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.367416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.367418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.367420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.367436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.374816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.376196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.376207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.376208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.376211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.376215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3693 [2:7556556257487832181:9211]
2025-10-02T09:37:37.376222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.376231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.376236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.376238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.376239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.376247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.376250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.376254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.376285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.376289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.376290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.376292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.376293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.376332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.376337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.376344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.376349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.376357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.376372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421432:4482], now have 1 active actors on pipe
2025-10-02T09:37:37.376378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421149:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.376382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.376383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.376384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.376392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.376401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.376404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.376406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.376407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.376413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.376414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.376426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.376431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.376422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3693
2025-10-02T09:37:37.376451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.376430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3693
2025-10-02T09:37:37.376467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.376472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.376487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.376494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.376496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.376497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.376502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.376511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.376518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.376651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.376656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.376663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.376727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3694 partition: 0 MaxSeqNo: 36 sessionId: src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0
2025-10-02T09:37:37.377036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33009f4-71b3b254-97507fb8-41dc9c97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.379604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Write session: try to update token
2025-10-02T09:37:37.379616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.385438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.385449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.385450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.385450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.385454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.385456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.385474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487832176:9211]
2025-10-02T09:37:37.385496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.385499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.385500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.385502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.385505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.385508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.385621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.391748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3694 sessionId: src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.393958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.445923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563421457:9529]
2025-10-02T09:37:37.446069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3693, pipe: [1:7556556257563421457:9529]
2025-10-02T09:37:37.495831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.496345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.496358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.496371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421457:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.496521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.496572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:37.496578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563421457:9529]
2025-10-02T09:37:37.496586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:37.496602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.496664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3694 reason: error at write: Disconnected sessionId: src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0
2025-10-02T09:37:37.496822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3694 sessionId: src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0 is DEAD
2025-10-02T09:37:37.496962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:37.496973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Write session will restart in 0.005860s
2025-10-02T09:37:37.496995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Write session: Do CDS request
2025-10-02T09:37:37.497000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.504171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.504281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.504293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3695
2025-10-02T09:37:37.504405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.504428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.504435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.504438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.504789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3695 sessionId:  describe result for acl check
2025-10-02T09:37:37.504835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.504840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.504841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.504846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.505263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.507432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.509990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.509998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.510001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563421501:4458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.510006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.514896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.516849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.516990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.516997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.517004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.517036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.517063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487832470:9203]
2025-10-02T09:37:37.517421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.517597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.517620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.517801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.517831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.517835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.517835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.517836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.517836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.517837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.517837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.517838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.517839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.517839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.517840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.517840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.517843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.517850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.517852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.517854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.517856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.517858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.517860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.517862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.517864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.517867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.517868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.517870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.517876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.517880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.517883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.517886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.517888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.517891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.517894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.517896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.517899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.517902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.517905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.517908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.517911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.517913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.517915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.517918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.517920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.517923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.517925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.517928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.517931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.517934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.517939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.517942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.517960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.525565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.527149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.527160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.527163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.527166Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3694 [2:7556556257487832470:9203]
2025-10-02T09:37:37.527173Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.527183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.527188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.527190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.527191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.527200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.527206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.527214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.527248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.527261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.527262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.527264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.527266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.527303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.527308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.527314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.527320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.527331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.527346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421622:4458], now have 1 active actors on pipe
2025-10-02T09:37:37.527352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421458:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.527356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.527357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.527359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.527367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.527377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.527381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.527383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.527384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.527388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.527390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.527403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.527408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.527409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.527414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3694
2025-10-02T09:37:37.527418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3694
2025-10-02T09:37:37.527479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.527484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.527499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.527506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.527508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.527509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.527515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.527524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.527534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.527656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.527661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.527668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.527733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3695 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0
2025-10-02T09:37:37.528003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c739e5-e869eadb-a3c3d67a-b1796662_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.530313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Write session: try to update token
2025-10-02T09:37:37.530326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.536668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.536680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.536681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.536682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.536686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.536688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.536690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487832465:9203]
2025-10-02T09:37:37.536711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.536711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.536713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.536714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.536714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.536715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.536848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.542561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3695 sessionId: src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.544909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.596981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563421754:9529]
2025-10-02T09:37:37.597221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3694, pipe: [1:7556556257563421754:9529]
2025-10-02T09:37:37.652008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.652342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.652352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.652365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421754:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.652496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.652582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:37.652584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563421754:9529]
2025-10-02T09:37:37.652605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.652679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3695 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0
2025-10-02T09:37:37.652855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3695 sessionId: src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0 is DEAD
2025-10-02T09:37:37.652964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:37.652974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Write session will restart in 0.009657s
2025-10-02T09:37:37.652997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Write session: Do CDS request
2025-10-02T09:37:37.653002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.663192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.663273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.663286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3696
2025-10-02T09:37:37.663381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.663404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.663412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.663415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.663803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3696 sessionId:  describe result for acl check
2025-10-02T09:37:37.663836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.663841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.663843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.663847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.664294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.666231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.666462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.668193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.668400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.668408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.668415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.668448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.668474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487832757:9198]
2025-10-02T09:37:37.668496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.668505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.668507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563421927:4446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.668512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.668845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.669015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.669037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.669224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.669254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.669258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.669258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.669259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.669260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.669260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.669261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.669261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.669262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.669262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.669263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.669263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.669266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.669273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.669276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.669278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.669280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.669282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.669284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.669286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.669288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.669291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.669293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.669294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.669298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.669303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.669306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.669310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.669312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.669315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.669317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.669320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.669325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.669328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.669330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.669333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.669336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.669339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.669344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.669346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.669349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.669351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.669353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.669357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.669360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.669362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.669367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.669370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.669386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.676840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.678512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.678522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.678523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.678525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.678529Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3695 [2:7556556257487832757:9198]
2025-10-02T09:37:37.678536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.678546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.678551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.678553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.678554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.678563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.678569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.678574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.678609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.678613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.678614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.678617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.678618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.678655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.678660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.678667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.678672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.678683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.678698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422040:4446], now have 1 active actors on pipe
2025-10-02T09:37:37.678703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563421755:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.678707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.678708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.678709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.678719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.678729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.678730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.678732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.678733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.678739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.678741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.678755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.678763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.678775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.678784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.678786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.678759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3695
2025-10-02T09:37:37.678759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3695
2025-10-02T09:37:37.678807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.678813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.678816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.678817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.678822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.678831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.678842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.679062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.679073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.679089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.679167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3696 partition: 0 MaxSeqNo: 36 sessionId: src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0
2025-10-02T09:37:37.679455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfafc72e-e0032c5-cf4093c5-6f0d2bb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.681889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Write session: try to update token
2025-10-02T09:37:37.681908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.687778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.687790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.687792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.687793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.687797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.687799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.687801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487832752:9198]
2025-10-02T09:37:37.687821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.687826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.687828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.687829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.687829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.687831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.687936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.694228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3696 sessionId: src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.696509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.752615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563422065:9529]
2025-10-02T09:37:37.752831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3695, pipe: [1:7556556257563422065:9529]
2025-10-02T09:37:37.803912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.804294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.804303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.804315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422065:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.804445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:37.804448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:37.804460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:37.804512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563422065:9529]
2025-10-02T09:37:37.804536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.804603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3696 reason: error at write: Disconnected sessionId: src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0
2025-10-02T09:37:37.804764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3696 sessionId: src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0 is DEAD
2025-10-02T09:37:37.804896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:37.804907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Write session will restart in 0.005911s
2025-10-02T09:37:37.804927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Write session: Do CDS request
2025-10-02T09:37:37.804933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.812149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.812274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.812283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3697
2025-10-02T09:37:37.812384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.812407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.812415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.812418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.812767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3697 sessionId:  describe result for acl check
2025-10-02T09:37:37.812797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.812811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.812813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.812817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.813255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.815287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.817818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.817829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.817831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563422142:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.817888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.820539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.820834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.820944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.820950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.820956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.820984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.821008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487833083:9172]
2025-10-02T09:37:37.821356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.821530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.821552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.821726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.821755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.821759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.821760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.821760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.821761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.821761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.821762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.821762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.821763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.821763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.821764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.821764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.821767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.821775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.821777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.821779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.821781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.821783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.821785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.821787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.821789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.821791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.821793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.821795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.821798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.821802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.821806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.821809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.821811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.821813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.821815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.821818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.821820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.821823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.821825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.821828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.821830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.821832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.821834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.821837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.821839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.821842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.821845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.821848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.821850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.821852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.821854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.821856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.821874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.830820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.830832Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.830833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.830835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.830839Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3696 [2:7556556257487833083:9172]
2025-10-02T09:37:37.830846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.830857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.830859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.830860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.830861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.830870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.830877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.830882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.830912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.830917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.830918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.830921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.830922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.830961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.830966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.830973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.830978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.830990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.831005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422075:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.831011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422357:4381], now have 1 active actors on pipe
2025-10-02T09:37:37.831015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.831018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.831019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.831026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.831034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.831041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.831044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.831046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.831048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.831049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.831059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.831064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.831066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.831079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3696
2025-10-02T09:37:37.831097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3696
2025-10-02T09:37:37.831139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.831144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.831159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.831165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.831169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.831173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.831177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.831183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.831194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.831345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.831350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.831357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.831421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3697 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0
2025-10-02T09:37:37.831666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53f6cfd-db6dcfd4-41ae69f1-840c6561_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.834075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Write session: try to update token
2025-10-02T09:37:37.834090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:37.840261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:37.840271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.840276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.840299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:37.840300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:37.840490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:37.840614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:37.840742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:37.840882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:37.841047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:37.841072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:37.846919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3697 sessionId: src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:37.849307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:37.850018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.850034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.850045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:37.850047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:37.850048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:37.850049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:37.850053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.850056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.850058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487833078:9172]
2025-10-02T09:37:37.850085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:37.850085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:37.850088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:37.850090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:37.850094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.850095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:37.850207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:37.904699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556257563422373:9529]
2025-10-02T09:37:37.905076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3696, pipe: [1:7556556257563422373:9529]
2025-10-02T09:37:37.965254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:37.965598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:37.965619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422373:9529], now have 1 active actors on pipe
2025-10-02T09:37:37.965683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:37.965765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:37.965812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556257563422373:9529]
2025-10-02T09:37:37.975443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:37.975459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:37.975479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3697 reason: error at write: Disconnected sessionId: src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0
2025-10-02T09:37:37.975613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3697 sessionId: src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0 is DEAD
2025-10-02T09:37:37.975746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:37.975760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Write session will restart in 0.006942s
2025-10-02T09:37:37.975782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Write session: Do CDS request
2025-10-02T09:37:37.975791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:37.983265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:37.984183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.984308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:37.984322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3698
2025-10-02T09:37:37.984412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:37.984436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:37.984444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:37.984447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:37.984811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3698 sessionId:  describe result for acl check
2025-10-02T09:37:37.984840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:37.984845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:37.984846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:37.984850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:37.985051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:37.985155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:37.985162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:37.985168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:37.985194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:37.985219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556257487833372:9167]
2025-10-02T09:37:37.985284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:37.985575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:37.985756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:37.985780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:37.985962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:37.985993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.985997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.985998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.985998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.985999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.985999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.986000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.986000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.986001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.986001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.986002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.986002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.986005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.986012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.986014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.986016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.986018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.986021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.986023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.986025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.986027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.986029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.986031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.986033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.986037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.986041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:37.986044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.986047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:37.986049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.986052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:37.986054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.986057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:37.986059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.986062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:37.986064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.986067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:37.986069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:37.986077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.986080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:37.986082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.986085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:37.986087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.986090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.986092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.986097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.986099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.986101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.986119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:37.987641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:37.992984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:37.992994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:37.992996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556257563422636:4344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:37.993002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:37.993705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:37.995207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:37.995218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:37.995220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:37.995222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:37.995226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3697 [2:7556556257487833372:9167]
2025-10-02T09:37:37.995232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:37.995243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:37.995245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.995246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.995247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.995266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:37.995272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:37.995276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:37.995308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.995312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.995313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.995315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:37.995317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:37.995353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:37.995358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:37.995365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:37.995371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:37.995382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:37.995396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422384:2446], now have 1 active actors on pipe
2025-10-02T09:37:37.995402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556257563422671:4344], now have 1 active actors on pipe
2025-10-02T09:37:37.995406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:37.995407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:37.995409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:37.995417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:37.995427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:37.995428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3697
2025-10-02T09:37:37.995434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:37.995435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3697
2025-10-02T09:37:37.995438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:37.995440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:37.995442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:37.995443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:37.995455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:37.995459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:37.995461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:37.995472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.995477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.995504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d33739f5-89a0b330-e077ad95-4c524be9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:37.995511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:37.995514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:37.995518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:37.995523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:37.995531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:37.995543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.995651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:37.995656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:37.995663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:37.995727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3698 partition: 0 MaxSeqNo: 36 sessionId: src_id|d33739f5-89a0b330-e077ad95-4c524be9_0
2025-10-02T09:37:37.995975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7b7cf3-7b6fd548-8cdfc04a-7c329452_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d33739f5-89a0b330-e077ad95-4c524be9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:37.998291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Write session: try to update token
2025-10-02T09:37:37.998304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.004489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.004502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.004503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.004504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.004508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:38.004510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:38.004512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556257487833367:9167]
2025-10-02T09:37:38.004531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.004534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.004535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.004539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.004542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.004544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.004643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.010382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3698 sessionId: src_id|d33739f5-89a0b330-e077ad95-4c524be9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.012620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.065974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858389978:9529]
2025-10-02T09:37:38.066206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3697, pipe: [1:7556556261858389978:9529]
2025-10-02T09:37:38.119671Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.119967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.119977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.119990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858389978:9529], now have 1 active actors on pipe
2025-10-02T09:37:38.120138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.120192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.120194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:38.120198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:38.120242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858389978:9529]
2025-10-02T09:37:38.120268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3698 reason: error at write: Disconnected sessionId: src_id|d33739f5-89a0b330-e077ad95-4c524be9_0
2025-10-02T09:37:38.120418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3698 sessionId: src_id|d33739f5-89a0b330-e077ad95-4c524be9_0 is DEAD
2025-10-02T09:37:38.120561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:38.120566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Write session will restart in 0.008593s
2025-10-02T09:37:38.120584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Write session: Do CDS request
2025-10-02T09:37:38.120589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.130183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.130251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.130262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3699
2025-10-02T09:37:38.130370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.130394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.130402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.130405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.130796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3699 sessionId:  describe result for acl check
2025-10-02T09:37:38.130819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.130824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.130825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.130830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.131265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.134122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.136887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.136896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.136902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858390056:4357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.136907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.139321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.142070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.142203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.142210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.142216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.142246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.142270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782800960:9154]
2025-10-02T09:37:38.142618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.142848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.142870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.143050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.143080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.143084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.143084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.143085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.143085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.143086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.143086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.143087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.143087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.143088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.143088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.143089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.143092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.143099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.143101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.143103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.143105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.143107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.143109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.143111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.143113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.143115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.143117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.143119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.143123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.143127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.143131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.143134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.143136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.143138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.143141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.143143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.143146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.143148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.143150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.143153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.143155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.143158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.143160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.143164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.143166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.143168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.143170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.143173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.143175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.143177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.143179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.143182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.143198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.150742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.152363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.152375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.152376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.152378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.152381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3698 [2:7556556261782800960:9154]
2025-10-02T09:37:38.152388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.152398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.152402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.152404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.152405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.152415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.152418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.152423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.152455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.152459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.152460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.152462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.152464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.152500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.152507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.152514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.152520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.152528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.152540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390228:4357], now have 1 active actors on pipe
2025-10-02T09:37:38.152542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858389980:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.152546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.152547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.152548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.152556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.152563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.152570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.152572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.152573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.152574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.152576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.152589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.152593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.152594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.152627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3698
2025-10-02T09:37:38.152632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3698
2025-10-02T09:37:38.152676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.152682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.152698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.152705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.152707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.152708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.152713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.152719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.152728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.152850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.152856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.152863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.152929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3699 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0
2025-10-02T09:37:38.153228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33739f5-89a0b330-e077ad95-4c524be9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.155509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Write session: try to update token
2025-10-02T09:37:38.155524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.161927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.161941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.161942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.161944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.161949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.161951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.161955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782800955:9154]
2025-10-02T09:37:38.161974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.161976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.161978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.161983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.161985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.161987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.162094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.167483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3699 sessionId: src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.169742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.220594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858390280:9529]
2025-10-02T09:37:38.220817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3698, pipe: [1:7556556261858390280:9529]
2025-10-02T09:37:38.276948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.277336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.277346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.277358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390280:9529], now have 1 active actors on pipe
2025-10-02T09:37:38.277504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.277552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.277568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858390280:9529]
2025-10-02T09:37:38.277605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:38.277697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3699 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0
2025-10-02T09:37:38.277859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3699 sessionId: src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0 is DEAD
2025-10-02T09:37:38.278010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:38.278022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Write session will restart in 0.007190s
2025-10-02T09:37:38.278047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Write session: Do CDS request
2025-10-02T09:37:38.278052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.286144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.286225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.286237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3700
2025-10-02T09:37:38.286337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.286361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.286370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.286373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.286769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3700 sessionId:  describe result for acl check
2025-10-02T09:37:38.286798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.286803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.286804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.286809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.287285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.289279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.291685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.291693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.291698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858390358:4346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.291703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.292521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.294249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.294362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.294369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.294375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.294403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.294555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782801254:9163]
2025-10-02T09:37:38.294907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.295091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.295115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.295303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.295333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.295336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.295337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.295338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.295338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.295339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.295339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.295340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.295340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.295340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.295341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.295341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.295344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.295351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.295353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.295355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.295357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.295359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.295361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.295363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.295365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.295367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.295369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.295371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.295375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.295379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.295382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.295385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.295389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.295392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.295394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.295397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.295399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.295402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.295405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.295408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.295410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.295412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.295416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.295419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.295421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.295424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.295426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.295428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.295432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.295434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.295436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.295439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.295455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.302818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.304333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.304344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.304345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.304347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.304351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3699 [2:7556556261782801254:9163]
2025-10-02T09:37:38.304357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.304366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.304367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.304369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.304370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.304378Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.304381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.304389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.304420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.304425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.304426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.304428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.304429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.304467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.304472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.304479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.304484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.304494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.304507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390566:4346], now have 1 active actors on pipe
2025-10-02T09:37:38.304513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390281:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.304516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.304517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.304519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.304526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.304537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.304543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.304545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.304546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.304548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.304550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.304562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.304567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.304569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.304579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3699
2025-10-02T09:37:38.304582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3699
2025-10-02T09:37:38.304641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.304646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.304661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.304668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.304670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.304671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.304676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.304682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.304689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.304847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.304852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.304859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.304926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3700 partition: 0 MaxSeqNo: 36 sessionId: src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0
2025-10-02T09:37:38.305182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3dfaf6-8ab306f5-9ba6a7a5-611f3a01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.307503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Write session: try to update token
2025-10-02T09:37:38.307517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.313616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.313624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.313625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.313627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.313630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.313633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.313635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782801249:9163]
2025-10-02T09:37:38.313655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.313658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.313661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.313662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.313664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.313666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.313778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.319526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3700 sessionId: src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.321792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.377776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858390584:9529]
2025-10-02T09:37:38.377945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3699, pipe: [1:7556556261858390584:9529]
2025-10-02T09:37:38.425307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.425546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.425554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.425567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390584:9529], now have 1 active actors on pipe
2025-10-02T09:37:38.425710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.425783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:38.425783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858390584:9529]
2025-10-02T09:37:38.425807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.425878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3700 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0
2025-10-02T09:37:38.426031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3700 sessionId: src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0 is DEAD
2025-10-02T09:37:38.426141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:38.426151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Write session will restart in 0.009751s
2025-10-02T09:37:38.426170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Write session: Do CDS request
2025-10-02T09:37:38.426175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.437205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.437287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.437300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3701
2025-10-02T09:37:38.437417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.437441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.437448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.437454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.437831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3701 sessionId:  describe result for acl check
2025-10-02T09:37:38.437860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.437865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.437867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.437871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.438298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.439860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.442042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.442206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.442214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.442217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858390773:4314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.442223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.442320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.442424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.442430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.442436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.442464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.442489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782801560:9160]
2025-10-02T09:37:38.442836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.442997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.443020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.443201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.443231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.443235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.443236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.443237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.443237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.443238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.443238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.443239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.443241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.443241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.443244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.443251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.443253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.443263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.443265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.443267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.443269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.443271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.443273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.443276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.443278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.443280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.443284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.443288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.443291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.443294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.443296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.443299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.443301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.443304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.443306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.443308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.443310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.443313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.443315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.443318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.443320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.443326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.443328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.443330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.443337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.443339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.443341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.443343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.443345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.443362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.450815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.452429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.452441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.452442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.452444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.452448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3700 [2:7556556261782801560:9160]
2025-10-02T09:37:38.452457Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.452468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.452470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.452472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.452473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.452483Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.452486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.452490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.452526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.452531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.452532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.452534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.452536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.452582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.452586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.452593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.452598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.452610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.452625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390585:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.452631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390885:4314], now have 1 active actors on pipe
2025-10-02T09:37:38.452635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.452636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.452638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.452645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.452653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.452661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.452663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.452665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.452668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.452669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.452680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.452682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.452683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.452723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3700
2025-10-02T09:37:38.452740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.452738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3700
2025-10-02T09:37:38.452746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.452761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.452768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.452770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.452771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.452777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.452784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.452791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.452923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.452930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.452938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.453001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3701 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0
2025-10-02T09:37:38.453309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f139b896-e8c92c1b-fa7b167b-4139ae8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.456221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Write session: try to update token
2025-10-02T09:37:38.456235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.462304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.462320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.462322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.462323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.462331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.462334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.462336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782801554:9160]
2025-10-02T09:37:38.462361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.462364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.462365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.462367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.462367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.462368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.462480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.468677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3701 sessionId: src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.470919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.525772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858390899:9529]
2025-10-02T09:37:38.525982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3700, pipe: [1:7556556261858390899:9529]
2025-10-02T09:37:38.577654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.578028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.578039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.578052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390899:9529], now have 1 active actors on pipe
2025-10-02T09:37:38.578193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.578257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.578270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858390899:9529]
2025-10-02T09:37:38.578298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:38.578300Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:37:38.578378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3701 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0
2025-10-02T09:37:38.578439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3701 sessionId: src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0 is DEAD
2025-10-02T09:37:38.578482Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 37 consumer shared/user session shared/user_1_37_10987558573187239452_v1 is DEAD
2025-10-02T09:37:38.578605Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:37:38.578606Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556197433855592:9506] disconnected; active server actors: 1
2025-10-02T09:37:38.578612Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556197433855592:9506] client user disconnected session shared/user_1_37_10987558573187239452_v1
2025-10-02T09:37:38.578656Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:38.578660Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:38.578665Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007162s
2025-10-02T09:37:38.578756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:38.578766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Write session will restart in 0.009624s
2025-10-02T09:37:38.578784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Write session: Do CDS request
2025-10-02T09:37:38.578789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.587114Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:37:38.587265Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:37:38.587271Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 38
2025-10-02T09:37:38.587414Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 38 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:38.587451Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:38.587517Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 auth for : user
2025-10-02T09:37:38.587652Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 Handle describe topics response
2025-10-02T09:37:38.587677Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 auth is DEAD
2025-10-02T09:37:38.587683Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:37:38.587868Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:37:38.587941Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:38.587954Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556261858390993:4318] connected; active server actors: 1
2025-10-02T09:37:38.587965Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556261858390993:4318] session shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:38.587973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:37:38.587979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:37:38.587988Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_38_17833371258278499700_v1" (Sender=[1:7556556261858390975:4318], Pipe=[1:7556556261858390993:4318], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:38.587991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:37:38.587999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:37:38.588012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_38_17833371258278499700_v1" (Sender=[1:7556556261858390975:4318], Pipe=[1:7556556261858390993:4318], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:38.588023Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_38_17833371258278499700_v1" sender [1:7556556261858390975:4318] lock partition 0 for ReadingSession "shared/user_1_38_17833371258278499700_v1" (Sender=[1:7556556261858390975:4318], Pipe=[1:7556556261858390993:4318], Partitions=[], ActiveFamilyCount=1) generation 1 step 38
2025-10-02T09:37:38.588034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:37:38.588041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-02T09:37:38.588173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 38 Session: "shared/user_1_38_17833371258278499700_v1" ClientId: "user" PipeClient { RawX1: 7556556261858390993 RawX2: 4503603922342110 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:37:38.588187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:37:38.589078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.589096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.589103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3702
2025-10-02T09:37:38.589178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.589197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.589203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.589206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.589496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3702 sessionId:  describe result for acl check
2025-10-02T09:37:38.589516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.589521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.589522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.589525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.589923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.591868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.593713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.593721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.593724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858391047:4301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.593729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.595464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.595723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.595898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.595906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.595913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.595945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.595967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782801855:9159]
2025-10-02T09:37:38.596334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.596493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.596516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.596712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.596748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.596752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.596753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.596753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.596754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.596754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.596755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.596756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.596756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.596757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.596757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.596758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.596760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.596767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.596769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.596772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.596774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.596776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.596778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.596780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.596782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.596784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.596786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.596788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.596791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.596795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.596799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.596811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.596814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.596816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.596819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.596822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.596826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.596828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.596830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.596833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.596837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.596839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.596842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.596844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.596847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.596849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.596852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.596854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.596856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.596859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.596865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.596868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.596886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.604244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.605831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.605843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.605844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.605846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.605852Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3701 [2:7556556261782801855:9159]
2025-10-02T09:37:38.605860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.605870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.605876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.605877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.605878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.605887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.605889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.605894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.605930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.605935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.605935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.605938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.605939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.605977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.605982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.605989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.605995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.606005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.606020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391197:4301], now have 1 active actors on pipe
2025-10-02T09:37:38.606026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391005:4294], now have 1 active actors on pipe
2025-10-02T09:37:38.606028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858390900:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.606031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.606033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.606035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.606043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.606053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.606059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.606061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.606062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.606062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.606063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.606077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.606082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.606092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.606101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.606103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.606082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3701
2025-10-02T09:37:38.606108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3701, pipe: [1:7556556261858391005:4294]
2025-10-02T09:37:38.606110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3701
2025-10-02T09:37:38.606117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.606121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.606125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_38_17833371258278499700_v1 on pipe: [1:7556556261858391005:4294]
2025-10-02T09:37:38.606140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.606148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.606150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.606153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.606158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.606162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.606161Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_38_17833371258278499700_v1:1 with generation 3701
2025-10-02T09:37:38.606172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.606176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.606176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.606184Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:38.606188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.606201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.606213Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:37:38.606293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.606298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.606306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.606357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3702 partition: 0 MaxSeqNo: 36 sessionId: src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0
2025-10-02T09:37:38.606569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6735dec-16330a2e-bfb940be-3e9ac634_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.609334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Write session: try to update token
2025-10-02T09:37:38.609347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.609536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:37:38.609556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:37:38.609563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.609564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.609565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.609568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:37:38.609573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:37:38.609675Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397858606 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:37:38.609689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:37:38.609715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 sending to client partition status
2025-10-02T09:37:38.615198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.615212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.615213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.615214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.615219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.615222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.615225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782801850:9159]
2025-10-02T09:37:38.615247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.615252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.615253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.615263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.615264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.615265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.615436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.620866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3702 sessionId: src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.623204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.729682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.730019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.730028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.730240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:38.730253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.730292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.730296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:38.730300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:38.730355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858391005:4294]
2025-10-02T09:37:38.730373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3702 reason: error at write: Disconnected sessionId: src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0
2025-10-02T09:37:38.730513Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:38.730536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3702 sessionId: src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0 is DEAD
2025-10-02T09:37:38.730662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:38.730678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Write session will restart in 0.008323s
2025-10-02T09:37:38.730695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Write session: Do CDS request
2025-10-02T09:37:38.730700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.740112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.740212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.740222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3703
2025-10-02T09:37:38.740329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.740353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.740360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.740363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.740712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3703 sessionId:  describe result for acl check
2025-10-02T09:37:38.740741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.740747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.740748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.740756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.741187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.743227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.745249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.745257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.745260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858391329:4295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.745264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.745285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.747163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.747328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.747335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.747342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.747375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.747398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782802165:9156]
2025-10-02T09:37:38.747761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.747934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.747958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.748136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.748163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.748167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.748167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.748168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.748169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.748169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.748170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.748170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.748171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.748171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.748172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.748172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.748175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.748181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.748183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.748185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.748187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.748189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.748191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.748193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.748195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.748197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.748199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.748201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.748205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.748209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.748212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.748215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.748218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.748221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.748224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.748227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.748229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.748232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.748234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.748236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.748242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.748245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.748247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.748250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.748254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.748256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.748258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.748261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.748264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.748267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.748269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.748271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.748287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.755659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.757389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.757402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.757403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.757405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.757410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3702 [2:7556556261782802165:9156]
2025-10-02T09:37:38.757418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.757431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.757435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.757439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.757440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.757449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.757455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.757460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.757491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.757495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.757496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.757498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.757500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.757535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.757540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.757547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.757552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.757563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.757577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.757581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.757583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.757588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.757594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.757596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391502:4295], now have 1 active actors on pipe
2025-10-02T09:37:38.757596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.757597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.757598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391211:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.757603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.757610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.757611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.757626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.757634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.757673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.757681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.757683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.757656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3702
2025-10-02T09:37:38.757696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.757703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.757705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.757706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.757667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3702
2025-10-02T09:37:38.757711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.757716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.757726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.757841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.757846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.757853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.757920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3703 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0
2025-10-02T09:37:38.758197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cccb6c7c-8b40cee4-764881ea-e95ac395_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.761027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Write session: try to update token
2025-10-02T09:37:38.761040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.766913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.766926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.766927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.766928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.766934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.766936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.766938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782802159:9156]
2025-10-02T09:37:38.766962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.766964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.766966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.766968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.766968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.766970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.767137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.773318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3703 sessionId: src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.775682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.830385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858391536:4294]
2025-10-02T09:37:38.830614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3702, pipe: [1:7556556261858391536:4294]
2025-10-02T09:37:38.881435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:38.881787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.881797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.881809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391536:4294], now have 1 active actors on pipe
2025-10-02T09:37:38.881982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:38.882051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858391536:4294]
2025-10-02T09:37:38.882083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:38.882770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:38.882845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0
2025-10-02T09:37:38.883004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3703 sessionId: src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0 is DEAD
2025-10-02T09:37:38.883153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:38.883164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Write session will restart in 0.006342s
2025-10-02T09:37:38.883183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Write session: Do CDS request
2025-10-02T09:37:38.883188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:38.890111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.890241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:38.890252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3704
2025-10-02T09:37:38.890385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:38.890408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:38.890416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:38.890419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:38.890757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3704 sessionId:  describe result for acl check
2025-10-02T09:37:38.890786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:38.890791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:38.890792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:38.890796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:38.891220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:38.893141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:38.895446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:38.895480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:38.895486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556261858391605:4249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:38.895490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:38.897525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:38.899355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:38.899466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:38.899473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:38.899479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:38.899507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:38.899543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556261782802484:9134]
2025-10-02T09:37:38.899897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:38.900080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:38.900106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:38.900294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:38.900323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.900327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.900328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.900328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.900329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.900330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.900330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.900331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.900331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.900332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.900333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.900333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.900336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.900343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.900345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.900347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.900349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.900351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.900353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.900355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.900357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.900359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.900361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.900364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.900367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.900372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:38.900375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.900377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:38.900380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.900383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:38.900385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.900388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:38.900390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.900393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:38.900395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.900398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:38.900400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.900403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:38.900405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.900411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:38.900414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.900420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:38.900422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.900425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.900427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.900432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.900434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.900436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.900454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:38.908003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:38.909628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:38.909639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:38.909640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:38.909643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:38.909646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3703 [2:7556556261782802484:9134]
2025-10-02T09:37:38.909656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:38.909665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:38.909670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.909673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.909673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.909683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:38.909686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:38.909690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:38.909719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.909724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.909725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.909727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:38.909728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:38.909770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:38.909776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.909786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:38.909799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:38.909817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:38.909833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391538:2446], now have 1 active actors on pipe
2025-10-02T09:37:38.909839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391782:4249], now have 1 active actors on pipe
2025-10-02T09:37:38.909843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.909844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.909845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.909853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:38.909863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:38.909865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:38.909867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:38.909868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:38.909874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:38.909875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:38.909889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.909897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:38.909878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3703
2025-10-02T09:37:38.909884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3703
2025-10-02T09:37:38.909901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:38.909929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.909936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.909957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e958eab3-aac185e9-e286de4a-acd13730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:38.909965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:38.909972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:38.909973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:38.909979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:38.909990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:38.910003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.910159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:38.910166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:38.910176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:38.910251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3704 partition: 0 MaxSeqNo: 36 sessionId: src_id|e958eab3-aac185e9-e286de4a-acd13730_0
2025-10-02T09:37:38.910504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9481e1-606dd068-bb7cabcd-f8f87a60_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e958eab3-aac185e9-e286de4a-acd13730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:38.913296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Write session: try to update token
2025-10-02T09:37:38.913308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:38.919955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:38.919969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:38.919970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:38.919971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:38.919976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.919982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.919984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556261782802479:9134]
2025-10-02T09:37:38.920010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:38.920016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:38.920018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:38.920020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:38.920024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:38.920026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:38.920151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:38.924861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3704 sessionId: src_id|e958eab3-aac185e9-e286de4a-acd13730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:38.927245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:38.982450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556261858391849:4294]
2025-10-02T09:37:38.982612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3703, pipe: [1:7556556261858391849:4294]
2025-10-02T09:37:39.029533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.029834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.029842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.029868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556261858391849:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.030028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.030091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.030105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556261858391849:4294]
2025-10-02T09:37:39.030126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:39.030213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3704 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e958eab3-aac185e9-e286de4a-acd13730_0
2025-10-02T09:37:39.030389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3704 sessionId: src_id|e958eab3-aac185e9-e286de4a-acd13730_0 is DEAD
2025-10-02T09:37:39.030506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:39.030517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Write session will restart in 0.007164s
2025-10-02T09:37:39.030531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Write session: Do CDS request
2025-10-02T09:37:39.030536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.039143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.039271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.039282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3705
2025-10-02T09:37:39.039406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.039431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.039438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.039441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.039782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3705 sessionId:  describe result for acl check
2025-10-02T09:37:39.039810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.039815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.039816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.039820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.040253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.042127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.044289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.044300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.044303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153359250:4221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.044310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.047004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.047303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.047410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.047417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.047423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.047454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.047478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077770077:9133]
2025-10-02T09:37:39.047827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.047994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.048020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.048201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.048232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.048236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.048237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.048237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.048238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.048238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.048239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.048239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.048240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.048240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.048241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.048241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.048244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.048251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.048253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.048255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.048257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.048259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.048262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.048263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.048265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.048267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.048269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.048271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.048275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.048279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.048283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.048286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.048288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.048291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.048293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.048296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.048298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.048301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.048303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.048305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.048308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.048310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.048313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.048315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.048318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.048324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.048326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.048329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.048331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.048335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.048337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.048339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.048358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.055697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.057285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.057296Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.057297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.057299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.057303Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3704 [2:7556556266077770077:9133]
2025-10-02T09:37:39.057310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.057318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.057320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.057321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.057322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.057331Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.057334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.057338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.057367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.057375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.057376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.057378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.057379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.057421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.057427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.057437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.057450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.057466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.057485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359441:4221], now have 1 active actors on pipe
2025-10-02T09:37:39.057492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359150:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.057496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.057497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.057498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.057507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.057515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.057519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.057521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.057522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.057525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.057526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.057526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3704
2025-10-02T09:37:39.057541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.057528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3704
2025-10-02T09:37:39.057547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.057548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.057565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.057572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.057599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.057610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.057613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.057615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.057621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.057628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.057640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.057758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.057765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.057775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.057837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3705 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0
2025-10-02T09:37:39.058094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e958eab3-aac185e9-e286de4a-acd13730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.060868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Write session: try to update token
2025-10-02T09:37:39.060879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.066825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.066839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.066840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.066842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.066846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.066851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.066852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077770072:9133]
2025-10-02T09:37:39.066874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.066877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.066878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.066884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.066894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.066896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.066998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.072487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3705 sessionId: src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.074795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.130407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153359455:4294]
2025-10-02T09:37:39.130590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3704, pipe: [1:7556556266153359455:4294]
2025-10-02T09:37:39.175357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.175716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.175725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.175738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359455:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.175905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.175957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:39.175963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153359455:4294]
2025-10-02T09:37:39.175971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:39.175987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.176049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3705 reason: error at write: Disconnected sessionId: src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0
2025-10-02T09:37:39.176210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3705 sessionId: src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0 is DEAD
2025-10-02T09:37:39.176339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:39.176350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Write session will restart in 0.008118s
2025-10-02T09:37:39.176370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Write session: Do CDS request
2025-10-02T09:37:39.176374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.185121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.185237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.185248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3706
2025-10-02T09:37:39.185378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.185402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.185410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.185413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.185809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3706 sessionId:  describe result for acl check
2025-10-02T09:37:39.185833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.185838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.185839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.185843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.186280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.188375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.190662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.190671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.190673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153359550:4214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.190677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.191318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.193067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.193186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.193193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.193200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.193228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.193252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077770376:9125]
2025-10-02T09:37:39.193608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.193782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.193811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.194002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.194035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.194039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.194039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.194040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.194041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.194041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.194042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.194042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.194043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.194043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.194044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.194044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.194047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.194054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.194056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.194058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.194060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.194062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.194064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.194066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.194068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.194071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.194073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.194075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.194080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.194084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.194087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.194090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.194092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.194095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.194097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.194100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.194102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.194105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.194107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.194109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.194112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.194115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.194117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.194119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.194122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.194124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.194126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.194133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.194135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.194138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.194141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.194143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.194161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.201719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.203370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.203381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.203382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.203384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.203387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3705 [2:7556556266077770376:9125]
2025-10-02T09:37:39.203394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.203403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.203406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.203407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.203408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.203417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.203420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.203424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.203457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.203462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.203463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.203465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.203467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.203510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.203516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.203526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.203539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.203557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.203575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359456:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.203582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359750:4214], now have 1 active actors on pipe
2025-10-02T09:37:39.203587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.203593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.203595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.203601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.203606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.203611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.203613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.203614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.203624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.203628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.203620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3705
2025-10-02T09:37:39.203622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3705
2025-10-02T09:37:39.203645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.203651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.203652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.203667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.203674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.203704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.203714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.203717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.203718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.203726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.203734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.203750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.203885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.203892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.203903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.203972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3706 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0
2025-10-02T09:37:39.204244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0421b3c-fd12e2eb-ea1f0758-3076d30f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.207013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Write session: try to update token
2025-10-02T09:37:39.207025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.213497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.213515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.213517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.213519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.213527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.213532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.213537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077770371:9125]
2025-10-02T09:37:39.213568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.213572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.213577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.213577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.213579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.213580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.213757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.219541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3706 sessionId: src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.221846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.276339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153359767:4294]
2025-10-02T09:37:39.276538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3705, pipe: [1:7556556266153359767:4294]
2025-10-02T09:37:39.322902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.323335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.323344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.323357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359767:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.323500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.323534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.323534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:39.323538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:39.323585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153359767:4294]
2025-10-02T09:37:39.323608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3706 reason: error at write: Disconnected sessionId: src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0
2025-10-02T09:37:39.323760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3706 sessionId: src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0 is DEAD
2025-10-02T09:37:39.323914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:39.323929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Write session will restart in 0.009756s
2025-10-02T09:37:39.323948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Write session: Do CDS request
2025-10-02T09:37:39.323953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.335126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.335197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.335208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3707
2025-10-02T09:37:39.335343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.335366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.335373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.335376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.335732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3707 sessionId:  describe result for acl check
2025-10-02T09:37:39.335762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.335768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.335769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.335773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.336254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.337861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.338036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.339886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.339993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.340002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.340002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.340009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.340004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153359964:4211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.340014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.340009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.340041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.340065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077770674:9129]
2025-10-02T09:37:39.340435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.340621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.340657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.340862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.340892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.340897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.340897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.340898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.340899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.340899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.340900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.340900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.340901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.340902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.340902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.340903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.340906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.340913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.340915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.340918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.340920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.340922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.340924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.340926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.340928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.340931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.340933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.340935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.340939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.340943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.340947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.340950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.340952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.340955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.340957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.340959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.340962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.340964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.340970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.340973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.340976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.340978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.340984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.340986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.340992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.340998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.341000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.341003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.341005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.341008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.341012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.341015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.341030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.348524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.349958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.349970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.349971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.349974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.349977Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3706 [2:7556556266077770674:9129]
2025-10-02T09:37:39.349984Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.349994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.350000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.350002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.350003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.350012Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.350016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.350020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.350050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.350056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.350057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.350059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.350060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.350096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.350101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.350108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.350115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.350129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.350148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153359768:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.350156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360065:4211], now have 1 active actors on pipe
2025-10-02T09:37:39.350160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.350164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.350166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.350175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.350187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.350189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.350194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.350195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.350200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.350203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.350222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.350233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.350224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3706
2025-10-02T09:37:39.350246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.350261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.350263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.350239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3706
2025-10-02T09:37:39.350283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.350290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.350292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.350294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.350301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.350310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.350323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.350530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.350539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.350555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.350626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3707 partition: 0 MaxSeqNo: 36 sessionId: src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0
2025-10-02T09:37:39.350900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ea68bb-a62ebb65-a8c3f40f-11e5afb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.353782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Write session: try to update token
2025-10-02T09:37:39.353796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.359756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.359774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.359777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.359779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.359785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.359790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.359793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077770669:9129]
2025-10-02T09:37:39.359820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.359825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.359828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.359829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.359830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.359830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.359991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.366483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3707 sessionId: src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.368781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.423783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153360079:4294]
2025-10-02T09:37:39.423960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3706, pipe: [1:7556556266153360079:4294]
2025-10-02T09:37:39.468364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.468691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.468700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.468712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360079:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.468883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.468925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.468935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153360079:4294]
2025-10-02T09:37:39.468957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:39.469050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0
2025-10-02T09:37:39.469196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3707 sessionId: src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0 is DEAD
2025-10-02T09:37:39.469608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:39.469620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Write session will restart in 0.005360s
2025-10-02T09:37:39.469635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Write session: Do CDS request
2025-10-02T09:37:39.469639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.476111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.476196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.476205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3708
2025-10-02T09:37:39.476316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.476340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.476348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.476351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.476644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3708 sessionId:  describe result for acl check
2025-10-02T09:37:39.476673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.476679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.476681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.476686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.477084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.478819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.481322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.481331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.481336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153360136:4175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.481340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.484381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.486088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.486193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.486200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.486205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.486231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.486256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077770989:9119]
2025-10-02T09:37:39.486606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.486773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.486800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.486984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.487013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.487017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.487018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.487018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.487019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.487019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.487020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.487021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.487021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.487022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.487022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.487023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.487026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.487033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.487035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.487037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.487039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.487041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.487043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.487045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.487047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.487049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.487051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.487053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.487057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.487061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.487065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.487069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.487071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.487074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.487076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.487078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.487080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.487083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.487087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.487089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.487091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.487094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.487096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.487098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.487100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.487103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.487108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.487111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.487113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.487116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.487119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.487122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.487139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.494437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.496041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.496053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.496054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.496056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.496060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3707 [2:7556556266077770989:9119]
2025-10-02T09:37:39.496068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.496081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.496085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.496087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.496088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.496097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.496099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.496106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.496137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.496142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.496143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.496145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.496146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.496187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.496193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.496202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.496216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.496233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.496251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360092:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.496256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360299:4175], now have 1 active actors on pipe
2025-10-02T09:37:39.496259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.496260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.496261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.496269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.496278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.496281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.496283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.496284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.496289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.496291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.496304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.496310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.496315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.496315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3707
2025-10-02T09:37:39.496315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3707
2025-10-02T09:37:39.496352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.496360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.496378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.496387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.496389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.496393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.496401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.496412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.496424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.496545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.496551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.496560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.496624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3708 partition: 0 MaxSeqNo: 36 sessionId: src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0
2025-10-02T09:37:39.496930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66dcadf3-1a3dc1b0-b29ae3da-46b314a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.499643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Write session: try to update token
2025-10-02T09:37:39.499653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.505899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.505914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.505915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.505916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.505921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.505923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.505925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077770984:9119]
2025-10-02T09:37:39.505948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.505954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.505956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.505965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.505975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.505977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.506071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.511073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3708 sessionId: src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.513427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.569208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153360401:4294]
2025-10-02T09:37:39.569460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3707, pipe: [1:7556556266153360401:4294]
2025-10-02T09:37:39.615642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.616010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.616019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.616044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360401:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.616197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.616200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:39.616214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:39.616214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.616261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153360401:4294]
2025-10-02T09:37:39.616283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3708 reason: error at write: Disconnected sessionId: src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0
2025-10-02T09:37:39.616448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3708 sessionId: src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0 is DEAD
2025-10-02T09:37:39.616595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:39.616607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Write session will restart in 0.005253s
2025-10-02T09:37:39.616625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Write session: Do CDS request
2025-10-02T09:37:39.616629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.623115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.623215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.623224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3709
2025-10-02T09:37:39.623343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.623367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.623374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.623377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.623704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3709 sessionId:  describe result for acl check
2025-10-02T09:37:39.623733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.623781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.623787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.623791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.624233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.626795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.629427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.629435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.629438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153360444:4177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.629443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.631347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.633057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.633261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.633270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.633277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.633310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.633334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077771290:9117]
2025-10-02T09:37:39.633677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.633839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.633861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.634035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.634064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.634068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.634069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.634070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.634070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.634071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.634071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.634072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.634072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.634073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.634073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.634074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.634076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.634083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.634085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.634087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.634089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.634091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.634093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.634095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.634097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.634099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.634101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.634102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.634106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.634111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.634115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.634118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.634120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.634123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.634124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.634127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.634129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.634132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.634134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.634137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.634139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.634142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.634144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.634146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.634150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.634156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.634158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.634161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.634163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.634165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.634167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.634170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.634188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.641583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.643010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.643022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.643023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.643026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.643029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3708 [2:7556556266077771290:9117]
2025-10-02T09:37:39.643037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.643046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.643048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.643049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.643050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.643060Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.643067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.643071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.643227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.643233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.643234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.643236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.643237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.643285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.643290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.643297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.643302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.643313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.643327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360402:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.643333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360644:4177], now have 1 active actors on pipe
2025-10-02T09:37:39.643337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.643338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.643340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.643348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.643358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.643363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.643365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.643366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.643369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.643371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.643363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3708
2025-10-02T09:37:39.643385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.643365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3708
2025-10-02T09:37:39.643390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.643391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.643405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.643410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.643434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.643441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.643444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.643445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.643450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.643459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.643470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.643575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.643580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.643587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.643651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3709 partition: 0 MaxSeqNo: 36 sessionId: src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0
2025-10-02T09:37:39.643903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8481d088-9cf9de35-56dd1f40-fe0287c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.646588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Write session: try to update token
2025-10-02T09:37:39.646598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.652619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.652633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.652634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.652635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.652639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.652644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.652646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077771285:9117]
2025-10-02T09:37:39.652668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.652671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.652672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.652674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.652677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.652679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.652783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.658683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3709 sessionId: src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.661017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.716643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153360713:4294]
2025-10-02T09:37:39.716839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3708, pipe: [1:7556556266153360713:4294]
2025-10-02T09:37:39.763230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.763451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.763460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.763472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360713:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.763606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.763640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.763640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:39.763644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:39.763702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153360713:4294]
2025-10-02T09:37:39.763719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3709 reason: error at write: Disconnected sessionId: src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0
2025-10-02T09:37:39.763893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3709 sessionId: src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0 is DEAD
2025-10-02T09:37:39.764022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:39.764033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Write session will restart in 0.009357s
2025-10-02T09:37:39.764048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Write session: Do CDS request
2025-10-02T09:37:39.764052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.774124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.774268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.774278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3710
2025-10-02T09:37:39.774405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.774429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.774436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.774439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.774848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3710 sessionId:  describe result for acl check
2025-10-02T09:37:39.774877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.774882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.774883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.774887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.775302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.777480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.779470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.779479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.779481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153360856:4156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.779485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.781751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.782029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.782181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.782189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.782195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.782227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.782251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077771606:9111]
2025-10-02T09:37:39.782598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.782802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.782830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.783014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.783042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.783046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.783047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.783048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.783048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.783049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.783049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.783050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.783050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.783051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.783051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.783052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.783055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.783061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.783063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.783065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.783067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.783069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.783071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.783073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.783075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.783077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.783081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.783083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.783087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.783091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.783094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.783097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.783099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.783102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.783105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.783108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.783121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.783127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.783129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.783131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.783133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.783136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.783139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.783142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.783144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.783146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.783148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.783151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.783153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.783155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.783157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.783160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.783177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.790669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.792273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.792285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.792286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.792288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.792293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3709 [2:7556556266077771606:9111]
2025-10-02T09:37:39.792300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.792309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.792314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.792315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.792316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.792325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.792327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.792331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.792358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.792363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.792364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.792366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.792367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.792410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.792417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.792427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.792441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.792458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.792475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153360717:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.792482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153361013:4156], now have 1 active actors on pipe
2025-10-02T09:37:39.792485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.792486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.792488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.792496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.792509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.792510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.792512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.792513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.792525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.792529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.792544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.792531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3709
2025-10-02T09:37:39.792541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3709
2025-10-02T09:37:39.792553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.792572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.792580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.792583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.792605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.792615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.792619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.792621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.792627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.792637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.792651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.792777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.792783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.792793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.792873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3710 partition: 0 MaxSeqNo: 36 sessionId: src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0
2025-10-02T09:37:39.793149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25cc78b7-e71cc630-3753440e-60bc7ba0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.796200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Write session: try to update token
2025-10-02T09:37:39.796211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.805459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:39.805473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.805478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.805507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:39.805518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:39.805687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:39.805821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:39.805939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:39.806060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:39.806258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:39.806283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:39.808037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3710 sessionId: src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.811590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.811605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.811606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.811607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.811612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.811614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.811616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077771601:9111]
2025-10-02T09:37:39.811636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.811643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.811644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.811763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.811877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.811890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.811892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.815514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:39.864099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556266153361053:4294]
2025-10-02T09:37:39.864278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3709, pipe: [1:7556556266153361053:4294]
2025-10-02T09:37:39.921190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:39.922208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.922219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.922232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153361053:4294], now have 1 active actors on pipe
2025-10-02T09:37:39.922366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:39.922416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:39.922442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556266153361053:4294]
2025-10-02T09:37:39.922464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:39.922553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3710 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0
2025-10-02T09:37:39.922700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3710 sessionId: src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0 is DEAD
2025-10-02T09:37:39.922856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:39.922867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Write session will restart in 0.008985s
2025-10-02T09:37:39.922886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Write session: Do CDS request
2025-10-02T09:37:39.922890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:39.933133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.933231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:39.933241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3711
2025-10-02T09:37:39.933348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:39.933370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:39.933377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:39.933380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:39.933710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3711 sessionId:  describe result for acl check
2025-10-02T09:37:39.933740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:39.933745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:39.933747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:39.933751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:39.934181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:39.935246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:39.935522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:39.935743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:39.935754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:39.935763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:39.935802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:39.935830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556266077771930:9100]
2025-10-02T09:37:39.936185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:39.936296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:39.936350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:39.936375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:39.936556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:39.936593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.936598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.936599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.936599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.936600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.936600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.936601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.936602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.936602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.936603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.936603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.936604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.936607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.936613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.936615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.936617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.936619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.936621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.936623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.936625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.936627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.936629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.936631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.936633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.936638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.936643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:39.936646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.936649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:39.936652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.936655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:39.936658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.936663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:39.936666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.936671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:39.936675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.936684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:39.936689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.936698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:39.936701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.936704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:39.936706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.936709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:39.936711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.936714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.936716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.936720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.936722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.936725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.936742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:39.940550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:39.940558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:39.940561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556266153361564:4122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:39.940565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:39.944292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:39.946143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:39.946157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:39.946158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:39.946159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:39.946163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3710 [2:7556556266077771930:9100]
2025-10-02T09:37:39.946170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:39.946183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:39.946188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.946189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.946190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.946199Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:39.946205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:39.946210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:39.946257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.946262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.946263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.946264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:39.946266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:39.946304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:39.946309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.946315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:39.946321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:39.946333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:39.946347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153361054:2446], now have 1 active actors on pipe
2025-10-02T09:37:39.946352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556266153361606:4122], now have 1 active actors on pipe
2025-10-02T09:37:39.946356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.946358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.946359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.946367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:39.946378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:39.946385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:39.946389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:39.946390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:39.946394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:39.946396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:39.946404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.946405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:39.946407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:39.946403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3710
2025-10-02T09:37:39.946437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.946442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.946458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:39.946465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:39.946466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:39.946468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:39.946473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:39.946481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:39.946492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.946574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3710
2025-10-02T09:37:39.946618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:39.946623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:39.946635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:39.946706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3711 partition: 0 MaxSeqNo: 36 sessionId: src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0
2025-10-02T09:37:39.946954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a425407-7f422fa9-c52c4704-a130e1d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:39.949757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Write session: try to update token
2025-10-02T09:37:39.949768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:39.956221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:39.956239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:39.956241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:39.956242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:39.956250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.956255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.956259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556266077771925:9100]
2025-10-02T09:37:39.956292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:39.956298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:39.956299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:39.956303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:39.956304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:39.956306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:39.956466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:39.962224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3711 sessionId: src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:39.964557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.022818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448328917:4294]
2025-10-02T09:37:40.023014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3710, pipe: [1:7556556270448328917:4294]
2025-10-02T09:37:40.065891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.066115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.066124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.066137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448328917:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.066307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.066319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.066331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448328917:4294]
2025-10-02T09:37:40.066358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:40.066521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3711 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0
2025-10-02T09:37:40.066675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3711 sessionId: src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0 is DEAD
2025-10-02T09:37:40.067084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:40.067096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Write session will restart in 0.009649s
2025-10-02T09:37:40.067112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Write session: Do CDS request
2025-10-02T09:37:40.067116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.078207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.078330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.078341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3712
2025-10-02T09:37:40.078462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.078488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.078497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.078501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.078823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3712 sessionId:  describe result for acl check
2025-10-02T09:37:40.078849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.078854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.078857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.078860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.079041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.079295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.079305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.079489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.079498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.079505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.079539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.079561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372739530:9097]
2025-10-02T09:37:40.079910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.080085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.080108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.080289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.080321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.080325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.080326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.080326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.080327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.080328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.080328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.080329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.080329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.080330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.080330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.080331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.080333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.080340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.080343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.080345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.080347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.080349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.080351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.080353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.080355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.080357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.080359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.080361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.080365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.080369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.080373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.080376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.080378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.080381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.080383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.080386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.080388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.080391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.080393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.080396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.080398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.080401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.080403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.080406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.080408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.080410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.080412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.080415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.080417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.080422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.080424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.080426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.080443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.080615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.085261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.085269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.085271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448329433:3028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.085275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.087936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.089448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.089461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.089462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.089464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.089468Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3711 [2:7556556270372739530:9097]
2025-10-02T09:37:40.089474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.089483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.089489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.089491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.089492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.089502Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.089505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.089509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.089539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.089544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.089545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.089547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.089549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.089584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.089589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.089596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.089601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.089609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.089622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.089629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.089630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.089637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.089645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448329472:3028], now have 1 active actors on pipe
2025-10-02T09:37:40.089647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.089649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.089651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448328921:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.089651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.089656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.089663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.089664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.089662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3711
2025-10-02T09:37:40.089670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3711
2025-10-02T09:37:40.089678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.089684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.089685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.089700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.089705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.089728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0040874-5ab58485-d298d240-b195843e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.089735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.089736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.089738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.089742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.089749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.089761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.089892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.089897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.089905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.089969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3712 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0040874-5ab58485-d298d240-b195843e_0
2025-10-02T09:37:40.090205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ad3553-d2316c6d-86b8557c-cc0ecbd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0040874-5ab58485-d298d240-b195843e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.093016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Write session: try to update token
2025-10-02T09:37:40.093026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.099211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.099231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.099233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.099235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.099242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.099247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.099255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372739525:9097]
2025-10-02T09:37:40.099294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.099298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.099303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.099305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.099305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.099308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.099458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.105342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3712 sessionId: src_id|b0040874-5ab58485-d298d240-b195843e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.107646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.166716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448329479:4294]
2025-10-02T09:37:40.166910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3711, pipe: [1:7556556270448329479:4294]
2025-10-02T09:37:40.209410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.209756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.209766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.209779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448329479:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.209905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.209955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448329479:4294]
2025-10-02T09:37:40.209988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.210055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:40.210143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0040874-5ab58485-d298d240-b195843e_0
2025-10-02T09:37:40.210284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3712 sessionId: src_id|b0040874-5ab58485-d298d240-b195843e_0 is DEAD
2025-10-02T09:37:40.210645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:40.210657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Write session will restart in 0.007427s
2025-10-02T09:37:40.210674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Write session: Do CDS request
2025-10-02T09:37:40.210679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.219132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.219252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.219273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3713
2025-10-02T09:37:40.219408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.219433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.219438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.219441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.219782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3713 sessionId:  describe result for acl check
2025-10-02T09:37:40.219813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.219818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.219819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.219823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.220244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.222030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.222114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.222911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.223026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.223033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.223039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.223084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.223105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372739846:9087]
2025-10-02T09:37:40.223473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.223633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.223657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.223842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.223871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.223875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.223876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.223877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.223877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.223876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.223878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.223885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.223878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.223879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.223879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.223880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.223880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.223881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.223884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.223902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448329886:4075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.223910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.223891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.223893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.223895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.223897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.223900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.223902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.223904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.223906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.223908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.223910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.223912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.223915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.223919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.223922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.223925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.223927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.223930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.223932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.223934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.223937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.223939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.223941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.223944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.223948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.223950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.223952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.223955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.223958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.223960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.223964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.223966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.223969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.223971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.223973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.223976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.223992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.231294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.232903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.232913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.232914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.232916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.232920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3712 [2:7556556270372739846:9087]
2025-10-02T09:37:40.232927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.232935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.232940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.232941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.232942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.232951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.232957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.232961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.232995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.233002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.233003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.233006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.233008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.233049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.233053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.233061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.233069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.233080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.233094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330034:4075], now have 1 active actors on pipe
2025-10-02T09:37:40.233100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448329481:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.233103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.233105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.233106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.233114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.233124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.233128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.233130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.233131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.233134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.233136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.233150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.233154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.233156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.233150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3712
2025-10-02T09:37:40.233153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3712
2025-10-02T09:37:40.233183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.233188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.233204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.233210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.233212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.233214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.233219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.233227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.233237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.233365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.233370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.233377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.233438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3713 partition: 0 MaxSeqNo: 36 sessionId: src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0
2025-10-02T09:37:40.233712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0040874-5ab58485-d298d240-b195843e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.236473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Write session: try to update token
2025-10-02T09:37:40.236484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.242999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.243017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.243019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.243021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.243027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.243031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.243034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372739837:9087]
2025-10-02T09:37:40.243062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.243063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.243066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.243068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.243074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.243076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.243203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.248616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3713 sessionId: src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.250939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.310062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448330043:4294]
2025-10-02T09:37:40.310234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3712, pipe: [1:7556556270448330043:4294]
2025-10-02T09:37:40.351627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.352056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.352066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.352078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330043:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.352191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.352244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:40.352254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:40.352267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.352306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448330043:4294]
2025-10-02T09:37:40.352317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3713 reason: error at write: Disconnected sessionId: src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0
2025-10-02T09:37:40.352459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3713 sessionId: src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0 is DEAD
2025-10-02T09:37:40.352581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:40.352591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Write session will restart in 0.007411s
2025-10-02T09:37:40.352606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Write session: Do CDS request
2025-10-02T09:37:40.352610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.357258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.357932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.358031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.358037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.358043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.358068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.358094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372739915:9082]
2025-10-02T09:37:40.358428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.358593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.358618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.358797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.358828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.358832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.358833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.358833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.358834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.358835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.358835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.358836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.358837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.358837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.358838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.358839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.358842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.358848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.358850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.358852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.358856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.358858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.358860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.358861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.358863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.358865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.358867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.358869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.358873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.358878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.358881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.358884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.358886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.358889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.358891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.358894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.358896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.358899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.358901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.358904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.358906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.358909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.358911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.358914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.358916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.358919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.358921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.358924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.358929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.358932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.358934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.358937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.358957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.361101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.361221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.361233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3714
2025-10-02T09:37:40.361339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.361360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.361365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.361369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.361718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3714 sessionId:  describe result for acl check
2025-10-02T09:37:40.361746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.361751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.361753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.361761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.362180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.363756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.365801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.365810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.365812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448330071:4048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.365817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.366406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.368115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.368130Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.368131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.368134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.368137Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3713 [2:7556556270372739915:9082]
2025-10-02T09:37:40.368147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.368157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.368162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.368164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.368165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.368174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.368177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.368181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.368215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.368220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.368221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.368223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.368225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.368264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.368269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.368276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.368281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.368290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.368304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330106:4048], now have 1 active actors on pipe
2025-10-02T09:37:40.368310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330045:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.368314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.368315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.368317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.368324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.368335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.368338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.368340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.368342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.368346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.368347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.368363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.368369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.368374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.368370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3713
2025-10-02T09:37:40.368376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3713
2025-10-02T09:37:40.368424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.368430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.368447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.368453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.368455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.368456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.368461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.368467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.368478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.368611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.368616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.368624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.368691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3714 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0
2025-10-02T09:37:40.368928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93df6d2-c91ac63b-4361c6bf-2163247_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.371657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Write session: try to update token
2025-10-02T09:37:40.371667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.377688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.377703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.377704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.377705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.377710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.377715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.377717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372739910:9082]
2025-10-02T09:37:40.377737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.377742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.377744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.377745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.377746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.377746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.377860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.382818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3714 sessionId: src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.385221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.452379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448330125:4294]
2025-10-02T09:37:40.452517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3713, pipe: [1:7556556270448330125:4294]
2025-10-02T09:37:40.487964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.488334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.488344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.488356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330125:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.488496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.488546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:40.488556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:40.488567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448330125:4294]
2025-10-02T09:37:40.488589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.488621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3714 reason: error at write: Disconnected sessionId: src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0
2025-10-02T09:37:40.488771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3714 sessionId: src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0 is DEAD
2025-10-02T09:37:40.488894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:40.488905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Write session will restart in 0.009204s
2025-10-02T09:37:40.488924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Write session: Do CDS request
2025-10-02T09:37:40.488929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.493601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.494405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.494526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.494534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.494541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.494571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.494599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372739975:9065]
2025-10-02T09:37:40.494958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.495131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.495154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.495344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.495379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.495383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.495383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.495384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.495386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.495387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.495387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.495388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.495388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.495389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.495389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.495390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.495393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.495400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.495403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.495405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.495407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.495409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.495411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.495413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.495415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.495417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.495419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.495421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.495425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.495429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.495433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.495436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.495438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.495441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.495443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.495446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.495449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.495451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.495453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.495456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.495459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.495466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.495469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.495472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.495474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.495477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.495479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.495482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.495484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.495487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.495489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.495495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.495513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.499278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.499329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.499342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3715
2025-10-02T09:37:40.499485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.499507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.499510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.499513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.499884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3715 sessionId:  describe result for acl check
2025-10-02T09:37:40.499923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.499929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.499930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.499935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.500380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.502022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.503048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.503947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.503957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.503959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448330150:4044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.503964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.504678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.504690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.504692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.504694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.504699Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3714 [2:7556556270372739975:9065]
2025-10-02T09:37:40.504706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.504719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.504724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.504726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.504727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.504737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.504742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.504746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.504779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.504783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.504784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.504786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.504787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.504839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.504844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.504851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.504856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.504864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.504878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330126:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.504884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330185:4044], now have 1 active actors on pipe
2025-10-02T09:37:40.504888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.504889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.504890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.504897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.504905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.504912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.504913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.504914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.504915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.504915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.504919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3714
2025-10-02T09:37:40.504921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3714
2025-10-02T09:37:40.504930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.504936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.504939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.504961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.504966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.504981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.504988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.504990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.504991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.504997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.505002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.505011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.505108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.505113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.505121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.505178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3715 partition: 0 MaxSeqNo: 36 sessionId: src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0
2025-10-02T09:37:40.505395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d9c724-29cdd753-7d6f1365-1713a745_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.507867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Write session: try to update token
2025-10-02T09:37:40.507882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.513953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.513965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.513967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.513967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.513971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.513973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.513975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372739970:9065]
2025-10-02T09:37:40.513994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.513998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.514001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.514001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.514002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.514003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.514185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.519975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3715 sessionId: src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.522026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.588627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448330193:4294]
2025-10-02T09:37:40.588880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3714, pipe: [1:7556556270448330193:4294]
2025-10-02T09:37:40.626777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.627142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.627151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.627164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330193:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.627313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.627298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448330193:4294]
2025-10-02T09:37:40.627323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:40.627325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:40.627334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.627371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3715 reason: error at write: Disconnected sessionId: src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0
2025-10-02T09:37:40.627507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3715 sessionId: src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0 is DEAD
2025-10-02T09:37:40.627667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:40.627678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Write session will restart in 0.005629s
2025-10-02T09:37:40.627702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Write session: Do CDS request
2025-10-02T09:37:40.627707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.632267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.633043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.633158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.633166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.633173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.633202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.633228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372740034:9066]
2025-10-02T09:37:40.633604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.633795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.633821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.634003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.634034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.634038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.634039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.634039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.634040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.634040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.634041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.634042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.634042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.634043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.634043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.634044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.634046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.634054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.634056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.634058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.634060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.634062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.634065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.634067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.634069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.634071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.634073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.634075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.634079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.634083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.634086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.634089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.634091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.634096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.634097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.634100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.634102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.634105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.634108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.634110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.634112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.634115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.634118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.634121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.634123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.634125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.634127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.634130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.634132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.634134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.634136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.634139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.634158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.634156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.634205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.634214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3716
2025-10-02T09:37:40.634371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.634391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.634398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.634401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.634749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3716 sessionId:  describe result for acl check
2025-10-02T09:37:40.634785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.634789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.634791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.634795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.635236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.636634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.640537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.640548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.640550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448330219:4025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.640555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.641750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.643326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.643338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.643340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.643342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.643345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3715 [2:7556556270372740034:9066]
2025-10-02T09:37:40.643355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.643369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.643373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.643375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.643376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.643385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.643391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.643395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.643428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.643433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.643434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.643436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.643437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.643475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.643480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.643488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.643493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.643504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.643517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330194:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.643522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330254:4025], now have 1 active actors on pipe
2025-10-02T09:37:40.643526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.643527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.643528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.643535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.643545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.643555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.643557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.643559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.643561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.643547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3715
2025-10-02T09:37:40.643560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3715
2025-10-02T09:37:40.643561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.643578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.643580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.643586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.643588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.643590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.643611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc8644c-cc376739-9996adb8-3b1931db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.643621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.643624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.643625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.643630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.643635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.643648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.643745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.643751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.643761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.643826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3716 partition: 0 MaxSeqNo: 36 sessionId: src_id|cbc8644c-cc376739-9996adb8-3b1931db_0
2025-10-02T09:37:40.644035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9ced8-9921d9d8-8da246c4-5db9cbb1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cbc8644c-cc376739-9996adb8-3b1931db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.646316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Write session: try to update token
2025-10-02T09:37:40.646330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.652597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.652608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.652609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.652610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.652614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.652616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.652618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372740029:9066]
2025-10-02T09:37:40.652637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.652639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.652641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.652643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.652643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.652644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.652765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.658142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3716 sessionId: src_id|cbc8644c-cc376739-9996adb8-3b1931db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.660196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.727343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448330262:4294]
2025-10-02T09:37:40.727518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3715, pipe: [1:7556556270448330262:4294]
2025-10-02T09:37:40.764857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.765094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.765103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.765116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330262:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.765244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.765278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448330262:4294]
2025-10-02T09:37:40.765299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.765329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:40.765420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3716 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cbc8644c-cc376739-9996adb8-3b1931db_0
2025-10-02T09:37:40.765581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3716 sessionId: src_id|cbc8644c-cc376739-9996adb8-3b1931db_0 is DEAD
2025-10-02T09:37:40.765714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:40.765723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Write session will restart in 0.006413s
2025-10-02T09:37:40.765743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Write session: Do CDS request
2025-10-02T09:37:40.765748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.770349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.771118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.771224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.771231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.771237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.771263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.771300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372740093:9076]
2025-10-02T09:37:40.771704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.771892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.771920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.772119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.772153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.772157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.772158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.772158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.772159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.772159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.772160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.772161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.772161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.772162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.772162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.772163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.772165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.772174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.772176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.772178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.772180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.772182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.772184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.772186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.772188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.772190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.772192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.772194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.772197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.772201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.772204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.772207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.772209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.772212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.772214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.772217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.772219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.772221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.772224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.772226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.772229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.772231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.772233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.772236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.772240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.772244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.772246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.772249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.772252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.772255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.772258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.772260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.772277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.773166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.773241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.773249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3717
2025-10-02T09:37:40.773362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.773383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.773386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.773389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.773749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3717 sessionId:  describe result for acl check
2025-10-02T09:37:40.773780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.773785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.773786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.773790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.774236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.775970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.779137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.779146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.779149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448330289:4023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.779153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.779678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.781213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.781226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.781228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.781230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.781233Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3716 [2:7556556270372740093:9076]
2025-10-02T09:37:40.781241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.781252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.781257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.781258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.781260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.781268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.781271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.781279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.781312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.781317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.781319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.781321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.781323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.781360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.781365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.781372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.781377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.781385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.781399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330324:4023], now have 1 active actors on pipe
2025-10-02T09:37:40.781404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330263:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.781408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.781413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.781414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.781422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.781432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.781435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.781438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.781439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.781442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.781444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.781458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.781463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.781464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.781445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3716
2025-10-02T09:37:40.781478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.781447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3716
2025-10-02T09:37:40.781483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.781638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.781646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.781650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.781654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.781659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.781668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.781684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.781811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.781818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.781828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.781898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3717 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0
2025-10-02T09:37:40.782156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc8644c-cc376739-9996adb8-3b1931db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.784371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Write session: try to update token
2025-10-02T09:37:40.784383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.790753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.790768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.790770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.790772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.790779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.790781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.790784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372740088:9076]
2025-10-02T09:37:40.790803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.790807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.790809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.790810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.790810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.790812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.790917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.795917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3717 sessionId: src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.798070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:40.865562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556270448330354:4294]
2025-10-02T09:37:40.865696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3716, pipe: [1:7556556270448330354:4294]
2025-10-02T09:37:40.902642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:40.902969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.902980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.903003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330354:4294], now have 1 active actors on pipe
2025-10-02T09:37:40.903127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:40.903151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:40.903161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:40.903205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3717 reason: error at write: Disconnected sessionId: src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0
2025-10-02T09:37:40.903217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:40.903262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556270448330354:4294]
2025-10-02T09:37:40.903351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3717 sessionId: src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0 is DEAD
2025-10-02T09:37:40.903503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:40.903512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Write session will restart in 0.008235s
2025-10-02T09:37:40.903534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Write session: Do CDS request
2025-10-02T09:37:40.903539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:40.908641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:40.908941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:40.909103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:40.909110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:40.909117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:40.909150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:40.909175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556270372740191:9056]
2025-10-02T09:37:40.909540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:40.909705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:40.909735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:40.909928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:40.909962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.909966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.909967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.909968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.909968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.909969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.909969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.909970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.909970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.909971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.909971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.909972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.909974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.909981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.909983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.909985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.909987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.909989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.909991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.909993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.909995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.909997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.909999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.910001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.910004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.910008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:40.910012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.910015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:40.910017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.910021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:40.910022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.910025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:40.910027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.910030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:40.910032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.910035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:40.910038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.910047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:40.910050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.910055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:40.910063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.910066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:40.910070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.910073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.910075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.910078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.910082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.910084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.910100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:40.913115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.913214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:40.913227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3718
2025-10-02T09:37:40.913318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:40.913339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:40.913346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:40.913349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:40.913708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3718 sessionId:  describe result for acl check
2025-10-02T09:37:40.913745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:40.913750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:40.913751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:40.913755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:40.914178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:40.915672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:40.917423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:40.917751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:40.917760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:40.917762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556270448330382:3987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:40.917767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:40.919032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:40.919045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:40.919046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:40.919049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:40.919052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3717 [2:7556556270372740191:9056]
2025-10-02T09:37:40.919059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:40.919068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:40.919070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.919072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.919073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.919084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:40.919086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:40.919091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:40.919121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.919126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.919128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.919130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:40.919131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:40.919170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:40.919175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.919182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:40.919187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:40.919195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:40.919209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330417:3987], now have 1 active actors on pipe
2025-10-02T09:37:40.919215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556270448330355:2446], now have 1 active actors on pipe
2025-10-02T09:37:40.919218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.919219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.919220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.919229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:40.919238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:40.919242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:40.919244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:40.919245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:40.919249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:40.919233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3717
2025-10-02T09:37:40.919250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:40.919245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3717
2025-10-02T09:37:40.919275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.919282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:40.919283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:40.919300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.919306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.919326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c924205-f8d7c78d-958c7285-60734508_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:40.919334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:40.919336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:40.919337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:40.919342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:40.919351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:40.919364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.919470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:40.919478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:40.919487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:40.919552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3718 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c924205-f8d7c78d-958c7285-60734508_0
2025-10-02T09:37:40.919784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8893c40-47254e3f-fff4ffb0-1fe39fe5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c924205-f8d7c78d-958c7285-60734508_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:40.922020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Write session: try to update token
2025-10-02T09:37:40.922034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:40.928240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:40.928255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:40.928257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:40.928258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:40.928262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.928264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.928266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556270372740186:9056]
2025-10-02T09:37:40.928285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:40.928292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:40.928293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:40.928293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:40.928295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:40.928297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:40.928407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:40.933902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3718 sessionId: src_id|2c924205-f8d7c78d-958c7285-60734508_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:40.936046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.003305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743297725:4294]
2025-10-02T09:37:41.003504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3717, pipe: [1:7556556274743297725:4294]
2025-10-02T09:37:41.037454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.037859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.037869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.037882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297725:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.038032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.038050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:41.038062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:41.038086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743297725:4294]
2025-10-02T09:37:41.038104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.038108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3718 reason: error at write: Disconnected sessionId: src_id|2c924205-f8d7c78d-958c7285-60734508_0
2025-10-02T09:37:41.038232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3718 sessionId: src_id|2c924205-f8d7c78d-958c7285-60734508_0 is DEAD
2025-10-02T09:37:41.038391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:41.038402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Write session will restart in 0.006369s
2025-10-02T09:37:41.038422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Write session: Do CDS request
2025-10-02T09:37:41.038427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.044268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.044517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.044681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.044689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.044696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.044727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.044755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707548:9054]
2025-10-02T09:37:41.045108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.045315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.045492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.045524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.045528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.045528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.045529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.045529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.045530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.045531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.045531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.045532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.045532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.045533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.045533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.045536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.045543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.045545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.045547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.045549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.045551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.045553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.045555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.045557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.045559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.045560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.045562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.045568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.045572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.045575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.045578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.045580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.045582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.045584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.045588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.045590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.045592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.045596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.045598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.045600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.045603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.045605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.045608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.045610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.045612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.045614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.045617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.045619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.045621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.045623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.045626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.045644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.046158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.046371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.046381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3719
2025-10-02T09:37:41.046497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.046520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.046523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.046525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.046849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3719 sessionId:  describe result for acl check
2025-10-02T09:37:41.046876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.046881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.046882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.046885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.047303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.048811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.052440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.052448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.052451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743297758:3972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.052455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.052950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.054454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.054466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.054467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.054469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.054473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3718 [2:7556556274667707548:9054]
2025-10-02T09:37:41.054480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.054491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.054496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.054497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.054498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.054507Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.054513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.054517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.054548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.054553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.054553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.054555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.054557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.054594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.054599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.054606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.054613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.054623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.054637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297730:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.054640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297793:3972], now have 1 active actors on pipe
2025-10-02T09:37:41.054643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.054647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.054648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.054656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.054666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.054668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.054670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.054671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.054678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.054680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.054695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.054700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.054703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.054679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3718
2025-10-02T09:37:41.054717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.054722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.054687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3718
2025-10-02T09:37:41.054741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.054748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.054750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.054751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.054756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.054763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.054774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.054866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.054871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.054878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.054937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3719 partition: 0 MaxSeqNo: 36 sessionId: src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0
2025-10-02T09:37:41.055168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c924205-f8d7c78d-958c7285-60734508_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.057422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Write session: try to update token
2025-10-02T09:37:41.057434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.063919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.063932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.063933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.063934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.063938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.063940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.063942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707543:9054]
2025-10-02T09:37:41.063961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.063965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.063966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.063967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.063970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.063974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.064081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.069255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3719 sessionId: src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.071507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.138467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743297800:4294]
2025-10-02T09:37:41.138628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3718, pipe: [1:7556556274743297800:4294]
2025-10-02T09:37:41.173841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.174127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.174136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.174147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297800:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.174269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.174287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743297800:4294]
2025-10-02T09:37:41.174307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.174354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:41.174441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3719 reason: status is not ok: tablet will be restarted right now sessionId: src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0
2025-10-02T09:37:41.174604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3719 sessionId: src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0 is DEAD
2025-10-02T09:37:41.174740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:41.174749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Write session will restart in 0.006646s
2025-10-02T09:37:41.174768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Write session: Do CDS request
2025-10-02T09:37:41.174773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.179687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.180621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.180722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.180728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.180734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.180788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707613:9036]
2025-10-02T09:37:41.181150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.181343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.181367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.181546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.181575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.181581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.181582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.181582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.181583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.181584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.181584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.181585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.181585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.181586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.181586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.181587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.181589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.181597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.181599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.181601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.181603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.181605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.181607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.181609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.181611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.181613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.181615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.181617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.181621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.181625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.181629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.181632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.181634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.181636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.181638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.181641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.181643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.181646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.181648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.181651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.181653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.181659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.181662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.181664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.181667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.181673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.181676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.181678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.181680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.181686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.181688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.181691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.181709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.182137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.182196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.182205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3720
2025-10-02T09:37:41.182298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.182319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.182322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.182325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.182653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3720 sessionId:  describe result for acl check
2025-10-02T09:37:41.182683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.182687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.182689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.182693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.183110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.184529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.188699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.188707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.188709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743297831:3946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.188713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.189213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.190682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.190696Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.190697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.190700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.190704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3719 [2:7556556274667707613:9036]
2025-10-02T09:37:41.190711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.190721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.190726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.190727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.190728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.190737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.190741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.190747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.190782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.190787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.190788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.190790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.190791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.190826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.190831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.190838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.190843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.190857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.190872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297866:3946], now have 1 active actors on pipe
2025-10-02T09:37:41.190878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297801:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.190881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.190883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.190884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.190891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.190902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.190902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.190904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.190905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.190913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.190914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.190928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.190933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.190934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.190943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.190948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.190907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3719
2025-10-02T09:37:41.190913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3719
2025-10-02T09:37:41.190976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.190983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.190985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.190988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.190997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.191006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.191019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.191104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.191111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.191118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.191182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3720 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0
2025-10-02T09:37:41.191442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|884b1450-f7626f71-7c6ddea2-eb787b9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.193690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Write session: try to update token
2025-10-02T09:37:41.193702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.200187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.200201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.200203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.200204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.200207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.200211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.200214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707608:9036]
2025-10-02T09:37:41.200232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.200236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.200237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.200239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.200240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.200242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.200351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.205567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3720 sessionId: src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.207823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.274656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743297873:4294]
2025-10-02T09:37:41.274834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3719, pipe: [1:7556556274743297873:4294]
2025-10-02T09:37:41.308475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.308791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.308810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.308823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297873:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.308942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.308988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:41.308996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:41.309039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3720 reason: error at write: Disconnected sessionId: src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0
2025-10-02T09:37:41.309047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743297873:4294]
2025-10-02T09:37:41.309077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.309167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3720 sessionId: src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0 is DEAD
2025-10-02T09:37:41.309335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:41.309347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Write session will restart in 0.005275s
2025-10-02T09:37:41.309370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Write session: Do CDS request
2025-10-02T09:37:41.309375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.314049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.314876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.314994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.315001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.315007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.315035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.315111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.315158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707677:9048]
2025-10-02T09:37:41.315221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.315229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3721
2025-10-02T09:37:41.315330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.315349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.315352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.315355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.315511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.315653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3721 sessionId:  describe result for acl check
2025-10-02T09:37:41.315675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.315676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.315679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.315677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.315680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.315705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.315885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.315915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.315919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.315920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.315920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.315921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.315923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.315923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.315924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.315924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.315925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.315928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.315934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.315936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.315938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.315940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.315942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.315946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.315948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.315950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.315952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.315954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.315956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.315961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.315965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.315968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.315971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.315975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.315977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.315980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.315983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.315988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.315991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.315994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.315997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.316000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.316002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.316005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.316007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.316010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.316014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.316016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.316018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.316021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.316023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.316045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.316039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.317691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.322236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.322246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.322249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743297902:3933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.322254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.323389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.324874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.324886Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.324887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.324889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.324892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3720 [2:7556556274667707677:9048]
2025-10-02T09:37:41.324900Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.324909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.324910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.324912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.324913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.324922Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.324924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.324928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.324958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.324963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.324964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.324966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.324967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.325005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.325010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.325017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.325022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.325032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.325046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297874:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.325052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297939:3933], now have 1 active actors on pipe
2025-10-02T09:37:41.325055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.325057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.325059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.325067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.325076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.325079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.325081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.325081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.325088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.325090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.325108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.325113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.325114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.325077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3720
2025-10-02T09:37:41.325093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3720
2025-10-02T09:37:41.325122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.325127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.325150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.325157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.325159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.325160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.325165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.325173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.325182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.325273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.325279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.325287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.325342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3721 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0
2025-10-02T09:37:41.325596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd4cba0-8f0eb080-d6a4b687-a31a4045_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.327861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Write session: try to update token
2025-10-02T09:37:41.327873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.334106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.334119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.334120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.334121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.334124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.334126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.334128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707672:9048]
2025-10-02T09:37:41.334148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.334151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.334153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.334155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.334156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.334157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.334338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.339877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3721 sessionId: src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.342134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.409303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743297949:4294]
2025-10-02T09:37:41.409440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3720, pipe: [1:7556556274743297949:4294]
2025-10-02T09:37:41.443252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.443573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.443583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.443595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297949:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.443714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.443727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:41.443736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:41.443775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3721 reason: error at write: Disconnected sessionId: src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0
2025-10-02T09:37:41.443794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.443851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743297949:4294]
2025-10-02T09:37:41.443913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3721 sessionId: src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0 is DEAD
2025-10-02T09:37:41.444067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:41.444079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Write session will restart in 0.006346s
2025-10-02T09:37:41.444100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Write session: Do CDS request
2025-10-02T09:37:41.444105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.450090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.450350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.450485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.450492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.450498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.450524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.450549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707755:9044]
2025-10-02T09:37:41.450900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.451061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.451085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.451152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.451268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.451312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.451313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.451313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.451314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.451315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.451315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.451316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.451316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.451317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.451317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.451318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.451318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.451321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.451327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.451330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.451332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.451334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.451336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.451313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.451323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3722
2025-10-02T09:37:41.451340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.451342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.451344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.451346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.451348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.451350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.451354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.451357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.451361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.451363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.451367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.451369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.451371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.451374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.451377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.451379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.451381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.451384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.451386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.451389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.451391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.451393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.451395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.451398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.451400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.451403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.451405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.451408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.451410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.451412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.451429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.451428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.451449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.451451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.451454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.451684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3722 sessionId:  describe result for acl check
2025-10-02T09:37:41.451703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.451704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.451706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.451709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.451977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.453068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.456714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.456724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.456727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743297993:3921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.456732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.458820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.460407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.460419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.460420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.460422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.460425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3721 [2:7556556274667707755:9044]
2025-10-02T09:37:41.460432Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.460441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.460446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.460447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.460448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.460457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.460463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.460466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.460497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.460502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.460503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.460506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.460508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.460606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.460612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.460618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.460624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.460635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.460651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743297950:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.460656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298028:3921], now have 1 active actors on pipe
2025-10-02T09:37:41.460613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3721
2025-10-02T09:37:41.460658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3721
2025-10-02T09:37:41.460664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.460668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.460669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.460674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.460683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.460682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.460684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.460685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.460693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.460695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.460704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.460709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.460726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.460733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.460741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.460742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.460747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.460749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.460751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.460756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.460764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.460784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.460888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.460893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.460901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.460945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3722 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0
2025-10-02T09:37:41.461180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffddc4d-2174dfc-8f297132-2f648a1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.463531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Write session: try to update token
2025-10-02T09:37:41.463544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.469851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.469864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.469865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.469866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.469870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.469872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.469876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707750:9044]
2025-10-02T09:37:41.469895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.469896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.469897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.469898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.469899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.469901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.470099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.475477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3722 sessionId: src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.477708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.543958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743298036:4294]
2025-10-02T09:37:41.544119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3721, pipe: [1:7556556274743298036:4294]
2025-10-02T09:37:41.578618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.578836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.578844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.578857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298036:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.578987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.579030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743298036:4294]
2025-10-02T09:37:41.579058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.579082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:41.579185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3722 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0
2025-10-02T09:37:41.579344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3722 sessionId: src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0 is DEAD
2025-10-02T09:37:41.579479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:41.579489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Write session will restart in 0.005066s
2025-10-02T09:37:41.579508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Write session: Do CDS request
2025-10-02T09:37:41.579514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.584043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.584644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.584833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.584841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.584848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.584883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.584909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707821:9038]
2025-10-02T09:37:41.585138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.585252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.585226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.585235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3723
2025-10-02T09:37:41.585352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.585374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.585377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.585381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.585435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.585459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.585645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.585678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.585664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3723 sessionId:  describe result for acl check
2025-10-02T09:37:41.585682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.585683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.585684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.585686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.585684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.585685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.585687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.585688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.585685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.585686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.585686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.585687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.585687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.585688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.585691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.585691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.585698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.585700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.585702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.585704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.585706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.585708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.585710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.585712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.585714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.585716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.585718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.585722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.585726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.585729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.585732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.585736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.585739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.585741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.585744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.585746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.585750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.585752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.585755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.585757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.585760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.585763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.585766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.585768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.585771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.585773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.585776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.585778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.585781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.585783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.585785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.585802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.586045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.587451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.592052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.592062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.592065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743298067:4709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.592070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.593210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.594783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.594796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.594797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.594799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.594803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3722 [2:7556556274667707821:9038]
2025-10-02T09:37:41.594810Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.594820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.594825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.594827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.594828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.594840Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.594845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.594849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.594887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.594891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.594893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.594895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.594896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.594935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.594940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.594947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.594952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.594963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.594977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298037:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.594983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298104:4709], now have 1 active actors on pipe
2025-10-02T09:37:41.594987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.594991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.594992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.595001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.595004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.595006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.595007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.595012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.595019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.595024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.594988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3722
2025-10-02T09:37:41.595010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3722
2025-10-02T09:37:41.595049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.595055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.595062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.595067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.595075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.595088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.595095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.595097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.595098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.595103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.595109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.595124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.595209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.595216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.595224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.595294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3723 partition: 0 MaxSeqNo: 36 sessionId: src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0
2025-10-02T09:37:41.595530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb38a9c2-a5e58694-a9049b7a-c8fe3940_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.597799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Write session: try to update token
2025-10-02T09:37:41.597811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.604202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.604216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.604217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.604218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.604222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.604224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.604227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707816:9038]
2025-10-02T09:37:41.604245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.604250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.604251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.604253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.604253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.604255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.604364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.610186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3723 sessionId: src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.612451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.679158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743298114:4294]
2025-10-02T09:37:41.679387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3722, pipe: [1:7556556274743298114:4294]
2025-10-02T09:37:41.713897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.714228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.714238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.714250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298114:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.714389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.714415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743298114:4294]
2025-10-02T09:37:41.714439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:41.714469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.714499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3723 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0
2025-10-02T09:37:41.714631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3723 sessionId: src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0 is DEAD
2025-10-02T09:37:41.714787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:41.714798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Write session will restart in 0.006090s
2025-10-02T09:37:41.714821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Write session: Do CDS request
2025-10-02T09:37:41.714827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.719657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.720548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.720656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.720665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.720670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.720697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.720722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707888:9042]
2025-10-02T09:37:41.721089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.721269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.721292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.721559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.721596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.721600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.721601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.721601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.721603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.721603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.721604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.721604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.721605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.721605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.721606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.721606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.721609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.721616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.721618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.721620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.721622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.721624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.721625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.721627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.721629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.721633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.721635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.721637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.721641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.721645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.721649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.721652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.721654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.721656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.721658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.721662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.721664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.721667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.721669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.721673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.721676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.721681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.721683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.721685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.721687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.721690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.721692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.721694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.721696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.721699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.721701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.721705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.721721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.722141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.722266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.722277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3724
2025-10-02T09:37:41.722379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.722399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.722402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.722405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.722723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3724 sessionId:  describe result for acl check
2025-10-02T09:37:41.722746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.722748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.722749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.722752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.723117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.724685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.728712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.728722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.728725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743298149:3887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.728730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.729200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.730653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.730666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.730668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.730669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.730673Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3723 [2:7556556274667707888:9042]
2025-10-02T09:37:41.730682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.730696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.730701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.730703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.730705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.730714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.730720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.730724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.730758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.730762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.730763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.730765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.730766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.730801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.730806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.730812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.730818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.730829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.730844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298184:3887], now have 1 active actors on pipe
2025-10-02T09:37:41.730850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298116:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.730853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.730854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.730855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.730863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.730873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.730876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.730878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.730879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.730885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.730886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.730900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.730905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.730906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.730887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3723
2025-10-02T09:37:41.730925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.730889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3723
2025-10-02T09:37:41.730930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.730945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c869e5c0-922e70-df8ccb3b-f130b730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.730953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.730955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.730959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.730964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.730969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.730979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.731075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.731080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.731088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.731147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3724 partition: 0 MaxSeqNo: 36 sessionId: src_id|c869e5c0-922e70-df8ccb3b-f130b730_0
2025-10-02T09:37:41.731382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd7a5ba-673681-844cf96a-21cfeef6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c869e5c0-922e70-df8ccb3b-f130b730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.733633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Write session: try to update token
2025-10-02T09:37:41.733646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.740043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.740056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.740057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.740058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.740061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.740063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.740065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707883:9042]
2025-10-02T09:37:41.740086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.740087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.740089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.740091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.740092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.740093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.740221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.745399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3724 sessionId: src_id|c869e5c0-922e70-df8ccb3b-f130b730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.747690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.814812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743298191:4294]
2025-10-02T09:37:41.814956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3723, pipe: [1:7556556274743298191:4294]
2025-10-02T09:37:41.848591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.848887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.848896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.848909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298191:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.849031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.849050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:41.849058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:41.849096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3724 reason: error at write: Disconnected sessionId: src_id|c869e5c0-922e70-df8ccb3b-f130b730_0
2025-10-02T09:37:41.849126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743298191:4294]
2025-10-02T09:37:41.849228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3724 sessionId: src_id|c869e5c0-922e70-df8ccb3b-f130b730_0 is DEAD
2025-10-02T09:37:41.849285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.849447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:41.849457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Write session will restart in 0.007838s
2025-10-02T09:37:41.849480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Write session: Do CDS request
2025-10-02T09:37:41.849485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.854155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.855410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.855523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.855529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.855535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.855565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.855588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667707983:9027]
2025-10-02T09:37:41.855927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.856080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.856109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.856290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.856317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.856321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.856321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.856322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.856322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.856323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.856323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.856324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.856324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.856325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.856327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.856328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.856330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.856336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.856338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.856340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.856342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.856344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.856346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.856348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.856350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.856352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.856354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.856356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.856359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.856363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.856366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.856369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.856371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.856374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.856376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.856379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.856381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.856384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.856386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.856388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.856391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.856393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.856395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.856398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.856400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.856403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.856406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.856409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.856411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.856413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.856415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.856418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.856433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.858208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.858286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.858297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3725
2025-10-02T09:37:41.858410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.858428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.858430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.858433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.858656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3725 sessionId:  describe result for acl check
2025-10-02T09:37:41.858675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.858676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.858677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.858680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.858930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.860522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.863441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.863452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.863454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743298234:3862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.863459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.863900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:41.865371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:41.865384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:41.865385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:41.865387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:41.865390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3724 [2:7556556274667707983:9027]
2025-10-02T09:37:41.865398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:41.865409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:41.865414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.865416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.865417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.865425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:41.865428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:41.865432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:41.865463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.865467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.865470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.865471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:41.865473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:41.865509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:41.865514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.865520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.865525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.865535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:41.865549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298274:3862], now have 1 active actors on pipe
2025-10-02T09:37:41.865554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298192:2446], now have 1 active actors on pipe
2025-10-02T09:37:41.865558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.865560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.865561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.865568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:41.865579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:41.865583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:41.865585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:41.865586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:41.865589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:41.865590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:41.865604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.865609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:41.865617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:41.865591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3724
2025-10-02T09:37:41.865613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3724
2025-10-02T09:37:41.865620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.865622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.865646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:41.865649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:41.865651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:41.865652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:41.865658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:41.865663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:41.865672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.865786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.865791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.865797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:41.865866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3725 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0
2025-10-02T09:37:41.866083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c869e5c0-922e70-df8ccb3b-f130b730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:41.868359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Write session: try to update token
2025-10-02T09:37:41.868370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:41.874595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:41.874608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:41.874609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:41.874611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:41.874615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.874617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.874620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667707963:9027]
2025-10-02T09:37:41.874638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:41.874644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:41.874644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.874645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:41.874646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:41.874648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:41.874769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:41.880568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3725 sessionId: src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:41.882766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:41.949478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556274743298295:4294]
2025-10-02T09:37:41.949649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3724, pipe: [1:7556556274743298295:4294]
2025-10-02T09:37:41.983877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:41.984148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:41.984157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:41.984169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298295:4294], now have 1 active actors on pipe
2025-10-02T09:37:41.984294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:41.984317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:41.984328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:41.984351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:41.984394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556274743298295:4294]
2025-10-02T09:37:41.984699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3725 reason: error at write: Disconnected sessionId: src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0
2025-10-02T09:37:41.984862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3725 sessionId: src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0 is DEAD
2025-10-02T09:37:41.984977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:41.984988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Write session will restart in 0.007166s
2025-10-02T09:37:41.985007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Write session: Do CDS request
2025-10-02T09:37:41.985012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:41.989417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:41.990218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:41.990321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:41.990328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:41.990334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:41.990360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:41.990385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556274667708061:9017]
2025-10-02T09:37:41.990725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:41.990890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:41.990913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:41.991087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:41.991118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.991122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.991123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.991123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.991124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.991124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.991125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.991125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.991126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.991126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.991127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.991127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.991132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.991139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.991141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.991143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.991145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.991147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.991149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.991151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.991155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.991157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.991159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.991162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.991166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:41.991169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.991172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:41.991174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.991177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:41.991179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.991181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:41.991183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.991186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:41.991188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.991191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:41.991193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.991195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:41.991198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.991200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:41.991203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.991208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:41.991210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.991213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:41.991215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.991218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:41.991220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.991222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:41.991239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:41.993184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.993289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:41.993300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3726
2025-10-02T09:37:41.993435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:41.993456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:41.993459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:41.993462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:41.993791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3726 sessionId:  describe result for acl check
2025-10-02T09:37:41.993829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:41.993837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:41.993839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:41.993843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:41.994281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:41.996200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:41.998151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:41.998161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:41.998164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556274743298333:3829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:41.998169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:41.998628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.000230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.000242Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.000243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.000246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.000249Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3725 [2:7556556274667708061:9017]
2025-10-02T09:37:42.000257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.000266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.000268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.000269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.000270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.000279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.000284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.000288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.000318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.000323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.000324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.000327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.000328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.000364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.000369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.000375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.000380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.000388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.000403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298368:3829], now have 1 active actors on pipe
2025-10-02T09:37:42.000408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556274743298298:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.000413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.000414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.000415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.000422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.000431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.000439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.000444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.000445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.000447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.000448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.000467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.000471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.000434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3725
2025-10-02T09:37:42.000444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3725
2025-10-02T09:37:42.000482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.000489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.000502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.000505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.000508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.000511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.000512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.000518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.000523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.000534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.000627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.000631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.000639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.000697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3726 partition: 0 MaxSeqNo: 36 sessionId: src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0
2025-10-02T09:37:42.000947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6895a0f-e03a6615-7da2ec7c-5ac8fbac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.003176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Write session: try to update token
2025-10-02T09:37:42.003188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.009434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.009447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.009448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.009449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.009455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.009457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.009459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556274667708056:9017]
2025-10-02T09:37:42.009478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.009481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.009485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.009486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.009488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.009490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.009594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.014988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3726 sessionId: src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.017274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.084649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038265675:4294]
2025-10-02T09:37:42.084830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3725, pipe: [1:7556556279038265675:4294]
2025-10-02T09:37:42.118528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.118859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.118869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.118882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265675:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.119000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.118984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038265675:4294]
2025-10-02T09:37:42.119006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.119038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:42.119042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:42.119118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3726 reason: error at write: Disconnected sessionId: src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0
2025-10-02T09:37:42.119271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3726 sessionId: src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0 is DEAD
2025-10-02T09:37:42.119424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:42.119434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Write session will restart in 0.009256s
2025-10-02T09:37:42.119457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Write session: Do CDS request
2025-10-02T09:37:42.119462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.124223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.125124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.125226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.125232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.125238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.125263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.125353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675427:9018]
2025-10-02T09:37:42.125707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.125884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.125908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.126084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.126115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.126119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.126120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.126120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.126121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.126121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.126122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.126123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.126123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.126124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.126124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.126126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.126129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.126136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.126138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.126140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.126142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.126144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.126146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.126148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.126150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.126152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.126154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.126156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.126160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.126163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.126166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.126169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.126173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.126176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.126178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.126181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.126183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.126185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.126187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.126190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.126192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.126195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.126197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.126200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.126202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.126206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.126209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.126211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.126213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.126216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.126218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.126221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.126236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.130163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.130253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.130263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3727
2025-10-02T09:37:42.130382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.130404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.130407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.130410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.130725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3727 sessionId:  describe result for acl check
2025-10-02T09:37:42.130758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.130763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.130765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.130769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.131130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.132835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.133575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.134687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.134696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.134699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038265713:3813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.134703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.134969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.134981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.134982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.134985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.134988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3726 [2:7556556278962675427:9018]
2025-10-02T09:37:42.134995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.135005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.135008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.135010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.135011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.135020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.135022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.135027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.135060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.135065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.135068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.135070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.135071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.135110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.135115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.135121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.135127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.135135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.135148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265676:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.135154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265747:3813], now have 1 active actors on pipe
2025-10-02T09:37:42.135157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.135159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.135160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.135168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.135178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.135178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.135180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.135181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.135187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.135188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.135202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.135210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.135213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.135206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3726
2025-10-02T09:37:42.135208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3726
2025-10-02T09:37:42.135360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.135366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.135382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.135389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.135391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.135392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.135397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.135404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.135412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.135550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.135555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.135563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.135626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3727 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0
2025-10-02T09:37:42.135853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f2012b-c38010a8-66e71fd1-c8cc0943_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.138080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Write session: try to update token
2025-10-02T09:37:42.138092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.144205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.144218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.144221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.144222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.144225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.144228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.144231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675422:9018]
2025-10-02T09:37:42.144250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.144252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.144255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.144257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.144257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.144258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.144368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.150350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3727 sessionId: src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.152587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.219302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038265755:4294]
2025-10-02T09:37:42.219447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3726, pipe: [1:7556556279038265755:4294]
2025-10-02T09:37:42.252646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.252940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.252949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.252961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265755:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.253083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.253133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038265755:4294]
2025-10-02T09:37:42.253156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.253176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:42.253180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:42.253263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3727 reason: error at write: Disconnected sessionId: src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0
2025-10-02T09:37:42.253410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3727 sessionId: src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0 is DEAD
2025-10-02T09:37:42.253555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:42.253565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Write session will restart in 0.006102s
2025-10-02T09:37:42.253585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Write session: Do CDS request
2025-10-02T09:37:42.253590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.258463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.259384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.259493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.259500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.259506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.259533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.259559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675499:9013]
2025-10-02T09:37:42.259956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.260127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.260151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.260326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.260357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.260361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.260362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.260362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.260363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.260363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.260364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.260364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.260365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.260365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.260366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.260366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.260369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.260376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.260378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.260380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.260382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.260384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.260385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.260389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.260391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.260393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.260395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.260400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.260405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.260408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.260411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.260413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.260416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.260418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.260420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.260423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.260425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.260427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.260430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.260432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.260435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.260437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.260440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.260442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.260445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.260449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.260451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.260454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.260457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.260463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.260465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.261084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.261178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.261188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3728
2025-10-02T09:37:42.261318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.261338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.261341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.261344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.261615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3728 sessionId:  describe result for acl check
2025-10-02T09:37:42.261638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.261639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.261641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.261644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.262002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.263157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.266741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.266751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.266753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038265793:3790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.266758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.267997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.269631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.269641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.269643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.269645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.269648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3727 [2:7556556278962675499:9013]
2025-10-02T09:37:42.269656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.269666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.269668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.269669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.269671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.269680Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.269687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.269692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.269728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.269732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.269733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.269736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.269737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.269779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.269784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.269791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.269797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.269805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.269820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265756:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.269826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265828:3790], now have 1 active actors on pipe
2025-10-02T09:37:42.269829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.269831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.269833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.269841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.269851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.269858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.269862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.269864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.269865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.269867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.269879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.269884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.269886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.269863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3727
2025-10-02T09:37:42.269906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.269867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3727
2025-10-02T09:37:42.269911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.269931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.269938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.269940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.269941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.269946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.269955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.269965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.270062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.270068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.270075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.270130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3728 partition: 0 MaxSeqNo: 36 sessionId: src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0
2025-10-02T09:37:42.270385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1eab5e-4c8a3b45-f5506e80-b3f305d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.272662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Write session: try to update token
2025-10-02T09:37:42.272675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.279106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.279119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.279120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.279121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.279124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.279126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.279132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675494:9013]
2025-10-02T09:37:42.279151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.279154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.279156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.279158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.279161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.279163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.279263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.284437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3728 sessionId: src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.286753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.353433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038265836:4294]
2025-10-02T09:37:42.353575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3727, pipe: [1:7556556279038265836:4294]
2025-10-02T09:37:42.389627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.389818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.389829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.389842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265836:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.389972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.389986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038265836:4294]
2025-10-02T09:37:42.390001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:42.390003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:42.390043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3728 reason: error at write: Disconnected sessionId: src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0
2025-10-02T09:37:42.390167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3728 sessionId: src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0 is DEAD
2025-10-02T09:37:42.390313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:42.390325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Write session will restart in 0.009983s
2025-10-02T09:37:42.390346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Write session: Do CDS request
2025-10-02T09:37:42.390352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.390346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.395321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.396132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.396231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.396238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.396243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.396269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.396292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675583:9002]
2025-10-02T09:37:42.396690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.396859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.396882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.397056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.397086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.397090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.397091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.397091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.397092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.397092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.397093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.397093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.397094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.397094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.397095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.397096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.397098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.397105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.397108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.397110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.397112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.397114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.397116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.397118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.397120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.397123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.397125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.397127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.397131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.397135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.397138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.397141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.397144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.397147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.397149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.397152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.397154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.397156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.397158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.397161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.397164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.397166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.397168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.397171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.397175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.397178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.397180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.397182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.397185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.397189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.397191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.397194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.397209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.401174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.401239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.401250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3729
2025-10-02T09:37:42.401376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.401399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.401401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.401404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.401741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3729 sessionId:  describe result for acl check
2025-10-02T09:37:42.401763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.401764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.401765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.401768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.402115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.403426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.404572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.404982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.404992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.404994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038265878:3769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.404998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.406133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.406144Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.406145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.406147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.406150Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3728 [2:7556556278962675583:9002]
2025-10-02T09:37:42.406157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.406168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.406170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.406171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.406172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.406182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.406184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.406189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.406219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.406224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.406225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.406227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.406228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.406264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.406269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.406275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.406281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.406291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.406305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265912:3769], now have 1 active actors on pipe
2025-10-02T09:37:42.406310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265839:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.406313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.406315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.406316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.406324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.406334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.406339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.406341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.406342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.406344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.406346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.406360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.406365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.406367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.406334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3728
2025-10-02T09:37:42.406335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3728
2025-10-02T09:37:42.406377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.406382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.406404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.406410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.406412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.406413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.406418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.406426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.406438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.406546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.406550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.406558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.406620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3729 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0
2025-10-02T09:37:42.406828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ab342f-5e9ebfc2-cd764f1e-dc57932d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.409126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Write session: try to update token
2025-10-02T09:37:42.409138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.415401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.415410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.415411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.415412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.415415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.415417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.415419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675578:9002]
2025-10-02T09:37:42.415438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.415440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.415440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.415441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.415443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.415445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.415570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.421465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3729 sessionId: src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.423725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.490149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038265931:4294]
2025-10-02T09:37:42.490342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3728, pipe: [1:7556556279038265931:4294]
2025-10-02T09:37:42.524744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.524958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.524966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.524978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265931:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.525105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.525133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.525163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:42.525163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038265931:4294]
2025-10-02T09:37:42.525216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3729 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0
2025-10-02T09:37:42.525354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3729 sessionId: src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0 is DEAD
2025-10-02T09:37:42.525507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:42.525518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Write session will restart in 0.008773s
2025-10-02T09:37:42.525543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Write session: Do CDS request
2025-10-02T09:37:42.525548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.530284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.531311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.531417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.531423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.531429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.531455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.531487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675657:8997]
2025-10-02T09:37:42.531830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.532021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.532044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.532221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.532251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.532255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.532255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.532256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.532256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.532257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.532258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.532258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.532259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.532259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.532260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.532262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.532265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.532272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.532274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.532276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.532278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.532280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.532282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.532284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.532286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.532288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.532290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.532292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.532295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.532299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.532303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.532306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.532308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.532310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.532312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.532315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.532318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.532320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.532323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.532325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.532332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.532335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.532337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.532340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.532346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.532349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.532351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.532357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.532359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.532361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.532366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.532369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.532386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.535164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.535294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.535304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3730
2025-10-02T09:37:42.535420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.535443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.535446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.535448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.535725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3730 sessionId:  describe result for acl check
2025-10-02T09:37:42.535750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.535752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.535752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.535755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.536092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.537598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.539226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.539237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.539239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038265972:3734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.539243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.539751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.541326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.541336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.541337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.541339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.541343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3729 [2:7556556278962675657:8997]
2025-10-02T09:37:42.541349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.541359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.541361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.541362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.541364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.541372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.541375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.541380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.541408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.541413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.541417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.541418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.541420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.541457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.541462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.541468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.541473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.541483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.541498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266007:3734], now have 1 active actors on pipe
2025-10-02T09:37:42.541503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038265933:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.541507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.541508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.541509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.541517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.541524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.541532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.541535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.541535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.541536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.541536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.541549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.541553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.541562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.541530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3729
2025-10-02T09:37:42.541569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.541571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.541591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.541596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.541538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3729
2025-10-02T09:37:42.541598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.541599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.541604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.541609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.541618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.541702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.541707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.541714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.541774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3730 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0
2025-10-02T09:37:42.542004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebbe28-a17371d5-7344935c-e918b7ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.544236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Write session: try to update token
2025-10-02T09:37:42.544248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.550579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.550589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.550592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.550593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.550597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.550600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.550602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675652:8997]
2025-10-02T09:37:42.550621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.550623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.550624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.550624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.550627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.550629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.550747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.556256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3730 sessionId: src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.558537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.625323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038266014:4294]
2025-10-02T09:37:42.625490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3729, pipe: [1:7556556279038266014:4294]
2025-10-02T09:37:42.661149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.661460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.661469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.661481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266014:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.661635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.661659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.661696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038266014:4294]
2025-10-02T09:37:42.661700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:42.661754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3730 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0
2025-10-02T09:37:42.661871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3730 sessionId: src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0 is DEAD
2025-10-02T09:37:42.662023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:42.662035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Write session will restart in 0.008235s
2025-10-02T09:37:42.662057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Write session: Do CDS request
2025-10-02T09:37:42.662062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.667925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.668849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.668966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.668972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.668978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.669008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.669034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675731:8994]
2025-10-02T09:37:42.669391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.669570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.669594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.669779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.669809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.669813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.669814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.669814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.669815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.669815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.669816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.669816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.669818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.669819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.669820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.669820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.669823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.669830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.669832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.669834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.669836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.669838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.669840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.669842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.669844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.669846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.669848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.669850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.669853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.669857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.669860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.669863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.669865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.669868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.669870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.669873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.669875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.669878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.669880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.669883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.669885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.669887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.669890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.669892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.669896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.669900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.669902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.669905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.669907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.669913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.669915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.669918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.669936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.671184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.671319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.671331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3731
2025-10-02T09:37:42.671454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.671474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.671477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.671480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.671752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3731 sessionId:  describe result for acl check
2025-10-02T09:37:42.671778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.671779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.671780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.671785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.672141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.673799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.677067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.677080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.677082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038266055:3737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.677086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.677634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.679100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.679110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.679112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.679114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.679117Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3730 [2:7556556278962675731:8994]
2025-10-02T09:37:42.679124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.679135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.679137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.679138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.679139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.679148Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.679155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.679159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.679190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.679195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.679196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.679197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.679199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.679239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.679243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.679250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.679256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.679268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.679290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266015:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.679296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266090:3737], now have 1 active actors on pipe
2025-10-02T09:37:42.679299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.679301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.679302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.679310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.679320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.679312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3730
2025-10-02T09:37:42.679316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3730
2025-10-02T09:37:42.679330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.679330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.679332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.679333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.679335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.679359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.679361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.679368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.679375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.679390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.679391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.679395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.679398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.679399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.679404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.679408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.679420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.679540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.679545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.679553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.679619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3731 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0
2025-10-02T09:37:42.679860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e554ba-2d8134b4-ac1e60cf-9f8fac0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.682150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Write session: try to update token
2025-10-02T09:37:42.682162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.688549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.688559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.688560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.688561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.688564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.688567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.688570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675726:8994]
2025-10-02T09:37:42.688588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.688590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.688592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.688593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.688596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.688599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.688693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.694050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3731 sessionId: src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.696332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.762024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038266098:4294]
2025-10-02T09:37:42.762201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3730, pipe: [1:7556556279038266098:4294]
2025-10-02T09:37:42.796743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.796959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.796967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.796979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266098:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.797104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.797173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:42.797184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:42.797196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038266098:4294]
2025-10-02T09:37:42.797213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.797228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3731 reason: error at write: Disconnected sessionId: src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0
2025-10-02T09:37:42.797330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3731 sessionId: src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0 is DEAD
2025-10-02T09:37:42.797439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:42.797448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Write session will restart in 0.006913s
2025-10-02T09:37:42.797464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Write session: Do CDS request
2025-10-02T09:37:42.797468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.802315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.803321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.803437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.803443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.803449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.803476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.803510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675806:8980]
2025-10-02T09:37:42.803853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.804025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.804047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.804219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.804247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.804251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.804252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.804252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.804253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.804253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.804254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.804255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.804255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.804256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.804256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.804257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.804260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.804266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.804268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.804270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.804272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.804274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.804278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.804280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.804282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.804284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.804286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.804288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.804292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.804295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.804299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.804302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.804306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.804308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.804310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.804313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.804318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.804321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.804323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.804326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.804328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.804332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.804334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.804337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.804343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.804345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.804347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.804354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.804356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.804359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.804361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.804365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.804381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.805190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.805260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.805269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3732
2025-10-02T09:37:42.805389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.805410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.805413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.805415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.805669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3732 sessionId:  describe result for acl check
2025-10-02T09:37:42.805693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.805697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.805699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.805702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.806060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.807389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.811157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.811165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.811167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038266140:3723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.811172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.811683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.813367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.813379Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.813380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.813382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.813385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3731 [2:7556556278962675806:8980]
2025-10-02T09:37:42.813396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.813405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.813407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.813408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.813409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.813418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.813421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.813424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.813456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.813461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.813462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.813464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.813465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.813504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.813509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.813516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.813521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.813529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.813542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266175:3723], now have 1 active actors on pipe
2025-10-02T09:37:42.813548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266099:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.813552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.813553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.813554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.813561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.813570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.813577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.813579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.813580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.813580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.813582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.813593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.813598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.813600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.813607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.813611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.813634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67307a69-2051d871-ead3cf7f-2502995a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.813640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.813642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.813644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.813649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.813653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.813667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.813767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.813772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.813780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.813575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3731
2025-10-02T09:37:42.813576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3731
2025-10-02T09:37:42.813821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3732 partition: 0 MaxSeqNo: 36 sessionId: src_id|67307a69-2051d871-ead3cf7f-2502995a_0
2025-10-02T09:37:42.814021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a3cc7b-43092998-f5b1468c-17caab60_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67307a69-2051d871-ead3cf7f-2502995a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.816273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Write session: try to update token
2025-10-02T09:37:42.816288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.822579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.822590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.822592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.822593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.822596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.822599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.822601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675801:8980]
2025-10-02T09:37:42.822618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.822621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.822622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.822624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.822627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.822629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.822725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.828149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3732 sessionId: src_id|67307a69-2051d871-ead3cf7f-2502995a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.830430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:42.897173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556279038266196:4294]
2025-10-02T09:37:42.897327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3731, pipe: [1:7556556279038266196:4294]
2025-10-02T09:37:42.932731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:42.932931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.932939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.932950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266196:4294], now have 1 active actors on pipe
2025-10-02T09:37:42.933065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:42.933093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556279038266196:4294]
2025-10-02T09:37:42.933095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:42.933099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:42.933116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:42.933144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3732 reason: error at write: Disconnected sessionId: src_id|67307a69-2051d871-ead3cf7f-2502995a_0
2025-10-02T09:37:42.933300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3732 sessionId: src_id|67307a69-2051d871-ead3cf7f-2502995a_0 is DEAD
2025-10-02T09:37:42.933455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:42.933469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Write session will restart in 0.006995s
2025-10-02T09:37:42.933496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Write session: Do CDS request
2025-10-02T09:37:42.933502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:42.938528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:42.939345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:42.939444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:42.939450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:42.939456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:42.939481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:42.939504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556278962675917:8975]
2025-10-02T09:37:42.939841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:42.940011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:42.940033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:42.940205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:42.940234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.940238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.940239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.940239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.940240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.940240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.940241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.940241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.940242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.940242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.940243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.940243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.940246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.940253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.940255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.940257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.940259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.940261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.940263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.940265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.940267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.940269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.940271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.940273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.940277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.940281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:42.940285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.940288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:42.940291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.940294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:42.940296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.940299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:42.940301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.940304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:42.940306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.940308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:42.940310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.940313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:42.940315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.940319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:42.940321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.940327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:42.940329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.940331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.940333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.940336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.940340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.940343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.940359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:42.941176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.941245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:42.941254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3733
2025-10-02T09:37:42.941413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:42.941433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:42.941439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:42.941441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:42.941703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3733 sessionId:  describe result for acl check
2025-10-02T09:37:42.941724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:42.941729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:42.941729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:42.941733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:42.942056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:42.943584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:42.947303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:42.947311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:42.947313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556279038266248:3679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:42.947317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:42.947821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:42.949348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:42.949357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:42.949359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:42.949360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:42.949363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3732 [2:7556556278962675917:8975]
2025-10-02T09:37:42.949373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:42.949381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:42.949387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.949390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.949391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.949399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:42.949402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:42.949406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:42.949435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.949440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.949440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.949442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:42.949444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:42.949479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:42.949483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.949489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:42.949498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:42.949509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:42.949522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266206:2446], now have 1 active actors on pipe
2025-10-02T09:37:42.949527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556279038266283:3679], now have 1 active actors on pipe
2025-10-02T09:37:42.949531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.949532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.949533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.949540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:42.949550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:42.949553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:42.949555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:42.949557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:42.949561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:42.949562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:42.949557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3732
2025-10-02T09:37:42.949561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3732
2025-10-02T09:37:42.949575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.949581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:42.949583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:42.949590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.949595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.949621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|318017af-f540bad8-a2f65cb9-6c30c011_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:42.949627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:42.949629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:42.949630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:42.949635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:42.949642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:42.949655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.949758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:42.949764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:42.949771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:42.949830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3733 partition: 0 MaxSeqNo: 36 sessionId: src_id|318017af-f540bad8-a2f65cb9-6c30c011_0
2025-10-02T09:37:42.950053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67307a69-2051d871-ead3cf7f-2502995a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|318017af-f540bad8-a2f65cb9-6c30c011_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:42.952354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Write session: try to update token
2025-10-02T09:37:42.952367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:42.959101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:42.959112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:42.959113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:42.959113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:42.959118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.959120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.959122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556278962675912:8975]
2025-10-02T09:37:42.959141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:42.959144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:42.959144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:42.959145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:42.959147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:42.959149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:42.959263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:42.964150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3733 sessionId: src_id|318017af-f540bad8-a2f65cb9-6c30c011_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:42.966410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.033376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333233595:4294]
2025-10-02T09:37:43.033534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3732, pipe: [1:7556556283333233595:4294]
2025-10-02T09:37:43.069419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.069697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.069706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.069731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233595:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.069881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.069902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.069930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:43.069937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333233595:4294]
2025-10-02T09:37:43.070003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3733 reason: status is not ok: tablet will be restarted right now sessionId: src_id|318017af-f540bad8-a2f65cb9-6c30c011_0
2025-10-02T09:37:43.070162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3733 sessionId: src_id|318017af-f540bad8-a2f65cb9-6c30c011_0 is DEAD
2025-10-02T09:37:43.070302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:43.070317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Write session will restart in 0.006855s
2025-10-02T09:37:43.070339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Write session: Do CDS request
2025-10-02T09:37:43.070344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.075542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.076364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.076461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.076468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.076473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.076499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.076522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643290:8973]
2025-10-02T09:37:43.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.077111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.077134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.077304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.077333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.077337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.077337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.077338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.077338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.077339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.077339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.077340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.077341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.077341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.077342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.077343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.077345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.077352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.077354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.077356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.077358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.077360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.077362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.077365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.077367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.077369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.077373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.077375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.077378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.077382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.077385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.077389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.077391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.077394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.077400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.077403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.077405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.077408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.077410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.077412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.077414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.077417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.077420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.077425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.077427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.077430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.077432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.077434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.077436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.077440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.077442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.077444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.077463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.078142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.078224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.078233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3734
2025-10-02T09:37:43.078342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.078362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.078368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.078371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.078631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3734 sessionId:  describe result for acl check
2025-10-02T09:37:43.078653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.078658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.078659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.078662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.078999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.080337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.084272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.084282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.084284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333233639:3662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.084288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.084860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.086404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.086414Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.086416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.086418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.086423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3733 [2:7556556283257643290:8973]
2025-10-02T09:37:43.086432Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.086445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.086449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.086451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.086452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.086460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.086463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.086467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.086498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.086503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.086504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.086506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.086507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.086542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.086547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.086554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.086559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.086567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.086579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233596:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.086584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233674:3662], now have 1 active actors on pipe
2025-10-02T09:37:43.086587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.086588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.086590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.086598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.086608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.086612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.086614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.086616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.086619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.086620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.086614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3733
2025-10-02T09:37:43.086637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.086614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3733
2025-10-02T09:37:43.086642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.086644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.086652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.086656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.086685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f769742f-adf8ad22-212c9478-f5682b9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.086692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.086694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.086695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.086700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.086707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.086718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.086820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.086825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.086833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.086884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3734 partition: 0 MaxSeqNo: 36 sessionId: src_id|f769742f-adf8ad22-212c9478-f5682b9d_0
2025-10-02T09:37:43.087109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318017af-f540bad8-a2f65cb9-6c30c011_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f769742f-adf8ad22-212c9478-f5682b9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.089362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Write session: try to update token
2025-10-02T09:37:43.089376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.095721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.095731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.095732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.095733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.095736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.095738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.095740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643285:8973]
2025-10-02T09:37:43.095759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.095763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.095765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.095766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.095766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.095768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.095875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.101324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3734 sessionId: src_id|f769742f-adf8ad22-212c9478-f5682b9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.103584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.170082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333233681:4294]
2025-10-02T09:37:43.170256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3733, pipe: [1:7556556283333233681:4294]
2025-10-02T09:37:43.204205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.204493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.204501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.204513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233681:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.204633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.204643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333233681:4294]
2025-10-02T09:37:43.204661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.204668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:43.204719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3734 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f769742f-adf8ad22-212c9478-f5682b9d_0
2025-10-02T09:37:43.204856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3734 sessionId: src_id|f769742f-adf8ad22-212c9478-f5682b9d_0 is DEAD
2025-10-02T09:37:43.204948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:43.204954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Write session will restart in 0.005764s
2025-10-02T09:37:43.204969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Write session: Do CDS request
2025-10-02T09:37:43.204972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.210041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.211203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.211319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.211326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.211332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.211360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.211386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643369:8968]
2025-10-02T09:37:43.211734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.211916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.211939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.212106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.212114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.212144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.212148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.212149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.212149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.212150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.212150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.212151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.212152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.212152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.212153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.212153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.212154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.212156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.212164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.212166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.212168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.212170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.212172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.212174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.212176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.212178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.212180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.212181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.212183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.212189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.212192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.212196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.212199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.212201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.212203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.212205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.212208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.212210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.212213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.212215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.212217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.212220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.212222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.212228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.212230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.212233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.212236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.212238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.212241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.212243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.212245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.212224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.212232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3735
2025-10-02T09:37:43.212247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.212250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.212267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.212345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.212365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.212371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.212374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.212643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3735 sessionId:  describe result for acl check
2025-10-02T09:37:43.212666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.212670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.212671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.212674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.213016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.214466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.218724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.218734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.218736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333233727:3637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.218739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.219971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.221478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.221489Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.221490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.221492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.221496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3734 [2:7556556283257643369:8968]
2025-10-02T09:37:43.221504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.221516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.221521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.221522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.221523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.221533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.221539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.221543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.221574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.221578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.221579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.221581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.221582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.221619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.221624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.221631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.221636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.221647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.221662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233683:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.221667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233762:3637], now have 1 active actors on pipe
2025-10-02T09:37:43.221671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.221672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.221673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.221681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.221690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.221683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3734
2025-10-02T09:37:43.221695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.221698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.221684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3734
2025-10-02T09:37:43.221699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.221701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.221704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.221729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.221734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.221741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.221749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.221758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.221765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f936fd61-1d441e38-97e245dd-6c14801b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.221768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.221770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.221771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.221776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.221785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.221799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.221912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.221917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.221924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.221980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3735 partition: 0 MaxSeqNo: 36 sessionId: src_id|f936fd61-1d441e38-97e245dd-6c14801b_0
2025-10-02T09:37:43.222179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f769742f-adf8ad22-212c9478-f5682b9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f936fd61-1d441e38-97e245dd-6c14801b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.224617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Write session: try to update token
2025-10-02T09:37:43.224634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.230925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.230936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.230937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.230938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.230941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.230944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.230947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643364:8968]
2025-10-02T09:37:43.230966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.230968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.230969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.230970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.230972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.230974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.231080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.236683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3735 sessionId: src_id|f936fd61-1d441e38-97e245dd-6c14801b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.238945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.304742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333233769:4294]
2025-10-02T09:37:43.304902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3734, pipe: [1:7556556283333233769:4294]
2025-10-02T09:37:43.339784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.340053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.340061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.340073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233769:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.340196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.340239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333233769:4294]
2025-10-02T09:37:43.340260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:43.340263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.340312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f936fd61-1d441e38-97e245dd-6c14801b_0
2025-10-02T09:37:43.340450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3735 sessionId: src_id|f936fd61-1d441e38-97e245dd-6c14801b_0 is DEAD
2025-10-02T09:37:43.340593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:43.340605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Write session will restart in 0.007532s
2025-10-02T09:37:43.340628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Write session: Do CDS request
2025-10-02T09:37:43.340633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.345538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.346675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.346775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.346781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.346786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.346811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.346835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643448:8965]
2025-10-02T09:37:43.347450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.347622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.347644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.347916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.347944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.347949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.347951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.347951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.347954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.347957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.347965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.347968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.347970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.347972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.347974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.347976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.347978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.347980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.347982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.347984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.347986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.347990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.347993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.347996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.347999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.348002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.348005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.348007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.348010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.348012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.348015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.348017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.348020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.348022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.348024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.348028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.348030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.348032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.348035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.348037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.348040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.348044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.348047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.348049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.348052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.348071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.349145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.349228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.349237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3736
2025-10-02T09:37:43.349328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.349347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.349353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.349355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.349635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3736 sessionId:  describe result for acl check
2025-10-02T09:37:43.349666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.349670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.349671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.349674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.350042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.351685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.354919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.354926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.354928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333233815:3622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.354931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.355503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.356912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.356923Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.356924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.356927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.356931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3735 [2:7556556283257643448:8965]
2025-10-02T09:37:43.356940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.357013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.357018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.357020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.357021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.357031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.357037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.357041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.357072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.357076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.357078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.357079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.357080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.357117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.357122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.357128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.357137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.357148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.357162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233851:3622], now have 1 active actors on pipe
2025-10-02T09:37:43.357167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233770:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.357170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.357172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.357174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.357181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.357192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.357193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.357195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.357196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.357203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.357206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.357204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3735
2025-10-02T09:37:43.357205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3735
2025-10-02T09:37:43.357222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.357226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.357228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.357242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.357248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.357264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebe32797-b44b830e-18694ba8-a25f6068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.357271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.357273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.357274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.357279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.357287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.357312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.357410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.357415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.357422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.357478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3736 partition: 0 MaxSeqNo: 36 sessionId: src_id|ebe32797-b44b830e-18694ba8-a25f6068_0
2025-10-02T09:37:43.357687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f936fd61-1d441e38-97e245dd-6c14801b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ebe32797-b44b830e-18694ba8-a25f6068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.360107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Write session: try to update token
2025-10-02T09:37:43.360122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.366517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.366527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.366528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.366529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.366532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.366534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.366536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643443:8965]
2025-10-02T09:37:43.366555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.366557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.366560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.366560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.366561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.366562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.366671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.372257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3736 sessionId: src_id|ebe32797-b44b830e-18694ba8-a25f6068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.374532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.440416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333233860:4294]
2025-10-02T09:37:43.440566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3735, pipe: [1:7556556283333233860:4294]
2025-10-02T09:37:43.475919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.476166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.476177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.476192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233860:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.476324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.476361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:43.476372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:43.476414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3736 reason: error at write: Disconnected sessionId: src_id|ebe32797-b44b830e-18694ba8-a25f6068_0
2025-10-02T09:37:43.476562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3736 sessionId: src_id|ebe32797-b44b830e-18694ba8-a25f6068_0 is DEAD
2025-10-02T09:37:43.476600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.476639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333233860:4294]
2025-10-02T09:37:43.476663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:43.476669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Write session will restart in 0.005689s
2025-10-02T09:37:43.476683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Write session: Do CDS request
2025-10-02T09:37:43.476687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.482247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.483186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.483189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.483297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.483306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3737
2025-10-02T09:37:43.483337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.483344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.483350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.483380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.483407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643542:8957]
2025-10-02T09:37:43.483422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.483446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.483454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.483458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.483720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3737 sessionId:  describe result for acl check
2025-10-02T09:37:43.483738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.483743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.483743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.483746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.483749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.483924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.483956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.484081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.484132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.484162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.484166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.484166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.484167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.484167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.484168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.484168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.484169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.484169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.484170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.484170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.484171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.484174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.484180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.484182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.484184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.484185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.484188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.484189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.484191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.484193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.484195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.484197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.484199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.484204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.484209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.484212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.484215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.484217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.484220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.484222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.484224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.484227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.484229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.484231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.484234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.484236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.484239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.484241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.484244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.484248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.484250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.484253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.484256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.484258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.484261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.484262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.484265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.484283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.485290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.489618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.489626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.489628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333233915:3611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.489631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.491741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.493206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.493217Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.493218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.493220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.493223Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3736 [2:7556556283257643542:8957]
2025-10-02T09:37:43.493230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.493241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.493246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.493247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.493248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.493257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.493264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.493267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.493301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.493306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.493307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.493308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.493310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.493349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.493353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.493359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.493365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.493376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.493390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233954:3611], now have 1 active actors on pipe
2025-10-02T09:37:43.493395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233873:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.493399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.493403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.493405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.493411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.493421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.493425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.493427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.493428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.493431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.493434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.493423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3736
2025-10-02T09:37:43.493430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3736
2025-10-02T09:37:43.493449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.493454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.493455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.493465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.493470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.493494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.493500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.493502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.493503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.493508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.493516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.493528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.493618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.493623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.493630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.493699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3737 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0
2025-10-02T09:37:43.493883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe32797-b44b830e-18694ba8-a25f6068_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.496672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Write session: try to update token
2025-10-02T09:37:43.496684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.502674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.502686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.502688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.502689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.502694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.502697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.502699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643537:8957]
2025-10-02T09:37:43.502721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.502726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.502728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.502729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.502731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.502734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.502896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.508784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3737 sessionId: src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.510999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.576616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333233962:4294]
2025-10-02T09:37:43.576819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3736, pipe: [1:7556556283333233962:4294]
2025-10-02T09:37:43.612525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.612880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.612891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.612904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233962:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.613087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.613075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333233962:4294]
2025-10-02T09:37:43.613089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:43.613093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:43.613099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.613144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3737 reason: error at write: Disconnected sessionId: src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0
2025-10-02T09:37:43.613286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3737 sessionId: src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0 is DEAD
2025-10-02T09:37:43.613430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:43.613445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Write session will restart in 0.009296s
2025-10-02T09:37:43.613466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Write session: Do CDS request
2025-10-02T09:37:43.613472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.618536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.619745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.619847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.619853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.619859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.619885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.619908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643622:8955]
2025-10-02T09:37:43.620245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.620418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.620441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.620616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.620645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.620649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.620649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.620650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.620650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.620651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.620651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.620652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.620652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.620653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.620655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.620656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.620659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.620665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.620667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.620670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.620671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.620673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.620675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.620677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.620679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.620682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.620683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.620685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.620689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.620693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.620697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.620700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.620702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.620704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.620706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.620709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.620711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.620714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.620715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.620718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.620720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.620723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.620726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.620728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.620730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.620733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.620735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.620737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.620739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.620742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.620744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.620746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.620762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.624130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.624234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.624246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3738
2025-10-02T09:37:43.624358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.624379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.624385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.624388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.624661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3738 sessionId:  describe result for acl check
2025-10-02T09:37:43.624681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.624685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.624686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.624689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.625060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.626567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.628124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.628133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.628135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333234010:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.628139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.628318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.629910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.629921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.629922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.629924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.629927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3737 [2:7556556283257643622:8955]
2025-10-02T09:37:43.629936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.629945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.629950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.629952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.629953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.629962Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.629964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.629968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.630000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.630005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.630006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.630008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.630009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.630044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.630049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.630056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.630061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.630069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.630080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234045:3600], now have 1 active actors on pipe
2025-10-02T09:37:43.630085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333233963:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.630088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.630089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.630090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.630097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.630104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.630110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.630111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.630113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.630114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.630115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.630131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.630136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.630124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3737
2025-10-02T09:37:43.630138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.630126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3737
2025-10-02T09:37:43.630150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.630155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.630176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.630183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.630185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.630186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.630191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.630199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.630215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.630305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.630310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.630318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.630368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3738 partition: 0 MaxSeqNo: 36 sessionId: src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0
2025-10-02T09:37:43.630548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8207965-b1715e3f-4d0211e2-a6805adc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.633220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Write session: try to update token
2025-10-02T09:37:43.633237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.639561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.639572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.639573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.639574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.639578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.639580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.639582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643617:8955]
2025-10-02T09:37:43.639600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.639604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.639605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.639605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.639606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.639608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.639720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.645389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3738 sessionId: src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.647656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.713313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333234053:4294]
2025-10-02T09:37:43.713530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3737, pipe: [1:7556556283333234053:4294]
2025-10-02T09:37:43.749028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.749293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.749302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.749315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234053:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.749437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.749481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:43.749491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:43.749502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333234053:4294]
2025-10-02T09:37:43.749518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.749536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3738 reason: error at write: Disconnected sessionId: src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0
2025-10-02T09:37:43.749687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3738 sessionId: src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0 is DEAD
2025-10-02T09:37:43.749845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:43.749858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Write session will restart in 0.007925s
2025-10-02T09:37:43.749897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Write session: Do CDS request
2025-10-02T09:37:43.749902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.754616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.755710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.755884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.755891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.755898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.755930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.755953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643704:8949]
2025-10-02T09:37:43.756293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.756466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.756489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.756661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.756689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.756693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.756694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.756694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.756695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.756695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.756696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.756696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.756697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.756697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.756698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.756698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.756701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.756708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.756710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.756712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.756714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.756717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.756719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.756721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.756723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.756725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.756727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.756729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.756733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.756736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.756739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.756742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.756744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.756747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.756750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.756752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.756755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.756757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.756760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.756762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.756764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.756767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.756769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.756771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.756774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.756777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.756783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.756786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.756788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.756791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.756792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.756795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.756824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.759155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.759257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.759266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3739
2025-10-02T09:37:43.759380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.759401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.759409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.759413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.759683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3739 sessionId:  describe result for acl check
2025-10-02T09:37:43.759707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.759712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.759713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.759715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.760062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.761282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.763600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.763608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.763610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333234102:3576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.763613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.764160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.765655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.765665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.765666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.765668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.765672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3738 [2:7556556283257643704:8949]
2025-10-02T09:37:43.765679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.765688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.765690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.765691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.765693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.765701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.765705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.765712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.765744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.765749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.765750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.765752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.765753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.765788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.765793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.765799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.765807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.765819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.765832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234054:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.765838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234137:3576], now have 1 active actors on pipe
2025-10-02T09:37:43.765841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.765844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.765845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.765853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.765863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.765867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.765869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.765864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3738
2025-10-02T09:37:43.765870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.765873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.765875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.765868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3738
2025-10-02T09:37:43.765888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.765893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.765894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.765905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.765910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.765935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.765941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.765943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.765944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.765949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.765954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.765967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.766075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.766079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.766087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.766150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3739 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0
2025-10-02T09:37:43.766335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e8adf1-e7c9cc75-1e02be7d-fd59921_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.769120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Write session: try to update token
2025-10-02T09:37:43.769130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.775066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.775079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.775081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.775082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.775086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.775090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.775094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643699:8949]
2025-10-02T09:37:43.775115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.775119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.775122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.775122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.775123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.775124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.775228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.784152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3739 sessionId: src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.786358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.849532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333234144:4294]
2025-10-02T09:37:43.849716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3738, pipe: [1:7556556283333234144:4294]
2025-10-02T09:37:43.883778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:43.884121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.884133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.884144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234144:4294], now have 1 active actors on pipe
2025-10-02T09:37:43.884328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:43.884323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333234144:4294]
2025-10-02T09:37:43.884328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:43.884357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:43.884359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:43.884405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3739 reason: error at write: Disconnected sessionId: src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0
2025-10-02T09:37:43.884547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3739 sessionId: src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0 is DEAD
2025-10-02T09:37:43.884691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:43.884699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Write session will restart in 0.005999s
2025-10-02T09:37:43.884716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Write session: Do CDS request
2025-10-02T09:37:43.884724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:43.890959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:43.892220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.892331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:43.892331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:43.892339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3740
2025-10-02T09:37:43.892442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:43.892460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:43.892466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:43.892469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:43.892577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:43.892588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:43.892599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:43.892654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:43.892686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556283257643800:8944]
2025-10-02T09:37:43.892716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3740 sessionId:  describe result for acl check
2025-10-02T09:37:43.892793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:43.892823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:43.892825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:43.892839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:43.893245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:43.893333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:43.893460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:43.893500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:43.893798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:43.893856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.893863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.893864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.893865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.893866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.893867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.893868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.893869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.893870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.893871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.893872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.893873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.893878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.893888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.893893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.893897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.893900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.893904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.893911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.893915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.893923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.893927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.893934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.893937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.893946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.893956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:43.893965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.893973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:43.893981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.893987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:43.893995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.894003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:43.894012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.894024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:43.894031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.894039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:43.894046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.894054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:43.894061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.894065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:43.894073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.894079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:43.894087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.894093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.894101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.894106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.894113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.894118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.894154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:43.895154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:43.900274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:43.900285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:43.900288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556283333234191:3572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:43.900294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:43.902009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:43.904247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:43.904262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:43.904264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:43.904267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:43.904271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3739 [2:7556556283257643800:8944]
2025-10-02T09:37:43.904281Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:43.904297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:43.904304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.904306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.904308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.904319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:43.904327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:43.904335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:43.904375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.904381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.904383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.904385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:43.904387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:43.904434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:43.904440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.904452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:43.904467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:43.904488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:43.904494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3739
2025-10-02T09:37:43.904506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234146:2446], now have 1 active actors on pipe
2025-10-02T09:37:43.904513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234229:3572], now have 1 active actors on pipe
2025-10-02T09:37:43.904519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.904524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.904527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.904519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3739
2025-10-02T09:37:43.904534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:43.904539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:43.904541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:43.904542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:43.904547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:43.904560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:43.904567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:43.904587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.904594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.904616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.904626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:43.904633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:43.904641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:43.904650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:43.904658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:43.904663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:43.904670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:43.904680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:43.904710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.904827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:43.904836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:43.904849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:43.904912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3740 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0
2025-10-02T09:37:43.905135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2031aa5-4282a7ba-e4fcb15d-5dff0181_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:43.911177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Write session: try to update token
2025-10-02T09:37:43.911194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:43.914186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:43.914201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:43.914202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:43.914204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:43.914209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.914214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.914217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556283257643795:8944]
2025-10-02T09:37:43.914241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:43.914242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:43.914246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:43.914248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:43.914249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:43.914252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:43.914364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:43.925436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3740 sessionId: src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:43.927714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:43.984675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556283333234266:4294]
2025-10-02T09:37:43.984826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3739, pipe: [1:7556556283333234266:4294]
2025-10-02T09:37:44.023238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.023519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.023530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.023544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556283333234266:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.023656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.023666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556283333234266:4294]
2025-10-02T09:37:44.023685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:44.023720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.023733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3740 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0
2025-10-02T09:37:44.023868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3740 sessionId: src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0 is DEAD
2025-10-02T09:37:44.023998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:44.024006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Write session will restart in 0.009562s
2025-10-02T09:37:44.024019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Write session: Do CDS request
2025-10-02T09:37:44.024023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.030544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.030784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.030886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.030892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.030898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.030924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.030946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611202:8919]
2025-10-02T09:37:44.031583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.031741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.031775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.032060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.032091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.032095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.032096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.032096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.032097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.032097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.032098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.032099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.032099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.032100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.032100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.032101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.032104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.032111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.032113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.032115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.032118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.032120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.032122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.032124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.032126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.032129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.032130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.032132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.032136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.032140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.032143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.032146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.032148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.032152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.032154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.032157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.032159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.032162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.032164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.032167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.032169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.032172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.032174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.032176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.032180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.032182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.032186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.032189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.032191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.032194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.032196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.032199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.032219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.034170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.034297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.034307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3741
2025-10-02T09:37:44.034387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.034406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.034413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.034415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.034780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3741 sessionId:  describe result for acl check
2025-10-02T09:37:44.034821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.034828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.034830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.034834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.035279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.037118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.039407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.039420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.039422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628201617:3541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.039427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.039739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.041313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.041323Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.041324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.041326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.041330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3740 [2:7556556287552611202:8919]
2025-10-02T09:37:44.041336Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.041346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.041351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.041352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.041353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.041362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.041367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.041371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.041402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.041406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.041407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.041409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.041411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.041447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.041451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.041458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.041463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.041476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.041489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201652:3541], now have 1 active actors on pipe
2025-10-02T09:37:44.041495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201564:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.041499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.041500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.041501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.041509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.041516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.041507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3740
2025-10-02T09:37:44.041527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3740
2025-10-02T09:37:44.041523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.041524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.041527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.041527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.041528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.041551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.041556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.041564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.041569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.041579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.041584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.041587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.041589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.041590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.041596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.041600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.041614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.041703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.041708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.041715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.041764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3741 partition: 0 MaxSeqNo: 36 sessionId: src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0
2025-10-02T09:37:44.041962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b80682-88d6f473-2e26b446-ba06c6af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.044381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Write session: try to update token
2025-10-02T09:37:44.044395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.051062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.051072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.051073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.051074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.051078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.051080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.051084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611197:8919]
2025-10-02T09:37:44.051103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.051105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.051106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.051106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.051109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.051111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.051253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.056415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3741 sessionId: src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.058544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.123939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628201659:4294]
2025-10-02T09:37:44.124093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3740, pipe: [1:7556556287628201659:4294]
2025-10-02T09:37:44.161142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.161464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.161475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.161504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201659:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.161658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.161681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628201659:4294]
2025-10-02T09:37:44.161702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.161751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:44.161853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0
2025-10-02T09:37:44.162018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3741 sessionId: src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0 is DEAD
2025-10-02T09:37:44.162153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:44.162167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Write session will restart in 0.006640s
2025-10-02T09:37:44.162192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Write session: Do CDS request
2025-10-02T09:37:44.162198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.167658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.168751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.168921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.168931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.168937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.168969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.168993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611287:8914]
2025-10-02T09:37:44.169337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.169533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.169556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.169733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.169762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.169766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.169767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.169767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.169768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.169768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.169769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.169769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.169770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.169771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.169771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.169772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.169774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.169782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.169784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.169786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.169788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.169790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.169792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.169794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.169797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.169800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.169802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.169803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.169809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.169813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.169816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.169819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.169821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.169823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.169825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.169828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.169831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.169833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.169835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.169837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.169840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.169842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.169845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.169848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.169850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.169852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.169854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.169857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.169859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.169861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.169863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.169866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.169884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.170189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.170326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.170335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3742
2025-10-02T09:37:44.170420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.170438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.170444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.170446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.170844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3742 sessionId:  describe result for acl check
2025-10-02T09:37:44.170881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.170887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.170889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.170894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.171383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.173120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.177161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.177174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.177177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628201711:3518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.177183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.177595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.179112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.179121Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.179123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.179125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.179128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3741 [2:7556556287552611287:8914]
2025-10-02T09:37:44.179137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.179146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.179152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.179153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.179154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.179167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.179173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.179177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.179206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.179210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.179211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.179213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.179214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.179250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.179255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.179261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.179268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.179277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.179301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201746:3518], now have 1 active actors on pipe
2025-10-02T09:37:44.179306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201660:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.179310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.179311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.179312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.179320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.179329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.179335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.179338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.179339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.179339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.179341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.179343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3741
2025-10-02T09:37:44.179356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.179360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.179360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3741
2025-10-02T09:37:44.179367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.179381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.179386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.179404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.179411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.179413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.179414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.179419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.179426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.179435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.179547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.179552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.179559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.179623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3742 partition: 0 MaxSeqNo: 36 sessionId: src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0
2025-10-02T09:37:44.179834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21eab6e-49cbe942-cbee1640-b8906aef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.182287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Write session: try to update token
2025-10-02T09:37:44.182302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.188792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.188814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.188816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.188816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.188820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.188822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.188824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611282:8914]
2025-10-02T09:37:44.188842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.188848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.188850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.188851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.188852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.188854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.188957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.194347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3742 sessionId: src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.196462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.261665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628201754:4294]
2025-10-02T09:37:44.261842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3741, pipe: [1:7556556287628201754:4294]
2025-10-02T09:37:44.298526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.298824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.298834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.298863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201754:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.299199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.299191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:44.299202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:44.299253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3742 reason: error at write: Disconnected sessionId: src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0
2025-10-02T09:37:44.299254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628201754:4294]
2025-10-02T09:37:44.299295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.299409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3742 sessionId: src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0 is DEAD
2025-10-02T09:37:44.299559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:44.299571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Write session will restart in 0.006177s
2025-10-02T09:37:44.299590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Write session: Do CDS request
2025-10-02T09:37:44.299595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.305140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.306376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.306475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.306481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.306486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.306512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.306535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611375:8910]
2025-10-02T09:37:44.306872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.307050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.307072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.307195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.307248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.307277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.307280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.307281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.307281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.307282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.307282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.307291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.307292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.307293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.307293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.307293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.307294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.307294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.307302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3743
2025-10-02T09:37:44.307297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.307304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.307306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.307308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.307310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.307312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.307313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.307315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.307317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.307319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.307321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.307323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.307327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.307331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.307334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.307336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.307338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.307341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.307344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.307346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.307349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.307351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.307353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.307356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.307358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.307360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.307362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.307364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.307366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.307369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.307371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.307373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.307375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.307378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.307380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.307383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.307398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.307413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.307433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.307439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.307442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.307768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3743 sessionId:  describe result for acl check
2025-10-02T09:37:44.307804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.307812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.307813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.307818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.308275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.309831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.313970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.313984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.313987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628201807:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.313992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.315073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.316610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.316619Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.316620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.316622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.316625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3742 [2:7556556287552611375:8910]
2025-10-02T09:37:44.316633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.316643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.316647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.316649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.316650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.316658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.316661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.316665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.316695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.316700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.316701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.316702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.316704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.316739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.316744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.316750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.316755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.316763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.316777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201755:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.316782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201842:3524], now have 1 active actors on pipe
2025-10-02T09:37:44.316786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.316787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.316788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.316795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.316815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.316823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.316826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.316828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.316831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.316833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.316842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.316837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3742
2025-10-02T09:37:44.316847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.316860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.316852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3742
2025-10-02T09:37:44.316869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.316874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.316892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.316896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.316900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.316901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.316906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.316912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.316924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.317033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.317037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.317045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.317106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3743 partition: 0 MaxSeqNo: 36 sessionId: src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0
2025-10-02T09:37:44.317338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a07014-e5d27bf6-c08fecfe-89afe6d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.319748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Write session: try to update token
2025-10-02T09:37:44.319764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.326414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.326426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.326427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.326428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.326432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.326434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.326436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611370:8910]
2025-10-02T09:37:44.326454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.326457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.326458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.326463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.326467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.326469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.326564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.332458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3743 sessionId: src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.334750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.399387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628201852:4294]
2025-10-02T09:37:44.399536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3742, pipe: [1:7556556287628201852:4294]
2025-10-02T09:37:44.436230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.436442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.436453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.436467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201852:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.436584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628201852:4294]
2025-10-02T09:37:44.436589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.436630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.436648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:44.436663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:44.436743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3743 reason: error at write: Disconnected sessionId: src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0
2025-10-02T09:37:44.436941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3743 sessionId: src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0 is DEAD
2025-10-02T09:37:44.437071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:44.437084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Write session will restart in 0.009296s
2025-10-02T09:37:44.437105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Write session: Do CDS request
2025-10-02T09:37:44.437111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.442495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.443757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.443861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.443868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.443874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.443905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.443937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611475:8906]
2025-10-02T09:37:44.444278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.444506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.444529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.444706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.444736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.444739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.444740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.444740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.444741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.444742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.444742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.444743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.444743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.444744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.444744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.444745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.444747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.444755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.444757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.444759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.444761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.444763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.444765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.444766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.444768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.444770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.444772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.444774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.444779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.444783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.444786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.444789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.444791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.444793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.444795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.444798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.444812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.444814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.444817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.444820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.444822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.444824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.444826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.444829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.444831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.444834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.444836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.444838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.444840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.444842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.444844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.444847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.444862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.447156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.447241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.447249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3744
2025-10-02T09:37:44.447374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.447394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.447402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.447405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.447766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3744 sessionId:  describe result for acl check
2025-10-02T09:37:44.447805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.447814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.447816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.447822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.448327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.450028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.452048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.452060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.452062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628201906:3491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.452067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.452533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.454015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.454028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.454029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.454031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.454035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3743 [2:7556556287552611475:8906]
2025-10-02T09:37:44.454042Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.454055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.454060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.454061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.454062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.454071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.454074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.454078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.454109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.454114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.454116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.454118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.454119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.454226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3743
2025-10-02T09:37:44.454252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3743
2025-10-02T09:37:44.454274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.454278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.454285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.454290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.454301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.454315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201941:3491], now have 1 active actors on pipe
2025-10-02T09:37:44.454321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201853:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.454330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.454334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.454346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.454350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.454351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.454359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.454369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.454375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.454376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.454377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.454379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.454381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.454390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|318f7065-ec83aea-e4d722f7-c751f455_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.454397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.454398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.454399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.454404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.454411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.454426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.454434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.454442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.454443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.454528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.454535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.454542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.454585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3744 partition: 0 MaxSeqNo: 36 sessionId: src_id|318f7065-ec83aea-e4d722f7-c751f455_0
2025-10-02T09:37:44.454783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4f2e19-bc9d3406-e3f8eb68-8402d219_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|318f7065-ec83aea-e4d722f7-c751f455_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.457102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Write session: try to update token
2025-10-02T09:37:44.457119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.463533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:44.463544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.463548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.463567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:44.463569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:44.463697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:44.463805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:44.463909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:44.464015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:44.464180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:44.464201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:44.469079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3744 sessionId: src_id|318f7065-ec83aea-e4d722f7-c751f455_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.471343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.471441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.471449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.471463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:44.471521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:44.472448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.472459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.472461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.472462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.472468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.472470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.472472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611470:8906]
2025-10-02T09:37:44.472490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.472491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.472494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.472495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.472498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.472499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.472618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.536606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628201961:4294]
2025-10-02T09:37:44.536781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3743, pipe: [1:7556556287628201961:4294]
2025-10-02T09:37:44.583539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.590022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.590040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.590173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.590234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.590293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.590348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.590390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.590396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.590448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.590497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.590553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.590607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.590646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.590651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.590702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.590749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.590801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.590852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.591284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.591303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.591355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.591406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.591460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.591513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.591549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.591553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.591607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.591658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.591715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.591770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.591859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.591864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.591923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.591973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.592023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.592071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.592107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.592112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.592171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.592224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.592284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.592341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.592382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.592387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.592445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.592514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.592567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.592622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.592662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.592666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.592725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.592780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.592849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.592899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.592937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.592941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.592997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:44.593048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:44.593103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:44.593214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:44.593252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:44.593257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:44.593288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201961:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.593485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:44.593498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:44.593517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3744 reason: error at write: Disconnected sessionId: src_id|318f7065-ec83aea-e4d722f7-c751f455_0
2025-10-02T09:37:44.593546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628201961:4294]
2025-10-02T09:37:44.593586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.593611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.593662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3744 sessionId: src_id|318f7065-ec83aea-e4d722f7-c751f455_0 is DEAD
2025-10-02T09:37:44.593810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:44.593830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Write session will restart in 0.008806s
2025-10-02T09:37:44.593849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Write session: Do CDS request
2025-10-02T09:37:44.593855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.599762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.601147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.601248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.601255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.601261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.601288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.601314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611563:8904]
2025-10-02T09:37:44.601653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.601816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.601838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.602012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.602040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.602043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.602044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.602045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.602045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.602046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.602046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.602047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.602047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.602048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.602048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.602049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.602052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.602058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.602060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.602062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.602064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.602066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.602068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.602070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.602071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.602073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.602075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.602077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.602081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.602085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.602089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.602092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.602094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.602096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.602098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.602104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.602106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.602109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.602110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.602113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.602115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.602117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.602119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.602124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.602126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.602130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.602132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.602134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.602139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.602141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.602143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.602145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.602163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.604130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.604238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.604249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3745
2025-10-02T09:37:44.604355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.604374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.604380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.604382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.604749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3745 sessionId:  describe result for acl check
2025-10-02T09:37:44.604787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.604794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.604796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.604820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.605321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.606994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.609375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.609389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.609393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628202016:8114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.609398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.609787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.611252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.611263Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.611264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.611266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.611270Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3744 [2:7556556287552611563:8904]
2025-10-02T09:37:44.611277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.611295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.611300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.611304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.611305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.611313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.611316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.611319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.611349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.611354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.611354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.611357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.611358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.611391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.611395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.611402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.611408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.611416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.611432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628201962:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.611435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202051:8114], now have 1 active actors on pipe
2025-10-02T09:37:44.611438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.611439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.611440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.611447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.611454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.611460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.611455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3744
2025-10-02T09:37:44.611469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3744
2025-10-02T09:37:44.611461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.611463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.611467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.611468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.611477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.611479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.611480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.611495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.611500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.611517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|152a762f-521ea50-8abb26c9-e2684534_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.611524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.611529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.611533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.611537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.611542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.611555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.611650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.611655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.611662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.611715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3745 partition: 0 MaxSeqNo: 36 sessionId: src_id|152a762f-521ea50-8abb26c9-e2684534_0
2025-10-02T09:37:44.611888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318f7065-ec83aea-e4d722f7-c751f455_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|152a762f-521ea50-8abb26c9-e2684534_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.614170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Write session: try to update token
2025-10-02T09:37:44.614186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.620890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.620899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.620901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.620902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.620905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.620907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.620911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611558:8904]
2025-10-02T09:37:44.620928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.620931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.620932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.620934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.620937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.620939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.621034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.626596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3745 sessionId: src_id|152a762f-521ea50-8abb26c9-e2684534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.628944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.693802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628202059:4294]
2025-10-02T09:37:44.693986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3744, pipe: [1:7556556287628202059:4294]
2025-10-02T09:37:44.731127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.731399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.731409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.731439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202059:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.731559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.731562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.731600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628202059:4294]
2025-10-02T09:37:44.731620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:44.731640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:44.731720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3745 reason: error at write: Disconnected sessionId: src_id|152a762f-521ea50-8abb26c9-e2684534_0
2025-10-02T09:37:44.731885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3745 sessionId: src_id|152a762f-521ea50-8abb26c9-e2684534_0 is DEAD
2025-10-02T09:37:44.732027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:44.732039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Write session will restart in 0.007218s
2025-10-02T09:37:44.732060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Write session: Do CDS request
2025-10-02T09:37:44.732064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.737781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.739150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.739259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.739266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.739271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.739310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.739384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611652:8902]
2025-10-02T09:37:44.739735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.739937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.739966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.740106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.740173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.740204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.740208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.740208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.740209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.740209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.740210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.740210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.740211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.740211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.740212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.740212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.740213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.740215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.740222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.740224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.740226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.740228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.740230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.740232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.740234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.740236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.740238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.740240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.740242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.740246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.740250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.740253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.740256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.740260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.740263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.740266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.740269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.740271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.740273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.740275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.740278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.740280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.740282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.740284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.740287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.740271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.740289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.740292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.740294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.740296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.740279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3746
2025-10-02T09:37:44.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.740302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.740304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.740306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.740321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.740417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.740439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.740445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.740448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.740733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3746 sessionId:  describe result for acl check
2025-10-02T09:37:44.740753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.740757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.740758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.740761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.741127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.743049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.747192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.747206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.747208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628202115:3465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.747214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.747635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.749085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.749086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.749088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.749091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3745 [2:7556556287552611652:8902]
2025-10-02T09:37:44.749098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.749107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.749109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.749110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.749112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.749122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.749129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.749133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.749160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.749164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.749165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.749166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.749168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.749206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.749211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.749217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.749222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.749230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.749244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202150:3465], now have 1 active actors on pipe
2025-10-02T09:37:44.749250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202060:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.749253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.749254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.749255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.749262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.749269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.749275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.749277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.749278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.749279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.749281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.749275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3745
2025-10-02T09:37:44.749293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.749297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.749299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.749306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.749310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.749313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3745
2025-10-02T09:37:44.749330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.749337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.749339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.749340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.749347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.749354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.749367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.749450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.749454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.749461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.749517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3746 partition: 0 MaxSeqNo: 36 sessionId: src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0
2025-10-02T09:37:44.749739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152a762f-521ea50-8abb26c9-e2684534_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.752029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Write session: try to update token
2025-10-02T09:37:44.752041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.758371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.758382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.758383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.758384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.758388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.758390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.758392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611647:8902]
2025-10-02T09:37:44.758410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.758413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.758414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.758415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.758418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.758426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.758544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.764152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3746 sessionId: src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.766312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.831542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628202159:4294]
2025-10-02T09:37:44.831712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3745, pipe: [1:7556556287628202159:4294]
2025-10-02T09:37:44.869896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:44.870119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.870130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.870144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202159:4294], now have 1 active actors on pipe
2025-10-02T09:37:44.870435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:44.870445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628202159:4294]
2025-10-02T09:37:44.870467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:44.870507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:44.870614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3746 reason: status is not ok: tablet will be restarted right now sessionId: src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0
2025-10-02T09:37:44.870772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3746 sessionId: src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0 is DEAD
2025-10-02T09:37:44.870909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:44.870919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Write session will restart in 0.006339s
2025-10-02T09:37:44.870939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Write session: Do CDS request
2025-10-02T09:37:44.870943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:44.876300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:44.877651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:44.877755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:44.877762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:44.877768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:44.877793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:44.877817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556287552611741:8900]
2025-10-02T09:37:44.878164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:44.878226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.878282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:44.878302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3747
2025-10-02T09:37:44.878333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:44.878355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:44.878430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:44.878452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:44.878459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:44.878462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:44.878528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:44.878558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.878563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.878564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.878565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.878565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.878566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.878566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.878567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.878567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.878568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.878568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.878569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.878571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.878577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.878579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.878581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.878583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.878585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.878587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.878589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.878591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.878593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.878595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.878597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.878601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.878606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:44.878609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.878611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:44.878613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.878616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:44.878618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.878621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:44.878623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.878626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:44.878628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.878630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:44.878633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.878635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:44.878637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.878640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:44.878642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.878645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:44.878647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.878649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.878651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.878654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.878656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.878659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.878677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:44.878816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3747 sessionId:  describe result for acl check
2025-10-02T09:37:44.878853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:44.878858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:44.878859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:44.878864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:44.879332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:44.880662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:44.885603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:44.885618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:44.885621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556287628202217:3464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:44.885626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:44.886023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:44.887379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:44.887389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:44.887390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:44.887392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:44.887395Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3746 [2:7556556287552611741:8900]
2025-10-02T09:37:44.887403Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:44.887411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:44.887412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.887414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.887415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.887423Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:44.887426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:44.887431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:44.887465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.887469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.887470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.887472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:44.887473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:44.887510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:44.887515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.887520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:44.887525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:44.887537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:44.887551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202252:3464], now have 1 active actors on pipe
2025-10-02T09:37:44.887556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202161:2446], now have 1 active actors on pipe
2025-10-02T09:37:44.887560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.887561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.887562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.887569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:44.887579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:44.887582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:44.887584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:44.887585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:44.887589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:44.887591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:44.887580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3746
2025-10-02T09:37:44.887604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.887609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:44.887611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:44.887603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3746
2025-10-02T09:37:44.887619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.887624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.887649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:44.887657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:44.887661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:44.887665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:44.887669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:44.887674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:44.887683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.887772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:44.887776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:44.887784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:44.887845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3747 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0
2025-10-02T09:37:44.888039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630955fd-ad2d8796-f2437e82-2ef083f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:44.890914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Write session: try to update token
2025-10-02T09:37:44.890924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:44.896828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:44.896839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:44.896841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:44.896842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:44.896846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.896849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.896851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556287552611736:8900]
2025-10-02T09:37:44.896873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:44.896875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:44.896876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:44.896878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:44.896879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:44.896881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:44.897008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:44.903495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3747 sessionId: src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:44.905651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:44.970778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556287628202288:4294]
2025-10-02T09:37:44.970906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3746, pipe: [1:7556556287628202288:4294]
2025-10-02T09:37:45.014867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.015093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.015105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.015121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556287628202288:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.015264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.015301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:45.015310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:45.015364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3747 reason: error at write: Disconnected sessionId: src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0
2025-10-02T09:37:45.015371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.015432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556287628202288:4294]
2025-10-02T09:37:45.015502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3747 sessionId: src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0 is DEAD
2025-10-02T09:37:45.015637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:45.015646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Write session will restart in 0.006616s
2025-10-02T09:37:45.015662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Write session: Do CDS request
2025-10-02T09:37:45.015666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.021219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.022478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.022579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.022585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.022591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.022615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.022640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579163:12298]
2025-10-02T09:37:45.022987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.023153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.023181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.023175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.023314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.023323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3748
2025-10-02T09:37:45.023424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.023441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.023447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.023449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.023459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.023494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.023498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.023499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.023499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.023500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.023500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.023501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.023501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.023502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.023502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.023503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.023504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.023507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.023513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.023515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.023517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.023519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.023521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.023523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.023525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.023526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.023528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.023530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.023532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.023536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.023539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.023543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.023546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.023548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.023550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.023553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.023555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.023559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.023561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.023563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.023566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.023568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.023570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.023572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.023575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.023580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.023583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.023586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.023592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.023594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.023597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.023601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.023604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.023619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.023802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3748 sessionId:  describe result for acl check
2025-10-02T09:37:45.023840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.023847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.023849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.023853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.024314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.026234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.030787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.030802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.030805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923169643:3425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.030812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.031113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.032618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.032630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.032631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.032633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.032637Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3747 [2:7556556291847579163:12298]
2025-10-02T09:37:45.032646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.032656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.032661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.032663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.032664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.032673Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.032676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.032680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.032722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.032729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.032731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.032734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.032736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.032785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.032790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.032796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.032815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.032827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.032841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169585:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.032846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169678:3425], now have 1 active actors on pipe
2025-10-02T09:37:45.032850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.032851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.032852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.032860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.032854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3747
2025-10-02T09:37:45.032871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.032871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.032878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.032879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.032879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.032880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.032898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.032905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.032907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.032924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.032911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3747
2025-10-02T09:37:45.032929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.032946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.032953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.032955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.032956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.032962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.032970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.032980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.033073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.033078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.033085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.033134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3748 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0
2025-10-02T09:37:45.033368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7cb6388-fe6a462f-718e64c4-1c51f87a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.035933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Write session: try to update token
2025-10-02T09:37:45.035948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.042379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.042391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.042393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.042394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.042398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.042400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.042402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579158:12298]
2025-10-02T09:37:45.042421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.042424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.042427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.042428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.042431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.042433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.042540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.048775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3748 sessionId: src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.050916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.115693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923169688:4294]
2025-10-02T09:37:45.115911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3747, pipe: [1:7556556291923169688:4294]
2025-10-02T09:37:45.157915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.158235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.158246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.158260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169688:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.158397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.158424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.158459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.158496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923169688:4294]
2025-10-02T09:37:45.158515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3748 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0
2025-10-02T09:37:45.158659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3748 sessionId: src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0 is DEAD
2025-10-02T09:37:45.158796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.158804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Write session will restart in 0.007649s
2025-10-02T09:37:45.158824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Write session: Do CDS request
2025-10-02T09:37:45.158828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.164239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.165509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.165624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.165631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.165638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.165665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.165690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579254:12300]
2025-10-02T09:37:45.166043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.166210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.166233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.166413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.166445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.166449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.166450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.166450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.166451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.166452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.166453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.166454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.166454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.166455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.166455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.166456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.166459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.166466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.166468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.166470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.166472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.166474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.166476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.166478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.166480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.166482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.166484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.166487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.166490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.166494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.166498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.166500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.166503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.166505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.166507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.166511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.166513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.166515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.166517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.166524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.166526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.166529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.166531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.166537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.166539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.166541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.166546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.166549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.166551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.166557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.166559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.166562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.166579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.167215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.167287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.167305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3749
2025-10-02T09:37:45.167388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.167406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.167413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.167415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.167799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3749 sessionId:  describe result for acl check
2025-10-02T09:37:45.167842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.167849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.167850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.167854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.168290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.170003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.173905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.173919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.173921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923169747:3424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.173927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.174339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.175847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.175858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.175859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.175861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.175865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3748 [2:7556556291847579254:12300]
2025-10-02T09:37:45.175874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.175883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.175885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.175886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.175887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.175896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.175899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.175903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.175937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.175943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.175944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.175946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.175948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.175984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.175989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.175995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.176000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.176008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.176022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169689:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.176027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169782:3424], now have 1 active actors on pipe
2025-10-02T09:37:45.176031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.176033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.176034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.176043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.176053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.176058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.176061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.176062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.176068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.176074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.176062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3748
2025-10-02T09:37:45.176077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3748
2025-10-02T09:37:45.176092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.176099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.176107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.176118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.176125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.176146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16725768-9a9b2a11-383dd001-73324928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.176154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.176156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.176157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.176162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.176170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.176186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.176278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.176283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.176290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.176346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3749 partition: 0 MaxSeqNo: 36 sessionId: src_id|16725768-9a9b2a11-383dd001-73324928_0
2025-10-02T09:37:45.176591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca56f196-990a6dc-77e1e7f7-30e6fa70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16725768-9a9b2a11-383dd001-73324928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.178882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Write session: try to update token
2025-10-02T09:37:45.178896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.185613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.185625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.185626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.185627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.185631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.185633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.185635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579249:12300]
2025-10-02T09:37:45.185654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.185660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.185660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.185661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.185663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.185665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.185773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.191845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3749 sessionId: src_id|16725768-9a9b2a11-383dd001-73324928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.194162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.258547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923169790:4294]
2025-10-02T09:37:45.258738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3748, pipe: [1:7556556291923169790:4294]
2025-10-02T09:37:45.299742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.300131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.300143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.300156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169790:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.300296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.300326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.300366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.300391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923169790:4294]
2025-10-02T09:37:45.300419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3749 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16725768-9a9b2a11-383dd001-73324928_0
2025-10-02T09:37:45.300544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3749 sessionId: src_id|16725768-9a9b2a11-383dd001-73324928_0 is DEAD
2025-10-02T09:37:45.300626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.300633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Write session will restart in 0.005737s
2025-10-02T09:37:45.300650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Write session: Do CDS request
2025-10-02T09:37:45.300654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.307418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.307578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.307594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3750
2025-10-02T09:37:45.307694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.307724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.307730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.307733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.308285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3750 sessionId:  describe result for acl check
2025-10-02T09:37:45.308325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.308330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.308331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.308334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.308764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.309968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.310197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.310345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.310352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.310357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.310384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.310415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579348:12303]
2025-10-02T09:37:45.310573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.310865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.311020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.311042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.311253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.311297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.311301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.311302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.311302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.311303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.311303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.311304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.311304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.311305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.311306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.311306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.311307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.311309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.311315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.311317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.311319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.311321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.311326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.311328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.311330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.311333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.311335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.311337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.311339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.311342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.311346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.311350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.311357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.311367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.311372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.311374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.311377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.311384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.311387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.311397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.311403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.311405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.311408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.311410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.311415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.311418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.311421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.311423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.311426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.311431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.311433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.311435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.311438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.311453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.315639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.315651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.315654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923169844:2307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.315660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.319304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.321850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.321860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.321861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.321863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.321866Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3749 [2:7556556291847579348:12303]
2025-10-02T09:37:45.321873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.321882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.321884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.321886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.321887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.321896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.321898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.321902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.321938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.321943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.321944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.321946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.321947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.321983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.321988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.321994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.321999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.322011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.322025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169791:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.322031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169885:2307], now have 1 active actors on pipe
2025-10-02T09:37:45.322035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.322036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.322037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.322046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.322056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.322060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.322062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.322064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.322067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.322068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.322085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.322090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.322074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3749
2025-10-02T09:37:45.322092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.322094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3749
2025-10-02T09:37:45.322120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.322125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.322142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64d4c4f9-20454567-26ce6939-5965ef89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.322153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.322158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.322159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.322164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.322172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.322182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.322289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.322294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.322302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.322364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3750 partition: 0 MaxSeqNo: 36 sessionId: src_id|64d4c4f9-20454567-26ce6939-5965ef89_0
2025-10-02T09:37:45.322683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16725768-9a9b2a11-383dd001-73324928_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64d4c4f9-20454567-26ce6939-5965ef89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.331921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.331935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.331936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.331937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.331940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.331943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.331945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579343:12303]
2025-10-02T09:37:45.331964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.331968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.331969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.331970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.331973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.331980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.332074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.336418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Write session: try to update token
2025-10-02T09:37:45.336432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.350674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3750 sessionId: src_id|64d4c4f9-20454567-26ce6939-5965ef89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.352818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.400353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923169895:4294]
2025-10-02T09:37:45.400522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3749, pipe: [1:7556556291923169895:4294]
2025-10-02T09:37:45.447536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.447909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.447922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.447938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169895:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.448076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.448096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.448135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.448160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923169895:4294]
2025-10-02T09:37:45.448227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3750 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64d4c4f9-20454567-26ce6939-5965ef89_0
2025-10-02T09:37:45.448358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3750 sessionId: src_id|64d4c4f9-20454567-26ce6939-5965ef89_0 is DEAD
2025-10-02T09:37:45.448588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.448597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Write session will restart in 0.008696s
2025-10-02T09:37:45.448615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Write session: Do CDS request
2025-10-02T09:37:45.448619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.454901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.456051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.456270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.456278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.456286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.456323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.456349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579455:12307]
2025-10-02T09:37:45.456723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.456918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.456942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.457135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.457167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.457172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.457173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.457174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.457175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.457177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.457178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.457178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.457181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.457182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.457183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.457184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.457188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.457198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.457202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.457206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.457211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.457213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.457215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.457217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.457219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.457222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.457223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.457225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.457229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.457233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.457237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.457240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.457242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.457244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.457247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.457249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.457255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.457258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.457260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.457262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.457265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.457267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.457272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.457276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.457278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.457284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.457286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.457289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.457291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.457293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.457300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.457302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.457320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.458137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.458342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.458353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3751
2025-10-02T09:37:45.458432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.458449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.458455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.458457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.458728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3751 sessionId:  describe result for acl check
2025-10-02T09:37:45.458748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.458752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.458755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.458757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.459013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.460408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.464616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.464625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.464627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923169968:2341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.464632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.465082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.466515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.466526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.466527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.466529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.466532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3750 [2:7556556291847579455:12307]
2025-10-02T09:37:45.466543Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.466557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.466562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.466563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.466564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.466573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.466579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.466583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.466614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.466618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.466619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.466621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.466623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.466661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.466665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.466671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.466676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.466687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.466701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923169896:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.466707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170003:2341], now have 1 active actors on pipe
2025-10-02T09:37:45.466711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.466715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.466716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.466723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.466722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3750
2025-10-02T09:37:45.466725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3750
2025-10-02T09:37:45.466732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.466736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.466738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.466740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.466742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.466743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.466757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.466762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.466763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.466773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.466778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.466904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.466911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.466913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.466914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.466919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.466928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.466944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.467037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.467042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.467050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.467103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3751 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0
2025-10-02T09:37:45.467266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d4c4f9-20454567-26ce6939-5965ef89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.469777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Write session: try to update token
2025-10-02T09:37:45.469790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.476530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.476545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.476546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.476547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.476551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.476554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.476556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579450:12307]
2025-10-02T09:37:45.476578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.476582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.476583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.476583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.476587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.476589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.476696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.481977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3751 sessionId: src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.484086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.548323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923170011:4294]
2025-10-02T09:37:45.548534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3750, pipe: [1:7556556291923170011:4294]
2025-10-02T09:37:45.591048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.591385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.591397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.591414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170011:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.591584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.591594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.591622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923170011:4294]
2025-10-02T09:37:45.591632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.591693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3751 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0
2025-10-02T09:37:45.591832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3751 sessionId: src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0 is DEAD
2025-10-02T09:37:45.591968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.591977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Write session will restart in 0.005008s
2025-10-02T09:37:45.591998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Write session: Do CDS request
2025-10-02T09:37:45.592003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.597851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.598120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.598218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.598227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3752
2025-10-02T09:37:45.598316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.598337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.598343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.598346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.598626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3752 sessionId:  describe result for acl check
2025-10-02T09:37:45.598650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.598654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.598655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.598660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.599288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.599398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.599387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.599405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.599410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.599437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.599459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579549:12309]
2025-10-02T09:37:45.599827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.600000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.600023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.600204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.600238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.600242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.600243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.600243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.600245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.600245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.600246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.600246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.600247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.600250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.600256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.600258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.600260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.600262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.600264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.600266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.600268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.600270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.600274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.600276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.600278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.600282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.600286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.600291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.600296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.600304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.600308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.600315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.600319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.600326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.600331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.600339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.600342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.600350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.600359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.600368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.600375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.600378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.600380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.600383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.600389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.600391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.600394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.600396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.600401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.600417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.601146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.606476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.606493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.606496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923170069:2359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.606504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.608026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.609676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.609688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.609689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.609692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.609695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3751 [2:7556556291847579549:12309]
2025-10-02T09:37:45.609702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.609712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.609717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.609719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.609720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.609730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.609736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.609740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.609770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.609774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.609775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.609777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.609778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.609813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.609818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.609824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.609829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.609838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.609851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170108:2359], now have 1 active actors on pipe
2025-10-02T09:37:45.609857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170012:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.609861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.609862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.609863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.609870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.609880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.609886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.609888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.609889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.609890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.609892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.609888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3751
2025-10-02T09:37:45.609906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.609910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.609912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.609925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.609930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.609954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.609944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3751
2025-10-02T09:37:45.609969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.609974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.609975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.609980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.609985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.610000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.610088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.610093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.610100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.610154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3752 partition: 0 MaxSeqNo: 36 sessionId: src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0
2025-10-02T09:37:45.610373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59711f-4f3888c6-5f235e5f-997a2a39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.612922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Write session: try to update token
2025-10-02T09:37:45.612933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.619325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.619337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.619339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.619340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.619343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.619346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.619348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579544:12309]
2025-10-02T09:37:45.619368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.619372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.619373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.619373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.619377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.619379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.619495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.629563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3752 sessionId: src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.631882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.691671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923170116:4294]
2025-10-02T09:37:45.691841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3751, pipe: [1:7556556291923170116:4294]
2025-10-02T09:37:45.734248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.734475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.734486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.734498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170116:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.734627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.734666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923170116:4294]
2025-10-02T09:37:45.734689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.734721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.734739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3752 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0
2025-10-02T09:37:45.734878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3752 sessionId: src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0 is DEAD
2025-10-02T09:37:45.735084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.735090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Write session will restart in 0.005670s
2025-10-02T09:37:45.735108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Write session: Do CDS request
2025-10-02T09:37:45.735112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.741461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.742145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.742301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.742308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3753
2025-10-02T09:37:45.742422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.742441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.742443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.742445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.742622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.742827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.742836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.742844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.742819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3753 sessionId:  describe result for acl check
2025-10-02T09:37:45.742856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.742864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.742882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.742868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.742873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.742906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579644:12311]
2025-10-02T09:37:45.743246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.743342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.743426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.743452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.743631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.743659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.743663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.743663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.743664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.743665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.743665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.743666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.743666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.743667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.743668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.743669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.743669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.743672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.743678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.743680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.743682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.743684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.743686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.743688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.743690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.743691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.743693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.743695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.743697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.743700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.743704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.743707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.743710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.743712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.743715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.743716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.743719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.743721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.743724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.743725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.743728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.743730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.743733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.743735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.743737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.743741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.743744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.743746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.743749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.743751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.743753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.743755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.743758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.743774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.744974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.749124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.749137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.749139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923170175:2367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.749144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.751205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.752640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.752652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.752654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.752656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.752659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3752 [2:7556556291847579644:12311]
2025-10-02T09:37:45.752666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.752676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.752681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.752683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.752684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.752694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.752700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.752704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.752737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.752742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.752743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.752745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.752746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.752782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.752787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.752793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.752799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.752818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.752832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170214:2367], now have 1 active actors on pipe
2025-10-02T09:37:45.752838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170117:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.752842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.752843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.752844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.752852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.752862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.752866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.752868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.752869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.752872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.752874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.752861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3752
2025-10-02T09:37:45.752888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.752893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.752895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.752885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3752
2025-10-02T09:37:45.752903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.752908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.753026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.753037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.753040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.753041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.753045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.753050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.753064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.753189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.753194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.753202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.753254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3753 partition: 0 MaxSeqNo: 36 sessionId: src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0
2025-10-02T09:37:45.753476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198a5e4-ee0a7e52-dba5d8c3-dbb7bda1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.755966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Write session: try to update token
2025-10-02T09:37:45.755974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.763028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.763042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.763043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.763044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.763048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.763051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.763053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579639:12311]
2025-10-02T09:37:45.763075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.763078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.763079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.763080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.763081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.763083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.763184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.769666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3753 sessionId: src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.771892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.835060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923170221:4294]
2025-10-02T09:37:45.835231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3752, pipe: [1:7556556291923170221:4294]
2025-10-02T09:37:45.878492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:45.878822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.878835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.878865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170221:4294], now have 1 active actors on pipe
2025-10-02T09:37:45.879036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:45.879076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:45.879121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923170221:4294]
2025-10-02T09:37:45.879126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.879219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3753 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0
2025-10-02T09:37:45.879389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3753 sessionId: src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0 is DEAD
2025-10-02T09:37:45.879538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:45.879543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Write session will restart in 0.009266s
2025-10-02T09:37:45.879562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Write session: Do CDS request
2025-10-02T09:37:45.879567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:45.885374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:45.886796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:45.886899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:45.886907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:45.886912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:45.886938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:45.886961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556291847579739:12313]
2025-10-02T09:37:45.887331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:45.887498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:45.887521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:45.887706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:45.887737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.887741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.887742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.887742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.887743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.887743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.887744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.887744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.887745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.887745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.887749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.887756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.887758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.887761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.887763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.887765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.887767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.887769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.887771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.887773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.887775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.887777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.887781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.887785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:45.887788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.887791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:45.887794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.887796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:45.887799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.887801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:45.887805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.887808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:45.887810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.887813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:45.887815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.887819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:45.887825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.887827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:45.887829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.887832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:45.887837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.887840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.887843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.887849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.887851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.887853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.887884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:45.890138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.890328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:45.890338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3754
2025-10-02T09:37:45.890426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:45.890446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:45.890452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:45.890454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:45.890812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3754 sessionId:  describe result for acl check
2025-10-02T09:37:45.890848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:45.890855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:45.890856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:45.890861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:45.891338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:45.892870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:45.894791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:45.894803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:45.894806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556291923170286:2386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:45.894810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:45.895264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:45.896670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:45.896683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:45.896684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:45.896687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:45.896692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3753 [2:7556556291847579739:12313]
2025-10-02T09:37:45.896701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:45.896712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:45.896719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.896722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.896723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.896732Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:45.896735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:45.896743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:45.896791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.896796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.896797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.896798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:45.896811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:45.896924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3753
2025-10-02T09:37:45.896938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3753
2025-10-02T09:37:45.896968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:45.896974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.896981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:45.896986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:45.896995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:45.897009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170223:2446], now have 1 active actors on pipe
2025-10-02T09:37:45.897015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170321:2386], now have 1 active actors on pipe
2025-10-02T09:37:45.897033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.897038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.897048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.897052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.897053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.897061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:45.897073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:45.897078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:45.897081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:45.897082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:45.897083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:45.897085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:45.897093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:45.897100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:45.897102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:45.897103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:45.897108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:45.897117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:45.897136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.897143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:45.897151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:45.897152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.897247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.897252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.897259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:45.897305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3754 partition: 0 MaxSeqNo: 36 sessionId: src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0
2025-10-02T09:37:45.897506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2716cb9c-a3d8254f-91c75db7-f6f1b16d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:45.900056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Write session: try to update token
2025-10-02T09:37:45.900066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:45.910210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:45.910227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.910232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.910260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:45.910270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:45.910646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:45.910770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:45.910896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:45.911014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:45.911364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:45.911395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:45.912026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3754 sessionId: src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:45.914149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:45.914257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:45.914265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:45.914283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:45.914344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:45.915571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:45.915583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:45.915584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:45.915585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:45.915589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.915591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.915593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556291847579734:12313]
2025-10-02T09:37:45.915612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:45.915615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:45.915616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:45.915617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:45.915618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:45.915620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:45.915731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:45.979424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556291923170348:4294]
2025-10-02T09:37:45.979634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3753, pipe: [1:7556556291923170348:4294]
2025-10-02T09:37:46.029485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.036097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.036118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.036267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.036327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.036388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.036444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.036609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.036616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.036672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.036724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.036782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.036858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.036895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.036903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.036957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.037009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.037064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.037118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.037160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.037165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.037220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.037276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.037329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.037381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.037418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.037422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.037562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.037617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.037679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.037739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.037783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.037788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.037852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.037906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.037961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.038038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.038107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.038112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.038178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.038241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.038302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.038360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.038406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.038411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.038471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.038525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.038582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.038641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.038689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.038694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.038754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.038809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.038873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.038927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.038982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.038988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.039048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.039101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.039162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.039218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.039260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.039265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.039306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556291923170348:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.039506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556291923170348:4294]
2025-10-02T09:37:46.039557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:46.039560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:46.039587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3754 reason: error at write: Disconnected sessionId: src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0
2025-10-02T09:37:46.039587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.039750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3754 sessionId: src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0 is DEAD
2025-10-02T09:37:46.039889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:46.039899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Write session will restart in 0.007295s
2025-10-02T09:37:46.039916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Write session: Do CDS request
2025-10-02T09:37:46.039921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.039924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.047151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.047418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.047544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.047551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.047557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.047587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.047609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547169:12327]
2025-10-02T09:37:46.047955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.048146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.048140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.048166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.048261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.048272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3755
2025-10-02T09:37:46.048359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.048392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.048396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.048396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.048397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.048398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.048398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.048399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.048399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.048400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.048400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.048401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.048401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.048404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.048411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.048413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.048415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.048417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.048419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.048421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.048423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.048425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.048427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.048429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.048431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.048435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.048439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.048444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.048447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.048449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.048451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.048453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.048456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.048458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.048460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.048462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.048465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.048467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.048470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.048471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.048474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.048476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.048479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.048481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.048484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.048485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.048488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.048490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.048492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.048509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.048600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.048620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.048623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.048625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.048994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3755 sessionId:  describe result for acl check
2025-10-02T09:37:46.049031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.049032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.049033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.049038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.049490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.051163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.055494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.055508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.055510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218137722:2453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.055514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.055952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.057560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.057574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.057575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.057577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.057581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3754 [2:7556556296142547169:12327]
2025-10-02T09:37:46.057589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.057600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.057603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.057605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.057607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.057617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.057619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.057624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.057655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.057660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.057661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.057663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.057664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.057704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.057710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.057720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.057729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.057746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.057765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137756:2453], now have 1 active actors on pipe
2025-10-02T09:37:46.057772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137658:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.057777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.057779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.057780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.057791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.057783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3754
2025-10-02T09:37:46.057800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.057802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.057807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.057808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.057814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.057816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.057817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3754
2025-10-02T09:37:46.057844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.057852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.057865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.057876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.057883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.057897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.057906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.057908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.057910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.057915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.057920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.057942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.058044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.058051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.058063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.058121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3755 partition: 0 MaxSeqNo: 36 sessionId: src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0
2025-10-02T09:37:46.058336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e015ff4b-cf4fbcab-35327414-16b4cc47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.060836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Write session: try to update token
2025-10-02T09:37:46.060846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.067528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.067544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.067546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.067547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.067552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.067554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.067558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547164:12327]
2025-10-02T09:37:46.067582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.067586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.067587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.067588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.067590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.067592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.067701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.073588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3755 sessionId: src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.075844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.140014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218137764:4294]
2025-10-02T09:37:46.140210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3754, pipe: [1:7556556296218137764:4294]
2025-10-02T09:37:46.180392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.180768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.180778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.180791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137764:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.180917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.180964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218137764:4294]
2025-10-02T09:37:46.180994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:46.181019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.181053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3755 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0
2025-10-02T09:37:46.181193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3755 sessionId: src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0 is DEAD
2025-10-02T09:37:46.181318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:46.181327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Write session will restart in 0.006073s
2025-10-02T09:37:46.181346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Write session: Do CDS request
2025-10-02T09:37:46.181351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.187545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.188142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.188310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.188319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3756
2025-10-02T09:37:46.188427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.188447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.188454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.188456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.188742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3756 sessionId:  describe result for acl check
2025-10-02T09:37:46.188761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.188767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.188768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.188771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.189003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.189111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.189118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.189123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.189130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.189151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.189174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547270:12330]
2025-10-02T09:37:46.189549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.189735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.189761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.189989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.190049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.190055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.190056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.190056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.190057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.190058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.190059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.190060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.190061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.190061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.190062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.190063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.190067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.190076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.190079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.190082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.190085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.190089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.190092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.190095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.190098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.190101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.190104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.190107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.190116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.190123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.190128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.190133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.190139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.190143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.190151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.190156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.190163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.190168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.190175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.190179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.190182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.190189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.190192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.190200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.190204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.190210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.190213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.190217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.190224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.190229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.190234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.190238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.190267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.190993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.196321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.196338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.196340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218137826:2454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.196346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.197964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.199379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.199391Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.199392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.199394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.199398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3755 [2:7556556296142547270:12330]
2025-10-02T09:37:46.199405Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.199418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.199421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.199422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.199423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.199432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.199435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.199440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.199472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.199477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.199478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.199480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.199481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.199518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.199524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.199532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.199543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.199561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.199580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137866:2454], now have 1 active actors on pipe
2025-10-02T09:37:46.199586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137765:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.199591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.199592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.199594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.199604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.199616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.199608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3755
2025-10-02T09:37:46.199617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.199623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.199625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.199627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3755
2025-10-02T09:37:46.199628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.199630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.199658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.199663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.199671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.199678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.199686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.199694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.199698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.199703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.199704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.199709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.199715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.199731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.199826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.199832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.199841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.199895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3756 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0
2025-10-02T09:37:46.200140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ecc7-1d7bc87b-4be6faf2-9581620b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.202662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Write session: try to update token
2025-10-02T09:37:46.202673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.209437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.209454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.209455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.209457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.209462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.209464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.209467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547265:12330]
2025-10-02T09:37:46.209490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.209493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.209495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.209498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.209503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.209506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.209603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.214729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3756 sessionId: src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.216966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.281009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218137873:4294]
2025-10-02T09:37:46.281264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3755, pipe: [1:7556556296218137873:4294]
2025-10-02T09:37:46.321998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.322636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.322646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.322673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137873:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.322894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218137873:4294]
2025-10-02T09:37:46.322924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:46.322925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:46.322926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.322998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3756 reason: error at write: Disconnected sessionId: src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0
2025-10-02T09:37:46.323085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.323145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3756 sessionId: src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0 is DEAD
2025-10-02T09:37:46.323319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:46.323329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Write session will restart in 0.008774s
2025-10-02T09:37:46.323344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Write session: Do CDS request
2025-10-02T09:37:46.323348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.330784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.331052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.331175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.331182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.331188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.331215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.331239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547370:12332]
2025-10-02T09:37:46.331606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.331802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.331829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.332018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.332049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.332053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.332054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.332055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.332055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.332056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.332056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.332057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.332057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.332058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.332058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.332059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.332062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.332068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.332071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.332073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.332075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.332077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.332079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.332081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.332083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.332085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.332087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.332089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.332093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.332097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.332101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.332104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.332106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.332109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.332111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.332114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.332116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.332119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.332122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.332125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.332127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.332131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.332133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.332136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.332138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.332141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.332143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.332145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.332147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.332153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.332156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.332158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.332179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.333123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.333402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.333412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3757
2025-10-02T09:37:46.333534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.333553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.333558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.333561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.333923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3757 sessionId:  describe result for acl check
2025-10-02T09:37:46.333963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.333971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.333973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.333977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.334434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.335726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.339422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.339434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.339436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218137940:2471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.339441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.339961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.341589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.341602Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.341603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.341605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.341609Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3756 [2:7556556296142547370:12332]
2025-10-02T09:37:46.341617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.341627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.341628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.341630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.341631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.341640Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.341643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.341647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.341680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.341686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.341687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.341689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.341690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.341727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.341731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.341740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.341753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.341770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.341788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137975:2471], now have 1 active actors on pipe
2025-10-02T09:37:46.341795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137874:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.341799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.341803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.341805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.341814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.341826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.341827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.341833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.341835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.341838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.341840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.341858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.341865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.341851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3756
2025-10-02T09:37:46.341851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3756
2025-10-02T09:37:46.341877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.341900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.341906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.341920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.341928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.341931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.341932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.341940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.341949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.341960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.342067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.342074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.342084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.342141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3757 partition: 0 MaxSeqNo: 36 sessionId: src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0
2025-10-02T09:37:46.342365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d690d1d-ab14d3d9-10f0e07e-c606eac9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.345043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Write session: try to update token
2025-10-02T09:37:46.345054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.351394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:46.351411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.351417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.351440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:46.351459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:46.351582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:46.351703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.351829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.351950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.352190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:46.352216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:46.357227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3757 sessionId: src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.359301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.359425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.359439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.359457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:46.359500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:46.360347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.360360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.360362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.360363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.360368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.360371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.360374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547365:12332]
2025-10-02T09:37:46.360394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.360398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.360401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.360404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.360407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.360410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.360550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.422827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218137986:4294]
2025-10-02T09:37:46.423213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3756, pipe: [1:7556556296218137986:4294]
2025-10-02T09:37:46.473114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.479654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.479674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.479818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.479879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.479935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.479987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.480295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.480305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.480364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.480411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.480463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.480517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.480559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.480566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.480620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.480671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.480721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.480773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.480821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.480828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.480886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.480936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.480984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.481037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.481076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.481083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.481140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.481191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.481246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.481302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.481352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.481359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.481420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.481468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.481515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.481567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.481613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.481621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.481689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.481743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.481801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.481881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.481939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.481944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.482002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.482052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.482116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.482177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.482220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.482225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.482284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.482335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.482395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.482450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.482486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.482492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.482550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.482598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.482657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.482707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.482744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.482749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.482780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137986:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.482971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:46.482984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:46.483006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3757 reason: error at write: Disconnected sessionId: src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0
2025-10-02T09:37:46.483022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218137986:4294]
2025-10-02T09:37:46.483060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.483131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3757 sessionId: src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0 is DEAD
2025-10-02T09:37:46.483221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.483263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:46.483270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Write session will restart in 0.006509s
2025-10-02T09:37:46.483286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Write session: Do CDS request
2025-10-02T09:37:46.483291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.490866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.491119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.491189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.491291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.491306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.491312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.491344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.491362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.491370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3758
2025-10-02T09:37:46.491445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.491450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547484:12336]
2025-10-02T09:37:46.491462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.491468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.491471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.491822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.491836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3758 sessionId:  describe result for acl check
2025-10-02T09:37:46.491872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.491882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.491884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.491888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.492017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.492043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.492231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.492263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.492266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.492267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.492267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.492268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.492268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.492269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.492270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.492270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.492271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.492271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.492272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.492275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.492281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.492283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.492285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.492287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.492289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.492292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.492293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.492295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.492298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.492301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.492303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.492307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.492311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.492314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.492317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.492309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.492319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.492321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.492324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.492326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.492330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.492332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.492334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.492336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.492338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.492341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.492343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.492346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.492348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.492350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.492352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.492355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.492357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.492359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.492365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.492367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.492384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.494091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.497953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.497965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.497967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218138062:2495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.497981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.500137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.501669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.501682Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.501684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.501687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.501694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3757 [2:7556556296142547484:12336]
2025-10-02T09:37:46.501704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.501715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.501720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.501722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.501723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.501731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.501734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.501742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.501773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.501778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.501779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.501781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.501782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.501818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.501823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.501829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.501836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.501850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.501872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138101:2495], now have 1 active actors on pipe
2025-10-02T09:37:46.501878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218137999:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.501883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.501887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.501890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.501901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.501910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.501914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.501918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.501921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.501914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3757
2025-10-02T09:37:46.501926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.501933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3757
2025-10-02T09:37:46.501929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.501946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.501952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.501953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.501969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.501976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.501997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50f719a4-ea942888-d2727c03-2c420e45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.502006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.502010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.502013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.502021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.502032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.502054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.502143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.502151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.502161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.502216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3758 partition: 0 MaxSeqNo: 36 sessionId: src_id|50f719a4-ea942888-d2727c03-2c420e45_0
2025-10-02T09:37:46.502427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48dcd0eb-f48fe6a7-9230676d-ef51e99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50f719a4-ea942888-d2727c03-2c420e45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.504977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Write session: try to update token
2025-10-02T09:37:46.504989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.511730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.511744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.511746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.511747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.511752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.511755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.511757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547479:12336]
2025-10-02T09:37:46.511778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.511783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.511786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.511790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.511790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.511793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.511920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.517038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3758 sessionId: src_id|50f719a4-ea942888-d2727c03-2c420e45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.519139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.583088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218138109:4294]
2025-10-02T09:37:46.583354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3757, pipe: [1:7556556296218138109:4294]
2025-10-02T09:37:46.626594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.626891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.626900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.626926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138109:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.627129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.627132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:46.627144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:46.627183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.627189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3758 reason: error at write: Disconnected sessionId: src_id|50f719a4-ea942888-d2727c03-2c420e45_0
2025-10-02T09:37:46.627240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218138109:4294]
2025-10-02T09:37:46.627320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3758 sessionId: src_id|50f719a4-ea942888-d2727c03-2c420e45_0 is DEAD
2025-10-02T09:37:46.627482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:46.627491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Write session will restart in 0.005143s
2025-10-02T09:37:46.627521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Write session: Do CDS request
2025-10-02T09:37:46.627527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.633136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.633263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.633273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3759
2025-10-02T09:37:46.633389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.633409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.633415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.633417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.633763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3759 sessionId:  describe result for acl check
2025-10-02T09:37:46.633799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.633806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.633808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.633811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.634267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.635254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.635533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.635659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.635668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.635676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.635716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.635749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547586:12338]
2025-10-02T09:37:46.635833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.636280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.636473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.636499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.636689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.636723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.636727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.636727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.636728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.636728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.636729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.636730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.636731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.636732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.636732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.636733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.636733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.636736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.636743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.636746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.636749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.636751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.636753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.636755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.636757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.636759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.636761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.636763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.636765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.636768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.636773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.636777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.636781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.636783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.636785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.636788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.636791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.636794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.636797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.636799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.636815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.636818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.636821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.636823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.636826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.636828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.636831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.636835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.636838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.636841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.636844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.636847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.636850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.636867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.640954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.640966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.640969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218138175:2523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.640977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.644635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.646149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.646161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.646163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.646165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.646168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3758 [2:7556556296142547586:12338]
2025-10-02T09:37:46.646181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.646193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.646194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.646196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.646197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.646206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.646209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.646213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.646246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.646252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.646253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.646255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.646256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.646294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.646299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.646306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.646312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.646325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.646345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138113:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.646351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138216:2523], now have 1 active actors on pipe
2025-10-02T09:37:46.646357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.646359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.646361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.646370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.646381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.646386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.646388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.646390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.646392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.646394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.646411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.646417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.646405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3758
2025-10-02T09:37:46.646419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3758
2025-10-02T09:37:46.646420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.646441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.646444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.646472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd3a5927-8419303d-86b55265-d44a4695_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.646482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.646485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.646487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.646494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.646501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.646514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.646613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.646620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.646630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.646694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3759 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd3a5927-8419303d-86b55265-d44a4695_0
2025-10-02T09:37:46.646894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f719a4-ea942888-d2727c03-2c420e45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd3a5927-8419303d-86b55265-d44a4695_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.649420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Write session: try to update token
2025-10-02T09:37:46.649434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.656100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.656116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.656117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.656118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.656124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.656126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.656128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547581:12338]
2025-10-02T09:37:46.656149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.656153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.656154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.656158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.656163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.656166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.656267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.662728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3759 sessionId: src_id|bd3a5927-8419303d-86b55265-d44a4695_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.664897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.727474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218138224:4294]
2025-10-02T09:37:46.727678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3758, pipe: [1:7556556296218138224:4294]
2025-10-02T09:37:46.771214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.771561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.771571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.771583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138224:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.771788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.771783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.771836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:46.771851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218138224:4294]
2025-10-02T09:37:46.771893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3759 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd3a5927-8419303d-86b55265-d44a4695_0
2025-10-02T09:37:46.772021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3759 sessionId: src_id|bd3a5927-8419303d-86b55265-d44a4695_0 is DEAD
2025-10-02T09:37:46.772134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:46.772143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Write session will restart in 0.006657s
2025-10-02T09:37:46.772158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Write session: Do CDS request
2025-10-02T09:37:46.772163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.779983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.780181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.780248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.780260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3760
2025-10-02T09:37:46.780340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.780343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.780358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.780365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.780367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.780461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.780467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.780473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.780502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.780524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547689:12340]
2025-10-02T09:37:46.780753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3760 sessionId:  describe result for acl check
2025-10-02T09:37:46.780796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.780825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.780828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.780833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.780888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.781058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.781082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.781268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.781301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.781305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.781305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.781306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.781306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.781307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.781307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.781308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.781308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.781312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.781309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.781309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.781310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.781313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.781319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.781321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.781323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.781325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.781327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.781329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.781332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.781333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.781336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.781338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.781339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.781344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.781348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.781351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.781354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.781356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.781358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.781360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.781363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.781366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.781369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.781371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.781374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.781378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.781382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.781391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.781397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.781399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.781401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.781403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.781406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.781408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.781411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.781413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.781415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.781431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.782690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.786913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.786926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.786929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218138290:2541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.786934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.789122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.790652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.790663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.790665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.790667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.790671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3759 [2:7556556296142547689:12340]
2025-10-02T09:37:46.790678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.790689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.790694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.790695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.790696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.790706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.790713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.790718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.790753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.790757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.790758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.790760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.790761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.790797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.790801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.790808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.790813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.790820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.790835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138225:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.790840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138329:2541], now have 1 active actors on pipe
2025-10-02T09:37:46.790844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.790845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.790846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.790854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.790865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.790867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.790869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.790871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.790876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.790877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.790892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.790898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.790894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3759
2025-10-02T09:37:46.790904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.790905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3759
2025-10-02T09:37:46.790938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.790943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.790958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.790965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.790967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.790968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.790972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.790980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.790991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.791092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.791098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.791106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.791162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3760 partition: 0 MaxSeqNo: 36 sessionId: src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0
2025-10-02T09:37:46.791343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3a5927-8419303d-86b55265-d44a4695_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.794046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Write session: try to update token
2025-10-02T09:37:46.794060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.800275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:46.800290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.800295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.800321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:46.800337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:46.800458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:46.800580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.800702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.800837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:46.800996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:46.801019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:46.806216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3760 sessionId: src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.808348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:46.808516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.808530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.809357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.809368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.809370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.809371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.809376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.809378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.809381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547684:12340]
2025-10-02T09:37:46.809401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:46.809409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.809412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.809414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.809414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.809417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.809418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.809452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:46.809527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.871977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556296218138337:4294]
2025-10-02T09:37:46.872169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3759, pipe: [1:7556556296218138337:4294]
2025-10-02T09:37:46.921154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:46.927731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.927752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.927878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.927931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.927984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.928041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.928085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.928092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.928147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.928198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.928251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.928310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.928347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.928352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.928408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.928488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.928542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.928597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.928633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.928637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.928691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.928743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.928837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.928955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.928994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.928999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.929051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.929103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.929157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.929213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.929254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.929259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.929320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.929369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.929421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.929474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.929514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.929520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.929579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.929635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.929693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.929748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.929786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.929791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.929849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.929902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.929957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.930011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.930050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.930054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.930111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.930163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.930222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.930273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.930314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.930319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.930375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:46.930425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:46.930479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:46.930529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:46.930570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:46.930574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:46.930607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138337:4294], now have 1 active actors on pipe
2025-10-02T09:37:46.930814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:46.930825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:46.930846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3760 reason: error at write: Disconnected sessionId: src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0
2025-10-02T09:37:46.930868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556296218138337:4294]
2025-10-02T09:37:46.930900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:46.930991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3760 sessionId: src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0 is DEAD
2025-10-02T09:37:46.931121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:46.931130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Write session will restart in 0.007372s
2025-10-02T09:37:46.931145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Write session: Do CDS request
2025-10-02T09:37:46.931149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:46.931290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:46.937002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:46.938556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:46.938652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:46.938658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:46.938663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:46.938688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:46.938709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556296142547794:12342]
2025-10-02T09:37:46.939047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:46.939169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.939238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:46.939236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:46.939245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3761
2025-10-02T09:37:46.939261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:46.939387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:46.939404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:46.939410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:46.939412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:46.939443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:46.939473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.939478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.939478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.939479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.939479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.939480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.939481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.939481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.939482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.939482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.939483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.939483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.939486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.939492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.939494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.939496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.939498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.939500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.939502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.939504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.939506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.939508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.939510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.939512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.939516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.939520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:46.939523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.939526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:46.939528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.939530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:46.939532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.939535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:46.939537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.939540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:46.939542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.939544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:46.939547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.939549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:46.939551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.939554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:46.939556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.939560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:46.939562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.939565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.939567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.939570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.939572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.939574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.939590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:46.939786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3761 sessionId:  describe result for acl check
2025-10-02T09:37:46.939827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:46.939834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:46.939836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:46.939841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:46.940296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:46.942362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:46.946931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:46.946944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:46.946947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556296218138408:2553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:46.946952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:46.947312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:46.949064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:46.949075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:46.949076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:46.949077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:46.949080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3760 [2:7556556296142547794:12342]
2025-10-02T09:37:46.949087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:46.949097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:46.949098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.949100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.949101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.949109Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:46.949112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:46.949115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:46.949145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.949150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.949151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.949153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:46.949154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:46.949190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:46.949195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.949201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:46.949207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:46.949218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:46.949232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138338:2446], now have 1 active actors on pipe
2025-10-02T09:37:46.949238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556296218138443:2553], now have 1 active actors on pipe
2025-10-02T09:37:46.949242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.949244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.949245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.949252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:46.949262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:46.949265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:46.949267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:46.949268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:46.949271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:46.949273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:46.949262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3760
2025-10-02T09:37:46.949286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.949291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:46.949293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:46.949295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3760
2025-10-02T09:37:46.949323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.949328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.949342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|943036a2-b73e54c0-dca61383-7de030d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:46.949349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:46.949351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:46.949352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:46.949357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:46.949363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:46.949370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.949467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:46.949471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:46.949479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:46.949535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3761 partition: 0 MaxSeqNo: 36 sessionId: src_id|943036a2-b73e54c0-dca61383-7de030d1_0
2025-10-02T09:37:46.949724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4542ee88-7576d4cb-acb0ac3a-2afbef8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|943036a2-b73e54c0-dca61383-7de030d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:46.952231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Write session: try to update token
2025-10-02T09:37:46.952242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:46.958964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:46.958981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:46.958982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:46.958983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:46.958988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.958991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.958995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556296142547789:12342]
2025-10-02T09:37:46.959018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:46.959024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:46.959025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:46.959026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:46.959028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:46.959031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:46.959129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:46.963759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3761 sessionId: src_id|943036a2-b73e54c0-dca61383-7de030d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:46.965877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.031058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513105774:4294]
2025-10-02T09:37:47.031171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3760, pipe: [1:7556556300513105774:4294]
2025-10-02T09:37:47.069678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.069999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.070008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.070033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105774:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.070155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.070394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513105774:4294]
2025-10-02T09:37:47.070428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:47.070488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3761 reason: status is not ok: tablet will be restarted right now sessionId: src_id|943036a2-b73e54c0-dca61383-7de030d1_0
2025-10-02T09:37:47.070536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.070628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3761 sessionId: src_id|943036a2-b73e54c0-dca61383-7de030d1_0 is DEAD
2025-10-02T09:37:47.070762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:47.070772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Write session will restart in 0.007144s
2025-10-02T09:37:47.070793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Write session: Do CDS request
2025-10-02T09:37:47.070799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.076215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.077602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.077702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.077708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.077714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.077741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.077763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515232:12356]
2025-10-02T09:37:47.078111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.078286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.078309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.078484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.078514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.078518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.078519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.078519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.078520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.078520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.078521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.078521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.078522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.078522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.078523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.078523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.078526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.078533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.078535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.078537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.078540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.078542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.078544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.078545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.078547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.078550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.078552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.078553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.078557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.078561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.078564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.078567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.078569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.078572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.078574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.078577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.078579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.078582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.078584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.078587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.078589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.078592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.078595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.078598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.078600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.078602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.078604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.078607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.078609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.078612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.078619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.078622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.078639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.079144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.079229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.079239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3762
2025-10-02T09:37:47.079382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.079401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.079406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.079409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.079783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3762 sessionId:  describe result for acl check
2025-10-02T09:37:47.079820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.079827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.079829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.079833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.080263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.082012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.085949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.085962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.085965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513105849:2610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.085970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.086310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.087823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.087835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.087836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.087838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.087841Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3761 [2:7556556300437515232:12356]
2025-10-02T09:37:47.087848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.087857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.087860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.087862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.087863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.087873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.087875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.087880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.087913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.087918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.087919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.087921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.087922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.087958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.087962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.087968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.087974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.087984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.087998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105883:2610], now have 1 active actors on pipe
2025-10-02T09:37:47.088003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105778:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.088007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.088008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.088009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.088017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.088028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.088030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.088032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.088033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.088038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.088040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.088035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3761
2025-10-02T09:37:47.088053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.088048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3761
2025-10-02T09:37:47.088058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.088059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.088068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.088072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.088098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.088105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.088107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.088108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.088113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.088119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.088131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.088225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.088230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.088238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.088293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3762 partition: 0 MaxSeqNo: 36 sessionId: src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0
2025-10-02T09:37:47.088475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943036a2-b73e54c0-dca61383-7de030d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.090883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Write session: try to update token
2025-10-02T09:37:47.090892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.097713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.097731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.097733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.097733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.097738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.097741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.097743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515227:12356]
2025-10-02T09:37:47.097764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.097767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.097768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.097798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.097816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.097821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.097889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.102444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3762 sessionId: src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.104628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.170353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513105890:4294]
2025-10-02T09:37:47.170524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3761, pipe: [1:7556556300513105890:4294]
2025-10-02T09:37:47.208580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.208919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.208929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.208954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105890:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.209115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.209137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:47.209146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:47.209186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3762 reason: error at write: Disconnected sessionId: src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0
2025-10-02T09:37:47.209209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513105890:4294]
2025-10-02T09:37:47.209251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.209312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3762 sessionId: src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0 is DEAD
2025-10-02T09:37:47.209453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:47.209462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Write session will restart in 0.005499s
2025-10-02T09:37:47.209478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Write session: Do CDS request
2025-10-02T09:37:47.209482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.215389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.216151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.216220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.216229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3763
2025-10-02T09:37:47.216307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.216326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.216332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.216335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.216712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3763 sessionId:  describe result for acl check
2025-10-02T09:37:47.216751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.216758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.216760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.216764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.216831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.216932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.216939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.216945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.216971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.216995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515338:12359]
2025-10-02T09:37:47.217284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.217333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.217534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.217558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.217728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.217757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.217762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.217762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.217763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.217763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.217764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.217764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.217765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.217765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.217766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.217767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.217767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.217770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.217777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.217779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.217781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.217785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.217787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.217789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.217791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.217793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.217795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.217797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.217799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.217803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.217807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.217810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.217812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.217815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.217817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.217819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.217821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.217824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.217826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.217828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.217830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.217832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.217835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.217837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.217840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.217842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.217844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.217846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.217849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.217851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.217855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.217856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.217859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.217875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.219014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.223425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.223438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.223440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513105960:2648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.223445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.225552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.227047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.227058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.227059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.227062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.227065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3762 [2:7556556300437515338:12359]
2025-10-02T09:37:47.227073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.227083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.227086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.227088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.227089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.227097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.227104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.227108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.227136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.227141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.227142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.227144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.227145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.227181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.227186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.227193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.227198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.227208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.227223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105892:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.227228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513105999:2648], now have 1 active actors on pipe
2025-10-02T09:37:47.227232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.227233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.227234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.227241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.227252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.227253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.227255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.227256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.227261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.227262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.227276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.227283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.227273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3762
2025-10-02T09:37:47.227278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3762
2025-10-02T09:37:47.227305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.227336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.227341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.227355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.227363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.227365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.227366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.227371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.227376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.227388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.227499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.227504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.227511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.227571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3763 partition: 0 MaxSeqNo: 36 sessionId: src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0
2025-10-02T09:37:47.227848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb633c7-f52b4e80-68e141d3-3eed1db2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.230268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Write session: try to update token
2025-10-02T09:37:47.230279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.236960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.236975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.236976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.236977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.236981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.236985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.236987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515333:12359]
2025-10-02T09:37:47.237008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.237013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.237014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.237047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.237064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.237070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.237162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.241528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3763 sessionId: src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.243802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.309623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513106006:4294]
2025-10-02T09:37:47.309844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3762, pipe: [1:7556556300513106006:4294]
2025-10-02T09:37:47.345660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.345859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.345868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.345891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106006:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.346017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.346039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.346079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:47.346082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513106006:4294]
2025-10-02T09:37:47.346177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3763 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0
2025-10-02T09:37:47.346324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3763 sessionId: src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0 is DEAD
2025-10-02T09:37:47.346443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:47.346452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Write session will restart in 0.009881s
2025-10-02T09:37:47.346466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Write session: Do CDS request
2025-10-02T09:37:47.346470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.352052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.353527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.353622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.353628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.353634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.353658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.353680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515445:12361]
2025-10-02T09:37:47.354023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.354186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.354209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.354382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.354410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.354415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.354415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.354416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.354416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.354417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.354417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.354418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.354418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.354419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.354419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.354420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.354422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.354429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.354431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.354433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.354435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.354437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.354439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.354441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.354443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.354445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.354447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.354448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.354452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.354456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.354459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.354462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.354464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.354467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.354469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.354472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.354475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.354479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.354481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.354484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.354486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.354489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.354494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.354497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.354499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.354502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.354504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.354506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.354510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.354513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.354517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.354519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.354536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.357177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.357251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.357267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3764
2025-10-02T09:37:47.357388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.357415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.357424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.357427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.357776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3764 sessionId:  describe result for acl check
2025-10-02T09:37:47.357810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.357811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.357813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.357817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.358333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.359820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.361782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.361790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.361793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513106081:2646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.361797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.362246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.363728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.363741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.363742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.363744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.363749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3763 [2:7556556300437515445:12361]
2025-10-02T09:37:47.363756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.363766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.363767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.363768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.363770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.363777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.363784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.363787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.363816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.363821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.363822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.363824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.363825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.363862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.363867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.363873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.363879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.363886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.363901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106007:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.363906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106118:2646], now have 1 active actors on pipe
2025-10-02T09:37:47.363910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.363911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.363912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.363920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.363932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.363932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.363934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.363935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.363942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.363943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.363957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.363964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.363968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.363965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3763
2025-10-02T09:37:47.363975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3763
2025-10-02T09:37:47.364078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.364084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.364097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95321e30-b6369242-d14cefec-761adc95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.364105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.364107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.364108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.364113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.364122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.364131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.364256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.364261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.364269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.364325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3764 partition: 0 MaxSeqNo: 36 sessionId: src_id|95321e30-b6369242-d14cefec-761adc95_0
2025-10-02T09:37:47.364560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dab146-4628f06c-b3e49c38-5fd0abd7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95321e30-b6369242-d14cefec-761adc95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.367166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Write session: try to update token
2025-10-02T09:37:47.367177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.373296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:47.373310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.373315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.373336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:47.373341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:47.373473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:47.373595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:47.373708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:47.373824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:47.373980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:47.374004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:47.379623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3764 sessionId: src_id|95321e30-b6369242-d14cefec-761adc95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.381895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.382185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.382200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.382212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.382213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.382214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.382215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.382218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.382220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.382223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515440:12361]
2025-10-02T09:37:47.382245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.382246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.382249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.382251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.382252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.382253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.382357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.446335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513106125:4294]
2025-10-02T09:37:47.446535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3763, pipe: [1:7556556300513106125:4294]
2025-10-02T09:37:47.489936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.490135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:47.490157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106125:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.490275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:47.490317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513106125:4294]
2025-10-02T09:37:47.490338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.490381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:47.490388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:47.490445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3764 reason: error at write: Disconnected sessionId: src_id|95321e30-b6369242-d14cefec-761adc95_0
2025-10-02T09:37:47.490564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3764 sessionId: src_id|95321e30-b6369242-d14cefec-761adc95_0 is DEAD
2025-10-02T09:37:47.490688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:47.490698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Write session will restart in 0.005527s
2025-10-02T09:37:47.490713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Write session: Do CDS request
2025-10-02T09:37:47.490717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.496690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.497155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.497292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.497303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3765
2025-10-02T09:37:47.497424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.497448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.497456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.497459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.497812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3765 sessionId:  describe result for acl check
2025-10-02T09:37:47.497845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.497850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.497852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.497856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.498291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.498309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.498406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.498412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.498418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.498443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.498477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515567:12365]
2025-10-02T09:37:47.498821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.498986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.499010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.499186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.499217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.499220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.499221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.499221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.499222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.499222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.499223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.499224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.499224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.499224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.499225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.499226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.499229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.499236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.499238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.499240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.499242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.499244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.499246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.499247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.499249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.499252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.499253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.499255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.499260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.499264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.499267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.499270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.499274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.499276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.499279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.499281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.499284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.499286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.499288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.499291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.499293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.499296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.499298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.499309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.499311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.499314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.499316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.499319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.499321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.499324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.499326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.499328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.499345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.500071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.505112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.505123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.505126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513106208:2737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.505131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.506743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.508126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.508138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.508139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.508142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.508145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3764 [2:7556556300437515567:12365]
2025-10-02T09:37:47.508154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.508167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.508172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.508173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.508174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.508183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.508187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.508191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.508221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.508225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.508226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.508228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.508230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.508264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.508269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.508275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.508280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.508288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.508300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106138:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.508305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106247:2737], now have 1 active actors on pipe
2025-10-02T09:37:47.508309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.508310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.508311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.508319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.508330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.508331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.508333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.508334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.508340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.508342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.508357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.508361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.508354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3764
2025-10-02T09:37:47.508355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3764
2025-10-02T09:37:47.508378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.508385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.508387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.508404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df94727b-7691f7f4-112c7996-6949bcbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.508411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.508413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.508414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.508419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.508427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.508437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.508552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.508557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.508564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.508626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3765 partition: 0 MaxSeqNo: 36 sessionId: src_id|df94727b-7691f7f4-112c7996-6949bcbb_0
2025-10-02T09:37:47.508916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95321e30-b6369242-d14cefec-761adc95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df94727b-7691f7f4-112c7996-6949bcbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.511408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Write session: try to update token
2025-10-02T09:37:47.511417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.517681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.517697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.517698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.517699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.517703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.517705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.517707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515562:12365]
2025-10-02T09:37:47.517727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.517730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.517732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.517733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.517736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.517738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.517839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.523166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3765 sessionId: src_id|df94727b-7691f7f4-112c7996-6949bcbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.525409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.590687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513106255:4294]
2025-10-02T09:37:47.591002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3764, pipe: [1:7556556300513106255:4294]
2025-10-02T09:37:47.628035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.628272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.628282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.628294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106255:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.628450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.628472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.628506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513106255:4294]
2025-10-02T09:37:47.628518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:47.628602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3765 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df94727b-7691f7f4-112c7996-6949bcbb_0
2025-10-02T09:37:47.628768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3765 sessionId: src_id|df94727b-7691f7f4-112c7996-6949bcbb_0 is DEAD
2025-10-02T09:37:47.629149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:47.629169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Write session will restart in 0.006326s
2025-10-02T09:37:47.629188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Write session: Do CDS request
2025-10-02T09:37:47.629193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.635108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.636133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.636268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.636280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3766
2025-10-02T09:37:47.636428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.636445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.636451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.636458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.636461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.636543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.636550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.636556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.636581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.636605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515675:12367]
2025-10-02T09:37:47.636836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3766 sessionId:  describe result for acl check
2025-10-02T09:37:47.636875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.636882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.636883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.636889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.636961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.637142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.637166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.637341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.637348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.637370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.637374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.637375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.637376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.637376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.637378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.637378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.637379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.637379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.637380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.637389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.637391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.637393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.637395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.637397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.637399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.637401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.637403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.637405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.637407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.637409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.637413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.637417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.637420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.637423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.637425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.637427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.637429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.637432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.637434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.637437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.637439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.637441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.637444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.637447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.637449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.637451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.637453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.637456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.637458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.637460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.637462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.637465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.637467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.637470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.637487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.638803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.642715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.642726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.642729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513106327:2721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.642733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.644789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.646287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.646298Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.646299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.646301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.646307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3765 [2:7556556300437515675:12367]
2025-10-02T09:37:47.646313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.646322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.646327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.646329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.646330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.646339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.646347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.646351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.646383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.646387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.646388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.646390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.646391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.646428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.646432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.646439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.646444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.646455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.646470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106366:2721], now have 1 active actors on pipe
2025-10-02T09:37:47.646475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106256:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.646479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.646480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.646481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.646489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.646499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.646500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.646501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.646502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.646510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.646511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.646510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3765
2025-10-02T09:37:47.646524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.646529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.646513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3765
2025-10-02T09:37:47.646534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.646548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.646553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.646571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1917fff-5dc4c720-29654988-56b90588_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.646578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.646580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.646584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.646589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.646594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.646604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.646707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.646712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.646720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.646786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3766 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1917fff-5dc4c720-29654988-56b90588_0
2025-10-02T09:37:47.647023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df94727b-7691f7f4-112c7996-6949bcbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1917fff-5dc4c720-29654988-56b90588_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.649428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Write session: try to update token
2025-10-02T09:37:47.649439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.655646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.655661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.655662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.655663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.655667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.655670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.655672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515670:12367]
2025-10-02T09:37:47.655691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.655696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.655697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.655723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.655739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.655747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.655814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.661583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3766 sessionId: src_id|f1917fff-5dc4c720-29654988-56b90588_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.663911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.728420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513106374:4294]
2025-10-02T09:37:47.728577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3765, pipe: [1:7556556300513106374:4294]
2025-10-02T09:37:47.765576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.765946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.765956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.765968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106374:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.766190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.766177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.766213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:47.766220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513106374:4294]
2025-10-02T09:37:47.766224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:47.766307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3766 reason: error at write: Disconnected sessionId: src_id|f1917fff-5dc4c720-29654988-56b90588_0
2025-10-02T09:37:47.766466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3766 sessionId: src_id|f1917fff-5dc4c720-29654988-56b90588_0 is DEAD
2025-10-02T09:37:47.766605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:47.766615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Write session will restart in 0.009946s
2025-10-02T09:37:47.766630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Write session: Do CDS request
2025-10-02T09:37:47.766635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.774073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.774352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.774447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.774454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.774459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.774485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.774510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515785:12369]
2025-10-02T09:37:47.774850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.775024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.775047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.775228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.775258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.775263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.775263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.775264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.775265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.775265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.775266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.775266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.775267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.775267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.775268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.775268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.775271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.775278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.775280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.775282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.775284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.775287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.775289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.775291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.775293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.775295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.775297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.775299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.775312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.775317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.775320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.775323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.775325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.775328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.775330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.775332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.775335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.775337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.775340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.775342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.775345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.775347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.775350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.775352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.775355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.775359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.775362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.775364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.775368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.775370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.775374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.775377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.775395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.777158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.777268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.777280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3767
2025-10-02T09:37:47.777394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.777418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.777426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.777430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.777762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3767 sessionId:  describe result for acl check
2025-10-02T09:37:47.777791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.777797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.777798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.777802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.778237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.779653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.782475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.782485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.782487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513106451:2759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.782491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.782979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.784529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.784541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.784542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.784544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.784548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3766 [2:7556556300437515785:12369]
2025-10-02T09:37:47.784555Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.784565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.784570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.784572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.784573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.784581Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.784587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.784593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.784624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.784629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.784630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.784631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.784633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.784665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.784670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.784676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.784682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.784693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.784706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106486:2759], now have 1 active actors on pipe
2025-10-02T09:37:47.784711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106375:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.784715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.784717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.784718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.784727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.784736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.784741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.784744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.784745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.784747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.784749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.784738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3766
2025-10-02T09:37:47.784741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3766
2025-10-02T09:37:47.784763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.784768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.784769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.784778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.784783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.784822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.784829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.784831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.784832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.784837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.784842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.784853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.784956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.784961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.784969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.785036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3767 partition: 0 MaxSeqNo: 36 sessionId: src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0
2025-10-02T09:37:47.785258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1917fff-5dc4c720-29654988-56b90588_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.787771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Write session: try to update token
2025-10-02T09:37:47.787781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.793947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.793962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.793963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.793964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.793968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.793971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.793973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515780:12369]
2025-10-02T09:37:47.793993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.794001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.794002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.794006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.794009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.794012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.794111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.799917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3767 sessionId: src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.802186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:47.866146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556300513106494:4294]
2025-10-02T09:37:47.866324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3766, pipe: [1:7556556300513106494:4294]
2025-10-02T09:37:47.902137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:47.902469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.902478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.902490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106494:4294], now have 1 active actors on pipe
2025-10-02T09:37:47.902673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556300513106494:4294]
2025-10-02T09:37:47.902703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:47.902710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:47.902713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:47.902778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3767 reason: error at write: Disconnected sessionId: src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0
2025-10-02T09:37:47.902927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3767 sessionId: src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0 is DEAD
2025-10-02T09:37:47.902952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:47.903048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:47.903057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Write session will restart in 0.007662s
2025-10-02T09:37:47.903076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Write session: Do CDS request
2025-10-02T09:37:47.903081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:47.908896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:47.910306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:47.910404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:47.910410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:47.910416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:47.910442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:47.910466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556300437515896:12371]
2025-10-02T09:37:47.910808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:47.910970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:47.910992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:47.911164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:47.911194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.911198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.911198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.911199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.911200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.911200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.911201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.911201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.911202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.911202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.911203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.911203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.911206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.911213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.911215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.911217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.911219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.911221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.911223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.911225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.911227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.911229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.911231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.911233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.911236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.911240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:47.911245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.911247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:47.911250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.911253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:47.911255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.911258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:47.911261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.911263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:47.911266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.911268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:47.911270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.911273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:47.911275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.911279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:47.911282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.911284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:47.911286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.911289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.911291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.911295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.911297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.911299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.911325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:47.912148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.912227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:47.912235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3768
2025-10-02T09:37:47.912359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:47.912380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:47.912384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:47.912387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:47.912725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3768 sessionId:  describe result for acl check
2025-10-02T09:37:47.912754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:47.912759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:47.912760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:47.912764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:47.913248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:47.914700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:47.918149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:47.918163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:47.918166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556300513106572:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:47.918170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:47.918806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:47.920170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:47.920182Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:47.920183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:47.920185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:47.920190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3767 [2:7556556300437515896:12371]
2025-10-02T09:37:47.920200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:47.920214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:47.920217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.920220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.920221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.920229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:47.920236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:47.920240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:47.920270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.920274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.920276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.920278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:47.920279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:47.920314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:47.920318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.920325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:47.920330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:47.920341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:47.920355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106495:2446], now have 1 active actors on pipe
2025-10-02T09:37:47.920361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556300513106606:2785], now have 1 active actors on pipe
2025-10-02T09:37:47.920364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.920366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.920368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.920375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:47.920387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:47.920388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:47.920390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:47.920391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:47.920397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:47.920398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:47.920402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3767
2025-10-02T09:37:47.920403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3767
2025-10-02T09:37:47.920412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.920418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:47.920422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:47.920438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.920443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.920460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|972827c6-4d7dc047-c72a8840-def8e78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:47.920467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:47.920469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:47.920470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:47.920475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:47.920483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:47.920490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.920606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:47.920611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:47.920619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:47.920681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3768 partition: 0 MaxSeqNo: 36 sessionId: src_id|972827c6-4d7dc047-c72a8840-def8e78c_0
2025-10-02T09:37:47.920928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e998de3d-7752393a-9ccdc501-d47e1eb2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|972827c6-4d7dc047-c72a8840-def8e78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:47.923419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Write session: try to update token
2025-10-02T09:37:47.923429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:47.929523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:47.929538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:47.929540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:47.929541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:47.929545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.929548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.929550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556300437515891:12371]
2025-10-02T09:37:47.929570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:47.929573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:47.929574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:47.929580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:47.929584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:47.929586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:47.929696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:47.936312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3768 sessionId: src_id|972827c6-4d7dc047-c72a8840-def8e78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:47.938563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.002863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808073915:4294]
2025-10-02T09:37:48.003026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3767, pipe: [1:7556556304808073915:4294]
2025-10-02T09:37:48.039004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.039677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.039689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.039701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808073915:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.039808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.039841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808073915:4294]
2025-10-02T09:37:48.039870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.039903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.039978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3768 reason: status is not ok: tablet will be restarted right now sessionId: src_id|972827c6-4d7dc047-c72a8840-def8e78c_0
2025-10-02T09:37:48.040142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3768 sessionId: src_id|972827c6-4d7dc047-c72a8840-def8e78c_0 is DEAD
2025-10-02T09:37:48.040261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.040272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Write session will restart in 0.006687s
2025-10-02T09:37:48.040287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Write session: Do CDS request
2025-10-02T09:37:48.040291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.046078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.047519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.047621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.047627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.047632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.047660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.047685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483316:12379]
2025-10-02T09:37:48.048028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.048097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.048208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.048231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.048217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.048226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3769
2025-10-02T09:37:48.048337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.048358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.048366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.048370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.048519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.048561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.048566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.048567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.048567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.048568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.048568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.048570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.048571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.048571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.048574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.048580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.048582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.048584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.048586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.048588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.048590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.048592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.048594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.048596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.048598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.048600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.048604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.048607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.048610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.048613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.048615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.048618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.048620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.048623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.048625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.048628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.048630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.048633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.048636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.048638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.048670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3769 sessionId:  describe result for acl check
2025-10-02T09:37:48.048640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.048643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.048646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.048649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.048654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.048656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.048659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.048694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.048661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.048705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.048664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.048707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.048679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.048711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.049152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.050914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.055043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.055053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.055055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074009:2816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.055059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.056109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.057496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.057508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.057509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.057511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.057515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3768 [2:7556556304732483316:12379]
2025-10-02T09:37:48.057522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.057532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.057533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.057535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.057536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.057544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.057552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.057556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.057586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.057591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.057591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.057593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.057595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.057631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.057635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.057642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.057648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.057659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.057673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074055:2816], now have 1 active actors on pipe
2025-10-02T09:37:48.057678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808073933:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.057682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.057683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.057684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.057691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.057698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.057704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.057705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.057706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.057709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.057710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.057725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.057733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.057733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.057723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3768
2025-10-02T09:37:48.057870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3768
2025-10-02T09:37:48.057909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.057915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.057928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.057933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.057935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.057937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.057944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.057952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.057959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.058071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.058076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.058084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.058140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3769 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0
2025-10-02T09:37:48.058375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972827c6-4d7dc047-c72a8840-def8e78c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.060787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Write session: try to update token
2025-10-02T09:37:48.060798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.067100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.067115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.067117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.067118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.067122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.067124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.067127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483311:12379]
2025-10-02T09:37:48.067147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.067153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.067154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.067184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.067203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.067210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.067259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.072085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3769 sessionId: src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.074338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.140079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074062:4294]
2025-10-02T09:37:48.140269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3768, pipe: [1:7556556304808074062:4294]
2025-10-02T09:37:48.176298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.176646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.176655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.176680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074062:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.176790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.176865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074062:4294]
2025-10-02T09:37:48.176892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.176894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.177004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3769 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0
2025-10-02T09:37:48.177173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3769 sessionId: src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0 is DEAD
2025-10-02T09:37:48.177308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.177318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Write session will restart in 0.007132s
2025-10-02T09:37:48.177334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Write session: Do CDS request
2025-10-02T09:37:48.177338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.184816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.185089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.185184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.185205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.185212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.185217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.185246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.185271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483454:12388]
2025-10-02T09:37:48.185338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.185349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3770
2025-10-02T09:37:48.185479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.185504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.185513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.185516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.185622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.185805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.185828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.185868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3770 sessionId:  describe result for acl check
2025-10-02T09:37:48.185903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.185908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.185909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.185914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.186011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.186044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.186048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.186049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.186049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.186050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.186050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.186051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.186052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.186052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.186052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.186053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.186053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.186056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.186063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.186065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.186067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.186069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.186071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.186073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.186075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.186077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.186079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.186081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.186083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.186087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.186091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.186094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.186097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.186099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.186102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.186105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.186107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.186110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.186112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.186114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.186117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.186119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.186122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.186124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.186127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.186129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.186131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.186133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.186136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.186138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.186143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.186146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.186148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.186166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.186348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.188658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.193310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.193321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.193323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074140:2847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.193329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.193734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.195242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.195253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.195254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.195256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.195260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3769 [2:7556556304732483454:12388]
2025-10-02T09:37:48.195269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.195279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.195285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.195286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.195287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.195297Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.195300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.195316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.195351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.195355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.195356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.195358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.195360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.195395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.195400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.195407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.195413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.195421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.195436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074182:2847], now have 1 active actors on pipe
2025-10-02T09:37:48.195441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074063:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.195445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.195446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.195448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.195456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.195466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.195468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.195470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.195471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.195477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.195479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.195478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3769
2025-10-02T09:37:48.195493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.195481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3769
2025-10-02T09:37:48.195498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.195506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.195516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.195518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.195538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ea33b37-983e4c14-211144e3-418ce700_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.195542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.195544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.195546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.195552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.195557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.195569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.195671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.195677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.195684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.195749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3770 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ea33b37-983e4c14-211144e3-418ce700_0
2025-10-02T09:37:48.195983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8bc346d-a40ce6f-e3c76209-7ad57c48_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ea33b37-983e4c14-211144e3-418ce700_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.198418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Write session: try to update token
2025-10-02T09:37:48.198428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.204963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.204980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.204981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.204982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.204986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.204989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.204991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483449:12388]
2025-10-02T09:37:48.205012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.205015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.205016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.205048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.205069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.205075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.205129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.209708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3770 sessionId: src_id|1ea33b37-983e4c14-211144e3-418ce700_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.212017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.276789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074189:4294]
2025-10-02T09:37:48.277039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3769, pipe: [1:7556556304808074189:4294]
2025-10-02T09:37:48.315808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.316271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.316279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.316304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074189:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.316443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.316482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:48.316493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:48.316497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.316540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074189:4294]
2025-10-02T09:37:48.316560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3770 reason: error at write: Disconnected sessionId: src_id|1ea33b37-983e4c14-211144e3-418ce700_0
2025-10-02T09:37:48.316718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3770 sessionId: src_id|1ea33b37-983e4c14-211144e3-418ce700_0 is DEAD
2025-10-02T09:37:48.316857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:48.316867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Write session will restart in 0.005826s
2025-10-02T09:37:48.316886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Write session: Do CDS request
2025-10-02T09:37:48.316890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.322641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.324116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.324149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.324242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.324251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3771
2025-10-02T09:37:48.324262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.324268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.324274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.324300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.324324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483567:12390]
2025-10-02T09:37:48.324366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.324389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.324396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.324399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.324667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.324707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3771 sessionId:  describe result for acl check
2025-10-02T09:37:48.324729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.324734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.324735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.324739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.324856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.324878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.325052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.325082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.325086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.325086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.325087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.325087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.325088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.325088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.325089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.325089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.325090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.325090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.325091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.325093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.325100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.325102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.325104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.325106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.325108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.325110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.325112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.325114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.325116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.325118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.325120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.325123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.325127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.325130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.325133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.325135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.325138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.325140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.325142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.325145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.325147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.325150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.325152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.325155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.325157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.325162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.325165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.325167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.325171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.325173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.325176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.325177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.325180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.325186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.325188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.325179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.325205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.326970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.331373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.331383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.331386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074266:2870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.331391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.332552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.334054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.334066Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.334067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.334069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.334073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3770 [2:7556556304732483567:12390]
2025-10-02T09:37:48.334079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.334088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.334093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.334095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.334096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.334105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.334108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.334115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.334146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.334151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.334152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.334154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.334155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.334189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.334194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.334200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.334205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.334217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.334231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074190:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.334236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074306:2870], now have 1 active actors on pipe
2025-10-02T09:37:48.334239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.334241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.334241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.334248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.334259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.334262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.334263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.334264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.334269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.334270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.334284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.334292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.334293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.334280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3770
2025-10-02T09:37:48.334284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3770
2025-10-02T09:37:48.334315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.334319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.334335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.334342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.334344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.334345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.334351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.334356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.334366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.334469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.334473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.334485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.334547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3771 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0
2025-10-02T09:37:48.334787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea33b37-983e4c14-211144e3-418ce700_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.337218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Write session: try to update token
2025-10-02T09:37:48.337229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.343460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.343476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.343477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.343478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.343482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.343486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.343488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483562:12390]
2025-10-02T09:37:48.343509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.343512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.343513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.343544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.343561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.343564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.343617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.348406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3771 sessionId: src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.350602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.416561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074316:4294]
2025-10-02T09:37:48.416735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3770, pipe: [1:7556556304808074316:4294]
2025-10-02T09:37:48.452549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.452951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.452960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.452986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074316:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.453101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.453173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074316:4294]
2025-10-02T09:37:48.453173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.453210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.453292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3771 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0
2025-10-02T09:37:48.453448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3771 sessionId: src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0 is DEAD
2025-10-02T09:37:48.453571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.453582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Write session will restart in 0.005728s
2025-10-02T09:37:48.453598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Write session: Do CDS request
2025-10-02T09:37:48.453601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.459450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.460147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.460217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.460227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3772
2025-10-02T09:37:48.460333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.460366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.460370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.460373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.460665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3772 sessionId:  describe result for acl check
2025-10-02T09:37:48.460687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.460691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.460693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.460697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.460891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.461007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.461015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.461022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.461050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.461074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483696:12394]
2025-10-02T09:37:48.461140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.461418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.461625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.461686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.461917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.461952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.461956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.461957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.461957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.461958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.461959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.461959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.461960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.461960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.461961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.461962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.461962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.461966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.461972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.461975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.461977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.461979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.461981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.461983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.461985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.461987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.461989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.461991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.461993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.461997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.462001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.462004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.462007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.462010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.462012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.462015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.462017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.462021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.462025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.462028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.462031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.462033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.462036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.462040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.462042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.462045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.462047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.462050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.462053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.462057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.462060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.462062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.462065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.462082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.462254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.466881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.466891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.466894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074405:2908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.466898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.469434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.471000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.471012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.471013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.471015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.471018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3771 [2:7556556304732483696:12394]
2025-10-02T09:37:48.471026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.471036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.471041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.471043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.471044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.471054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.471056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.471064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.471092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.471097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.471098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.471101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.471102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.471139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.471144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.471151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.471156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.471167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.471180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074445:2908], now have 1 active actors on pipe
2025-10-02T09:37:48.471185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074317:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.471189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.471194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.471195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.471203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.471213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.471215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.471217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.471218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.471224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.471225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.471220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3771
2025-10-02T09:37:48.471236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3771
2025-10-02T09:37:48.471243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.471248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.471249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.471262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.471268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.471292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.471299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.471302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.471303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.471315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.471324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.471336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.471431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.471437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.471445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.471503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3772 partition: 0 MaxSeqNo: 36 sessionId: src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0
2025-10-02T09:37:48.471720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7f5462-d1a7bbe9-903c9874-f0e195ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.474126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Write session: try to update token
2025-10-02T09:37:48.474136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.480484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.480499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.480500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.480502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.480506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.480508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.480510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483691:12394]
2025-10-02T09:37:48.480531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.480535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.480536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.480562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.480578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.480583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.480641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.486008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3772 sessionId: src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.488274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.553254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074453:4294]
2025-10-02T09:37:48.553457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3771, pipe: [1:7556556304808074453:4294]
2025-10-02T09:37:48.593914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.594280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.594289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.594302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074453:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.594456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.594506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074453:4294]
2025-10-02T09:37:48.594535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.594542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.594631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3772 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0
2025-10-02T09:37:48.594808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3772 sessionId: src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0 is DEAD
2025-10-02T09:37:48.594930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.594940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Write session will restart in 0.009395s
2025-10-02T09:37:48.594956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Write session: Do CDS request
2025-10-02T09:37:48.594960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.600771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.602325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.602422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.602428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.602434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.602459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.602482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483812:12396]
2025-10-02T09:37:48.602817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.602977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.602998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.603177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.603205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.603209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.603209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.603210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.603210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.603211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.603211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.603212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.603212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.603213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.603213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.603214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.603216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.603223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.603225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.603227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.603229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.603231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.603235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.603237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.603239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.603241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.603243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.603247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.603251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.603254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.603257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.603259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.603262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.603265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.603268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.603270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.603272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.603276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.603279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.603281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.603286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.603296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.603299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.603301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.603314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.603317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.603319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.603338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.605105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.605202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.605213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3773
2025-10-02T09:37:48.605336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.605359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.605363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.605367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.605721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3773 sessionId:  describe result for acl check
2025-10-02T09:37:48.605746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.605751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.605752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.605755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.606170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.607467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.610242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.610253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.610255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074536:2928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.610260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.610765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.612181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.612193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.612194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.612196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.612200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3772 [2:7556556304732483812:12396]
2025-10-02T09:37:48.612207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.612217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.612218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.612219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.612220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.612230Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.612233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.612237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.612267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.612272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.612273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.612275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.612277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.612413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3772
2025-10-02T09:37:48.612414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3772
2025-10-02T09:37:48.612465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.612471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.612477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.612483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.612492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.612507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074571:2928], now have 1 active actors on pipe
2025-10-02T09:37:48.612512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074454:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.612523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.612527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.612540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.612545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.612546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.612554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.612564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.612568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.612569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.612571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.612575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.612577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.612585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.612592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.612594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.612595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.612600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.612606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.612623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.612631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.612638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.612639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.612744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.612749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.612757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.612823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3773 partition: 0 MaxSeqNo: 36 sessionId: src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0
2025-10-02T09:37:48.613093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b323163b-137cd3cb-f053e0f9-a1f070dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.615624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Write session: try to update token
2025-10-02T09:37:48.615636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.621725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.621738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.621739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.621740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.621744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.621746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.621748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483807:12396]
2025-10-02T09:37:48.621770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.621776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.621777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.621782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.621787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.621789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.621900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.627617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3773 sessionId: src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.629835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.694555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074579:4294]
2025-10-02T09:37:48.694741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3772, pipe: [1:7556556304808074579:4294]
2025-10-02T09:37:48.731481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.731705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.731714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.731727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074579:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.731849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.731904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074579:4294]
2025-10-02T09:37:48.731915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.732091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.732165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3773 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0
2025-10-02T09:37:48.732315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3773 sessionId: src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0 is DEAD
2025-10-02T09:37:48.732458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.732520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Write session will restart in 0.006542s
2025-10-02T09:37:48.732544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Write session: Do CDS request
2025-10-02T09:37:48.732549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.738633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.740081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.740136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.740187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.740194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.740199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.740226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.740250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732483929:12398]
2025-10-02T09:37:48.740255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.740267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3774
2025-10-02T09:37:48.740360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.740382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.740390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.740393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.740601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.740744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3774 sessionId:  describe result for acl check
2025-10-02T09:37:48.740776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.740781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.740783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.740787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.740823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.740868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.741080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.741114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.741119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.741120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.741121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.741121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.741122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.741123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.741123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.741124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.741124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.741125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.741125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.741129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.741136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.741138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.741140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.741143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.741145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.741147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.741150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.741152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.741154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.741156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.741158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.741163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.741168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.741171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.741174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.741177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.741180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.741183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.741186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.741190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.741193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.741195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.741198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.741200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.741207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.741209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.741212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.741214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.741217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.741219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.741222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.741224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.741230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.741233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.741239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.741224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.741257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.742709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.746713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.746726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.746730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074661:2948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.746737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.748882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.750411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.750423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.750425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.750427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.750430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3773 [2:7556556304732483929:12398]
2025-10-02T09:37:48.750439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.750449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.750454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.750456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.750456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.750466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.750468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.750473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.750504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.750508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.750509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.750511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.750513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.750546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.750551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.750558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.750566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.750578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.750592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074698:2948], now have 1 active actors on pipe
2025-10-02T09:37:48.750598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074580:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.750601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.750603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.750605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.750611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.750622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.750624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.750626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.750627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.750633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.750636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.750628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3773
2025-10-02T09:37:48.750635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3773
2025-10-02T09:37:48.750652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.750658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.750659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.750668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.750672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.750699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.750705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.750708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.750712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.750717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.750722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.750735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.750835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.750840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.750848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.750915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3774 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0
2025-10-02T09:37:48.751173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19411cf3-4b316c08-89ff9d42-7efdc0c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.753708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Write session: try to update token
2025-10-02T09:37:48.753727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.759937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.759951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.759952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.759953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.759956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.759958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.759961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732483924:12398]
2025-10-02T09:37:48.759979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.759983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.759982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.759985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.759987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.759989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.760172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.765879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3774 sessionId: src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.768151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.832308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074705:4294]
2025-10-02T09:37:48.832473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3773, pipe: [1:7556556304808074705:4294]
2025-10-02T09:37:48.869223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:48.869443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.869452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.869464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074705:4294], now have 1 active actors on pipe
2025-10-02T09:37:48.869606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:48.869668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074705:4294]
2025-10-02T09:37:48.869693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:48.869712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:48.869802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3774 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0
2025-10-02T09:37:48.869969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3774 sessionId: src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0 is DEAD
2025-10-02T09:37:48.870113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:48.870125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Write session will restart in 0.005364s
2025-10-02T09:37:48.870149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Write session: Do CDS request
2025-10-02T09:37:48.870155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:48.876175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.876245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:48.876256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3775
2025-10-02T09:37:48.876345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:48.876367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:48.876376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:48.876379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:48.876730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3775 sessionId:  describe result for acl check
2025-10-02T09:37:48.876761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:48.876766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:48.876767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:48.876771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:48.876782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:48.877254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:48.878754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:48.878854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:48.878851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:48.878861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:48.878866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:48.878891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:48.878915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556304732484046:12400]
2025-10-02T09:37:48.879255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:48.879441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:48.879464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:48.879658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:48.879691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.879695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.879696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.879696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.879697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.879697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.879698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.879698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.879699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.879699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.879700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.879700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.879703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.879710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.879712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.879714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.879716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.879718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.879720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.879722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.879723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.879725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.879727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.879729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.879733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.879737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:48.879740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.879743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:48.879745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.879748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:48.879750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.879753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:48.879755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.879758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:48.879760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.879762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:48.879766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.879768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:48.879770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.879773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:48.879775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.879779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:48.879781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.879785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.879787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.879790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.879792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.879795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.879811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:48.883722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:48.883732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:48.883735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556304808074786:2961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:48.883741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:48.887270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:48.888911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:48.888921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:48.888922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:48.888924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:48.888927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3774 [2:7556556304732484046:12400]
2025-10-02T09:37:48.888934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:48.888944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:48.888946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.888947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.888949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.888957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:48.888959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:48.888963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:48.888995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.889000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.889002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.889004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:48.889006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:48.889128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:48.889134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.889140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:48.889146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:48.889156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:48.889154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3774
2025-10-02T09:37:48.889157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3774
2025-10-02T09:37:48.889170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074707:2446], now have 1 active actors on pipe
2025-10-02T09:37:48.889176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074826:2961], now have 1 active actors on pipe
2025-10-02T09:37:48.889179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.889180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.889181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.889186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:48.889193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:48.889195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:48.889196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:48.889199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:48.889207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:48.889211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:48.889222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.889227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.889249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.889257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:48.889265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:48.889266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:48.889269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:48.889271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:48.889273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:48.889277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:48.889282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:48.889297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.889407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:48.889412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:48.889420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:48.889478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3775 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0
2025-10-02T09:37:48.889728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd462690-9758b860-4a6a49bc-e8849fb1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:48.892374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Write session: try to update token
2025-10-02T09:37:48.892384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:48.898436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:48.898452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:48.898453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:48.898457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:48.898461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.898463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.898465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556304732484041:12400]
2025-10-02T09:37:48.898486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:48.898487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:48.898489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:48.898490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:48.898491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:48.898493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:48.898605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:48.903811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3775 sessionId: src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:48.906098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:48.970029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556304808074836:4294]
2025-10-02T09:37:48.970235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3774, pipe: [1:7556556304808074836:4294]
2025-10-02T09:37:49.009316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.009529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.009537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.009549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556304808074836:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.009666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.009713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.009722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556304808074836:4294]
2025-10-02T09:37:49.009748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:49.009828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3775 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0
2025-10-02T09:37:49.009976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3775 sessionId: src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0 is DEAD
2025-10-02T09:37:49.010104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:49.010115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Write session will restart in 0.005905s
2025-10-02T09:37:49.010134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Write session: Do CDS request
2025-10-02T09:37:49.010140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.017178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.017280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.017296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3776
2025-10-02T09:37:49.017404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.017427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.017435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.017438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.017743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.017784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3776 sessionId:  describe result for acl check
2025-10-02T09:37:49.017807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.017813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.017814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.017818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.017997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.018093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.018100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.018106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.018131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.018156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027451461:12402]
2025-10-02T09:37:49.018246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.018767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.018932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.018954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.019230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.019262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.019265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.019266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.019267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.019268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.019268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.019269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.019270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.019270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.019271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.019271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.019272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.019275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.019281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.019283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.019285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.019287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.019289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.019291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.019293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.019295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.019297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.019299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.019301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.019304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.019316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.019319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.019322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.019324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.019327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.019329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.019332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.019334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.019337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.019339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.019341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.019344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.019346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.019349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.019351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.019354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.019356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.019358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.019361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.019364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.019366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.019370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.019372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.019388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.019680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.024171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.024182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.024185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042215:2993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.024190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.026738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.028242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.028253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.028254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.028256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.028260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3775 [2:7556556309027451461:12402]
2025-10-02T09:37:49.028266Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.028275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.028276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.028278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.028279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.028288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.028291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.028295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.028326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.028331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.028332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.028334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.028335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.028370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.028375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.028382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.028387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.028395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.028409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042255:2993], now have 1 active actors on pipe
2025-10-02T09:37:49.028414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042135:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.028418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.028419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.028420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.028427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.028438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.028441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.028443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.028444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.028447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.028448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.028462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.028467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.028468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.028448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3775
2025-10-02T09:37:49.028454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3775
2025-10-02T09:37:49.028484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.028489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.028624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ef6858e-93abaa0f-4397a76e-74566934_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.028632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.028635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.028636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.028641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.028647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.028662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.028787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.028792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.028808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.028871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3776 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ef6858e-93abaa0f-4397a76e-74566934_0
2025-10-02T09:37:49.029094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad57ad1f-cd2ee763-ecf2bf56-362c210d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ef6858e-93abaa0f-4397a76e-74566934_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.031638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Write session: try to update token
2025-10-02T09:37:49.031650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.037642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.037655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.037657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.037658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.037661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.037663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.037665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027451456:12402]
2025-10-02T09:37:49.037685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.037692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.037694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.037700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.037713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.037716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.037881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.043523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3776 sessionId: src_id|2ef6858e-93abaa0f-4397a76e-74566934_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.045740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.109798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042288:4294]
2025-10-02T09:37:49.109995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3775, pipe: [1:7556556309103042288:4294]
2025-10-02T09:37:49.148749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.149166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.149175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.149189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042288:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.149304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.149399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:49.149403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042288:4294]
2025-10-02T09:37:49.149436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.149504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3776 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ef6858e-93abaa0f-4397a76e-74566934_0
2025-10-02T09:37:49.149668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3776 sessionId: src_id|2ef6858e-93abaa0f-4397a76e-74566934_0 is DEAD
2025-10-02T09:37:49.149825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:49.149837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Write session will restart in 0.009231s
2025-10-02T09:37:49.149863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Write session: Do CDS request
2025-10-02T09:37:49.149868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.157507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.157766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.157926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.157934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.157941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.157969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.157993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027451616:12416]
2025-10-02T09:37:49.158335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.158498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.158520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.158699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.158730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.158732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.158733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.158733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.158734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.158734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.158735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.158735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.158736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.158736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.158737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.158737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.158740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.158747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.158749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.158751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.158753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.158755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.158757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.158759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.158762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.158764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.158766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.158768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.158772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.158776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.158780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.158783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.158785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.158787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.158790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.158792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.158795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.158797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.158799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.158802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.158803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.158806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.158808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.158811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.158813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.158816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.158818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.158820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.158822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.158824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.158829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.158831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.158849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.160180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.160285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.160300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3777
2025-10-02T09:37:49.160424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.160449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.160457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.160461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.160957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3777 sessionId:  describe result for acl check
2025-10-02T09:37:49.160998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.161004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.161005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.161010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.161502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.163397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.165980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.165990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.165992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042375:3064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.165998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.166469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.167963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.167975Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.167978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.167981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.167984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3776 [2:7556556309027451616:12416]
2025-10-02T09:37:49.167992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.168001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.168003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.168004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.168005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.168014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.168021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.168026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.168057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.168062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.168063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.168065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.168066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.168100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.168107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.168113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.168118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.168126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.168138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042410:3064], now have 1 active actors on pipe
2025-10-02T09:37:49.168141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042289:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.168144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.168145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.168147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.168156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.168164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.168169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.168170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.168171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.168174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.168175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.168190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.168182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3776
2025-10-02T09:37:49.168195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.168187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3776
2025-10-02T09:37:49.168201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.168220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.168225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.168242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.168249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.168251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.168252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.168257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.168265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.168272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.168381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.168386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.168393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.168454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3777 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0
2025-10-02T09:37:49.168693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef6858e-93abaa0f-4397a76e-74566934_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.171171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Write session: try to update token
2025-10-02T09:37:49.171186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.177625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.177635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.177636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.177637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.177641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.177644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.177648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027451611:12416]
2025-10-02T09:37:49.177667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.177671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.177673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.177673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.177674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.177676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.177780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.183214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3777 sessionId: src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.185309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.249590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042418:4294]
2025-10-02T09:37:49.249761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3776, pipe: [1:7556556309103042418:4294]
2025-10-02T09:37:49.286107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.286367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.286376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.286389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042418:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.286535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.286605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042418:4294]
2025-10-02T09:37:49.286625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:49.286632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.286715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3777 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0
2025-10-02T09:37:49.286882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3777 sessionId: src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0 is DEAD
2025-10-02T09:37:49.287021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:49.287033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Write session will restart in 0.009046s
2025-10-02T09:37:49.287052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Write session: Do CDS request
2025-10-02T09:37:49.287057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.293017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.294735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.294838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.294844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.294850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.294877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.294901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027451739:12419]
2025-10-02T09:37:49.295249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.295438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.295461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.295637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.295669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.295673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.295674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.295674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.295675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.295676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.295676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.295677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.295677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.295677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.295678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.295679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.295681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.295688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.295691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.295693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.295695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.295697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.295699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.295701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.295703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.295706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.295707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.295709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.295713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.295717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.295720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.295723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.295726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.295728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.295731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.295733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.295735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.295738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.295741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.295743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.295745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.295748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.295750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.295753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.295755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.295758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.295760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.295763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.295765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.295768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.295771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.295773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.295790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.297272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.297319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.297331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3778
2025-10-02T09:37:49.297483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.297507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.297514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.297517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.297851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3778 sessionId:  describe result for acl check
2025-10-02T09:37:49.297876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.297880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.297882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.297886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.298291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.299723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.302823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.302833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.302836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042506:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.302841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.303383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.304970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.304979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.304980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.304983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.304986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3777 [2:7556556309027451739:12419]
2025-10-02T09:37:49.304995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.305005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.305010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.305011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.305012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.305022Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.305028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.305032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.305062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.305067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.305068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.305070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.305072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.305105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.305110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.305116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.305122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.305130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.305141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042419:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.305147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042541:3081], now have 1 active actors on pipe
2025-10-02T09:37:49.305151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.305152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.305154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.305162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.305173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.305175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.305177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.305178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.305182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.305183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.305189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3777
2025-10-02T09:37:49.305200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.305197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3777
2025-10-02T09:37:49.305205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.305207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.305222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.305226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.305245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.305251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.305253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.305255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.305260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.305266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.305275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.305360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.305365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.305373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.305428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3778 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0
2025-10-02T09:37:49.305721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab44aa3a-b1736b8f-86364963-77d2adae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.308358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Write session: try to update token
2025-10-02T09:37:49.308369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.314740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.314752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.314753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.314754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.314759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.314761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.314764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027451734:12419]
2025-10-02T09:37:49.314787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.314791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.314792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.314796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.314801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.314804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.314922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.320238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3778 sessionId: src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.322424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.386791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042551:4294]
2025-10-02T09:37:49.386967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3777, pipe: [1:7556556309103042551:4294]
2025-10-02T09:37:49.423410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.423736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.423744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.423770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042551:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.423894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.423902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042551:4294]
2025-10-02T09:37:49.423921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.423933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:49.423935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:49.424002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3778 reason: error at write: Disconnected sessionId: src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0
2025-10-02T09:37:49.424159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3778 sessionId: src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0 is DEAD
2025-10-02T09:37:49.424308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:49.424318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Write session will restart in 0.008976s
2025-10-02T09:37:49.424339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Write session: Do CDS request
2025-10-02T09:37:49.424343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.432125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.432363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.432466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.432473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.432479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.432506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.432530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027451873:12422]
2025-10-02T09:37:49.432884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.433047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.433075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.433255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.433282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.433286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.433287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.433287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.433288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.433288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.433289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.433289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.433290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.433291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.433291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.433291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.433294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.433301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.433303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.433305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.433307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.433309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.433311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.433313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.433315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.433317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.433319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.433321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.433326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.433330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.433333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.433336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.433338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.433340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.433343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.433345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.433347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.433350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.433352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.433355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.433357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.433359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.433361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.433364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.433366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.433369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.433372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.433378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.433380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.433382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.433384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.433387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.433404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.434143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.434261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.434272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3779
2025-10-02T09:37:49.434374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.434394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.434398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.434401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.434751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3779 sessionId:  describe result for acl check
2025-10-02T09:37:49.434782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.434789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.434790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.434797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.435240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.436983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.440595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.440605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.440607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042640:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.440613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.441131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.442654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.442665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.442668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.442672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3778 [2:7556556309027451873:12422]
2025-10-02T09:37:49.442681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.442692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.442697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.442699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.442700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.442709Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.442712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.442717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.442749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.442754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.442755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.442757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.442759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.442794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.442798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.442805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.442810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.442821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.442836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042552:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.442841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042675:3130], now have 1 active actors on pipe
2025-10-02T09:37:49.442845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.442846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.442847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.442854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.442864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.442867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.442869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.442870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.442874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.442876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.442873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3778
2025-10-02T09:37:49.442881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3778
2025-10-02T09:37:49.442891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.442895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.442897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.442906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.442911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.442939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.442945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.442947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.442948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.442953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.442958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.442970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.443069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.443073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.443081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.443129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3779 partition: 0 MaxSeqNo: 36 sessionId: src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0
2025-10-02T09:37:49.443358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1aa0472-f01d9b0c-60d029de-8a51fbc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.445861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Write session: try to update token
2025-10-02T09:37:49.445872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.452499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.452511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.452513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.452513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.452517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.452520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.452523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027451868:12422]
2025-10-02T09:37:49.452544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.452547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.452549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.452550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.452550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.452552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.452670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.458583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3779 sessionId: src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.460851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.524014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042694:4294]
2025-10-02T09:37:49.524207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3778, pipe: [1:7556556309103042694:4294]
2025-10-02T09:37:49.561056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.561384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.561393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.561405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042694:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.561533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.561570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.561608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042694:4294]
2025-10-02T09:37:49.561616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:49.561697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0
2025-10-02T09:37:49.561859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3779 sessionId: src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0 is DEAD
2025-10-02T09:37:49.562004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:49.562016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Write session will restart in 0.007839s
2025-10-02T09:37:49.562033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Write session: Do CDS request
2025-10-02T09:37:49.562037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.568484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.569908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.570096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.570104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.570111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.570143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.570169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027451997:12425]
2025-10-02T09:37:49.570509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.570674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.570696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.570874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.570900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.570904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.570905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.570905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.570906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.570906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.570907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.570907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.570908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.570908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.570909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.570909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.570912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.570919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.570921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.570923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.570925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.570927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.570929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.570931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.570932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.570935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.570937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.570938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.570942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.570946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.570949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.570952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.570954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.570957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.570959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.570962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.570964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.570967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.570970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.570972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.570974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.570977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.570979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.570982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.570984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.570986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.570989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.570991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.570997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.571000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.571002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.571004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.571022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.571144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.571264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.571274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3780
2025-10-02T09:37:49.571402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.571423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.571433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.571436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.571786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3780 sessionId:  describe result for acl check
2025-10-02T09:37:49.571818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.571823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.571825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.571829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.572265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.573616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.577484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.577495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.577497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042785:3117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.577503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.578658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.580148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.580159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.580160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.580162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.580165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3779 [2:7556556309027451997:12425]
2025-10-02T09:37:49.580172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.580183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.580185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.580186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.580187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.580196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.580201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.580205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.580236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.580241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.580244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.580246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.580248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.580282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.580287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.580293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.580298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.580306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.580320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042820:3117], now have 1 active actors on pipe
2025-10-02T09:37:49.580326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042696:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.580330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.580331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.580332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.580339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.580349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.580352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.580354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.580355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.580357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.580359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.580372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.580377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.580367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3779
2025-10-02T09:37:49.580368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3779
2025-10-02T09:37:49.580384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.580503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.580509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.580527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.580534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.580536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.580537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.580542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.580549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.580557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.580674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.580679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.580686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.580740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3780 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0
2025-10-02T09:37:49.581014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3908cd18-3817adfb-89f5249c-dff4d2f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.583527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Write session: try to update token
2025-10-02T09:37:49.583538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.590081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.590097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.590101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.590102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.590106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.590109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.590111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027451992:12425]
2025-10-02T09:37:49.590132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.590135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.590136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.590139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.590142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.590145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.590252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.595743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3780 sessionId: src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.598041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.661742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042827:4294]
2025-10-02T09:37:49.661941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3779, pipe: [1:7556556309103042827:4294]
2025-10-02T09:37:49.700427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.700767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.700776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.700788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042827:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.700913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.700959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042827:4294]
2025-10-02T09:37:49.700984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:49.700987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.701066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3780 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0
2025-10-02T09:37:49.701234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3780 sessionId: src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0 is DEAD
2025-10-02T09:37:49.701369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:49.701379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Write session will restart in 0.007381s
2025-10-02T09:37:49.701394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Write session: Do CDS request
2025-10-02T09:37:49.701399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.707583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.709202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.709388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.709397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.709403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.709434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.709462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027452122:12427]
2025-10-02T09:37:49.709810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.709983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.710005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.710176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.710189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.710220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.710224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.710225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.710225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.710226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.710226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.710227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.710227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.710228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.710228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.710229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.710229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.710232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.710239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.710241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.710243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.710246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.710248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.710250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.710252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.710254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.710256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.710248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.710257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3781
2025-10-02T09:37:49.710258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.710260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.710263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.710268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.710272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.710274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.710277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.710279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.710282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.710284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.710287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.710289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.710291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.710294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.710296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.710299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.710302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.710304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.710307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.710309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.710311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.710314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.710316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.710319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.710321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.710323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.710340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.710377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.710400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.710410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.710413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.710735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3781 sessionId:  describe result for acl check
2025-10-02T09:37:49.710764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.710769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.710770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.710774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.711208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.712932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.716882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.716891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.716893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103042920:3138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.716897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.718108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.719676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.719686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.719689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.719691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.719695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3780 [2:7556556309027452122:12427]
2025-10-02T09:37:49.719702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.719712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.719717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.719719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.719720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.719729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.719735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.719740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.719769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.719774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.719775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.719777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.719778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.719815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.719820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.719827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.719832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.719844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.719858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042955:3138], now have 1 active actors on pipe
2025-10-02T09:37:49.719860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042830:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.719865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.719866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.719868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.719876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.719886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.719893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.719895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.719896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.719900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.719893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3780
2025-10-02T09:37:49.719895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3780
2025-10-02T09:37:49.719901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.719909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.719911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.719912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.719925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.719929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.719951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d7c63ef-f64a356-c31d485-98179041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.719957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.719960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.719961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.719966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.719976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.719989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.720109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.720113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.720121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.720179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3781 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d7c63ef-f64a356-c31d485-98179041_0
2025-10-02T09:37:49.720417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d47831c-fd0440a7-7653c48b-a3df8e74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d7c63ef-f64a356-c31d485-98179041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.722913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Write session: try to update token
2025-10-02T09:37:49.722927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.729178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.729190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.729191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.729192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.729196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.729198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.729201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027452117:12427]
2025-10-02T09:37:49.729225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.729227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.729228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.729229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.729231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.729235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.729352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.734276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3781 sessionId: src_id|5d7c63ef-f64a356-c31d485-98179041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.736501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.801004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103042966:4294]
2025-10-02T09:37:49.801196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3780, pipe: [1:7556556309103042966:4294]
2025-10-02T09:37:49.839347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.839628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.839636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.839660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042966:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.839780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.839810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.839813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:49.839817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:49.839869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103042966:4294]
2025-10-02T09:37:49.839887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3781 reason: error at write: Disconnected sessionId: src_id|5d7c63ef-f64a356-c31d485-98179041_0
2025-10-02T09:37:49.840048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3781 sessionId: src_id|5d7c63ef-f64a356-c31d485-98179041_0 is DEAD
2025-10-02T09:37:49.840195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:49.840205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Write session will restart in 0.005311s
2025-10-02T09:37:49.840224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Write session: Do CDS request
2025-10-02T09:37:49.840228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.846169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.846284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.846295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3782
2025-10-02T09:37:49.846413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.846437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.846444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.846447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.846773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3782 sessionId:  describe result for acl check
2025-10-02T09:37:49.846799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.846806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.846808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.846812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.846919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.847260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.848633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.848736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.848743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.848749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.848777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.848816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027452247:12429]
2025-10-02T09:37:49.849155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.849245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:49.849315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.849338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.849512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.849541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.849545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.849545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.849546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.849546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.849547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.849548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.849549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.849550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.849551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.849552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.849552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.849555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.849562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.849564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.849566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.849568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.849570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.849572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.849573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.849575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.849577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.849579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.849581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.849586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.849591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.849594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.849597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.849599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.849602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.849605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.849607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.849610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.849612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.849614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.849617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.849619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.849622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.849624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.849626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.849629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.849632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.849634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.849636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.849638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.849642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.849646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.849649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.849667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.853706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:49.853718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:49.853721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103043053:3163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:49.853727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:49.857265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:49.858877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:49.858888Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:49.858889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:49.858891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:49.858895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3781 [2:7556556309027452247:12429]
2025-10-02T09:37:49.858902Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:49.858913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:49.858918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.858920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.858921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.858930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:49.858933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:49.858938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:49.858968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.858972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.858973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.858975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:49.858977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:49.859012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:49.859017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.859024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.859029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.859037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:49.859052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103043093:3163], now have 1 active actors on pipe
2025-10-02T09:37:49.859057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103042967:2446], now have 1 active actors on pipe
2025-10-02T09:37:49.859061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.859062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.859063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.859071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:49.859080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:49.859083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:49.859085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:49.859086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:49.859089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:49.859092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:49.859105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.859111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:49.859116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:49.859117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3781
2025-10-02T09:37:49.859138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.859144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.859143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3781
2025-10-02T09:37:49.859159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:49.859166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:49.859168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:49.859169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:49.859173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:49.859178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:49.859186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.859284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.859289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.859296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:49.859362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3782 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0
2025-10-02T09:37:49.859632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d7c63ef-f64a356-c31d485-98179041_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:49.862221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Write session: try to update token
2025-10-02T09:37:49.862233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:49.871930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:49.871941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.871945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.871972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:49.871974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:49.872132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:49.872255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:49.872377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:49.872502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:49.872675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:49.872698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:49.875250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3782 sessionId: src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:49.876786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:49.876796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:49.876797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:49.876798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:49.876817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.876819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.876821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027452242:12429]
2025-10-02T09:37:49.876837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:49.876840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:49.876843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.876844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:49.876844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:49.876847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:49.876951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:49.877567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:49.940272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556309103043101:4294]
2025-10-02T09:37:49.940514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3781, pipe: [1:7556556309103043101:4294]
2025-10-02T09:37:49.985210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:49.985480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:49.985488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:49.985501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103043101:4294], now have 1 active actors on pipe
2025-10-02T09:37:49.985621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:49.985662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:49.985672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:49.985676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:49.985724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556309103043101:4294]
2025-10-02T09:37:49.985747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3782 reason: error at write: Disconnected sessionId: src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0
2025-10-02T09:37:49.985920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3782 sessionId: src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0 is DEAD
2025-10-02T09:37:49.986046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:49.986057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Write session will restart in 0.006556s
2025-10-02T09:37:49.986073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Write session: Do CDS request
2025-10-02T09:37:49.986077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:49.992099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:49.993153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.993254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:49.993264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3783
2025-10-02T09:37:49.993405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:49.993428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:49.993435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:49.993438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:49.993763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:49.993797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3783 sessionId:  describe result for acl check
2025-10-02T09:37:49.993827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:49.993832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:49.993834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:49.993838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:49.993867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:49.993873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:49.993879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:49.993905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:49.993927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556309027452372:12431]
2025-10-02T09:37:49.994270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:49.994282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:49.994437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:49.994460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:49.994638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:49.994666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.994671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.994672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.994673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.994674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.994675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.994676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.994677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.994678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.994678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.994679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.994680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.994683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.994690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.994692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.994694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.994696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.994698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.994700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.994702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.994704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.994706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.994708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.994710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.994714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.994718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:49.994721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.994724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:49.994726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.994729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:49.994731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.994734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:49.994736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.994739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:49.994742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.994745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:49.994747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.994749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:49.994752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.994755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:49.994757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.994760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:49.994763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.994766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:49.994768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.994770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:49.994772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.994774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:49.994791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:49.996061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.000058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.000068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.000071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556309103043197:3166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.000077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.002233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.003808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.003819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.003820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.003822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.003825Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3782 [2:7556556309027452372:12431]
2025-10-02T09:37:50.003832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.003841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.003846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.003847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.003848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.003857Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.003863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.003868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.003901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.003905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.003906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.003908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.003909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.003942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.003947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.003954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.003959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.003967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.003981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010532:3166], now have 1 active actors on pipe
2025-10-02T09:37:50.003986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556309103043109:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.003990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.003991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.003992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.004000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.004010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.004012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.004014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.004015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.004020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.004021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.004035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.004042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.004045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.004034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3782
2025-10-02T09:37:50.004038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3782
2025-10-02T09:37:50.004064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.004069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.004089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.004095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.004097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.004099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.004104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.004112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.004122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.004236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.004240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.004247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.004314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3783 partition: 0 MaxSeqNo: 36 sessionId: src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0
2025-10-02T09:37:50.004565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b620dfb-213b141e-7e68a701-db03ddbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.007100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Write session: try to update token
2025-10-02T09:37:50.007111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.013250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.013265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.013266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.013267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.013271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.013273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.013275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556309027452367:12431]
2025-10-02T09:37:50.013296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.013299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.013300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.013304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.013307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.013309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.013425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.018939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3783 sessionId: src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.021291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.085653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398010547:4294]
2025-10-02T09:37:50.085824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3782, pipe: [1:7556556313398010547:4294]
2025-10-02T09:37:50.123922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.124192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.124200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.124213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010547:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.124320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.124372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:50.124385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:50.124399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398010547:4294]
2025-10-02T09:37:50.124418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.124440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3783 reason: error at write: Disconnected sessionId: src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0
2025-10-02T09:37:50.124602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3783 sessionId: src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0 is DEAD
2025-10-02T09:37:50.124725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:50.124735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Write session will restart in 0.007108s
2025-10-02T09:37:50.124751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Write session: Do CDS request
2025-10-02T09:37:50.124756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.131367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.133064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.133119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.133237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.133244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.133251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.133283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.133306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322419831:12445]
2025-10-02T09:37:50.133517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.133528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3784
2025-10-02T09:37:50.133626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.133648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.133656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.133659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.133651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.133858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.134016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3784 sessionId:  describe result for acl check
2025-10-02T09:37:50.134048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.134053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.134054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.134059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.134070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.134102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.134106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.134107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.134107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.134109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.134110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.134112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.134112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.134113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.134115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.134122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.134124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.134126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.134128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.134130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.134132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.134134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.134136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.134139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.134141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.134143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.134146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.134150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.134153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.134156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.134158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.134161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.134164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.134166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.134169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.134171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.134173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.134176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.134178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.134181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.134186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.134191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.134194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.134196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.134202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.134205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.134208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.134210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.134212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.134216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.134233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.134462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.135826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.141114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.141124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.141126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398010660:3232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.141131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.141779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.143337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.143346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.143347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.143349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.143353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3783 [2:7556556313322419831:12445]
2025-10-02T09:37:50.143359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.143369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.143370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.143372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.143372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.143381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.143384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.143392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.143423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.143428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.143429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.143431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.143432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.143469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.143475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.143482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.143487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.143495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.143506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010694:3232], now have 1 active actors on pipe
2025-10-02T09:37:50.143509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010569:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.143512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.143515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.143516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.143523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.143531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.143538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.143542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.143543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.143544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.143546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.143557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.143558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.143561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.143570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3783
2025-10-02T09:37:50.143571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3783
2025-10-02T09:37:50.143630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.143635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.143655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.143661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.143664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.143665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.143670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.143676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.143686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.143804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.143809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.143816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.143876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3784 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0
2025-10-02T09:37:50.144104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb9fd6d-e8127737-d908ab50-da0523d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.146700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Write session: try to update token
2025-10-02T09:37:50.146712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.152843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:50.152854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.152859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.152883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:50.152890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:50.153024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:50.153150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:50.153270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:50.153391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:50.153599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:50.153624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:50.158156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3784 sessionId: src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.160499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.161365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.161380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.161392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.161394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.161395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.161396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.161399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.161402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.161404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322419826:12445]
2025-10-02T09:37:50.161430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.161430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.161433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.161433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.161435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.161437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.161557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.224431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398010702:4294]
2025-10-02T09:37:50.224641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3783, pipe: [1:7556556313398010702:4294]
2025-10-02T09:37:50.273549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.273930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:50.273952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010702:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.274045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:50.274131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.274154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:50.274160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:50.274191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398010702:4294]
2025-10-02T09:37:50.274223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3784 reason: error at write: Disconnected sessionId: src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0
2025-10-02T09:37:50.274333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3784 sessionId: src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0 is DEAD
2025-10-02T09:37:50.274465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:50.274477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Write session will restart in 0.008428s
2025-10-02T09:37:50.274492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Write session: Do CDS request
2025-10-02T09:37:50.274501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.282754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.283086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.283186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.283192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.283197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.283223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.283245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322419961:12448]
2025-10-02T09:37:50.283611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.283779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.283802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.283984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.284013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.284017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.284018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.284018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.284019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.284019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.284020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.284020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.284021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.284022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.284022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.284023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.284025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.284033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.284035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.284037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.284039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.284041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.284043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.284045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.284047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.284049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.284051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.284053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.284056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.284060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.284063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.284066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.284069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.284071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.284073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.284076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.284080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.284083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.284086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.284089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.284091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.284096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.284100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.284102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.284105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.284107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.284115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.284118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.284120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.284122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.284142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.284170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.284254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.284265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3785
2025-10-02T09:37:50.284389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.284410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.284419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.284422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.284736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3785 sessionId:  describe result for acl check
2025-10-02T09:37:50.284758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.284764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.284765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.284769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.285194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.286856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.290746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.290755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.290758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398010798:3270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.290763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.291967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.293379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.293389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.293391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.293394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.293397Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3784 [2:7556556313322419961:12448]
2025-10-02T09:37:50.293404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.293415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.293425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.293429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.293432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.293441Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.293446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.293450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.293480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.293485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.293486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.293488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.293489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.293525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.293530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.293537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.293542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.293550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.293565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010833:3270], now have 1 active actors on pipe
2025-10-02T09:37:50.293573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.293574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.293575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.293581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.293586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010703:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.293591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.293593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.293595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.293597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.293599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.293600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.293615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.293621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.293619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3784
2025-10-02T09:37:50.293630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.293627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3784
2025-10-02T09:37:50.293636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.293638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.293662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.293669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.293672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.293673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.293678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.293683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.293699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.293827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.293832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.293841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.293898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3785 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0
2025-10-02T09:37:50.294132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e43ebc8-f5f68caa-42118030-8c5a7ea2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.296627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Write session: try to update token
2025-10-02T09:37:50.296636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.303089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.303101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.303102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.303103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.303109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.303111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.303113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322419956:12448]
2025-10-02T09:37:50.303134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.303137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.303138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.303170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.303187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.303190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.303246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.308723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3785 sessionId: src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.310950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.374440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398010845:4294]
2025-10-02T09:37:50.374633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3784, pipe: [1:7556556313398010845:4294]
2025-10-02T09:37:50.414722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.415204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.415213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.415225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010845:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.415350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.415377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:50.415390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:50.415404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.415453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398010845:4294]
2025-10-02T09:37:50.415462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3785 reason: error at write: Disconnected sessionId: src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0
2025-10-02T09:37:50.415605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3785 sessionId: src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0 is DEAD
2025-10-02T09:37:50.415734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:50.415745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Write session will restart in 0.009356s
2025-10-02T09:37:50.415760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Write session: Do CDS request
2025-10-02T09:37:50.415764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.422604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.424078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.424177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.424183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.424189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.424214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.424238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322420102:12451]
2025-10-02T09:37:50.424577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.424731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.424754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.425005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.425042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.425046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.425047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.425047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.425048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.425048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.425049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.425049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.425050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.425050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.425051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.425051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.425054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.425061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.425063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.425065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.425067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.425068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.425070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.425072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.425074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.425077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.425079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.425081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.425085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.425089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.425092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.425095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.425097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.425100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.425102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.425105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.425113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.425116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.425118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.425120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.425122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.425125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.425127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.425129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.425134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.425138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.425140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.425142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.425148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.425150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.425152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.425155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.425173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.426177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.426280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.426289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3786
2025-10-02T09:37:50.426410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.426432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.426440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.426443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.426788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3786 sessionId:  describe result for acl check
2025-10-02T09:37:50.426819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.426826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.426828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.426832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.427278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.428716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.432127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.432137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.432140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398010941:3293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.432145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.432633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.434222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.434232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.434233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.434235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.434239Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3785 [2:7556556313322420102:12451]
2025-10-02T09:37:50.434245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.434257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.434262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.434263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.434264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.434273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.434277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.434281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.434311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.434315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.434316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.434319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.434320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.434355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.434361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.434368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.434373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.434383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.434395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010976:3293], now have 1 active actors on pipe
2025-10-02T09:37:50.434400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010846:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.434403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.434405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.434406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.434413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.434424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.434426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.434428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.434429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.434434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.434437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.434450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.434455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.434443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3785
2025-10-02T09:37:50.434448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3785
2025-10-02T09:37:50.434465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.434483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.434488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.434501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.434508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.434510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.434511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.434517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.434523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.434535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.434652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.434656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.434664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.434727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3786 partition: 0 MaxSeqNo: 36 sessionId: src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0
2025-10-02T09:37:50.434979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd177e79-8c45b99-df820b7c-664b9ec9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.437618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Write session: try to update token
2025-10-02T09:37:50.437632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.443744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.443755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.443756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.443757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.443760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.443762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.443766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322420097:12451]
2025-10-02T09:37:50.443784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.443788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.443791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.443791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.443793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.443793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.443902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.450078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3786 sessionId: src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.452169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.515741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398010996:4294]
2025-10-02T09:37:50.515914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3785, pipe: [1:7556556313398010996:4294]
2025-10-02T09:37:50.555361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.555698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.555707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.555720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010996:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.555845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.555893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398010996:4294]
2025-10-02T09:37:50.555906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.555928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:50.556007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3786 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0
2025-10-02T09:37:50.556162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3786 sessionId: src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0 is DEAD
2025-10-02T09:37:50.556308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:50.556319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Write session will restart in 0.006112s
2025-10-02T09:37:50.556343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Write session: Do CDS request
2025-10-02T09:37:50.556348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.563163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.563279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.563288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3787
2025-10-02T09:37:50.563402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.563424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.563432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.563435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.563803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3787 sessionId:  describe result for acl check
2025-10-02T09:37:50.563835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.563840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.563842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.563847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.564305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.564368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.564599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.564710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.564717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.564722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.564749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.564773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322420233:12454]
2025-10-02T09:37:50.565142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.565318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.565342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.565534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.565565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.565569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.565570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.565571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.565571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.565572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.565572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.565573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.565573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.565574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.565574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.565575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.565578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.565585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.565587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.565589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.565591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.565593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.565595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.565597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.565599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.565601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.565603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.565605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.565609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.565613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.565617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.565619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.565622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.565624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.565626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.565629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.565631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.565634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.565636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.565639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.565641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.565644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.565649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.565652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.565654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.565657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.565659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.565662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.565664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.565668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.565670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.565673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.565689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.565890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.570546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.570556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.570559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398011088:3322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.570564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.573191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.574689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.574699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.574700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.574702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.574706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3786 [2:7556556313322420233:12454]
2025-10-02T09:37:50.574714Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.574725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.574729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.574731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.574732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.574741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.574747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.574750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.574780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.574785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.574786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.574788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.574789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.574826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.574831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.574837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.574843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.574853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.574867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398010997:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.574873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011128:3322], now have 1 active actors on pipe
2025-10-02T09:37:50.574876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.574878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.574879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.574887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.574898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.574901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.574903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.574904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.574908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.574910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.574924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.574929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.574931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.574916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3786
2025-10-02T09:37:50.574953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.574958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.574943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3786
2025-10-02T09:37:50.574972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.574979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.574981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.574982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.574988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.574997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.575007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.575153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.575157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.575165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.575223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3787 partition: 0 MaxSeqNo: 36 sessionId: src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0
2025-10-02T09:37:50.575452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de8c5a-1d68016b-63e20122-2a8f2aa7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.578072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Write session: try to update token
2025-10-02T09:37:50.578086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.584555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.584569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.584570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.584572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.584576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.584579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.584581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322420228:12454]
2025-10-02T09:37:50.584601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.584604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.584605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.584610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.584616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.584620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.584742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.589973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3787 sessionId: src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.592338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.656060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398011135:4294]
2025-10-02T09:37:50.656294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3786, pipe: [1:7556556313398011135:4294]
2025-10-02T09:37:50.697307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.697519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.697528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.697553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011135:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.697689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.697719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.697754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398011135:4294]
2025-10-02T09:37:50.697767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:50.697852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3787 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0
2025-10-02T09:37:50.698005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3787 sessionId: src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0 is DEAD
2025-10-02T09:37:50.698158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:50.698168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Write session will restart in 0.007269s
2025-10-02T09:37:50.698185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Write session: Do CDS request
2025-10-02T09:37:50.698190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.704763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.706204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.706296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.706308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3788
2025-10-02T09:37:50.706408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.706431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.706438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.706442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.706488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.706593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.706599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.706605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.706630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.706651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322420364:12456]
2025-10-02T09:37:50.706774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3788 sessionId:  describe result for acl check
2025-10-02T09:37:50.706805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.706810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.706812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.706816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.706999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.707162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.707184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.707250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.707369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.707399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.707402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.707403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.707404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.707404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.707405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.707405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.707406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.707406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.707407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.707407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.707408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.707410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.707417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.707419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.707421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.707423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.707425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.707427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.707429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.707431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.707433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.707435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.707437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.707441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.707444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.707448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.707451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.707453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.707456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.707458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.707460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.707463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.707465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.707467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.707470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.707473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.707480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.707482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.707484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.707487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.707489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.707495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.707497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.707500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.707502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.707507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.707510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.707528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.708740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.712916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.712928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.712930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398011230:3371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.712937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.714961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.716673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.716685Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.716686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.716689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.716692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3787 [2:7556556313322420364:12456]
2025-10-02T09:37:50.716700Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.716711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.716713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.716714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.716715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.716725Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.716729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.716733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.716765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.716770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.716771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.716773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.716775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.716867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.716872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.716879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.716888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.716896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.716911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011137:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.716916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011269:3371], now have 1 active actors on pipe
2025-10-02T09:37:50.716920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.716921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.716922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.716931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.716921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3787
2025-10-02T09:37:50.716922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3787
2025-10-02T09:37:50.716942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.716947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.716949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.716950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.716953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.716954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.716983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.716988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.716996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.717004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.717021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.717022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.717025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.717027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.717028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.717035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.717041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.717052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.717179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.717184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.717191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.717260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3788 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0
2025-10-02T09:37:50.717513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ce1c8d-1633ff28-e7a9a819-d107bded_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.720165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Write session: try to update token
2025-10-02T09:37:50.720179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.726408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.726420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.726421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.726422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.726426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.726429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.726431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322420359:12456]
2025-10-02T09:37:50.726452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.726455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.726457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.726457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.726460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.726462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.726564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.732505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3788 sessionId: src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.734720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.797878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398011276:4294]
2025-10-02T09:37:50.798116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3787, pipe: [1:7556556313398011276:4294]
2025-10-02T09:37:50.842560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.842776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.842784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.842796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011276:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.842927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.842953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.843000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398011276:4294]
2025-10-02T09:37:50.843004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:50.843088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3788 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0
2025-10-02T09:37:50.843225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3788 sessionId: src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0 is DEAD
2025-10-02T09:37:50.843364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:50.843375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Write session will restart in 0.005769s
2025-10-02T09:37:50.843410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Write session: Do CDS request
2025-10-02T09:37:50.843414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.850095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.850175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.850231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.850239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3789
2025-10-02T09:37:50.850389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.850410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.850417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.850420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.850803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3789 sessionId:  describe result for acl check
2025-10-02T09:37:50.850833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.850838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.850839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.850843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.851341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.851803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.851903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.851909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.851915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.851940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.851966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322420496:12458]
2025-10-02T09:37:50.852309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.852466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.852488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.852664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.852693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.852698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.852698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.852700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.852700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.852701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.852705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.852711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.852713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.852715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.852717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.852719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.852721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.852723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.852725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.852727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.852729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.852731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.852738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.852741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.852744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.852746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.852749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.852751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.852754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.852756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.852759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.852761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.852763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.852765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.852768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.852770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.852773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.852776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.852778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.852780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.852783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.852785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.852788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.852793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.852795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.852824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.853178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.857596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.857606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.857609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398011372:3418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.857615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.860194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:50.861815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:50.861826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:50.861828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:50.861830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:50.861833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3788 [2:7556556313322420496:12458]
2025-10-02T09:37:50.861840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:50.861849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:50.861851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.861853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.861854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.861862Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:50.861869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:50.861874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:50.861906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.861911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.861912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.861914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:50.861916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:50.861952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:50.861956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.861962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.861968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.861975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:50.861990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011411:3418], now have 1 active actors on pipe
2025-10-02T09:37:50.861996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011278:2446], now have 1 active actors on pipe
2025-10-02T09:37:50.861999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.862000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.862001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.862009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:50.862019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:50.862022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:50.862024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:50.862025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:50.862029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:50.862031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:50.862045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.862051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:50.862055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:50.862049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3788
2025-10-02T09:37:50.862053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3788
2025-10-02T09:37:50.862083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.862088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.862104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:50.862111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:50.862114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:50.862116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:50.862121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:50.862129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:50.862136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.862260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.862265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.862273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:50.862334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3789 partition: 0 MaxSeqNo: 36 sessionId: src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0
2025-10-02T09:37:50.862576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a354579-240beb7c-1e983b5b-1082c9bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:50.865128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Write session: try to update token
2025-10-02T09:37:50.865141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:50.871067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:50.871080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:50.871081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:50.871082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:50.871086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.871088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.871090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322420491:12458]
2025-10-02T09:37:50.871107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:50.871110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.871114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:50.871115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:50.871117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:50.871121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:50.871224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:50.877107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3789 sessionId: src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:50.879247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:50.943282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556313398011418:4294]
2025-10-02T09:37:50.943541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3788, pipe: [1:7556556313398011418:4294]
2025-10-02T09:37:50.982160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:50.982358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:50.982367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:50.982379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011418:4294], now have 1 active actors on pipe
2025-10-02T09:37:50.982497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:50.982538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:50.982552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:50.982567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:50.982615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3789 reason: error at write: Disconnected sessionId: src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0
2025-10-02T09:37:50.982627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556313398011418:4294]
2025-10-02T09:37:50.982751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3789 sessionId: src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0 is DEAD
2025-10-02T09:37:50.982895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:50.982906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Write session will restart in 0.006610s
2025-10-02T09:37:50.982928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Write session: Do CDS request
2025-10-02T09:37:50.982933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:50.989367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:50.990209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.990299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:50.990308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3790
2025-10-02T09:37:50.990403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:50.990425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:50.990432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:50.990435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:50.990783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3790 sessionId:  describe result for acl check
2025-10-02T09:37:50.990812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:50.990816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:50.990818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:50.990821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:50.990916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:50.991016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:50.991023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:50.991029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:50.991053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:50.991076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556313322420629:12460]
2025-10-02T09:37:50.991244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:50.991431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:50.991601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:50.991624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:50.991830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:50.991863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.991867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.991868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.991868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.991869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.991869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.991870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.991871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.991871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.991871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.991872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.991872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.991875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.991882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.991884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.991886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.991888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.991890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.991892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.991894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.991896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.991898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.991900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.991902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.991906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.991910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:50.991913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.991916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:50.991918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.991920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:50.991922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.991925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:50.991927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.991930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:50.991932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.991935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:50.991936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.991939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:50.991941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.991944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:50.991946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.991948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:50.991951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.991953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:50.991956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.991959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:50.991962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.991965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:50.991981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:50.992996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:50.997694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:50.997703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:50.997705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556313398011521:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:50.997710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:50.999362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.000922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.000931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.000932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.000934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.000937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3789 [2:7556556313322420629:12460]
2025-10-02T09:37:51.000944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.000954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.000955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.000957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.000957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.000966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.000973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.000977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.001005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.001011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.001012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.001013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.001015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.001050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.001055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.001061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.001067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.001076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.001090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011426:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.001097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.001098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.001100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.001104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.001112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556313398011559:3439], now have 1 active actors on pipe
2025-10-02T09:37:51.001112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.001114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.001117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.001121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.001128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.001130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.001142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.001147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.001148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.001150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3789
2025-10-02T09:37:51.001153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3789
2025-10-02T09:37:51.001209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.001214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.001230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.001237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.001239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.001240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.001245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.001253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.001265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.001393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.001398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.001406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.001469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3790 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0
2025-10-02T09:37:51.001700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67be4b73-9c66c45c-ed164f5c-2163b604_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.004438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Write session: try to update token
2025-10-02T09:37:51.004449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.010493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:51.010505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.010510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.010533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:51.010537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:51.010670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:51.010782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.010892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.011006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.011162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:51.011185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:51.016923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3790 sessionId: src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.019147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.019159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.019160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.019161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.019165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.019167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.019169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556313322420624:12460]
2025-10-02T09:37:51.019188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.019190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.019192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.019192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.019194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.019194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.019251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.019312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.082547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692978866:4294]
2025-10-02T09:37:51.082741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3789, pipe: [1:7556556317692978866:4294]
2025-10-02T09:37:51.133364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.133663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.133673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.133686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692978866:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.133824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.133883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692978866:4294]
2025-10-02T09:37:51.133912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.134020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:51.134096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0
2025-10-02T09:37:51.134247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3790 sessionId: src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0 is DEAD
2025-10-02T09:37:51.134360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:51.134370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Write session will restart in 0.006742s
2025-10-02T09:37:51.134385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Write session: Do CDS request
2025-10-02T09:37:51.134389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.141500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.142146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.142248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.142258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3791
2025-10-02T09:37:51.142364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.142395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.142406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.142409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.142709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3791 sessionId:  describe result for acl check
2025-10-02T09:37:51.142732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.142734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.142735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.142739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.143161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.143213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.143314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.143325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.143331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.143357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.143405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388087:12468]
2025-10-02T09:37:51.143751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.143918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.143941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.144116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.144146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.144150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.144153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.144153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.144158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.144164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.144166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.144168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.144170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.144172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.144174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.144176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.144178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.144180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.144182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.144184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.144187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.144191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.144194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.144197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.144199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.144202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.144204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.144206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.144208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.144211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.144213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.144216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.144218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.144221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.144223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.144226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.144229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.144232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.144234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.144237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.144240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.144242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.144244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.144248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.144266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.145257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.149985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.149996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.149998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692978979:3479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.150003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.151629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.153151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.153161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.153163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.153164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.153168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3790 [2:7556556317617388087:12468]
2025-10-02T09:37:51.153175Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.153184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.153185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.153187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.153189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.153198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.153205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.153209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.153239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.153244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.153245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.153247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.153248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.153284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.153289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.153295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.153300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.153311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.153325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692978880:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.153330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979022:3479], now have 1 active actors on pipe
2025-10-02T09:37:51.153334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.153339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.153340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.153348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.153358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.153356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3790
2025-10-02T09:37:51.153369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.153356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3790
2025-10-02T09:37:51.153369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.153372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.153374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.153375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.153399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.153404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.153413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.153420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.153432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.153436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.153440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.153442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.153443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.153448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.153454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.153469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.153566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.153571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.153578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.153636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3791 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0
2025-10-02T09:37:51.153891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d32fdba-71dd1eaf-febc2f29-dd4187b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.156359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Write session: try to update token
2025-10-02T09:37:51.156369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.162619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.162632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.162633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.162634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.162639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.162642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.162644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388082:12468]
2025-10-02T09:37:51.162665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.162668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.162669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.162670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.162674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.162676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.162789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.168302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3791 sessionId: src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.170501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.234091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979030:4294]
2025-10-02T09:37:51.234286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3790, pipe: [1:7556556317692979030:4294]
2025-10-02T09:37:51.272370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.272659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.272668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.272681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979030:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.272845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.272914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:51.272923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979030:4294]
2025-10-02T09:37:51.272949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.273001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3791 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0
2025-10-02T09:37:51.273144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3791 sessionId: src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0 is DEAD
2025-10-02T09:37:51.273331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:51.273343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Write session will restart in 0.005746s
2025-10-02T09:37:51.273361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Write session: Do CDS request
2025-10-02T09:37:51.273366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.280153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.280203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.280297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.280307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3792
2025-10-02T09:37:51.280495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.280518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.280525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.280528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.280862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3792 sessionId:  describe result for acl check
2025-10-02T09:37:51.280891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.280897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.280899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.280903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.281320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.281846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.281948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.281954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.281960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.281987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.282117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388232:12477]
2025-10-02T09:37:51.282462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.282617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.282642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.282634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.282821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.282852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.282856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.282856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.282857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.282857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.282858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.282858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.282860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.282860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.282861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.282864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.282871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.282873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.282875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.282877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.282879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.282881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.282883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.282885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.282887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.282889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.282891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.282895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.282898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.282902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.282904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.282906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.282909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.282911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.282914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.282916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.282919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.282921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.282924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.282927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.282931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.282934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.282937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.282940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.282942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.282944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.282947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.282948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.282951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.282955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.282957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.282973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.287730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.287740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.287742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979128:3497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.287747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.290372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.291863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.291873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.291874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.291876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.291880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3791 [2:7556556317617388232:12477]
2025-10-02T09:37:51.291887Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.291898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.291903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.291904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.291905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.291915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.291919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.291924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.291953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.291958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.291961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.291963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.291964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.292001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.292006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.292012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.292018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.292025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.292039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979167:3497], now have 1 active actors on pipe
2025-10-02T09:37:51.292045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979031:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.292049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.292050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.292051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.292058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.292070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.292072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.292074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.292075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.292080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.292082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.292097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.292101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.292087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3791
2025-10-02T09:37:51.292108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.292088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3791
2025-10-02T09:37:51.292120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.292126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.292144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f621a93-ac386e17-23557ee9-46ed243b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.292150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.292153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.292154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.292159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.292167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.292175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.292279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.292283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.292291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.292360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3792 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f621a93-ac386e17-23557ee9-46ed243b_0
2025-10-02T09:37:51.292582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e28e4a3-6c1f7e75-ba7854b8-7e20c9fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f621a93-ac386e17-23557ee9-46ed243b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.295257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Write session: try to update token
2025-10-02T09:37:51.295273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.301315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.301326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.301329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.301330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.301334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.301336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.301339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388227:12477]
2025-10-02T09:37:51.301357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.301361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.301362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.301365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.301368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.301370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.301473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.307896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3792 sessionId: src_id|3f621a93-ac386e17-23557ee9-46ed243b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.310066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.372841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979178:4294]
2025-10-02T09:37:51.373022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3791, pipe: [1:7556556317692979178:4294]
2025-10-02T09:37:51.413552Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.414003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.414015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.414027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979178:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.414193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:51.414195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979178:4294]
2025-10-02T09:37:51.414208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:51.414222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.414275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3792 reason: error at write: Disconnected sessionId: src_id|3f621a93-ac386e17-23557ee9-46ed243b_0
2025-10-02T09:37:51.414425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3792 sessionId: src_id|3f621a93-ac386e17-23557ee9-46ed243b_0 is DEAD
2025-10-02T09:37:51.414471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.414567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:51.414578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Write session will restart in 0.005630s
2025-10-02T09:37:51.414597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Write session: Do CDS request
2025-10-02T09:37:51.414603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.421123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.421337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.421329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.421341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3793
2025-10-02T09:37:51.421461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.421485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.421492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.421496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.421824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3793 sessionId:  describe result for acl check
2025-10-02T09:37:51.421853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.421857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.421859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.421865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.422265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.422875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.422977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.422984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.422989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.423014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.423038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388381:12480]
2025-10-02T09:37:51.423390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.423555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.423577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.423755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.423785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.423788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.423789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.423789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.423790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.423790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.423791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.423792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.423792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.423792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.423793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.423794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.423797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.423803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.423805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.423807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.423809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.423811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.423813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.423815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.423817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.423819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.423821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.423822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.423826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.423830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.423833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.423836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.423838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.423841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.423843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.423846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.423848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.423851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.423853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.423856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.423858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.423861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.423863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.423865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.423869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.423872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.423874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.423877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.423880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.423883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.423885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.423887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.423903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.424047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.428681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.428691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.428693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979277:3531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.428698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.431279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.432845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.432854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.432855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.432857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.432860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3792 [2:7556556317617388381:12480]
2025-10-02T09:37:51.432868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.432877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.432879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.432880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.432881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.432891Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.432898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.432902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.432934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.432939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.432940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.432942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.432943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.432978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.432982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.432989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.432994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.433002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.433016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979179:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.433020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979315:3531], now have 1 active actors on pipe
2025-10-02T09:37:51.433025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.433030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.433031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.433040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.433050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.433054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.433055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.433056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.433060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.433061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.433075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.433080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.433082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.433078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3792
2025-10-02T09:37:51.433084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3792
2025-10-02T09:37:51.433119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.433124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.433138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.433145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.433151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.433152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.433156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.433165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.433175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.433313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.433323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.433340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.433411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3793 partition: 0 MaxSeqNo: 36 sessionId: src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0
2025-10-02T09:37:51.433654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f621a93-ac386e17-23557ee9-46ed243b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.436205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Write session: try to update token
2025-10-02T09:37:51.436215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.442134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.442147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.442148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.442149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.442152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.442155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.442157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388376:12480]
2025-10-02T09:37:51.442177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.442180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.442181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.442186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.442190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.442192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.442287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.449657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3793 sessionId: src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.451923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.514138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979335:4294]
2025-10-02T09:37:51.514329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3792, pipe: [1:7556556317692979335:4294]
2025-10-02T09:37:51.550728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.551104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.551112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.551124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979335:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.551241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.551326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.551369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979335:4294]
2025-10-02T09:37:51.551391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:51.551486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0
2025-10-02T09:37:51.551632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3793 sessionId: src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0 is DEAD
2025-10-02T09:37:51.551742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:51.551752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Write session will restart in 0.005040s
2025-10-02T09:37:51.551767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Write session: Do CDS request
2025-10-02T09:37:51.551771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.558089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.558209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.558226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3794
2025-10-02T09:37:51.558374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.558400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.558409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.558412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.558807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3794 sessionId:  describe result for acl check
2025-10-02T09:37:51.558840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.558846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.558847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.558853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.559296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.559392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.560890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.561087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.561191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.561197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.561204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.561230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.561256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388518:12483]
2025-10-02T09:37:51.561610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.561778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.561802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.561982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.562013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.562017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.562017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.562018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.562018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.562019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.562019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.562020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.562020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.562021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.562021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.562022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.562025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.562031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.562033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.562035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.562037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.562039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.562041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.562043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.562045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.562048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.562050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.562052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.562055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.562059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.562063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.562065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.562068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.562070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.562072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.562075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.562077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.562080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.562082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.562085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.562087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.562090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.562092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.562094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.562096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.562099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.562101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.562103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.562105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.562108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.562110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.562118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.562134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.564086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.564096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.564098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979433:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.564103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.569726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.571265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.571277Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.571278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.571280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.571284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3793 [2:7556556317617388518:12483]
2025-10-02T09:37:51.571291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.571300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.571305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.571307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.571309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.571327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.571329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.571333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.571363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.571368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.571369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.571371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.571373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.571412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.571417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.571424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.571429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.571439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.571453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979336:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.571459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979474:3539], now have 1 active actors on pipe
2025-10-02T09:37:51.571463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.571464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.571465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.571473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.571481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.571488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.571490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.571490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.571491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.571492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.571505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.571510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.571512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.571523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3793
2025-10-02T09:37:51.571528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3793
2025-10-02T09:37:51.571602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.571607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.571624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.571631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.571633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.571634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.571639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.571648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.571658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.571784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.571789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.571796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.571858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3794 partition: 0 MaxSeqNo: 36 sessionId: src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0
2025-10-02T09:37:51.572181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1843181b-52214c8e-7c0d0c79-86603cfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.574692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Write session: try to update token
2025-10-02T09:37:51.574703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.584673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:51.584687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.584692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.584721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:51.584748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:51.584875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:51.584997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.585113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.585229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:51.585387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:51.585413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:51.587033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3794 sessionId: src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.589367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.589467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.589478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.589479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.589480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.589486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.589490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.589492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388513:12483]
2025-10-02T09:37:51.589514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.589518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.589521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.589522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.589526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.589531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.589534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.589535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.589642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.651391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979484:4294]
2025-10-02T09:37:51.651608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3793, pipe: [1:7556556317692979484:4294]
2025-10-02T09:37:51.701261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.701590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979484:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.701798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.701836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979484:4294]
2025-10-02T09:37:51.701847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:51.701849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:51.701914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3794 reason: error at write: Disconnected sessionId: src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0
2025-10-02T09:37:51.702063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3794 sessionId: src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0 is DEAD
2025-10-02T09:37:51.702140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.702197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:51.702207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Write session will restart in 0.006462s
2025-10-02T09:37:51.702223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Write session: Do CDS request
2025-10-02T09:37:51.702227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.708736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.710143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.710221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.710229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3795
2025-10-02T09:37:51.710354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.710376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.710383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.710386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.710499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.710688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.710696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.710703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.710701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3795 sessionId:  describe result for acl check
2025-10-02T09:37:51.710735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.710735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.710740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.710742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.710759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388656:12485]
2025-10-02T09:37:51.710747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.711101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.711174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.711261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.711282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.711479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.711511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.711514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.711515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.711515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.711516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.711517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.711517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.711518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.711518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.711519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.711519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.711520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.711523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.711529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.711532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.711534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.711535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.711537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.711540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.711541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.711543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.711545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.711547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.711549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.711553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.711557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.711560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.711563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.711565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.711568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.711570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.711572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.711575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.711577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.711579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.711582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.711584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.711587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.711589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.711592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.711595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.711597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.711599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.711603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.711606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.711609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.711614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.711617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.711633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.712739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.716894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.716905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.716912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979586:3586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.716918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.718972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.720341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.720351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.720352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.720355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.720359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3794 [2:7556556317617388656:12485]
2025-10-02T09:37:51.720367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.720377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.720380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.720382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.720383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.720393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.720399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.720405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.720435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.720440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.720441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.720443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.720444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.720481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.720486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.720492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.720501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.720509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.720524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979625:3586], now have 1 active actors on pipe
2025-10-02T09:37:51.720529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979486:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.720532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.720533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.720535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.720542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.720550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.720554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.720556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.720557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.720560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.720562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.720575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.720577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.720569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3794
2025-10-02T09:37:51.720571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3794
2025-10-02T09:37:51.720586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.720602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.720606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.720624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.720632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.720634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.720635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.720641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.720646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.720656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.720751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.720756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.720763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.720835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3795 partition: 0 MaxSeqNo: 36 sessionId: src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0
2025-10-02T09:37:51.721096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddec27f1-bb2f25cf-56aac1f3-88b072ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.723760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Write session: try to update token
2025-10-02T09:37:51.723774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.730885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.730897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.730898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.730899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.730903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.730906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.730908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388651:12485]
2025-10-02T09:37:51.730929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.730932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.730933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.730935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.730938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.730941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.731050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.736864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3795 sessionId: src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.739133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.801898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979632:4294]
2025-10-02T09:37:51.802110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3794, pipe: [1:7556556317692979632:4294]
2025-10-02T09:37:51.841204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.841532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.841541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.841553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979632:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.841679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.841714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.841716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:51.841719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:51.841770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979632:4294]
2025-10-02T09:37:51.841787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3795 reason: error at write: Disconnected sessionId: src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0
2025-10-02T09:37:51.841924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3795 sessionId: src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0 is DEAD
2025-10-02T09:37:51.842043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:51.842051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Write session will restart in 0.009537s
2025-10-02T09:37:51.842067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Write session: Do CDS request
2025-10-02T09:37:51.842072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.849529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.851250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.851356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.851362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.851368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.851393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.851417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388795:12487]
2025-10-02T09:37:51.851759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.851919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.851940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.852112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.852114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.852142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.852148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.852149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.852149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.852150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.852150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.852151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.852151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.852152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.852152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.852153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.852154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.852156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.852163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.852166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.852168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.852169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.852172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.852173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.852175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.852177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.852179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.852181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.852183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.852187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.852191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.852194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.852197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.852199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.852202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.852204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.852206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.852210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.852212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.852214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.852217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.852219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.852222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.852224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.852226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.852228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.852231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.852234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.852237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.852239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.852220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.852231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3796
2025-10-02T09:37:51.852242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.852244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.852246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.852263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.852373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.852396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.852404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.852407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.852760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3796 sessionId:  describe result for acl check
2025-10-02T09:37:51.852795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.852819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.852826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.852833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.853328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.855150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:51.859235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:51.859249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:51.859252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979739:3605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:51.859258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:51.859732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:51.861272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:51.861283Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:51.861284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:51.861286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:51.861290Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3795 [2:7556556317617388795:12487]
2025-10-02T09:37:51.861297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:51.861306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:51.861307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.861309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.861310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.861319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:51.861322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:51.861325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:51.861356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.861361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.861362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.861364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:51.861366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:51.861400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:51.861407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.861414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.861419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.861427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:51.861439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979633:2446], now have 1 active actors on pipe
2025-10-02T09:37:51.861445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979774:3605], now have 1 active actors on pipe
2025-10-02T09:37:51.861449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.861450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.861451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.861459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:51.861466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:51.861471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:51.861473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:51.861474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:51.861476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:51.861478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:51.861492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.861496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:51.861481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3795
2025-10-02T09:37:51.861507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:51.861486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3795
2025-10-02T09:37:51.861529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.861533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.861548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:51.861556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:51.861558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:51.861560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:51.861566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:51.861575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:51.861586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.861703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.861708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.861716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:51.861776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3796 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0
2025-10-02T09:37:51.862016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afac6ef7-b2364138-ae9034b7-b0e079d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:51.864681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Write session: try to update token
2025-10-02T09:37:51.864694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:51.872157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:51.872169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:51.872171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:51.872172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:51.872176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.872178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.872180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388790:12487]
2025-10-02T09:37:51.872201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:51.872204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.872205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:51.872211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:51.872216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:51.872218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:51.872310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:51.877479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3796 sessionId: src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:51.879750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:51.941675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556317692979781:4294]
2025-10-02T09:37:51.941870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3795, pipe: [1:7556556317692979781:4294]
2025-10-02T09:37:51.983074Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:51.983432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:51.983441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:51.983467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979781:4294], now have 1 active actors on pipe
2025-10-02T09:37:51.983623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:51.983674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556317692979781:4294]
2025-10-02T09:37:51.983726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:51.983736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:51.983801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3796 reason: error at write: Disconnected sessionId: src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0
2025-10-02T09:37:51.983989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3796 sessionId: src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0 is DEAD
2025-10-02T09:37:51.984102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:51.984113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Write session will restart in 0.008161s
2025-10-02T09:37:51.984129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Write session: Do CDS request
2025-10-02T09:37:51.984138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:51.984483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:51.991515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:51.993081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:51.993163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.993185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:51.993191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:51.993197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:51.993223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:51.993245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556317617388934:12489]
2025-10-02T09:37:51.993276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:51.993288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3797
2025-10-02T09:37:51.993398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:51.993422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:51.993428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:51.993432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:51.993589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:51.993754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:51.993775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:51.993775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3797 sessionId:  describe result for acl check
2025-10-02T09:37:51.993804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:51.993809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:51.993810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:51.993814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:51.993953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:51.993984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.993988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.993989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.993989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.993990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.993990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.993992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.993992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.993993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.993993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.993996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.994003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.994005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.994007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.994009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.994011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.994013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.994015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.994017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.994019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.994021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.994023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.994027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.994031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:51.994034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.994037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:51.994039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.994042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:51.994044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.994047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:51.994049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.994052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:51.994054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.994057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:51.994059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.994061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:51.994063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.994066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:51.994068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.994076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:51.994078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.994080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:51.994082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.994085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:51.994087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.994090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:51.994106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:51.994234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:51.995888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.000354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.000363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.000366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556317692979893:3647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.000370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.001509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.002975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.002984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.002986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.002987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.002991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3796 [2:7556556317617388934:12489]
2025-10-02T09:37:52.002999Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.003008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.003009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.003012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.003013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.003022Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.003029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.003033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.003064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.003069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.003070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.003071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.003072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.003105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.003110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.003116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.003125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.003136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.003150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979930:3647], now have 1 active actors on pipe
2025-10-02T09:37:52.003155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556317692979789:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.003158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.003160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.003161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.003169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.003179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.003182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.003184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.003185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.003189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.003190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.003203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.003198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3796
2025-10-02T09:37:52.003204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3796
2025-10-02T09:37:52.003212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.003218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.003235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.003240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.003255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0a510a0-906fb095-f9af83fc-6262a740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.003262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.003267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.003268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.003273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.003278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.003287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.003413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.003418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.003425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.003488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3797 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0a510a0-906fb095-f9af83fc-6262a740_0
2025-10-02T09:37:52.003754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c92c9ef-f9d6451b-a0a49275-aeb599f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0a510a0-906fb095-f9af83fc-6262a740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.006262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Write session: try to update token
2025-10-02T09:37:52.006274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.012321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.012332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.012334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.012335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.012339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.012341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.012345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556317617388929:12489]
2025-10-02T09:37:52.012365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.012371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.012373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.012372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.012376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.012379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.012500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.017521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3797 sessionId: src_id|f0a510a0-906fb095-f9af83fc-6262a740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.019752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.084022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987947237:4294]
2025-10-02T09:37:52.084211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3796, pipe: [1:7556556321987947237:4294]
2025-10-02T09:37:52.121904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.122273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.122283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.122294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947237:4294], now have 1 active actors on pipe
2025-10-02T09:37:52.122437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.122474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987947237:4294]
2025-10-02T09:37:52.122499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.122503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:52.122596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3797 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0a510a0-906fb095-f9af83fc-6262a740_0
2025-10-02T09:37:52.122750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3797 sessionId: src_id|f0a510a0-906fb095-f9af83fc-6262a740_0 is DEAD
2025-10-02T09:37:52.122882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:52.122893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Write session will restart in 0.007663s
2025-10-02T09:37:52.122910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Write session: Do CDS request
2025-10-02T09:37:52.122914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.129539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.131168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.131239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.131277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.131288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3798
2025-10-02T09:37:52.131348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.131353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.131359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.131385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.131420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.131430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912356371:12491]
2025-10-02T09:37:52.131443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.131450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.131454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.131777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.131806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3798 sessionId:  describe result for acl check
2025-10-02T09:37:52.131838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.131842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.131844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.131848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.131956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.131981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.132159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.132187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.132191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.132192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.132192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.132193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.132193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.132194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.132194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.132195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.132195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.132196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.132196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.132199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.132206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.132208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.132210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.132212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.132214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.132216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.132218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.132220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.132222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.132224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.132226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.132230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.132234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.132237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.132239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.132242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.132244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.132246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.132249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.132251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.132254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.132255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.132258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.132260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.132263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.132265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.132267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.132269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.132272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.132276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.132282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.132284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.132288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.132293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.132296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.132312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.132317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.133620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.137598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.137608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.137611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987947341:3649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.137616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.139690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.141200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.141210Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.141211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.141213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.141217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3797 [2:7556556321912356371:12491]
2025-10-02T09:37:52.141226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.141235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.141236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.141238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.141239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.141248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.141254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.141258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.141291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.141295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.141296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.141298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.141300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.141334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.141338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.141345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.141350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.141358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.141372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947238:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.141377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947380:3649], now have 1 active actors on pipe
2025-10-02T09:37:52.141382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.141383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.141384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.141392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.141401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.141403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.141405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.141406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.141410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.141411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.141425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.141429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.141430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.141432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3797
2025-10-02T09:37:52.141445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3797
2025-10-02T09:37:52.141465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.141470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.141486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.141493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.141495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.141496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.141501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.141508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.141517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.141632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.141636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.141644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.141701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3798 partition: 0 MaxSeqNo: 36 sessionId: src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0
2025-10-02T09:37:52.141902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0a510a0-906fb095-f9af83fc-6262a740_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.144506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Write session: try to update token
2025-10-02T09:37:52.144520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.150402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.150413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.150414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.150415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.150420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.150422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.150424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912356366:12491]
2025-10-02T09:37:52.150443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.150448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.150449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.150450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.150451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.150452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.150554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.157267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3798 sessionId: src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.159521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.222778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987947410:4294]
2025-10-02T09:37:52.222961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3797, pipe: [1:7556556321987947410:4294]
2025-10-02T09:37:52.258473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.258835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.258844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.258855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947410:4294], now have 1 active actors on pipe
2025-10-02T09:37:52.258959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.258995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987947410:4294]
2025-10-02T09:37:52.259016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.259023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:52.259101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3798 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0
2025-10-02T09:37:52.259253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3798 sessionId: src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0 is DEAD
2025-10-02T09:37:52.259371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:52.259378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Write session will restart in 0.007439s
2025-10-02T09:37:52.259396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Write session: Do CDS request
2025-10-02T09:37:52.259400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.266709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.268121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.268269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.268277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3799
2025-10-02T09:37:52.268483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.268486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.268505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.268512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.268514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.268592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.268598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.268604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.268628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.268654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912356551:12506]
2025-10-02T09:37:52.268875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3799 sessionId:  describe result for acl check
2025-10-02T09:37:52.268908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.268914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.268916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.268922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.269025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.269194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.269219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.269357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.269396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.269424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.269428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.269429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.269429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.269430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.269431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.269431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.269432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.269432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.269433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.269433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.269434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.269437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.269444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.269446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.269448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.269450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.269452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.269454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.269456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.269458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.269460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.269462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.269464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.269468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.269472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.269475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.269478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.269480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.269482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.269484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.269487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.269489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.269492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.269494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.269497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.269499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.269502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.269504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.269506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.269509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.269512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.269515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.269517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.269520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.269522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.269526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.269528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.269547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.271356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.275750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.275760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.275762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987947515:3716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.275767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.276880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.278451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.278453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.278456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.278460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3798 [2:7556556321912356551:12506]
2025-10-02T09:37:52.278470Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.278483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.278491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.278493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.278494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.278505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.278513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.278518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.278563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.278568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.278569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.278571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.278572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.278606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.278611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.278618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.278623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.278634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.278648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947554:3716], now have 1 active actors on pipe
2025-10-02T09:37:52.278653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947411:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.278657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.278658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.278659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.278667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.278678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.278680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.278682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.278684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.278688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.278690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.278704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.278711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.278701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3798
2025-10-02T09:37:52.278716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.278707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3798
2025-10-02T09:37:52.278766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.278771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.278786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.278793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.278795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.278796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.278801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.278807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.278816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.278931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.278937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.278944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.279003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3799 partition: 0 MaxSeqNo: 36 sessionId: src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0
2025-10-02T09:37:52.279206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36b71f8-4c693a96-d58a333e-91ce2963_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.281669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Write session: try to update token
2025-10-02T09:37:52.281682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.287734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.287744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.287745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.287746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.287751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.287754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.287756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912356546:12506]
2025-10-02T09:37:52.287775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.287778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.287779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.287780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.287785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.287786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.287892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.294464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3799 sessionId: src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.296546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.358951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987947562:4294]
2025-10-02T09:37:52.359152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3798, pipe: [1:7556556321987947562:4294]
2025-10-02T09:37:52.396859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.397223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.397232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.397244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947562:4294], now have 1 active actors on pipe
2025-10-02T09:37:52.397379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.397423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:52.397437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:52.397446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.397495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987947562:4294]
2025-10-02T09:37:52.397504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3799 reason: error at write: Disconnected sessionId: src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0
2025-10-02T09:37:52.397648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3799 sessionId: src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0 is DEAD
2025-10-02T09:37:52.397796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:52.397805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Write session will restart in 0.006149s
2025-10-02T09:37:52.397833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Write session: Do CDS request
2025-10-02T09:37:52.397840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.404976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.405190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.405241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.405253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3800
2025-10-02T09:37:52.405337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.405359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.405366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.405369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.405769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3800 sessionId:  describe result for acl check
2025-10-02T09:37:52.405802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.405809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.405811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.405814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.406236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.406938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.407041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.407047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.407053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.407080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.407104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912356705:12509]
2025-10-02T09:37:52.407453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.407609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.407631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.407643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.407806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.407977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.407983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.407983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.407984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.407985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.407985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.407985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.407986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.407987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.407987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.407988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.407988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.407992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.407998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.408000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.408004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.408006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.408008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.408010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.408014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.408016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.408018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.408022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.408026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.408031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.408034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.408036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.408041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.408043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.408046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.408048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.408050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.408054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.408057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.408059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.408061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.408063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.408065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.408068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.408070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.408073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.408075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.408077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.408079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.408082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.408098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.411960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.411970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.411973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987947670:3738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.411978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.415521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.417043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.417053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.417054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.417056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.417060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3799 [2:7556556321912356705:12509]
2025-10-02T09:37:52.417069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.417078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.417080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.417082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.417083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.417091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.417097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.417102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.417132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.417137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.417138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.417140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.417141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.417176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.417181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.417187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.417192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.417203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.417218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947565:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.417223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947709:3738], now have 1 active actors on pipe
2025-10-02T09:37:52.417227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.417228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.417229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.417236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.417245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.417252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.417253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.417255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.417260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.417262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.417268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.417269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.417271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.417285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3799
2025-10-02T09:37:52.417294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3799
2025-10-02T09:37:52.417329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.417334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.417350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.417357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.417358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.417359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.417365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.417372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.417380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.417504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.417509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.417516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.417581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3800 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0
2025-10-02T09:37:52.417793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabb3258-aea2cd14-b8b50153-ef5581e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.420232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Write session: try to update token
2025-10-02T09:37:52.420244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.426276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.426287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.426288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.426289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.426292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.426294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.426296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912356700:12509]
2025-10-02T09:37:52.426315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.426316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.426319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.426319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.426320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.426323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.426504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.432662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3800 sessionId: src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.434769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.497708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987947728:4294]
2025-10-02T09:37:52.497918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3799, pipe: [1:7556556321987947728:4294]
2025-10-02T09:37:52.535370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.535665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.535673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.535686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947728:4294], now have 1 active actors on pipe
2025-10-02T09:37:52.535892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.535945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987947728:4294]
2025-10-02T09:37:52.535969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.535977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:52.536052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0
2025-10-02T09:37:52.536213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3800 sessionId: src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0 is DEAD
2025-10-02T09:37:52.536336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:52.536346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Write session will restart in 0.006500s
2025-10-02T09:37:52.536365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Write session: Do CDS request
2025-10-02T09:37:52.536370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.544284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.544350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.544367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3801
2025-10-02T09:37:52.544699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.544728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.544735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.544740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.545151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3801 sessionId:  describe result for acl check
2025-10-02T09:37:52.545185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.545190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.545194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.545198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.545734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.547403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.547506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.549236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.549365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.549372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.549378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.549407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.549430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912356852:12512]
2025-10-02T09:37:52.549449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.549459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.549462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987947789:3755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.549467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.549784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.549951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.549974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.550154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.550184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.550188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.550188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.550189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.550190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.550190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.550191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.550191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.550192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.550192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.550193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.550193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.550196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.550202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.550204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.550206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.550208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.550211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.550213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.550215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.550217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.550219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.550221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.550223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.550227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.550231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.550234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.550237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.550240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.550242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.550244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.550247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.550249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.550252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.550254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.550257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.550262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.550265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.550271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.550273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.550276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.550280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.550286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.550288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.550292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.550297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.550300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.550302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.550322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.559791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.561336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.561349Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.561350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.561352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.561356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3800 [2:7556556321912356852:12512]
2025-10-02T09:37:52.561364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.561375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.561376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.561378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.561379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.561389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.561392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.561397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.561430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.561440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.561441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.561443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.561444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.561549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.561554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.561561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.561567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.561582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.561572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3800
2025-10-02T09:37:52.561598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947871:3755], now have 1 active actors on pipe
2025-10-02T09:37:52.561577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3800
2025-10-02T09:37:52.561604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947730:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.561608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.561609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.561610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.561617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.561629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.561631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.561637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.561638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.561639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.561641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.561651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.561656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.561680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.561687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.561695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.561696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.561702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.561705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.561706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.561711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.561717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.561738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.561852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.561858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.561872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.561936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3801 partition: 0 MaxSeqNo: 36 sessionId: src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0
2025-10-02T09:37:52.562194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8b58b1-77fc95cf-eca11430-7097c7b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.564742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Write session: try to update token
2025-10-02T09:37:52.564752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.573506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.573518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.573519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.573521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.573526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.573528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.573532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912356846:12512]
2025-10-02T09:37:52.573554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.573556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.573559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.573560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.573561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.573562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.573686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.579852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3801 sessionId: src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.582152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.635952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987947882:4294]
2025-10-02T09:37:52.636184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3800, pipe: [1:7556556321987947882:4294]
2025-10-02T09:37:52.684983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.685545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.685554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.685581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947882:4294], now have 1 active actors on pipe
2025-10-02T09:37:52.685748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.685779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.685787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:52.685791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:52.685796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987947882:4294]
2025-10-02T09:37:52.685813Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:37:52.685866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3801 reason: error at write: Disconnected sessionId: src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0
2025-10-02T09:37:52.685927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3801 sessionId: src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0 is DEAD
2025-10-02T09:37:52.686008Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 38 consumer shared/user session shared/user_1_38_17833371258278499700_v1 is DEAD
2025-10-02T09:37:52.686145Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:37:52.686228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:52.686237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Write session will restart in 0.008026s
2025-10-02T09:37:52.686237Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556261858390993:4318] disconnected; active server actors: 1
2025-10-02T09:37:52.686253Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:52.686256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Write session: Do CDS request
2025-10-02T09:37:52.686244Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556261858390993:4318] client user disconnected session shared/user_1_38_17833371258278499700_v1
2025-10-02T09:37:52.686262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.686259Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:37:52.686275Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008317s
2025-10-02T09:37:52.693641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.695073Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:37:52.695126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.695302Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:37:52.695310Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 39
2025-10-02T09:37:52.695309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.695316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3802
2025-10-02T09:37:52.695385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.695463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.695486Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 39 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:52.695496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.695492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.695501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.695506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.695498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.695504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.695530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.695532Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:37:52.695551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912356996:12514]
2025-10-02T09:37:52.695616Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 auth for : user
2025-10-02T09:37:52.695727Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 Handle describe topics response
2025-10-02T09:37:52.695748Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 auth is DEAD
2025-10-02T09:37:52.695763Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:37:52.695804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3802 sessionId:  describe result for acl check
2025-10-02T09:37:52.695827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.695832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.695833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.695837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.695898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.695957Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:37:52.696009Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556556321987947995:3766] connected; active server actors: 1
2025-10-02T09:37:52.696017Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556556321987947995:3766] session shared/user_1_39_1223468248787352148_v1
2025-10-02T09:37:52.696024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:37:52.696034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:37:52.696044Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_39_1223468248787352148_v1
2025-10-02T09:37:52.696039Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_39_1223468248787352148_v1" (Sender=[1:7556556321987947989:3766], Pipe=[1:7556556321987947995:3766], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:52.696078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.696044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:37:52.696101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.696052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:37:52.696059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_39_1223468248787352148_v1" (Sender=[1:7556556321987947989:3766], Pipe=[1:7556556321987947995:3766], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:37:52.696066Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_39_1223468248787352148_v1" sender [1:7556556321987947989:3766] lock partition 0 for ReadingSession "shared/user_1_39_1223468248787352148_v1" (Sender=[1:7556556321987947989:3766], Pipe=[1:7556556321987947995:3766], Partitions=[], ActiveFamilyCount=1) generation 1 step 39
2025-10-02T09:37:52.696073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:37:52.696076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:37:52.696214Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 39 Session: "shared/user_1_39_1223468248787352148_v1" ClientId: "user" PipeClient { RawX1: 7556556321987947995 RawX2: 4503603922341558 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:37:52.696239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:37:52.696239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.696430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.696472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.696476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.696477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.696477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.696478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.696478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.696479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.696479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.696480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.696480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.696481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.696481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.696484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.696490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.696492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.696494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.696496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.696498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.696500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.696502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.696504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.696506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.696508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.696510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.696514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.696518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.696521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.696524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.696526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.696529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.696531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.696534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.696536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.696538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.696540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.696544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.696547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.696549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.696551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.696554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.696556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.696558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.696560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.696563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.696565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.696567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.696569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.696571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.696588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.697832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.703287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.703298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.703301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987947994:3770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.703306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.705827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.707222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.707233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.707234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.707236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.707240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3801 [2:7556556321912356996:12514]
2025-10-02T09:37:52.707246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.707255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.707261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.707263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.707264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.707272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.707275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.707283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.707314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.707319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.707320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.707323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.707333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.707367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.707372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.707378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.707383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.707391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.707400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.707404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.707407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.707412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.707418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.707420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.707424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.707425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.707427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.707429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.707436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948037:3770], now have 1 active actors on pipe
2025-10-02T09:37:52.707438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987947884:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.707440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948001:3784], now have 1 active actors on pipe
2025-10-02T09:37:52.707452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.707459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.707468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.707482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3801
2025-10-02T09:37:52.707484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3801
2025-10-02T09:37:52.707504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3801, pipe: [1:7556556321987948001:3784]
2025-10-02T09:37:52.707539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.707545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.707558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.707562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.707565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_39_1223468248787352148_v1 on pipe: [1:7556556321987948001:3784]
2025-10-02T09:37:52.707583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.707589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.707591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.707592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.707594Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_39_1223468248787352148_v1:1 with generation 3801
2025-10-02T09:37:52.707597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.707602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.707609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.707614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.707615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.707622Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_39_1223468248787352148_v1
2025-10-02T09:37:52.707625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.707637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.707649Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:37:52.707748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.707752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.707761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.707806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3802 partition: 0 MaxSeqNo: 36 sessionId: src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0
2025-10-02T09:37:52.708013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dfc03d6-b50d75be-e661285a-ea80c04a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.710562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Write session: try to update token
2025-10-02T09:37:52.710572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.712190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:37:52.712208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:37:52.712212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.712213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.712214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.712218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:37:52.712224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:37:52.712320Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397872707 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:37:52.712337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:37:52.712361Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 sending to client partition status
2025-10-02T09:37:52.722651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:52.722661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.722666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.722691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:52.722691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:52.722886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:52.722965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3802 sessionId: src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.723004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:52.723124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:52.723271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:52.723440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:52.723468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:52.725183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.725453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.725461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.725477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:52.725539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:52.729210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.729221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.729222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.729223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.729227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.729229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.729234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912356991:12514]
2025-10-02T09:37:52.729253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.729255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.729258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.729260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.729260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.729261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.729386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.841916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.848699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.848718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.848857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.848910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.848974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.849027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.849068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.849075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.849135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.849186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.849246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.849302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.849340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.849349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.849404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.849456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.849515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.849572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.849609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.849614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.849668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.849726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.849782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.849832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.849873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.849878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.849930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.849991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.850053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.850128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.850172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.850177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.850246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.850302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.850369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.850419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.850467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.850474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.850542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.850594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.850684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.850743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.850803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.850808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.850866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.850921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.850974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.851039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.851094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.851101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.851161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.851213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.851274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.851331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.851372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.851377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.851432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:52.851481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:52.851539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:52.851590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:52.851631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:52.851635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:52.851824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:52.851824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:52.851828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:52.851857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3802 reason: error at write: Disconnected sessionId: src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0
2025-10-02T09:37:52.851886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987948001:3784]
2025-10-02T09:37:52.852007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3802 sessionId: src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0 is DEAD
2025-10-02T09:37:52.852113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:52.852121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Write session will restart in 0.009140s
2025-10-02T09:37:52.852135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Write session: Do CDS request
2025-10-02T09:37:52.852139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:52.852319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_39_1223468248787352148_v1
2025-10-02T09:37:52.852332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:52.852349Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_39_1223468248787352148_v1
2025-10-02T09:37:52.859595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:52.861288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:52.861392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:52.861399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:52.861404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:52.861430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:52.861453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556321912357145:12516]
2025-10-02T09:37:52.861817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:52.861992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:52.862023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:52.862095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.862206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:52.862194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:52.862210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3803
2025-10-02T09:37:52.862234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.862238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.862239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.862239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.862240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.862240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.862241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.862242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.862242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.862242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.862243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.862244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.862248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.862257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.862261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.862264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.862268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.862274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.862276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.862278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.862280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.862283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.862288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.862289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.862294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.862298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:52.862301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.862303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:52.862306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.862308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:52.862313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.862316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:52.862318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.862321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:52.862326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.862329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:52.862331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.862334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:52.862322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:52.862336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.862342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:52.862344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.862347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:52.862349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.862352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.862346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:52.862359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.862361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.862364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.862356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:52.862366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.862359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:52.862383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:52.862768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3803 sessionId:  describe result for acl check
2025-10-02T09:37:52.862811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:52.862818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:52.862820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:52.862825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:52.863268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:52.865386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:52.870358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:52.870370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:52.870373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556321987948158:3805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:52.870378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:52.871746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:52.873136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:52.873147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:52.873148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:52.873150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:52.873154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3802 [2:7556556321912357145:12516]
2025-10-02T09:37:52.873161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:52.873171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:52.873173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.873174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.873176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.873184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:52.873191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:52.873195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:52.873224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.873229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.873230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.873231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:52.873233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:52.873274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:52.873282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.873291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:52.873303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:52.873315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:52.873330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948194:3805], now have 1 active actors on pipe
2025-10-02T09:37:52.873335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948046:2446], now have 1 active actors on pipe
2025-10-02T09:37:52.873339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.873340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.873341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.873349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:52.873360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:52.873363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:52.873365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:52.873367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:52.873370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:52.873372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:52.873386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.873391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:52.873376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3802
2025-10-02T09:37:52.873377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3802
2025-10-02T09:37:52.873405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:52.873411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.873413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.873430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:52.873433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:52.873435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:52.873436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:52.873442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:52.873447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:52.873454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.873564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.873571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.873581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:52.873652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3803 partition: 0 MaxSeqNo: 36 sessionId: src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0
2025-10-02T09:37:52.873897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95f4f0f-7c6969a2-f4dacc0c-1da7014b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:52.876351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Write session: try to update token
2025-10-02T09:37:52.876361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:52.884993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:52.885005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:52.885007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:52.885008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:52.885013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.885017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.885020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556321912357140:12516]
2025-10-02T09:37:52.885045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:52.885049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:52.885052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:52.885053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:52.885053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:52.885055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:52.885169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:52.888534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3803 sessionId: src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:52.890856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:52.951865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556321987948201:3784]
2025-10-02T09:37:52.952072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3802, pipe: [1:7556556321987948201:3784]
2025-10-02T09:37:52.999365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:52.999717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:52.999728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:52.999755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948201:3784], now have 1 active actors on pipe
2025-10-02T09:37:52.999969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556321987948201:3784]
2025-10-02T09:37:52.999975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:52.999979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:53.000005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.000061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3803 reason: error at write: Disconnected sessionId: src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0
2025-10-02T09:37:53.000233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3803 sessionId: src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0 is DEAD
2025-10-02T09:37:53.000351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.000370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:53.000379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Write session will restart in 0.009252s
2025-10-02T09:37:53.000398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Write session: Do CDS request
2025-10-02T09:37:53.000402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.008109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.009787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.009889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.009895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.009901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.009928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.009952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207324588:12518]
2025-10-02T09:37:53.010168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.010266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.010283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3804
2025-10-02T09:37:53.010327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.010406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.010431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.010440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.010444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.010516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.010544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.010740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.010776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.010780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.010781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.010781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.010782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.010782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.010783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.010783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.010784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.010785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.010785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.010786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.010789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.010795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.010797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.010800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.010802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.010804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.010806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.010808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.010810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.010812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.010814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.010816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.010820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.010824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.010827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.010830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.010834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.010836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.010805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3804 sessionId:  describe result for acl check
2025-10-02T09:37:53.010838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.010840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.010841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.010845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.010847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.010841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.010850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.010852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.010854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.010857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.010859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.010843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.010847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.010861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.010864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.010866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.010868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.010871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.010873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.010876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.010878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.010881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.010899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.011307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.012767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.017735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.017746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.017771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282915614:3812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.017780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.020371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.021832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.021844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.021845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.021847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.021850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3803 [2:7556556326207324588:12518]
2025-10-02T09:37:53.021856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.021867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.021872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.021874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.021875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.021884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.021887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.021895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.021925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.021929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.021930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.021932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.021933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.021970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.021975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.021982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.021987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.022005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.022023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915652:3812], now have 1 active actors on pipe
2025-10-02T09:37:53.022029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556321987948207:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.022033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.022034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.022037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.022044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.022054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.022049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3803
2025-10-02T09:37:53.022060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3803
2025-10-02T09:37:53.022058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.022062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.022063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.022067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.022068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.022077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.022078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.022081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.022099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.022104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.022120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.022127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.022130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.022131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.022136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.022144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.022154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.022272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.022279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.022288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.022352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3804 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0
2025-10-02T09:37:53.022593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95226a2b-ad7b48da-49d85a1f-e722bfb9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.025010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Write session: try to update token
2025-10-02T09:37:53.025020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.033849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.033860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.033862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.033863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.033867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.033869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.033872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207324583:12518]
2025-10-02T09:37:53.033892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.033895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.033897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.033900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.033903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.033905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.034007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.036838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3804 sessionId: src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.039091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.100320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282915662:3784]
2025-10-02T09:37:53.100554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3803, pipe: [1:7556556326282915662:3784]
2025-10-02T09:37:53.145521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.145727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.145736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.145760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915662:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.145901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.145957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:53.145976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282915662:3784]
2025-10-02T09:37:53.145998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.146045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0
2025-10-02T09:37:53.146193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3804 sessionId: src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0 is DEAD
2025-10-02T09:37:53.146339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:53.146350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Write session will restart in 0.005420s
2025-10-02T09:37:53.146366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Write session: Do CDS request
2025-10-02T09:37:53.146371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.153147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.153341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.153354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3805
2025-10-02T09:37:53.153467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.153490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.153498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.153501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.153812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3805 sessionId:  describe result for acl check
2025-10-02T09:37:53.153835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.153840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.153841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.153845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.153848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.154279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.155693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.155798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.155804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.155809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.155836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.155861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207324735:12520]
2025-10-02T09:37:53.156222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.156226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.156407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.156440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.156634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.156674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.156679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.156679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.156680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.156680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.156681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.156681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.156682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.156682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.156683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.156683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.156684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.156687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.156693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.156696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.156698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.156700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.156702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.156703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.156705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.156707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.156709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.156711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.156713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.156717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.156721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.156724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.156727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.156730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.156732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.156735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.156737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.156740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.156743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.156745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.156748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.156750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.156753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.156755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.156759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.156762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.156767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.156771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.156774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.156776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.156779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.156781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.156783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.156811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.161602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.161614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.161617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282915772:3839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.161624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.165846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.167488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.167497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.167498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.167500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.167503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3804 [2:7556556326207324735:12520]
2025-10-02T09:37:53.167512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.167521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.167525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.167527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.167528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.167537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.167543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.167547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.167577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.167582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.167583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.167586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.167587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.167622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.167627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.167634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.167639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.167650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.167667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915663:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.167676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.167681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.167683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.167689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.167696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.167698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.167698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915812:3839], now have 1 active actors on pipe
2025-10-02T09:37:53.167699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.167703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.167710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.167715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.167728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.167724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3804
2025-10-02T09:37:53.167736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.167726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3804
2025-10-02T09:37:53.167751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.167771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.167776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.167789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.167796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.167798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.167799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.167805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.167813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.167822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.167947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.167954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.167963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.168030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3805 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0
2025-10-02T09:37:53.168266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f09b7c-c60c63bb-117cf218-ba6921f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.170768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Write session: try to update token
2025-10-02T09:37:53.170777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.177154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:53.177165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.177170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.177191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:53.177198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:53.177330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:53.177462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.177584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.177711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.177866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:53.177892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:53.182183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3805 sessionId: src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.184616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.184738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.184747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.184763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:53.184825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:53.185842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.185855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.185857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.185858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.185863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.185866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.185868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207324730:12520]
2025-10-02T09:37:53.185888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.185889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.185892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.185893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.185894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.185897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.186003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.246250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282915842:3784]
2025-10-02T09:37:53.246438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3804, pipe: [1:7556556326282915842:3784]
2025-10-02T09:37:53.297354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.304039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.304059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.304208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.304267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.304323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.304383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.304426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.304433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.304487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.304537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.304589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.304655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.304694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.304700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.304752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.304816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.304874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.304936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.304975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.304983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.305037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.305087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.305143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.305198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.305238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.305243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.305298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.305350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.305417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.305477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.305516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.305521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.305582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.305633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.305691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.305744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.305785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.305790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.305852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.305911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.305974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.306032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.306076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.306081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.306140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.306204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.306261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.306317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.306357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.306362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.306424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.306482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.306538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.306589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.306626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.306631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.306693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:53.306743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:53.306795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:53.306844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:53.306886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:53.306890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:53.306921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915842:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.307131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:53.307143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:53.307157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.307169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3805 reason: error at write: Disconnected sessionId: src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0
2025-10-02T09:37:53.307208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282915842:3784]
2025-10-02T09:37:53.307325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3805 sessionId: src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0 is DEAD
2025-10-02T09:37:53.307464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:53.307474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Write session will restart in 0.005488s
2025-10-02T09:37:53.307489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Write session: Do CDS request
2025-10-02T09:37:53.307494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.307516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.314206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.314276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.314286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3806
2025-10-02T09:37:53.314379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.314401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.314408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.314411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.314752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3806 sessionId:  describe result for acl check
2025-10-02T09:37:53.314786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.314790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.314792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.314796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.315232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.316034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.317300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.317723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.317827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.317833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.317838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.317864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.317892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207324922:12535]
2025-10-02T09:37:53.318260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.318446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.318478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.318668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.318700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.318705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.318706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.318707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.318708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.318709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.318710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.318711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.318712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.318713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.318714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.318715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.318719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.318726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.318728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.318730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.318732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.318734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.318736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.318739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.318741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.318743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.318745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.318747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.318751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.318754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.318758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.318761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.318763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.318765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.318767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.318770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.318772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.318775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.318777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.318780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.318782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.318785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.318788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.318790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.318792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.318795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.318800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.318803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.318805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.318812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.318814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.318817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.318834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.321296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.321308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.321311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282915951:3866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.321315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.327623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.329226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.329237Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.329238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.329240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.329243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3805 [2:7556556326207324922:12535]
2025-10-02T09:37:53.329253Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.329261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.329266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.329268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.329269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.329276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.329282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.329287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.329319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.329324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.329325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.329327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.329328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.329363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.329368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.329374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.329380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.329387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.329400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915993:3866], now have 1 active actors on pipe
2025-10-02T09:37:53.329406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282915843:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.329409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.329410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.329411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.329419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.329426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.329432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.329435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.329435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.329436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.329436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.329451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.329456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.329457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.329465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3805
2025-10-02T09:37:53.329476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3805
2025-10-02T09:37:53.329498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.329504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.329520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.329524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.329526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.329527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.329532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.329537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.329548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.329745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3806 partition: 0 MaxSeqNo: 36 sessionId: src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0
2025-10-02T09:37:53.329966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e6ad2d-69fe53a1-219c4a47-381d0262_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.329666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.329672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.329682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.332616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Write session: try to update token
2025-10-02T09:37:53.332631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.339015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.339026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.339027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.339028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.339031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.339034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.339035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207324917:12535]
2025-10-02T09:37:53.339053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.339056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.339057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.339057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.339059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.339061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.339162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.344751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3806 sessionId: src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.346930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.407519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282916003:3784]
2025-10-02T09:37:53.407714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3805, pipe: [1:7556556326282916003:3784]
2025-10-02T09:37:53.451205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.451619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.451629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.451642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916003:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.451822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.451869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:53.451874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:53.451873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282916003:3784]
2025-10-02T09:37:53.451940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3806 reason: error at write: Disconnected sessionId: src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0
2025-10-02T09:37:53.452103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3806 sessionId: src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0 is DEAD
2025-10-02T09:37:53.452247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:53.452253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Write session will restart in 0.007933s
2025-10-02T09:37:53.452273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Write session: Do CDS request
2025-10-02T09:37:53.452278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.452404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.461198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.461304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.461314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3807
2025-10-02T09:37:53.461436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.461466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.461476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.461480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.461450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.461736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.461842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.461849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.461855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.461876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3807 sessionId:  describe result for acl check
2025-10-02T09:37:53.461883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.461906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.461915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.461917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.461908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207325086:12539]
2025-10-02T09:37:53.461923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.462281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.462390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.462456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.462482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.462679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.462712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.462716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.462716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.462717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.462717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.462718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.462718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.462719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.462719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.462720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.462720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.462721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.462723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.462730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.462732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.462735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.462737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.462739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.462741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.462743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.462745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.462747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.462749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.462751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.462755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.462759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.462762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.462765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.462767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.462770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.462772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.462775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.462777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.462781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.462784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.462786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.462788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.462791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.462793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.462796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.462798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.462801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.462803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.462806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.462808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.462811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.462813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.462816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.462847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.463834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.469084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.469095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.469098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282916116:3896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.469105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.471503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.472994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.473005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.473006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.473009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.473012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3806 [2:7556556326207325086:12539]
2025-10-02T09:37:53.473020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.473030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.473035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.473036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.473037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.473046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.473052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.473057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.473103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.473108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.473109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.473111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.473112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.473148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.473153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.473160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.473165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.473177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.473191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916004:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.473197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916155:3896], now have 1 active actors on pipe
2025-10-02T09:37:53.473200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.473202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.473203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.473210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.473223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.473223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.473225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.473226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.473233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.473235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.473248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.473241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3806
2025-10-02T09:37:53.473256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.473260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.473278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.473280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.473245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3806
2025-10-02T09:37:53.473297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.473304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.473306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.473307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.473311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.473319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.473332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.473433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.473438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.473446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.473509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3807 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0
2025-10-02T09:37:53.473767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a8aaa4-be8c47d2-b0f89dc4-27bcb53f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.476282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Write session: try to update token
2025-10-02T09:37:53.476297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.482820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.482831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.482832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.482833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.482836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.482839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.482841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207325081:12539]
2025-10-02T09:37:53.482860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.482864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.482864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.482865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.482867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.482869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.482977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.489726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3807 sessionId: src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.491872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.551920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282916175:3784]
2025-10-02T09:37:53.552147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3806, pipe: [1:7556556326282916175:3784]
2025-10-02T09:37:53.595977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.596513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.596523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.596536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916175:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.596699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.596738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.596760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282916175:3784]
2025-10-02T09:37:53.596780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:53.596878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3807 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0
2025-10-02T09:37:53.597030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3807 sessionId: src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0 is DEAD
2025-10-02T09:37:53.597166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:53.597175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Write session will restart in 0.007193s
2025-10-02T09:37:53.597196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Write session: Do CDS request
2025-10-02T09:37:53.597202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.603845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.605154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.605229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.605240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3808
2025-10-02T09:37:53.605323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.605346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.605354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.605357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.605518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.605654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.605660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.605667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.605703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.605699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3808 sessionId:  describe result for acl check
2025-10-02T09:37:53.605728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207325237:12541]
2025-10-02T09:37:53.605733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.605738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.605740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.605745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.606075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.606178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.606254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.606282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.606480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.606515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.606519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.606520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.606520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.606521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.606521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.606522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.606522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.606523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.606523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.606524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.606524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.606527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.606534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.606536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.606538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.606540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.606542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.606544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.606546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.606548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.606550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.606551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.606553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.606557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.606561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.606564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.606567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.606569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.606572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.606575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.606578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.606580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.606582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.606585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.606587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.606589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.606592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.606594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.606600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.606602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.606605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.606608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.606611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.606614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.606616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.606618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.606621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.606638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.607753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.612821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.612834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.612838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282916289:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.612846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.615136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.616648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.616661Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.616662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.616664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.616668Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3807 [2:7556556326207325237:12541]
2025-10-02T09:37:53.616676Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.616685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.616689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.616691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.616692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.616703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.616710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.616715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.616748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.616753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.616754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.616756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.616758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.616793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.616813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.616823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.616831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.616843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.616857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916176:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.616862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916328:3927], now have 1 active actors on pipe
2025-10-02T09:37:53.616866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.616868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.616869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.616876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.616887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.616891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.616893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.616894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.616898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.616900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.616897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3807
2025-10-02T09:37:53.616917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.616909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3807
2025-10-02T09:37:53.616922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.616924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.616942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.616948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.616967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.616974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.616976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.616977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.616982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.616990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.617005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.617136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.617145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.617159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.617225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3808 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0
2025-10-02T09:37:53.617440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6bd8169-1847ef79-80d13610-4f3f6199_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.619957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Write session: try to update token
2025-10-02T09:37:53.619970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.626334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.626345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.626347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.626347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.626352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.626354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.626356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207325232:12541]
2025-10-02T09:37:53.626376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.626377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.626379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.626382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.626383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.626384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.626505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.632135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3808 sessionId: src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.634358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.640180Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:37:53.696813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282916336:3784]
2025-10-02T09:37:53.697048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3807, pipe: [1:7556556326282916336:3784]
2025-10-02T09:37:53.739363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.739884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.739894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.739908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916336:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.740085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:53.740133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.740154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282916336:3784]
2025-10-02T09:37:53.740183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:53.740262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3808 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0
2025-10-02T09:37:53.740417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3808 sessionId: src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0 is DEAD
2025-10-02T09:37:53.740561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:53.740572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Write session will restart in 0.007138s
2025-10-02T09:37:53.740590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Write session: Do CDS request
2025-10-02T09:37:53.740595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.747501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.749132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.749264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.749275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3809
2025-10-02T09:37:53.749368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.749390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.749397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.749400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.749455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.749562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.749570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.749576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.749604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.749627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207325388:12543]
2025-10-02T09:37:53.749732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3809 sessionId:  describe result for acl check
2025-10-02T09:37:53.749764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.749769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.749771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.749776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.749982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.750158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.750184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.750315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.750378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.750409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.750413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.750413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.750414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.750414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.750415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.750415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.750416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.750416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.750417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.750417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.750418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.750420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.750427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.750429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.750431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.750433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.750435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.750437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.750439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.750441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.750443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.750445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.750447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.750450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.750454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.750457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.750460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.750462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.750465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.750467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.750470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.750472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.750475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.750478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.750481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.750483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.750486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.750492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.750495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.750498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.750501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.750503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.750506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.750509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.750511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.750517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.750519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.750536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.752089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.756898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.756909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.756912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282916451:3938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.756919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.759202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.760799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.760827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.760830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.760833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.760838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3808 [2:7556556326207325388:12543]
2025-10-02T09:37:53.760846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.760856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.760861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.760863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.760863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.760872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.760875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.760879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.760913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.760917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.760919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.760921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.760922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.760959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.760964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.760971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.760980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.760989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.761001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.761006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.761007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.761012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.761020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.761020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.761024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.761025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.761031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.761032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.761039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916490:3938], now have 1 active actors on pipe
2025-10-02T09:37:53.761041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916337:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.761055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.761062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.761067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.761086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3808
2025-10-02T09:37:53.761093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3808
2025-10-02T09:37:53.761108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.761114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.761131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.761135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.761137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.761138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.761143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.761149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.761161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.761278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.761285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.761294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.761353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3809 partition: 0 MaxSeqNo: 36 sessionId: src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0
2025-10-02T09:37:53.761620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3c37ba-3b812a69-92a94986-f34c0f78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.764083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Write session: try to update token
2025-10-02T09:37:53.764097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.774340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:53.774351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.774356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.774381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:53.774384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:53.774520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:53.774644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.774763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.774876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:53.775052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:53.775079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:53.776176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3809 sessionId: src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.778419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.779185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.779200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.779211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.779212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.779213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.779215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.779218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.779222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.779224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207325383:12543]
2025-10-02T09:37:53.779247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.779250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.779254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.779256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.779256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.779258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.779380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.840179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282916497:3784]
2025-10-02T09:37:53.840335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3808, pipe: [1:7556556326282916497:3784]
2025-10-02T09:37:53.892331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:53.892522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:53.892545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916497:3784], now have 1 active actors on pipe
2025-10-02T09:37:53.892656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282916497:3784]
2025-10-02T09:37:53.892657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:53.892687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:53.892752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:53.892762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:53.892864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3809 reason: error at write: Disconnected sessionId: src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0
2025-10-02T09:37:53.893016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3809 sessionId: src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0 is DEAD
2025-10-02T09:37:53.893153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:53.893163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Write session will restart in 0.005088s
2025-10-02T09:37:53.893179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Write session: Do CDS request
2025-10-02T09:37:53.893187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:53.899165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.899234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:53.899244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3810
2025-10-02T09:37:53.899383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:53.899407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:53.899414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:53.899417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:53.899753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3810 sessionId:  describe result for acl check
2025-10-02T09:37:53.899782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:53.899787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:53.899788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:53.899792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:53.900220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:53.900214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:53.901606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:53.901974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:53.902077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:53.902083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:53.902089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:53.902116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:53.902146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556326207325541:12545]
2025-10-02T09:37:53.902510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:53.902695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:53.902723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:53.902924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:53.902955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.902959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.902960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.902961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.902961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.902962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.902962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.902963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.902963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.902964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.902964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.902965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.902968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.902974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.902976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.902978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.902980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.902982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.902984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.902986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.902988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.902990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.902992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.902994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.902999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.903003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:53.903006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.903009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:53.903011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.903014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:53.903016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.903019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:53.903021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.903023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:53.903026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.903028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:53.903031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.903034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:53.903036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.903038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:53.903041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.903044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:53.903046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.903052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.903054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.903057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.903061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.903066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.903084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:53.903547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:53.903560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:53.903563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556326282916612:3965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:53.903570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:53.910692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:53.912150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:53.912161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:53.912162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:53.912164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:53.912167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3809 [2:7556556326207325541:12545]
2025-10-02T09:37:53.912174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:53.912183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:53.912184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.912186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.912187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.912195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:53.912199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:53.912204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:53.912235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.912240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.912241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.912243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:53.912244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:53.912281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:53.912286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.912292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:53.912299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:53.912308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:53.912323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916499:2446], now have 1 active actors on pipe
2025-10-02T09:37:53.912329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916652:3965], now have 1 active actors on pipe
2025-10-02T09:37:53.912333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.912334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.912336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.912343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:53.912351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:53.912356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:53.912358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:53.912359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:53.912364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:53.912367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:53.912372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3809
2025-10-02T09:37:53.912384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.912394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3809
2025-10-02T09:37:53.912390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:53.912397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:53.912418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.912423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.912439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:53.912446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:53.912448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:53.912449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:53.912454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:53.912459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:53.912466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.912585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:53.912592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:53.912602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:53.912664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3810 partition: 0 MaxSeqNo: 36 sessionId: src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0
2025-10-02T09:37:53.912941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ade7cb-11b40f7c-dcb22ea5-460a9a7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:53.915404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Write session: try to update token
2025-10-02T09:37:53.915418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:53.921829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:53.921840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:53.921841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:53.921842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:53.921846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.921848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.921850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556326207325536:12545]
2025-10-02T09:37:53.921871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:53.921874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:53.921877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:53.921877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:53.921879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:53.921881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:53.921994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:53.927363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3810 sessionId: src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:53.929583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:53.992759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556326282916665:3784]
2025-10-02T09:37:53.992973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3809, pipe: [1:7556556326282916665:3784]
2025-10-02T09:37:54.033730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.033951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.033961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.033974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556326282916665:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.034122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.034152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:54.034165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:54.034169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556326282916665:3784]
2025-10-02T09:37:54.034193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.034236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3810 reason: error at write: Disconnected sessionId: src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0
2025-10-02T09:37:54.034405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3810 sessionId: src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0 is DEAD
2025-10-02T09:37:54.034576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:54.034588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Write session will restart in 0.006534s
2025-10-02T09:37:54.034607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Write session: Do CDS request
2025-10-02T09:37:54.034612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.042172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.042194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.042274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.042285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3811
2025-10-02T09:37:54.042397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.042420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.042429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.042431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.042740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3811 sessionId:  describe result for acl check
2025-10-02T09:37:54.042763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.042768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.042770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.042775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.043193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.043823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.043941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.043948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.043954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.043983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.044006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502292991:12547]
2025-10-02T09:37:54.044359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.044513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.044536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.044716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.044744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.044748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.044749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.044749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.044750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.044750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.044751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.044751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.044752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.044752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.044753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.044753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.044756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.044763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.044766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.044768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.044770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.044772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.044774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.044776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.044778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.044781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.044783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.044785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.044789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.044793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.044796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.044811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.044816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.044820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.044826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.044835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.044841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.044843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.044846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.044852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.044856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.044860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.044862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.044867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.044869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.044875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.044878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.044880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.044883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.044885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.044887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.044909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.044980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.050037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.050048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.050051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884082:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.050056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.052694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.054144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.054157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.054159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.054160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.054165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3810 [2:7556556330502292991:12547]
2025-10-02T09:37:54.054174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.054184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.054189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.054190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.054191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.054200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.054206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.054211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.054241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.054245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.054246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.054248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.054250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.054287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.054292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.054298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.054303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.054315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.054327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577883963:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.054332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884121:3981], now have 1 active actors on pipe
2025-10-02T09:37:54.054338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.054339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.054340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.054347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.054355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.054365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.054365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.054368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.054369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.054370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.054383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.054385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.054380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3810
2025-10-02T09:37:54.054382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3810
2025-10-02T09:37:54.054398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.054406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.054408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.054424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.054431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.054433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.054434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.054439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.054445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.054452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.054578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.054583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.054591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.054654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3811 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0
2025-10-02T09:37:54.054870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c91-c8f0cc0f-1122ba45-d5f4139e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.057319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Write session: try to update token
2025-10-02T09:37:54.057332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.063700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.063711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.063712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.063713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.063716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.063719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.063721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502292986:12547]
2025-10-02T09:37:54.063740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.063743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.063744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.063744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.063746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.063748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.063857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.069862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3811 sessionId: src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.072079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.134575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577884128:3784]
2025-10-02T09:37:54.134787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3810, pipe: [1:7556556330577884128:3784]
2025-10-02T09:37:54.174301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.174965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.174975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.174989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884128:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.175130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.175173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577884128:3784]
2025-10-02T09:37:54.175179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.175206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:54.175286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0
2025-10-02T09:37:54.175429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3811 sessionId: src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0 is DEAD
2025-10-02T09:37:54.175594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:54.175607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Write session will restart in 0.005923s
2025-10-02T09:37:54.175626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Write session: Do CDS request
2025-10-02T09:37:54.175631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.182197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.182316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.182326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3812
2025-10-02T09:37:54.182446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.182472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.182480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.182483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.182649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.182874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3812 sessionId:  describe result for acl check
2025-10-02T09:37:54.182920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.182926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.182927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.182931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.183314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.184509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.184611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.184618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.184623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.184650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.184675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293148:12549]
2025-10-02T09:37:54.184709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.185034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.185206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.185229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.185403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.185430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.185434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.185434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.185435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.185435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.185436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.185437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.185437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.185437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.185438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.185438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.185439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.185442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.185448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.185450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.185452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.185454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.185456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.185458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.185460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.185462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.185464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.185466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.185468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.185471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.185475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.185478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.185481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.185483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.185486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.185488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.185490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.185493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.185495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.185497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.185500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.185502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.185505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.185507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.185509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.185511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.185514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.185516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.185518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.185520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.185522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.185524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.185527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.185544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.186793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.186803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.186805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884247:4002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.186809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.193095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.194489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.194498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.194499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.194501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.194504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3811 [2:7556556330502293148:12549]
2025-10-02T09:37:54.194512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.194521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.194522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.194524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.194525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.194534Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.194538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.194543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.194572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.194577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.194578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.194582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.194583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.194620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.194624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.194631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.194636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.194644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.194658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884129:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.194662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884288:4002], now have 1 active actors on pipe
2025-10-02T09:37:54.194665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.194666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.194667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.194675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.194682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.194687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.194689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.194690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.194692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.194694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.194708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.194710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.194686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3811
2025-10-02T09:37:54.194701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3811
2025-10-02T09:37:54.194711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.194722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.194724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.194912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.194921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.194923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.194924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.194929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.194935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.194948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.195077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.195082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.195091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.195156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3812 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0
2025-10-02T09:37:54.195424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b878ba-ed4afbc9-5e1f94e3-7728df9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.197891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Write session: try to update token
2025-10-02T09:37:54.197904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.203794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.203805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.203807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.203808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.203811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.203814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.203816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293143:12549]
2025-10-02T09:37:54.203835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.203838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.203838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.203839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.203840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.203842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.203952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.219475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3812 sessionId: src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.235272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.275394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577884319:3784]
2025-10-02T09:37:54.275642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3811, pipe: [1:7556556330577884319:3784]
2025-10-02T09:37:54.317639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.317956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.317965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.317978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884319:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.318147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.318198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.318198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577884319:3784]
2025-10-02T09:37:54.318218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:54.318290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3812 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0
2025-10-02T09:37:54.318489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3812 sessionId: src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0 is DEAD
2025-10-02T09:37:54.318677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:54.318683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Write session will restart in 0.007502s
2025-10-02T09:37:54.318703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Write session: Do CDS request
2025-10-02T09:37:54.318707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.326721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.327196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.327407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.327417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3813
2025-10-02T09:37:54.327534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.327559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.327568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.327572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.327946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3813 sessionId:  describe result for acl check
2025-10-02T09:37:54.327970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.327975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.327976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.327980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.328462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.328742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.328934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.328942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.328949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.328986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.329009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293339:12564]
2025-10-02T09:37:54.329354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.329513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.329535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.329710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.329742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.329745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.329746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.329747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.329747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.329748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.329748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.329749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.329749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.329750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.329750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.329751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.329754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.329760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.329762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.329764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.329766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.329768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.329770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.329772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.329774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.329776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.329778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.329780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.329784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.329788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.329791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.329794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.329796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.329799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.329801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.329804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.329806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.329809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.329811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.329813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.329816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.329818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.329821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.329824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.329826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.329828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.329831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.329833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.329837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.329839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.329842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.329844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.329860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.330579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.335715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.335724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.335727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884438:4059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.335731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.338814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.340204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.340214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.340215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.340217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.340221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3812 [2:7556556330502293339:12564]
2025-10-02T09:37:54.340229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.340239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.340240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.340242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.340243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.340251Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.340258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.340262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.340292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.340297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.340298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.340301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.340302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.340427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3812
2025-10-02T09:37:54.340440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3812
2025-10-02T09:37:54.340513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.340518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.340525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.340532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.340545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.340561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884320:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.340566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884478:4059], now have 1 active actors on pipe
2025-10-02T09:37:54.340577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.340582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.340592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.340596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.340597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.340607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.340618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.340620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.340624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.340625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.340630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.340631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.340641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.340647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.340649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.340650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.340655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.340663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.340679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.340687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.340695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.340695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.340809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.340814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.340823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.340889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3813 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0
2025-10-02T09:37:54.341147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd5a968-411d3e47-2cbcd7ec-cd771b69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.344196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Write session: try to update token
2025-10-02T09:37:54.344206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.353991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:54.354004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.354009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.354035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:54.354046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:54.354193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:54.354320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.354440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.354566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.354724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:54.354750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:54.357347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3813 sessionId: src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.358920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.358930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.358931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.358932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.358937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.358939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.358942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293334:12564]
2025-10-02T09:37:54.358963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.358965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.358967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.358967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.358968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.358970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.359082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.359603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.418218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577884488:3784]
2025-10-02T09:37:54.418388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3812, pipe: [1:7556556330577884488:3784]
2025-10-02T09:37:54.467469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.467811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.467820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.467832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884488:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.467974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.467970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.468013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:54.468019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577884488:3784]
2025-10-02T09:37:54.468090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0
2025-10-02T09:37:54.468260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3813 sessionId: src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0 is DEAD
2025-10-02T09:37:54.468402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:54.468409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Write session will restart in 0.006192s
2025-10-02T09:37:54.468425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Write session: Do CDS request
2025-10-02T09:37:54.468429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.475174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.475249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.475260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3814
2025-10-02T09:37:54.475369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.475391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.475399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.475402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.475724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3814 sessionId:  describe result for acl check
2025-10-02T09:37:54.475756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.475761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.475762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.475766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.475802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.476087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.477470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.477674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.477776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.477782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.477788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.477814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.477838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293510:12568]
2025-10-02T09:37:54.478192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.478365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.478387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.478558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.478588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.478591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.478592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.478593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.478593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.478594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.478595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.478596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.478596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.478597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.478597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.478598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.478600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.478607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.478609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.478611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.478613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.478615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.478617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.478619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.478621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.478623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.478625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.478627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.478631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.478635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.478638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.478641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.478644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.478647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.478649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.478652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.478654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.478656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.478658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.478661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.478663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.478666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.478668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.478671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.478673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.478676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.478681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.478684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.478686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.478688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.478693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.478696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.478711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.482618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.482628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.482631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884619:4114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.482637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.486165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.487699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.487710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.487711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.487713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.487717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3813 [2:7556556330502293510:12568]
2025-10-02T09:37:54.487724Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.487734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.487735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.487737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.487738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.487747Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.487753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.487757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.487787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.487792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.487794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.487795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.487797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.487832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.487837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.487843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.487848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.487856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.487869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884659:4114], now have 1 active actors on pipe
2025-10-02T09:37:54.487873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884489:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.487877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.487878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.487879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.487886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.487894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.487900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.487902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.487903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.487903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.487904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.487918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.487921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.487922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.487931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3813
2025-10-02T09:37:54.487947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3813
2025-10-02T09:37:54.487985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.487990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.488008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.488015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.488017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.488018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.488023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.488028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.488036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.488144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.488148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.488155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.488217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3814 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0
2025-10-02T09:37:54.488450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9995a2-d73341a6-991fabb8-b7540ff8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.490918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Write session: try to update token
2025-10-02T09:37:54.490930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.497164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.497177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.497178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.497179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.497184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.497187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.497191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293505:12568]
2025-10-02T09:37:54.497214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.497219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.497221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.497220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.497224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.497227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.497328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.503402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3814 sessionId: src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.505641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.568253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577884667:3784]
2025-10-02T09:37:54.568473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3813, pipe: [1:7556556330577884667:3784]
2025-10-02T09:37:54.606922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.607355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.607364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.607378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884667:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.607593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577884667:3784]
2025-10-02T09:37:54.607600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.607628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:54.607631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:54.607706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3814 reason: error at write: Disconnected sessionId: src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0
2025-10-02T09:37:54.607863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3814 sessionId: src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0 is DEAD
2025-10-02T09:37:54.608009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:54.608019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Write session will restart in 0.008598s
2025-10-02T09:37:54.608036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Write session: Do CDS request
2025-10-02T09:37:54.608045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.608197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.615688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.617173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.617269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.617279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3815
2025-10-02T09:37:54.617392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.617414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.617421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.617424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.617509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.617610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.617617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.617622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.617647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.617671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293668:12570]
2025-10-02T09:37:54.617780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3815 sessionId:  describe result for acl check
2025-10-02T09:37:54.617812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.617819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.617821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.617825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.618016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.618176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.618199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.618257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.618388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.618419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.618423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.618424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.618424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.618425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.618425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.618426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.618427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.618427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.618427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.618428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.618429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.618432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.618438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.618440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.618442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.618444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.618446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.618448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.618450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.618452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.618455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.618457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.618459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.618462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.618466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.618469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.618472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.618474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.618476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.618478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.618481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.618483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.618486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.618488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.618491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.618493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.618496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.618497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.618500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.618502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.618505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.618507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.618510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.618512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.618516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.618518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.618520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.618539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.619899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.623836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.623846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.623849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884788:4117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.623854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.625935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.627540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.627549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.627550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.627552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.627556Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3814 [2:7556556330502293668:12570]
2025-10-02T09:37:54.627562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.627572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.627573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.627575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.627576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.627584Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.627592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.627596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.627629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.627634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.627635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.627637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.627638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.627673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.627678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.627684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.627689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.627697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.627713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884827:4117], now have 1 active actors on pipe
2025-10-02T09:37:54.627718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884668:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.627721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.627724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.627725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.627732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.627739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.627745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.627747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.627748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.627750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.627751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.627765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.627770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.627771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.627780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3814
2025-10-02T09:37:54.627783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3814
2025-10-02T09:37:54.627836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.627841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.627857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e837b95-aec688e6-ef687858-aecc75c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.627864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.627866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.627867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.627872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.627877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.627885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.628000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.628005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.628012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.628076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3815 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e837b95-aec688e6-ef687858-aecc75c1_0
2025-10-02T09:37:54.628322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ca93e-39b0a174-dbc881c3-f469d02_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e837b95-aec688e6-ef687858-aecc75c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.630928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Write session: try to update token
2025-10-02T09:37:54.630940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.636748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:54.636757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.636762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.636788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:54.636790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:54.636945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:54.637067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.637241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.637361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:54.637516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:54.637541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:54.642187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3815 sessionId: src_id|8e837b95-aec688e6-ef687858-aecc75c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.644452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.647249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.647266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.647278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.647280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.647281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.647282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.647286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.647288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.647292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293663:12570]
2025-10-02T09:37:54.647319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.647322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.647324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.647326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.647327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.647327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.647446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.707491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577884835:3784]
2025-10-02T09:37:54.707717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3814, pipe: [1:7556556330577884835:3784]
2025-10-02T09:37:54.759346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.759552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:54.759575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884835:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.759660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:54.759728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577884835:3784]
2025-10-02T09:37:54.759754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.759759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:54.759762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:54.759822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3815 reason: error at write: Disconnected sessionId: src_id|8e837b95-aec688e6-ef687858-aecc75c1_0
2025-10-02T09:37:54.759934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3815 sessionId: src_id|8e837b95-aec688e6-ef687858-aecc75c1_0 is DEAD
2025-10-02T09:37:54.760068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:54.760080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Write session will restart in 0.007759s
2025-10-02T09:37:54.760095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Write session: Do CDS request
2025-10-02T09:37:54.760099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.769133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.769248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.769258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3816
2025-10-02T09:37:54.769364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.769386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.769394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.769397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.769555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.769740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3816 sessionId:  describe result for acl check
2025-10-02T09:37:54.769773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.769774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.769776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.769780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.769841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.770032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.770040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.770047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.770085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.770107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293827:12572]
2025-10-02T09:37:54.770212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.770533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.770771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.770799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.770984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.771013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.771017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.771018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.771018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.771019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.771020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.771020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.771021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.771021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.771022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.771022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.771023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.771026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.771032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.771035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.771037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.771039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.771041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.771043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.771045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.771047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.771049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.771053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.771057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.771061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.771064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.771067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.771070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.771072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.771075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.771077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.771079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.771082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.771084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.771087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.771089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.771092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.771094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.771097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.771099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.771102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.771105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.771108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.771110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.771113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.771115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.771117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.771135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.771990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.777111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.777121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.777124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577884957:4136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.777129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.778814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.780208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.780219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.780220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.780222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.780226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3815 [2:7556556330502293827:12572]
2025-10-02T09:37:54.780233Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.780243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.780245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.780246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.780247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.780256Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.780263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.780267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.780301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.780306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.780307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.780309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.780311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.780350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.780355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.780361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.780367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.780378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.780392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884996:4136], now have 1 active actors on pipe
2025-10-02T09:37:54.780398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577884836:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.780402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.780404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.780405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.780412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.780421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.780428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.780430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.780432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.780432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.780433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.780441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3815
2025-10-02T09:37:54.780452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3815
2025-10-02T09:37:54.780448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.780453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.780456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.780474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.780476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.780493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15b2f76e-79de7558-3bb4743c-533d4800_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.780504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.780506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.780507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.780513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.780518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.780526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.780631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.780636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.780644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.780708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3816 partition: 0 MaxSeqNo: 36 sessionId: src_id|15b2f76e-79de7558-3bb4743c-533d4800_0
2025-10-02T09:37:54.780984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e837b95-aec688e6-ef687858-aecc75c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15b2f76e-79de7558-3bb4743c-533d4800_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.783420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Write session: try to update token
2025-10-02T09:37:54.783431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.789949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.789962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.789964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.789965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.789970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.789973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.789975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293822:12572]
2025-10-02T09:37:54.789999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.789999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.790002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.790005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.790006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.790006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.790120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.794344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3816 sessionId: src_id|15b2f76e-79de7558-3bb4743c-533d4800_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.796527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:54.860063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556330577885004:3784]
2025-10-02T09:37:54.860247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3815, pipe: [1:7556556330577885004:3784]
2025-10-02T09:37:54.900940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:54.901296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.901304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.901329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577885004:3784], now have 1 active actors on pipe
2025-10-02T09:37:54.901513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:54.901527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:54.901537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:54.901590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556330577885004:3784]
2025-10-02T09:37:54.901598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3816 reason: error at write: Disconnected sessionId: src_id|15b2f76e-79de7558-3bb4743c-533d4800_0
2025-10-02T09:37:54.901758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3816 sessionId: src_id|15b2f76e-79de7558-3bb4743c-533d4800_0 is DEAD
2025-10-02T09:37:54.901776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:54.901898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:54.901907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Write session will restart in 0.005098s
2025-10-02T09:37:54.901923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Write session: Do CDS request
2025-10-02T09:37:54.901927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:54.908181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.908254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:54.908264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3817
2025-10-02T09:37:54.908371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:54.908394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:54.908402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:54.908406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:54.908759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3817 sessionId:  describe result for acl check
2025-10-02T09:37:54.908790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:54.908795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:54.908796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:54.908811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:54.909238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:54.909623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:54.910744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:54.911465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:54.911573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:54.911580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:54.911585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:54.911611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:54.911634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556330502293986:12574]
2025-10-02T09:37:54.911990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:54.912152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:54.912174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:54.912351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:54.912376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.912380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.912381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.912381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.912382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.912382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.912383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.912383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.912384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.912386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.912388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.912395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.912397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.912399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.912401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.912403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.912405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.912407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.912409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.912411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.912413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.912415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.912418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.912422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:54.912426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.912429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:54.912431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.912434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:54.912436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.912439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:54.912441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.912444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:54.912446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.912448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:54.912450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.912453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:54.912455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.912458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:54.912460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.912463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:54.912465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.912468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.912470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.912474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.912476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.912479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.912496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:54.912675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:54.912686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:54.912689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556330577885124:4166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:54.912692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:54.919877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:54.921434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:54.921445Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:54.921446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:54.921448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:54.921451Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3816 [2:7556556330502293986:12574]
2025-10-02T09:37:54.921459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:54.921469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:54.921470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.921471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.921473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.921481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:54.921484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:54.921488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:54.921519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.921524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.921526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.921528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:54.921529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:54.921564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:54.921569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.921576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:54.921581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:54.921592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:54.921605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577885165:4166], now have 1 active actors on pipe
2025-10-02T09:37:54.921610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556330577885005:2446], now have 1 active actors on pipe
2025-10-02T09:37:54.921614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.921615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.921616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.921624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:54.921631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:54.921638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:54.921639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:54.921640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:54.921641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:54.921642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:54.921655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.921660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:54.921661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:54.921658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3816
2025-10-02T09:37:54.921659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3816
2025-10-02T09:37:54.921710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.921715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.921728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:54.921735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:54.921737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:54.921738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:54.921839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:54.921848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:54.921855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.921985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:54.921990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:54.921998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:54.922060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3817 partition: 0 MaxSeqNo: 36 sessionId: src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0
2025-10-02T09:37:54.922315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b2f76e-79de7558-3bb4743c-533d4800_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:54.925242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Write session: try to update token
2025-10-02T09:37:54.925253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:54.930993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:54.931006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:54.931007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:54.931008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:54.931013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.931015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.931018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556330502293981:12574]
2025-10-02T09:37:54.931038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:54.931042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:54.931045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:54.931045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:54.931046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:54.931047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:54.931157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:54.937600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3817 sessionId: src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:54.939832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.001885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872852483:3784]
2025-10-02T09:37:55.002066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3816, pipe: [1:7556556334872852483:3784]
2025-10-02T09:37:55.040962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.041257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.041266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.041277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852483:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.041475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:55.041482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872852483:3784]
2025-10-02T09:37:55.041491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:55.041508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.041564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3817 reason: error at write: Disconnected sessionId: src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0
2025-10-02T09:37:55.041718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3817 sessionId: src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0 is DEAD
2025-10-02T09:37:55.041782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.041869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:55.041878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Write session will restart in 0.005499s
2025-10-02T09:37:55.041897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Write session: Do CDS request
2025-10-02T09:37:55.041901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.048104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.048241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.048255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3818
2025-10-02T09:37:55.048373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.048402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.048406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.048409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.048761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3818 sessionId:  describe result for acl check
2025-10-02T09:37:55.048788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.048795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.048797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.048812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.049276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.049855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.051140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.051731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.051915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.051922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.051928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.051960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.051984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797261443:12576]
2025-10-02T09:37:55.052333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.052517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.052539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.052723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.052755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.052756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.052757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.052757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.052758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.052758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.052759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.052759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.052760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.052760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.052761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.052761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.052764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.052770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.052772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.052774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.052776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.052778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.052780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.052782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.052784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.052786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.052788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.052790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.052795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.052798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.052812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.052814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.052816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.052819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.052821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.052823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.052826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.052828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.052830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.052833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.052835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.052837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.052839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.052842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.052844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.052846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.052848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.052851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.052854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.052856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.052858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.052861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.052878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.052934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.052943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.052945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872852608:4164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.052950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.060214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.061778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.061789Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.061790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.061792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.061797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3817 [2:7556556334797261443:12576]
2025-10-02T09:37:55.061806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.061815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.061817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.061818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.061819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.061827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.061830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.061835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.061865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.061870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.061871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.061874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.061875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.061911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.061915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.061922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.061927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.061938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.061949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852488:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.061954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852649:4164], now have 1 active actors on pipe
2025-10-02T09:37:55.061958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.061959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.061960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.061968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.061975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.061981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.061983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.061984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.061986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.061988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.062001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.062009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.062017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.062006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3817
2025-10-02T09:37:55.062013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3817
2025-10-02T09:37:55.062036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.062041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.062054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.062061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.062064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.062065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.062070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.062075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.062082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.062191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.062196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.062203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.062268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3818 partition: 0 MaxSeqNo: 36 sessionId: src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0
2025-10-02T09:37:55.062527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551bf88b-ea3fb65-68207305-a3f5e47f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.065119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Write session: try to update token
2025-10-02T09:37:55.065129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.070899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:55.070910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.070914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.070940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:55.070949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:55.071075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:55.071187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:55.071295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:55.071421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:55.071589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:55.071613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:55.076210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3818 sessionId: src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.078552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.078656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.078664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.079458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:55.079477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.079479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.079480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.079481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.079486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.079488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.079490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797261438:12576]
2025-10-02T09:37:55.079506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.079508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.079511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.079512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.079516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.079519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.079535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:55.079638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.141678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872852657:3784]
2025-10-02T09:37:55.141890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3817, pipe: [1:7556556334872852657:3784]
2025-10-02T09:37:55.189729Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.196271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.196292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.196418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.196472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.196534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.196591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.196629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.196636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.196690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.196741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.196792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.196862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.196903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.196906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.196960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.197007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.197060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.197109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.197147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.197152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.197203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.197252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.197306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.197354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.197390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.197396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.197448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.197499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.197555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.197608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.197647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.197652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.197711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.197760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.197836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.197888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.197926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.197931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.197989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.198046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.198100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.198157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.198199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.198206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.198259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.198310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.198362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.198418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.198459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.198464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.198520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.198570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.198623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.198672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.198721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.198726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.198778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:55.198829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:55.198891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:55.198947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:55.198988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:55.198993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:55.199024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852657:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.199213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872852657:3784]
2025-10-02T09:37:55.199216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:55.199220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:55.199247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3818 reason: error at write: Disconnected sessionId: src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0
2025-10-02T09:37:55.199247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.199398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3818 sessionId: src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0 is DEAD
2025-10-02T09:37:55.199513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:55.199522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Write session will restart in 0.006547s
2025-10-02T09:37:55.199538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Write session: Do CDS request
2025-10-02T09:37:55.199542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.199717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.207135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.207254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.207267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3819
2025-10-02T09:37:55.207401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.207425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.207430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.207438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.207798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3819 sessionId:  describe result for acl check
2025-10-02T09:37:55.207831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.207837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.207838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.207845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.208299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.208353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.210254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.210364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.210370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.210376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.210402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.210424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797261607:12579]
2025-10-02T09:37:55.210533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.210777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.210943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.210966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.211147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.211311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.211317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.211317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.211318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.211318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.211319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.211319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.211320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.211320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.211321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.211321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.211322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.211325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.211332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.211334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.211344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.211346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.211348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.211350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.211352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.211354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.211356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.211358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.211360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.211364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.211368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.211371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.211374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.211376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.211379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.211381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.211384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.211386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.211389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.211391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.211394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.211396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.211398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.211400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.211403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.211407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.211409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.211411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.211413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.211416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.211418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.211420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.211423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.211439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.215331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.215351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.215353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872852781:4199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.215359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.218978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.220406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.220416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.220417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.220419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.220423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3818 [2:7556556334797261607:12579]
2025-10-02T09:37:55.220431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.220441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.220446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.220448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.220449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.220458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.220461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.220465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.220495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.220500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.220501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.220503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.220505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.220542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.220546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.220553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.220558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.220566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.220581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852659:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.220586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852822:4199], now have 1 active actors on pipe
2025-10-02T09:37:55.220590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.220591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.220592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.220599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.220607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.220614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.220618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.220619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.220620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.220622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.220632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.220634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.220636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.220636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3818
2025-10-02T09:37:55.220642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3818
2025-10-02T09:37:55.220685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.220690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.220706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40273838-fd161f4c-9c9b6638-4210f080_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.220713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.220715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.220716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.220722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.220727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.220734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.220867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.220872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.220880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.220946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3819 partition: 0 MaxSeqNo: 36 sessionId: src_id|40273838-fd161f4c-9c9b6638-4210f080_0
2025-10-02T09:37:55.221220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7bb2ed-be3b4552-88dea0db-9951a41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40273838-fd161f4c-9c9b6638-4210f080_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.223703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Write session: try to update token
2025-10-02T09:37:55.223712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.229860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.229874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.229875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.229876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.229884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.229886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.229887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797261602:12579]
2025-10-02T09:37:55.229910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.229912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.229914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.229915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.229919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.229923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.230022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.234693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3819 sessionId: src_id|40273838-fd161f4c-9c9b6638-4210f080_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.237048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.299384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872852851:3784]
2025-10-02T09:37:55.299592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3818, pipe: [1:7556556334872852851:3784]
2025-10-02T09:37:55.340467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.340792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.340810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.340836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852851:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.340976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.341004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.341034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:55.341047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872852851:3784]
2025-10-02T09:37:55.341119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3819 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40273838-fd161f4c-9c9b6638-4210f080_0
2025-10-02T09:37:55.341267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3819 sessionId: src_id|40273838-fd161f4c-9c9b6638-4210f080_0 is DEAD
2025-10-02T09:37:55.341413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:55.341425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Write session will restart in 0.007779s
2025-10-02T09:37:55.341459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Write session: Do CDS request
2025-10-02T09:37:55.341463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.350109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.350273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.350284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3820
2025-10-02T09:37:55.350983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.351008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.351015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.351019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.351403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3820 sessionId:  describe result for acl check
2025-10-02T09:37:55.351434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.351439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.351440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.351443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.351581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.351844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.351873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.351975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.351981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.351987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.352015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.352042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797261806:12593]
2025-10-02T09:37:55.352392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.352560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.352584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.352840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.352896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.352901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.352901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.352902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.352902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.352903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.352903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.352904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.352904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.352905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.352905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.352906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.352909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.352915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.352919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.352922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.352925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.352929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.352931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.352934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.352937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.352941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.352944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.352946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.352953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.352963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.352972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.352980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.352987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.352990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.352993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.353001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.353008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.353012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.353019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.353023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.353031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.353035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.353043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.353047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.353056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.353061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.353065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.353071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.353073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.353076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.353078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.353080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.353097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.353604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.358822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.358833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.358835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872852976:4269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.358840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.360454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.361970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.361980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.361982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.361983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.361987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3819 [2:7556556334797261806:12593]
2025-10-02T09:37:55.361995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.362003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.362008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.362010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.362011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.362020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.362023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.362028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.362060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.362065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.362067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.362068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.362071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.362107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.362112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.362119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.362124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.362135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.362150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853017:4269], now have 1 active actors on pipe
2025-10-02T09:37:55.362157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872852852:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.362162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.362167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.362169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.362179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.362191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.362197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.362200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.362195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3819
2025-10-02T09:37:55.362198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3819
2025-10-02T09:37:55.362205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.362207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.362207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.362223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.362226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.362228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.362239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.362244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.362272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.362278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.362281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.362284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.362289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.362297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.362308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.362422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.362429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.362438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.362506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3820 partition: 0 MaxSeqNo: 36 sessionId: src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0
2025-10-02T09:37:55.362747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40273838-fd161f4c-9c9b6638-4210f080_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.365274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Write session: try to update token
2025-10-02T09:37:55.365285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.371385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.371398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.371399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.371400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.371406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.371410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.371412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797261801:12593]
2025-10-02T09:37:55.371433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.371439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.371440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.371444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.371448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.371451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.371544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.376294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3820 sessionId: src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.379007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.441206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872853026:3784]
2025-10-02T09:37:55.441377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3819, pipe: [1:7556556334872853026:3784]
2025-10-02T09:37:55.480457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.480815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.480825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.480836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853026:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.480957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.481000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:55.481011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:55.481033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.481065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872853026:3784]
2025-10-02T09:37:55.481067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3820 reason: error at write: Disconnected sessionId: src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0
2025-10-02T09:37:55.481212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3820 sessionId: src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0 is DEAD
2025-10-02T09:37:55.481353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:55.481364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Write session will restart in 0.007505s
2025-10-02T09:37:55.481380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Write session: Do CDS request
2025-10-02T09:37:55.481384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.490122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.490363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.490374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3821
2025-10-02T09:37:55.490496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.490519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.490526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.490529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.490873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3821 sessionId:  describe result for acl check
2025-10-02T09:37:55.490903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.490907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.490909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.490913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.491291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.491704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.491997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.492124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.492133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.492141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.492179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.492208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797261983:12597]
2025-10-02T09:37:55.492643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.492815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.492822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.492855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.493119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.493171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.493177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.493178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.493179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.493180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.493180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.493181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.493182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.493183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.493184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.493185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.493186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.493190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.493200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.493203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.493207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.493210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.493214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.493217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.493221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.493224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.493229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.493236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.493239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.493248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.493256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.493259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.493265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.493268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.493271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.493276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.493279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.493281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.493284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.493286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.493292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.493295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.493297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.493302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.493305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.493307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.493313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.493315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.493318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.493320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.493324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.493330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.493334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.493365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.497389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.497401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.497404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872853164:4311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.497410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.500991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.502585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.502596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.502597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.502599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.502603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3820 [2:7556556334797261983:12597]
2025-10-02T09:37:55.502611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.502620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.502621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.502623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.502624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.502633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.502636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.502640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.502669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.502675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.502676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.502678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.502680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.502715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.502720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.502726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.502731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.502747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.502766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853204:4311], now have 1 active actors on pipe
2025-10-02T09:37:55.502772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853039:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.502777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.502782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.502784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.502794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.502806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.502808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.502812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.502814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.502819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.502821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.502803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3820
2025-10-02T09:37:55.502804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3820
2025-10-02T09:37:55.502845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.502851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.502862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.502866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.502874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.502885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.502891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.502893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.502894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.502899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.502905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.502920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.503020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.503027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.503037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.503100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3821 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0
2025-10-02T09:37:55.503361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d6a462-e8b0dea1-aaf5ffb5-2db38780_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.505885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Write session: try to update token
2025-10-02T09:37:55.505897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.512371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.512386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.512387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.512389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.512393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.512395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.512398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797261978:12597]
2025-10-02T09:37:55.512419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.512422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.512423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.512426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.512430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.512433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.512540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.517504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3821 sessionId: src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.519812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.580976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872853212:3784]
2025-10-02T09:37:55.581185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3820, pipe: [1:7556556334872853212:3784]
2025-10-02T09:37:55.621459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.621846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.621855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.621881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853212:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.622022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.622063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872853212:3784]
2025-10-02T09:37:55.622064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:55.622068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:55.622146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3821 reason: error at write: Disconnected sessionId: src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0
2025-10-02T09:37:55.622228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.622302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3821 sessionId: src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0 is DEAD
2025-10-02T09:37:55.622429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:55.622439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Write session will restart in 0.007991s
2025-10-02T09:37:55.622458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Write session: Do CDS request
2025-10-02T09:37:55.622462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.630346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.631148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.631285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.631294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3822
2025-10-02T09:37:55.631450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.631473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.631480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.631484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.631896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3822 sessionId:  describe result for acl check
2025-10-02T09:37:55.631926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.631931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.631932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.631937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.632443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.632572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.632697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.632702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.632709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.632739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.632763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797262148:12599]
2025-10-02T09:37:55.633124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.633351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.633389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.633631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.633678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.633686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.633686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.633687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.633689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.633689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.633690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.633691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.633692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.633693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.633694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.633694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.633698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.633708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.633711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.633715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.633718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.633721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.633724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.633727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.633729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.633733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.633736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.633740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.633745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.633751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.633760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.633764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.633767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.633772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.633776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.633780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.633787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.633793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.633799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.633802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.633804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.633807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.633810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.633812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.633815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.633817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.633819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.633822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.633824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.633827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.633831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.633833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.633856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.634165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.638716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.638728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.638731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872853340:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.638735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.641315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.642799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.642810Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.642811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.642812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.642816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3821 [2:7556556334797262148:12599]
2025-10-02T09:37:55.642823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.642832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.642834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.642835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.642836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.642844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.642850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.642854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.642885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.642889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.642891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.642893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.642894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.642931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.642937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.642944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.642952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.642968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.642986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853379:4359], now have 1 active actors on pipe
2025-10-02T09:37:55.642992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853213:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.642997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.642999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.643001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.643011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.643024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.643025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.643027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.643017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3821
2025-10-02T09:37:55.643018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3821
2025-10-02T09:37:55.643028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.643040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.643042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.643067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.643072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.643082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.643090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.643099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.643105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c525e89-892d730b-17b9c699-616f15a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.643109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.643111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.643112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.643118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.643126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.643138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.643237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.643244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.643255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.643328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3822 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c525e89-892d730b-17b9c699-616f15a7_0
2025-10-02T09:37:55.643584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c93c0a2-bc63c1d9-c6e0868d-af958fc4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c525e89-892d730b-17b9c699-616f15a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.646138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Write session: try to update token
2025-10-02T09:37:55.646153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.652446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.652459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.652460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.652461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.652465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.652468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.652471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797262143:12599]
2025-10-02T09:37:55.652492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.652495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.652496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.652496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.652500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.652502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.652606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.657523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3822 sessionId: src_id|3c525e89-892d730b-17b9c699-616f15a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.659740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.722295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872853387:3784]
2025-10-02T09:37:55.722522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3821, pipe: [1:7556556334872853387:3784]
2025-10-02T09:37:55.764572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.764787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.764796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.764833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853387:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.764959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.765032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872853387:3784]
2025-10-02T09:37:55.765054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:55.765065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.765150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3822 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c525e89-892d730b-17b9c699-616f15a7_0
2025-10-02T09:37:55.765336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3822 sessionId: src_id|3c525e89-892d730b-17b9c699-616f15a7_0 is DEAD
2025-10-02T09:37:55.765476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:55.765488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Write session will restart in 0.006537s
2025-10-02T09:37:55.765503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Write session: Do CDS request
2025-10-02T09:37:55.765508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.773174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.773348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.773361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3823
2025-10-02T09:37:55.773497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.773523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.773531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.773534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.773867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3823 sessionId:  describe result for acl check
2025-10-02T09:37:55.773899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.773903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.773905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.773909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.774350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.775422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.775731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.775849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.775856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.775862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.775890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.775912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797262314:12601]
2025-10-02T09:37:55.776013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.776278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.776445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.776469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.776707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.776745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.776749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.776750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.776750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.776751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.776751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.776752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.776752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.776753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.776753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.776754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.776754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.776757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.776764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.776766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.776768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.776769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.776772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.776773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.776775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.776777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.776780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.776782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.776784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.776787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.776791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.776795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.776798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.776810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.776813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.776815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.776818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.776820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.776823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.776825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.776827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.776830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.776832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.776834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.776837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.776839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.776842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.776844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.776846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.776850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.776853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.776855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.776858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.776873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.780791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.780819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.780823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872853515:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.780835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.784325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.785889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.785900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.785901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.785903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.785906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3822 [2:7556556334797262314:12601]
2025-10-02T09:37:55.785913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.785922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.785924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.785925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.785926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.785935Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.785941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.785946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.785977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.785982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.785984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.785986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.785987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.786022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.786027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.786033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.786039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.786050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.786067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853555:4339], now have 1 active actors on pipe
2025-10-02T09:37:55.786074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853388:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.786078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.786080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.786081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.786091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.786102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.786105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.786109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.786110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.786116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.786119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.786135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.786141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.786126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3822
2025-10-02T09:37:55.786128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3822
2025-10-02T09:37:55.786145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.786165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.786170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.786187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.786194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.786198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.786199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.786204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.786212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.786225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.786329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.786334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.786342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.786411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3823 partition: 0 MaxSeqNo: 36 sessionId: src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0
2025-10-02T09:37:55.786694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c525e89-892d730b-17b9c699-616f15a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.789219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Write session: try to update token
2025-10-02T09:37:55.789230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.795629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.795648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.795651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.795652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.795661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.795666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.795669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797262309:12601]
2025-10-02T09:37:55.795697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.795704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.795704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.795706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.795710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.795712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.795877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.802434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3823 sessionId: src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.804731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:55.865132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556334872853563:3784]
2025-10-02T09:37:55.865317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3822, pipe: [1:7556556334872853563:3784]
2025-10-02T09:37:55.906429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:55.906880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.906889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.906902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853563:3784], now have 1 active actors on pipe
2025-10-02T09:37:55.907062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:55.907117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556334872853563:3784]
2025-10-02T09:37:55.907128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:55.907148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:55.907219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3823 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0
2025-10-02T09:37:55.907383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3823 sessionId: src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0 is DEAD
2025-10-02T09:37:55.907779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:55.907790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Write session will restart in 0.005463s
2025-10-02T09:37:55.907805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Write session: Do CDS request
2025-10-02T09:37:55.907810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:55.914132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.914248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:55.914261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3824
2025-10-02T09:37:55.914403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:55.914439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:55.914445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:55.914449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:55.914800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3824 sessionId:  describe result for acl check
2025-10-02T09:37:55.914830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:55.914834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:55.914836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:55.914840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:55.915275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:55.917003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:55.918093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:55.918373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:55.918499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:55.918508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:55.918516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:55.918556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:55.918588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556334797262480:12603]
2025-10-02T09:37:55.918697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:55.918706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:55.918709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556334872853690:4391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:55.918714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:55.918995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:55.919161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:55.919186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:55.919381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:55.919413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.919417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.919418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.919419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.919419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.919420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.919420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.919421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.919421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.919422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.919423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.919423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.919426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.919433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.919435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.919437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.919439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.919441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.919443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.919445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.919447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.919449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.919451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.919453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.919457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.919461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:55.919464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.919467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:55.919469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.919472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:55.919474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.919477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:55.919480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.919482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:55.919484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.919487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:55.919489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.919495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:55.919498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.919500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:55.919506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.919509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:55.919511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.919514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.919516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.919519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.919521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.919524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.919544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:55.927049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:55.928376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:55.928386Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:55.928387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:55.928389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:55.928393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3823 [2:7556556334797262480:12603]
2025-10-02T09:37:55.928400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:55.928410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:55.928415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.928416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.928418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.928427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:55.928433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:55.928437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:55.928469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.928473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.928475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.928476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:55.928478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:55.928512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:55.928516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.928522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:55.928527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:55.928539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:55.928556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853564:2446], now have 1 active actors on pipe
2025-10-02T09:37:55.928562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556334872853727:4391], now have 1 active actors on pipe
2025-10-02T09:37:55.928567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.928568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.928570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.928579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:55.928590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:55.928592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:55.928597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:55.928598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:55.928603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:55.928605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:55.928621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.928627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:55.928629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:55.928609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3823
2025-10-02T09:37:55.928610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3823
2025-10-02T09:37:55.928642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.928648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.928673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:55.928680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:55.928682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:55.928686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:55.928691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:55.928697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:55.928708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.928819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:55.928825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:55.928836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:55.928908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3824 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0
2025-10-02T09:37:55.929179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ad8d27-a9e3311b-2cd33061-6c218215_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:55.931680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Write session: try to update token
2025-10-02T09:37:55.931691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:55.937867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:55.937880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:55.937882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:55.937883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:55.937890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.937892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.937894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556334797262475:12603]
2025-10-02T09:37:55.937912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:55.937915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:55.937916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:55.937918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:55.937921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:55.937922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:55.938038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:55.942659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3824 sessionId: src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:55.944944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.007486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821042:3784]
2025-10-02T09:37:56.007720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3823, pipe: [1:7556556339167821042:3784]
2025-10-02T09:37:56.048195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.048728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.048738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.048765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821042:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.048917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:56.048928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.048971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821042:3784]
2025-10-02T09:37:56.048976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.048990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.049060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3824 reason: error at write: Disconnected sessionId: src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0
2025-10-02T09:37:56.049224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3824 sessionId: src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0 is DEAD
2025-10-02T09:37:56.049360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.049368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Write session will restart in 0.006193s
2025-10-02T09:37:56.049388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Write session: Do CDS request
2025-10-02T09:37:56.049392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.056129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.056268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.056280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3825
2025-10-02T09:37:56.056415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.056439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.056447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.056451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.056880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3825 sessionId:  describe result for acl check
2025-10-02T09:37:56.056923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.056929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.056930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.056935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.057235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.057427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.059202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.059239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.059360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.059367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.059372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.059402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.059425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092229944:12605]
2025-10-02T09:37:56.059772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.059940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.059965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.060144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.060172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.060176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.060178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.060178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.060179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.060179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.060180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.060180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.060181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.060181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.060184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.060191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.060193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.060195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.060197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.060199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.060201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.060203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.060205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.060207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.060209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.060211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.060215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.060219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.060222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.060225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.060227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.060229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.060231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.060234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.060237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.060240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.060242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.060244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.060247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.060249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.060251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.060254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.060256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.060259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.060261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.060263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.060266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.060268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.060274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.060277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.060294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.064333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.064344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.064347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167821175:4392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.064352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.068038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.069616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.069628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.069629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.069631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.069634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3824 [2:7556556339092229944:12605]
2025-10-02T09:37:56.069641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.069649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.069653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.069654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.069656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.069664Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.069670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.069676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.069706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.069711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.069712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.069714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.069715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.069753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.069757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.069764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.069769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.069780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.069795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821047:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.069800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821216:4392], now have 1 active actors on pipe
2025-10-02T09:37:56.069803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.069805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.069806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.069813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.069823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.069827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.069829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.069830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.069834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.069835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.069849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.069854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.069855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.069850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3824
2025-10-02T09:37:56.069880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.069851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3824
2025-10-02T09:37:56.069885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.069901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb4c40b0-791206ae-8fc90679-914210da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.069907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.069911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.069912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.069917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.069926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.069937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.070062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.070067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.070075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.070140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3825 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb4c40b0-791206ae-8fc90679-914210da_0
2025-10-02T09:37:56.070407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdba7bda-ac4f641f-ae57c7e0-632ab3d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb4c40b0-791206ae-8fc90679-914210da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.073045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Write session: try to update token
2025-10-02T09:37:56.073054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.079243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:56.079256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.079261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.079283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:56.079295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:56.079430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:56.079546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.079671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.079796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.079950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:56.079974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:56.084361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3825 sessionId: src_id|cb4c40b0-791206ae-8fc90679-914210da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.086741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.086874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.086881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.086902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:56.086967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:56.087974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.087984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.087986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.087987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.087991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.087993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.087995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092229939:12605]
2025-10-02T09:37:56.088013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.088019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.088020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.088023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.088025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.088025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.088133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.149307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821223:3784]
2025-10-02T09:37:56.149514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3824, pipe: [1:7556556339167821223:3784]
2025-10-02T09:37:56.197988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.204448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.204470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.204595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.204648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.204703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.204760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.204816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.204823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.204877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.204934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.204988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.205041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.205079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.205086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.205140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.205190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.205243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.205299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.205338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.205343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.205396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.205449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.205501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.205557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.205595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.205600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.205655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.205710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.205769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.205848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.205889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.205894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.205952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.206021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.206074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.206126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.206165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.206170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.206230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.206285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.206345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.206406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.206443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.206448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.206504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.206560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.206618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.206672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.206708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.206712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.206768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.206823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.206880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.206936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.206972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.206977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.207033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.207085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.207144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.207200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.207240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.207244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.207275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821223:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.207451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.207460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821223:3784]
2025-10-02T09:37:56.207465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.207489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.207490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3825 reason: error at write: Disconnected sessionId: src_id|cb4c40b0-791206ae-8fc90679-914210da_0
2025-10-02T09:37:56.207639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3825 sessionId: src_id|cb4c40b0-791206ae-8fc90679-914210da_0 is DEAD
2025-10-02T09:37:56.207757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.207766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Write session will restart in 0.005118s
2025-10-02T09:37:56.207781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Write session: Do CDS request
2025-10-02T09:37:56.207785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.207858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:56.214105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.214229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.214241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3826
2025-10-02T09:37:56.214377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.214400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.214407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.214411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.214792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3826 sessionId:  describe result for acl check
2025-10-02T09:37:56.214824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.214829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.214830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.214837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.215252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.215332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.217245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.217343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.217349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.217354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.217348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.217379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.217505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092230116:12608]
2025-10-02T09:37:56.217851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.218014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.218038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.218215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.218243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.218247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.218248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.218249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.218249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.218250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.218251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.218252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.218253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.218253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.218254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.218255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.218259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.218269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.218272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.218275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.218278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.218281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.218284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.218287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.218290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.218294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.218297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.218301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.218306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.218309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.218314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.218317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.218319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.218322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.218324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.218326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.218329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.218331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.218333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.218336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.218339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.218342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.218345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.218347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.218350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.218354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.218358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.218360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.218364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.218366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.218368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.218371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.218388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.222361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.222370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.222373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167821354:4419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.222378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.226077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.227517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.227528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.227529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.227531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.227535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3825 [2:7556556339092230116:12608]
2025-10-02T09:37:56.227545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.227556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.227561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.227563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.227564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.227572Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.227575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.227580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.227609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.227614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.227615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.227617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.227618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.227650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.227655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.227661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.227667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.227678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.227690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821225:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.227695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821395:4419], now have 1 active actors on pipe
2025-10-02T09:37:56.227699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.227701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.227702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.227709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.227719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.227722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.227725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.227726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.227727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.227729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.227743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.227750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.227739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3825
2025-10-02T09:37:56.227745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3825
2025-10-02T09:37:56.227756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.227773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.227778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.227793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25586025-1b9492fe-93fec341-1c1c9609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.227800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.227802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.227803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.227807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.227812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.227819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.227936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.227941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.227949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.228013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3826 partition: 0 MaxSeqNo: 36 sessionId: src_id|25586025-1b9492fe-93fec341-1c1c9609_0
2025-10-02T09:37:56.228268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb4c40b0-791206ae-8fc90679-914210da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25586025-1b9492fe-93fec341-1c1c9609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.230850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Write session: try to update token
2025-10-02T09:37:56.230862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.237009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:56.237022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.237026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.237050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:56.237059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:56.237186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:56.237298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.237411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.237522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.237744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:56.237772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:56.242030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3826 sessionId: src_id|25586025-1b9492fe-93fec341-1c1c9609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.244304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.244438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.244448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.244465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:56.244527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:56.245951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.245965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.245966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.245967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.245972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.245974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.245976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092230111:12608]
2025-10-02T09:37:56.245995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.245998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.246000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.246002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.246003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.246003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.246129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.307483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821424:3784]
2025-10-02T09:37:56.307632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3825, pipe: [1:7556556339167821424:3784]
2025-10-02T09:37:56.357026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.363871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.363888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.364016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.364070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.364127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.364184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.364227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.364234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.364289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.364342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.364396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.364453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.364490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.364494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.364547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.364599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.364657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.364708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.364744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.364749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.364813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.364868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.364925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.364979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.365015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.365019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.365073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.365127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.365188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.365247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.365288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.365292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.365355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.365408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.365461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.365514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.365548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.365553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.365612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.365667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.365729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.365790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.365832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.365838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.365896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.365949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.366005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.366061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.366101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.366106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.366163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.366218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.366272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.366325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.366363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.366367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.366425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:37:56.366479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:37:56.366535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:37:56.366590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:37:56.366627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:37:56.366631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:37:56.366659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821424:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.366832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.366867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821424:3784]
2025-10-02T09:37:56.366880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.366883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.366910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3826 reason: error at write: Disconnected sessionId: src_id|25586025-1b9492fe-93fec341-1c1c9609_0
2025-10-02T09:37:56.367078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3826 sessionId: src_id|25586025-1b9492fe-93fec341-1c1c9609_0 is DEAD
2025-10-02T09:37:56.367213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.367222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Write session will restart in 0.007887s
2025-10-02T09:37:56.367239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Write session: Do CDS request
2025-10-02T09:37:56.367243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.367353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:56.375410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.376113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.376529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.376539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3827
2025-10-02T09:37:56.376657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.376679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.376686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.376690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.377043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3827 sessionId:  describe result for acl check
2025-10-02T09:37:56.377073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.377078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.377079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.377084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.377521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.377527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.377636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.377643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.377649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.377676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.377699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092230334:12622]
2025-10-02T09:37:56.378047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.378238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.378261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.378444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.378473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.378477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.378478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.378478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.378479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.378480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.378480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.378481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.378481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.378482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.378482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.378483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.378486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.378492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.378494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.378496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.378498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.378500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.378502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.378504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.378506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.378509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.378511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.378513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.378517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.378520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.378523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.378527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.378529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.378532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.378533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.378536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.378538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.378541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.378543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.378555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.378557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.378560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.378562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.378565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.378567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.378569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.378571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.378576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.378578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.378581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.378586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.378589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.378605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.378954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.383579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.383593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.383596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167821560:4506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.383602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.386258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.387648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.387660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.387662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.387664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.387667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3826 [2:7556556339092230334:12622]
2025-10-02T09:37:56.387673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.387685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.387690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.387692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.387693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.387702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.387705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.387711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.387741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.387745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.387746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.387748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.387749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.387784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.387790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.387796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.387801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.387813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.387828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821428:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.387833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821599:4506], now have 1 active actors on pipe
2025-10-02T09:37:56.387837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.387838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.387839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.387847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.387854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.387861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.387863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.387864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.387864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.387866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.387880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.387887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.387878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3826
2025-10-02T09:37:56.387893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.387880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3826
2025-10-02T09:37:56.387914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.387920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.387933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.387940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.387942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.387944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.387949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.387956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.387963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.388076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.388081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.388089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.388153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3827 partition: 0 MaxSeqNo: 36 sessionId: src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0
2025-10-02T09:37:56.388515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25586025-1b9492fe-93fec341-1c1c9609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.391070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Write session: try to update token
2025-10-02T09:37:56.391081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.397148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:56.397160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.397165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.397188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:56.397190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:56.397331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:56.397459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.397570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.397693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.397858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:56.397881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:56.403281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3827 sessionId: src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.405566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.405790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.405805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.405815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.405817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.405818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.405822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.405826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.405827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.405829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092230317:12622]
2025-10-02T09:37:56.405850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.405853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.405856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.405857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.405859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.405861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.405974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.467260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821606:3784]
2025-10-02T09:37:56.467450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3826, pipe: [1:7556556339167821606:3784]
2025-10-02T09:37:56.515497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.516051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:56.516072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821606:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.516166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:56.516249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821606:3784]
2025-10-02T09:37:56.516272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.516274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.516279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.516335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3827 reason: error at write: Disconnected sessionId: src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0
2025-10-02T09:37:56.516453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3827 sessionId: src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0 is DEAD
2025-10-02T09:37:56.516581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.516592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Write session will restart in 0.005363s
2025-10-02T09:37:56.516608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Write session: Do CDS request
2025-10-02T09:37:56.516612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.523177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.523286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.523299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3828
2025-10-02T09:37:56.523407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.523431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.523438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.523441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.523766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3828 sessionId:  describe result for acl check
2025-10-02T09:37:56.523789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.523792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.523793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.523797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.524192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.524270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.525598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.526239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.526341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.526348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.526354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.526379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.526404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092230507:12626]
2025-10-02T09:37:56.526752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.526915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.526937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.527117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.527149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.527153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.527154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.527155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.527155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.527156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.527156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.527157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.527157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.527158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.527158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.527159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.527168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.527172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.527176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.527178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.527180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.527182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.527184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.527186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.527188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.527192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.527197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.527200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.527205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.527208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.527210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.527215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.527221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.527224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.527226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.527228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.527232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.527234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.527236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.527239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.527241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.527243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.527245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.527248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.527250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.527252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.527269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.527466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.527475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.527477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167821751:4539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.527481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.534752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.536318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.536330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.536331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.536333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.536337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3827 [2:7556556339092230507:12626]
2025-10-02T09:37:56.536345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.536355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.536360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.536361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.536362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.536371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.536374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.536378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.536406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.536411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.536412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.536414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.536415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.536451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.536456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.536463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.536468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.536476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.536490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821619:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.536495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821791:4539], now have 1 active actors on pipe
2025-10-02T09:37:56.536499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.536500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.536501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.536508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.536517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.536522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.536524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.536525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.536526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.536527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.536541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.536546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.536548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.536544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3827
2025-10-02T09:37:56.536549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3827
2025-10-02T09:37:56.536577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.536582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.536596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.536604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.536606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.536607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.536612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.536620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.536631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.536766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.536776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.536792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.536880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3828 partition: 0 MaxSeqNo: 36 sessionId: src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0
2025-10-02T09:37:56.537136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc5405c-e3a6c8af-772dc009-fbb0575a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.539634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Write session: try to update token
2025-10-02T09:37:56.539646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.545786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.545800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.545801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.545802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.545807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.545809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.545811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092230502:12626]
2025-10-02T09:37:56.545834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.545837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.545838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.545838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.545842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.545843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.545941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.550686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3828 sessionId: src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.552959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.616233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821803:3784]
2025-10-02T09:37:56.616455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3827, pipe: [1:7556556339167821803:3784]
2025-10-02T09:37:56.659490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.659897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.659906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.659932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821803:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.660095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:56.660146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821803:3784]
2025-10-02T09:37:56.660167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.660179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:56.660255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3828 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0
2025-10-02T09:37:56.660399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3828 sessionId: src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0 is DEAD
2025-10-02T09:37:56.660522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:56.660531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Write session will restart in 0.008476s
2025-10-02T09:37:56.660552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Write session: Do CDS request
2025-10-02T09:37:56.660556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.670171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.670322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.670335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3829
2025-10-02T09:37:56.670467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.670490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.670498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.670501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.670855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3829 sessionId:  describe result for acl check
2025-10-02T09:37:56.670890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.670895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.670896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.670900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.671320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.671605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.671879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.672121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.672132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.672142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.672189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.672220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092230678:12628]
2025-10-02T09:37:56.672654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.672834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.672861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.673033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.673050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.673083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.673087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.673088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.673088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.673089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.673089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.673090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.673090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.673091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.673091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.673092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.673092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.673095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.673102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.673104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.673106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.673108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.673110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.673112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.673114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.673116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.673119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.673121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.673122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.673126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.673131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.673134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.673137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.673140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.673142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.673146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.673149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.673151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.673153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.673155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.673158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.673160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.673164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.673168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.673177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.673184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.673188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.673196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.673203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.673208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.673215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.673217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.673219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.673241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.678112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.678122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.678124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167821937:4549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.678129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.680698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.682048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.682060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.682061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.682063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.682067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3828 [2:7556556339092230678:12628]
2025-10-02T09:37:56.682074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.682085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.682090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.682092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.682093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.682102Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.682108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.682112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.682144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.682148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.682149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.682151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.682153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.682272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3828
2025-10-02T09:37:56.682279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3828
2025-10-02T09:37:56.682354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.682361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.682368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.682374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.682383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.682398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821977:4549], now have 1 active actors on pipe
2025-10-02T09:37:56.682403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821804:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.682413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.682418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.682431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.682435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.682436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.682444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.682454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.682457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.682459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.682460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.682464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.682466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.682475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.682482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.682484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.682485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.682490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.682499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.682516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.682524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.682530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.682532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.682659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.682666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.682676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.682755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3829 partition: 0 MaxSeqNo: 36 sessionId: src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0
2025-10-02T09:37:56.683004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ac2223-e35e6e69-a441bfab-616ecd4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.685763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Write session: try to update token
2025-10-02T09:37:56.685781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.691572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.691584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.691585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.691586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.691589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.691592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.691593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092230673:12628]
2025-10-02T09:37:56.691612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.691615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.691616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.691617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.691617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.691619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.691725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.698510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3829 sessionId: src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.700710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.760125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167821985:3784]
2025-10-02T09:37:56.760292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3828, pipe: [1:7556556339167821985:3784]
2025-10-02T09:37:56.801447Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.801790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.801801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.801812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821985:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.801962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:56.802004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.802015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.802037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167821985:3784]
2025-10-02T09:37:56.802061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.802096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3829 reason: error at write: Disconnected sessionId: src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0
2025-10-02T09:37:56.802253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3829 sessionId: src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0 is DEAD
2025-10-02T09:37:56.802398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.802411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Write session will restart in 0.005348s
2025-10-02T09:37:56.802431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Write session: Do CDS request
2025-10-02T09:37:56.802436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.809164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.809239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.809248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3830
2025-10-02T09:37:56.809332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.809354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.809362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.809364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.809718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3830 sessionId:  describe result for acl check
2025-10-02T09:37:56.809750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.809755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.809756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.809759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.810196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.811851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.812975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.813241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.813336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.813342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.813349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.813381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.813416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092230851:12630]
2025-10-02T09:37:56.813698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.813707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.813709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167822118:4574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.813713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.813869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.814038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.814071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.814254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.814284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.814287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.814288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.814289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.814289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.814290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.814290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.814291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.814291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.814292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.814292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.814293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.814296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.814302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.814304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.814306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.814308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.814310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.814312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.814314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.814316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.814318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.814320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.814322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.814326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.814331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.814334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.814336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.814339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.814341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.814343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.814346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.814348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.814350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.814352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.814355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.814357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.814360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.814362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.814364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.814367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.814369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.814371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.814374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.814376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.814378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.814385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.814387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.814405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.821828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.823384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.823393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.823394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.823396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.823399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3829 [2:7556556339092230851:12630]
2025-10-02T09:37:56.823406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.823416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.823420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.823422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.823423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.823431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.823434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.823441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.823471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.823476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.823477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.823479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.823480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.823514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.823518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.823525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.823530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.823541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.823553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.823557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.823558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.823566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.823571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.823573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.823574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.823580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167821986:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.823584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167822154:4574], now have 1 active actors on pipe
2025-10-02T09:37:56.823590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.823604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.823609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.823627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.823637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.823624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3829
2025-10-02T09:37:56.823634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3829
2025-10-02T09:37:56.823646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.823677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.823685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.823703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.823711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.823713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.823715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.823722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.823729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.823742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.823872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.823877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.823885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.823957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3830 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0
2025-10-02T09:37:56.824358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b2f1a3-8e0e413f-8118a3a9-d9757ed5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.827042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Write session: try to update token
2025-10-02T09:37:56.827054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.836573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:37:56.836588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.836592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.836619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:37:56.836622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:37:56.836762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:37:56.836893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.837014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.837132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:37:56.837293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:37:56.837317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:37:56.838861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3830 sessionId: src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.841193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:56.841852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.841866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.841876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.841878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.841879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.841880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.841885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.841890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.841892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092230846:12630]
2025-10-02T09:37:56.841910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.841914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.841917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.841918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.841920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.841922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.842024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.902445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556339167822168:3784]
2025-10-02T09:37:56.902671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3829, pipe: [1:7556556339167822168:3784]
2025-10-02T09:37:56.952344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:56.952736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:37:56.952763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167822168:3784], now have 1 active actors on pipe
2025-10-02T09:37:56.952849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:56.952955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556339167822168:3784]
2025-10-02T09:37:56.952983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:56.962332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:56.962345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:56.962364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3830 reason: error at write: Disconnected sessionId: src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0
2025-10-02T09:37:56.962483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3830 sessionId: src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0 is DEAD
2025-10-02T09:37:56.962622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:56.962632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Write session will restart in 0.009038s
2025-10-02T09:37:56.962647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Write session: Do CDS request
2025-10-02T09:37:56.962656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:56.966388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:56.966664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:56.966762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:56.966769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:56.966775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:56.966800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:56.966824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556339092231026:12632]
2025-10-02T09:37:56.967170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:56.967369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:56.967408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:56.967686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:56.967724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.967728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.967728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.967729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.967730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.967730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.967731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.967731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.967732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.967733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.967733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.967734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.967738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.967745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.967747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.967749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.967751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.967754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.967756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.967758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.967760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.967763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.967765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.967767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.967772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.967776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:56.967780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.967783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:56.967785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.967788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:56.967790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.967793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:56.967795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.967798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:56.967800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.967803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:56.967805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.967808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:56.967810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.967813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:56.967815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.967818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:56.967821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.967823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.967825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.967828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.967831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.967833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.967850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:56.973112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.973245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:56.973259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3831
2025-10-02T09:37:56.973399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:56.973427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:56.973435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:56.973439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:56.973789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3831 sessionId:  describe result for acl check
2025-10-02T09:37:56.973824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:56.973830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:56.973831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:56.973835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:56.974255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:56.975625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:56.976306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:56.977067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:56.977132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:56.977138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:56.977140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:56.977144Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3830 [2:7556556339092231026:12632]
2025-10-02T09:37:56.977151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:56.977164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:56.977169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.977170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.977171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.977180Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:56.977186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:56.977191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:56.977224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.977229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.977230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.977232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:56.977233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:56.977267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:56.977272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.977279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:56.977286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:56.977298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:56.977317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167822172:2446], now have 1 active actors on pipe
2025-10-02T09:37:56.977325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.977326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.977328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.977339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:56.977336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3830
2025-10-02T09:37:56.977352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:56.977353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:56.977355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:56.977356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:56.977367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:56.977369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:56.977386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.977393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:56.977406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:56.981061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:56.981070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:56.981073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556339167822319:4581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:56.981078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:56.981224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556339167822354:4581], now have 1 active actors on pipe
2025-10-02T09:37:56.981256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3830
2025-10-02T09:37:56.981295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.981301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.981318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16060669-3c73ef77-4e77ce22-3b970f69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:56.981325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:56.981330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:56.981331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:56.981337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:56.981347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:56.981357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.981474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:56.981479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:56.981486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:56.981540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3831 partition: 0 MaxSeqNo: 36 sessionId: src_id|16060669-3c73ef77-4e77ce22-3b970f69_0
2025-10-02T09:37:56.981780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a405cde-62a4b1df-1a8c3df5-29ac0f6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16060669-3c73ef77-4e77ce22-3b970f69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:56.984298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Write session: try to update token
2025-10-02T09:37:56.984309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:56.986855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:56.986869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:56.986870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:56.986871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:56.986875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.986878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.986881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556339092231021:12632]
2025-10-02T09:37:56.986901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:56.986906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:56.986907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:56.986908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:56.986909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:56.986911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:56.987019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:56.996093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3831 sessionId: src_id|16060669-3c73ef77-4e77ce22-3b970f69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:56.998396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.052970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462789657:3784]
2025-10-02T09:37:57.053175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3830, pipe: [1:7556556343462789657:3784]
2025-10-02T09:37:57.098497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.098728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.098737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.098750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462789657:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.098939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.098967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462789657:3784]
2025-10-02T09:37:57.098987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.098990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.099058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3831 reason: error at write: Disconnected sessionId: src_id|16060669-3c73ef77-4e77ce22-3b970f69_0
2025-10-02T09:37:57.099085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.099207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3831 sessionId: src_id|16060669-3c73ef77-4e77ce22-3b970f69_0 is DEAD
2025-10-02T09:37:57.099335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.099351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Write session will restart in 0.005160s
2025-10-02T09:37:57.099368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Write session: Do CDS request
2025-10-02T09:37:57.099373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.105098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.105202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.105211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3832
2025-10-02T09:37:57.105339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.105361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.105364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.105371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.105736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3832 sessionId:  describe result for acl check
2025-10-02T09:37:57.105768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.105770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.105771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.105775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.106242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.107725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.110308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.110447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.110457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.110459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462789741:4608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.110464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.110588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.110747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.110755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.110762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.110793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.110816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387198497:12634]
2025-10-02T09:37:57.111172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.111333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.111367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.111551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.111582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.111586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.111586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.111587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.111587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.111588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.111588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.111589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.111589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.111590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.111590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.111591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.111594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.111600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.111602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.111604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.111606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.111608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.111610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.111612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.111614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.111616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.111618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.111620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.111624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.111628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.111632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.111635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.111638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.111640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.111643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.111646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.111648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.111659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.111663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.111665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.111668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.111670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.111673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.111676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.111679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.111681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.111686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.111689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.111691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.111694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.111696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.111698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.111715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.119575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.120894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.120904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.120905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.120907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.120911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3831 [2:7556556343387198497:12634]
2025-10-02T09:37:57.120918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.120929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.120934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.120935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.120936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.120945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.120951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.120955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.120988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.120993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.120994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.120996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.120997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.121032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.121036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.121043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.121048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.121058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.121075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462789658:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.121082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462789829:4608], now have 1 active actors on pipe
2025-10-02T09:37:57.121087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.121092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.121094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.121103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.121114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.121116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.121122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.121123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.121127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.121129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.121143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.121126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3831
2025-10-02T09:37:57.121149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.121126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3831
2025-10-02T09:37:57.121150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.121170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.121175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.121310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d35292-448e9295-2201a763-50212055_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.121321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.121324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.121330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.121337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.121346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.121364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.121484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.121489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.121497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.121560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3832 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d35292-448e9295-2201a763-50212055_0
2025-10-02T09:37:57.121793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16060669-3c73ef77-4e77ce22-3b970f69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d35292-448e9295-2201a763-50212055_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.124467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Write session: try to update token
2025-10-02T09:37:57.124482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.130569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.130580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.130581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.130582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.130586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.130588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.130590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387198491:12634]
2025-10-02T09:37:57.130609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.130611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.130613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.130614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.130614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.130616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.130729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.137048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3832 sessionId: src_id|3d35292-448e9295-2201a763-50212055_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.139263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.199420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462789842:3784]
2025-10-02T09:37:57.199604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3831, pipe: [1:7556556343462789842:3784]
2025-10-02T09:37:57.238313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.238618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.238627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.238639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462789842:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.238828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.238828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462789842:3784]
2025-10-02T09:37:57.238855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.238858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.238921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3832 reason: error at write: Disconnected sessionId: src_id|3d35292-448e9295-2201a763-50212055_0
2025-10-02T09:37:57.239043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.239071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3832 sessionId: src_id|3d35292-448e9295-2201a763-50212055_0 is DEAD
2025-10-02T09:37:57.239207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.239218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Write session will restart in 0.006025s
2025-10-02T09:37:57.239234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Write session: Do CDS request
2025-10-02T09:37:57.239238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.246166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.246276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.246289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3833
2025-10-02T09:37:57.246388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.246410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.246417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.246420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.246787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3833 sessionId:  describe result for acl check
2025-10-02T09:37:57.246820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.246825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.246826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.246831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.247252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.249236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.250042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.250332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.250434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.250440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.250446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.250472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.250494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387198673:12637]
2025-10-02T09:37:57.250910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.250983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.250992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.250995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462789978:4636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.251000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.251082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.251107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.251297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.251332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.251336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.251337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.251337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.251338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.251338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.251339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.251339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.251340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.251341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.251341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.251342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.251353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.251360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.251362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.251364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.251366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.251368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.251370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.251372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.251374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.251376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.251378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.251380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.251384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.251388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.251391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.251394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.251396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.251401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.251403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.251405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.251409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.251412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.251415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.251418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.251420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.251423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.251425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.251427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.251429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.251432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.251437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.251440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.251442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.251445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.251448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.251451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.251467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.259289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.260735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.260748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.260749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.260751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.260754Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3832 [2:7556556343387198673:12637]
2025-10-02T09:37:57.260761Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.260769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.260771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.260772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.260773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.260782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.260789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.260793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.260837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.260841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.260843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.260845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.260846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.260882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.260887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.260893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.260899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.260910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.260928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462789843:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.260935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790018:4636], now have 1 active actors on pipe
2025-10-02T09:37:57.260940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.260945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.260947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.260956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.260968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.260969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.260976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.260977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.260981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.260984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.260999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.261006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.261007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.260986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3832
2025-10-02T09:37:57.260989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3832
2025-10-02T09:37:57.261025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.261030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.261050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df12a48-95320f9b-84ceae55-3610aafb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.261056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.261059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.261060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.261067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.261078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.261096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.261233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.261239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.261248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.261345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3833 partition: 0 MaxSeqNo: 36 sessionId: src_id|5df12a48-95320f9b-84ceae55-3610aafb_0
2025-10-02T09:37:57.261678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d35292-448e9295-2201a763-50212055_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5df12a48-95320f9b-84ceae55-3610aafb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.264239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Write session: try to update token
2025-10-02T09:37:57.264252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.270668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.270681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.270682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.270683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.270687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.270689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.270691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387198668:12637]
2025-10-02T09:37:57.270712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.270714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.270716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.270717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.270717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.270719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.270834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.276980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3833 sessionId: src_id|5df12a48-95320f9b-84ceae55-3610aafb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.279219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.339161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462790049:3784]
2025-10-02T09:37:57.339303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3832, pipe: [1:7556556343462790049:3784]
2025-10-02T09:37:57.384006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.384334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.384343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.384355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790049:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.384493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.384518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.384522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.384542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462790049:3784]
2025-10-02T09:37:57.384590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3833 reason: error at write: Disconnected sessionId: src_id|5df12a48-95320f9b-84ceae55-3610aafb_0
2025-10-02T09:37:57.384757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3833 sessionId: src_id|5df12a48-95320f9b-84ceae55-3610aafb_0 is DEAD
2025-10-02T09:37:57.384917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.384945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.384958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Write session will restart in 0.007761s
2025-10-02T09:37:57.384977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Write session: Do CDS request
2025-10-02T09:37:57.384983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.394161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.394573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.394585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3834
2025-10-02T09:37:57.394679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.394701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.394709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.394712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.395100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3834 sessionId:  describe result for acl check
2025-10-02T09:37:57.395131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.395136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.395137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.395141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.395558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.395679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.395979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.396234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.396247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.396257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.396313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.396346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387198899:12652]
2025-10-02T09:37:57.396763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.396943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.396969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.397120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.397154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.397185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.397189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.397190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.397191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.397193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.397194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.397194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.397195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.397196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.397196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.397197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.397198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.397200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.397206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.397209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.397211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.397213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.397215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.397217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.397219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.397221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.397223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.397225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.397227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.397230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.397234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.397237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.397240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.397243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.397245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.397249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.397253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.397256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.397260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.397264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.397271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.397274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.397278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.397283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.397288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.397295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.397299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.397305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.397307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.397309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.397312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.397314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.397320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.397337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.402513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.402524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.402527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462790191:4681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.402532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.405265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.406706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.406718Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.406719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.406721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.406724Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3833 [2:7556556343387198899:12652]
2025-10-02T09:37:57.406731Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.406740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.406741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.406743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.406744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.406752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.406755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.406759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.406789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.406794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.406796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.406797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.406799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.406836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.406841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.406847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.406853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.406860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.406879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790053:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.406886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790231:4681], now have 1 active actors on pipe
2025-10-02T09:37:57.406890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.406892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.406893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.406905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.406917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.406918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.406925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.406926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.406920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3833
2025-10-02T09:37:57.406923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3833
2025-10-02T09:37:57.406930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.406932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.406946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.406949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.406950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.406963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.406965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.406991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2881439-5b8f1086-9a65210-d449eaac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.406998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.407000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.407001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.407007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.407013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.407024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.407131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.407138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.407149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.407214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3834 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2881439-5b8f1086-9a65210-d449eaac_0
2025-10-02T09:37:57.407453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df12a48-95320f9b-84ceae55-3610aafb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2881439-5b8f1086-9a65210-d449eaac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.410030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Write session: try to update token
2025-10-02T09:37:57.410040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.416759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.416775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.416777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.416778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.416783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.416786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.416787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387198893:12652]
2025-10-02T09:37:57.416818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.416820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.416821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.416822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.416824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.416825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.416931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.421564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3834 sessionId: src_id|b2881439-5b8f1086-9a65210-d449eaac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.423921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.484579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462790250:3784]
2025-10-02T09:37:57.484774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3833, pipe: [1:7556556343462790250:3784]
2025-10-02T09:37:57.529608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.529896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.529904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.529928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790250:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.530153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.530121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.530136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.530139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.530190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462790250:3784]
2025-10-02T09:37:57.530206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3834 reason: error at write: Disconnected sessionId: src_id|b2881439-5b8f1086-9a65210-d449eaac_0
2025-10-02T09:37:57.530374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3834 sessionId: src_id|b2881439-5b8f1086-9a65210-d449eaac_0 is DEAD
2025-10-02T09:37:57.530519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.530530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Write session will restart in 0.007222s
2025-10-02T09:37:57.530544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Write session: Do CDS request
2025-10-02T09:37:57.530549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.539147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.539248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.539258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3835
2025-10-02T09:37:57.539381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.539403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.539410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.539414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.539751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3835 sessionId:  describe result for acl check
2025-10-02T09:37:57.539772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.539777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.539778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.539783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.540182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.541125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.541398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.541517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.541524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.541530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.541558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.541587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387199078:12655]
2025-10-02T09:37:57.541852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.541985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.542183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.542382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.542420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.542425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.542426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.542427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.542427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.542428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.542428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.542429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.542429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.542430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.542430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.542431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.542434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.542440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.542442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.542444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.542446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.542448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.542450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.542452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.542454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.542456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.542458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.542460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.542464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.542468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.542473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.542476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.542478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.542481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.542483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.542486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.542488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.542490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.542492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.542495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.542497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.542500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.542502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.542505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.542507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.542509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.542512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.542514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.542516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.542519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.542520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.542523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.542540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.546496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.546505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.546507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462790391:4722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.546512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.550076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.551566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.551577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.551578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.551580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.551583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3834 [2:7556556343387199078:12655]
2025-10-02T09:37:57.551593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.551601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.551606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.551608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.551609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.551617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.551620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.551624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.551653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.551658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.551659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.551661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.551662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.551700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.551705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.551711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.551716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.551726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.551744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790431:4722], now have 1 active actors on pipe
2025-10-02T09:37:57.551750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790252:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.551755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.551758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.551760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.551769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.551781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.551786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.551780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3834
2025-10-02T09:37:57.551779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3834
2025-10-02T09:37:57.551789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.551790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.551797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.551799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.551823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.551828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.551838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.551848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.551863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.551869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.551869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.551872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.551873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.551879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.551887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.551903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.552005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.552010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.552018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.552084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3835 partition: 0 MaxSeqNo: 36 sessionId: src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0
2025-10-02T09:37:57.552315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2881439-5b8f1086-9a65210-d449eaac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.555015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Write session: try to update token
2025-10-02T09:37:57.555029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.560891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.560901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.560903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.560903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.560907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.560910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.560911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387199073:12655]
2025-10-02T09:37:57.560930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.560933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.560935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.560937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.560937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.560938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.561046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.567660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3835 sessionId: src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.569893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.630516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462790438:3784]
2025-10-02T09:37:57.630753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3834, pipe: [1:7556556343462790438:3784]
2025-10-02T09:37:57.672333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.672569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.672585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.672599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790438:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.672793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.672823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.672828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.672860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462790438:3784]
2025-10-02T09:37:57.672918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3835 reason: error at write: Disconnected sessionId: src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0
2025-10-02T09:37:57.673048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.673078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3835 sessionId: src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0 is DEAD
2025-10-02T09:37:57.673212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.673222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Write session will restart in 0.007276s
2025-10-02T09:37:57.673245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Write session: Do CDS request
2025-10-02T09:37:57.673251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.681163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.681314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.681326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3836
2025-10-02T09:37:57.681437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.681462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.681470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.681473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.681800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3836 sessionId:  describe result for acl check
2025-10-02T09:37:57.681828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.681833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.681835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.681839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.682273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.683710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.683886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.684208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.684328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.684335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.684343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.684376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.684405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387199258:12657]
2025-10-02T09:37:57.684759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.684937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.684962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.685143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.685173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.685177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.685178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.685178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.685179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.685179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.685180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.685180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.685181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.685181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.685182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.685182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.685185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.685191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.685193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.685195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.685197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.685199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.685201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.685203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.685205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.685207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.685209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.685211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.685214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.685218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.685221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.685224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.685226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.685229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.685231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.685233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.685235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.685238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.685240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.685243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.685245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.685250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.685252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.685255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.685257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.685260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.685261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.685264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.685266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.685273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.685276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.685278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.685303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.685704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.685714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.685717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462790578:4763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.685722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.692740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.694305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.694317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.694318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.694320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.694323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3835 [2:7556556343387199258:12657]
2025-10-02T09:37:57.694330Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.694339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.694340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.694342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.694343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.694351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.694354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.694358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.694386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.694391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.694392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.694394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.694395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.694431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.694436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.694443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.694448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.694456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.694473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790617:4763], now have 1 active actors on pipe
2025-10-02T09:37:57.694482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.694485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.694486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.694496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.694506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790439:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.694509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.694511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.694512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.694512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.694523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.694529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.694521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3835
2025-10-02T09:37:57.694538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3835
2025-10-02T09:37:57.694551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.694558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.694567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.694575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.694583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.694595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.694602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.694605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.694606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.694611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.694619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.694636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.694830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3836 partition: 0 MaxSeqNo: 36 sessionId: src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0
2025-10-02T09:37:57.694743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.694749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.694759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.695085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d5ed4-75e87cb9-b783f934-f1e38888_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.697521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Write session: try to update token
2025-10-02T09:37:57.697534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.703726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.703737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.703738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.703739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.703745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.703749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.703754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387199253:12657]
2025-10-02T09:37:57.703775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.703778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.703781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.703782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.703784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.703791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.704336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.724648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3836 sessionId: src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.726978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.772862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462790626:3784]
2025-10-02T09:37:57.773101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3835, pipe: [1:7556556343462790626:3784]
2025-10-02T09:37:57.817636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.817881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.817891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.817904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790626:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.818105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:37:57.818117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.818120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:37:57.818178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462790626:3784]
2025-10-02T09:37:57.818188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.818192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3836 reason: error at write: Disconnected sessionId: src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0
2025-10-02T09:37:57.818345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3836 sessionId: src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0 is DEAD
2025-10-02T09:37:57.818501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:37:57.818512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Write session will restart in 0.006952s
2025-10-02T09:37:57.818534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Write session: Do CDS request
2025-10-02T09:37:57.818540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.826149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.826251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.826266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3837
2025-10-02T09:37:57.826390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.826416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.826425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.826428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.826786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3837 sessionId:  describe result for acl check
2025-10-02T09:37:57.826821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.826828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.826832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.826836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.827294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.829331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.831408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.831478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.831490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.831492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462790766:4789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.831497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.831682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.831803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.831810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.831816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.831843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.831872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387199439:12659]
2025-10-02T09:37:57.832220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.832385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.832409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.832594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.832626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.832630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.832631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.832631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.832632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.832632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.832633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.832633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.832634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.832634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.832635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.832636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.832638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.832645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.832647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.832649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.832651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.832653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.832655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.832657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.832659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.832661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.832663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.832665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.832669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.832673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.832676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.832679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.832681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.832684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.832686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.832689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.832691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.832693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.832697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.832699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.832702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.832704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.832706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.832709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.832711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.832714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.832718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.832721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.832724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.832726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.832728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.832733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.832750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.840531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.842249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.842260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.842261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.842263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.842267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3836 [2:7556556343387199439:12659]
2025-10-02T09:37:57.842274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.842284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.842289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.842291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.842292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.842300Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.842306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.842311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.842343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.842348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.842349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.842351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.842352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.842482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3836
2025-10-02T09:37:57.842487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3836
2025-10-02T09:37:57.842571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.842578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.842585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.842592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.842604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.842620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790627:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.842625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790803:4789], now have 1 active actors on pipe
2025-10-02T09:37:57.842636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.842641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.842652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.842656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.842657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.842665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.842676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.842678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.842679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.842680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.842684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.842685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.842694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52ede09-cf287454-41c4404b-404453b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.842701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.842704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.842707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.842711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.842717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.842735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.842743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.842749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.842751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.842880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.842887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.842896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.842970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3837 partition: 0 MaxSeqNo: 36 sessionId: src_id|a52ede09-cf287454-41c4404b-404453b7_0
2025-10-02T09:37:57.843320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|861fb918-b107baab-35cd7ed0-6e7a1d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a52ede09-cf287454-41c4404b-404453b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.845779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Write session: try to update token
2025-10-02T09:37:57.845792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.851816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.851828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.851829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.851830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.851834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.851837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.851839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387199432:12659]
2025-10-02T09:37:57.851858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.851861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.851863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.851864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.851865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.851866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.852023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:57.859812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3837 sessionId: src_id|a52ede09-cf287454-41c4404b-404453b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:57.862077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:57.918262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556343462790815:3784]
2025-10-02T09:37:57.918734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3836, pipe: [1:7556556343462790815:3784]
2025-10-02T09:37:57.965475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:57.965678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.965687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.965699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790815:3784], now have 1 active actors on pipe
2025-10-02T09:37:57.965820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:57.965907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556343462790815:3784]
2025-10-02T09:37:57.965912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:57.965941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:57.965997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3837 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a52ede09-cf287454-41c4404b-404453b7_0
2025-10-02T09:37:57.966144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3837 sessionId: src_id|a52ede09-cf287454-41c4404b-404453b7_0 is DEAD
2025-10-02T09:37:57.966288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:57.966295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Write session will restart in 0.009881s
2025-10-02T09:37:57.966317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Write session: Do CDS request
2025-10-02T09:37:57.966322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:57.977026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:57.977165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.977294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:57.977325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:57.977312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3838
2025-10-02T09:37:57.977425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:57.977432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:57.977438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:57.977466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:57.977473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:57.977489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556343387199619:12661]
2025-10-02T09:37:57.977498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:57.977506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:57.977510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:57.977832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3838 sessionId:  describe result for acl check
2025-10-02T09:37:57.977859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:57.977864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:57.977866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:57.977870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:57.977888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:57.978055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:57.978080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:57.978265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:57.978296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.978290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:57.978299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.978300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.978300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.978301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.978302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.978302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.978303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.978303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.978304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.978304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.978305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.978308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.978315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.978317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.978319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.978321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.978323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.978325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.978326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.978329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.978331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.978333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.978334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.978338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.978342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:57.978345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.978348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:57.978350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.978353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:57.978355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.978357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:57.978360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.978362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:57.978364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.978367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:57.978369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.978372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:57.978375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.978377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:57.978379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.978382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:57.978384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.978386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.978390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.978393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.978395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.978397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.978415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:57.979656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:57.984226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:57.984236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:57.984238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556343462790969:4791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:57.984245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:57.985843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:57.987494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:57.987504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:57.987505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:57.987507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:57.987510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3837 [2:7556556343387199619:12661]
2025-10-02T09:37:57.987518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:57.987527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:57.987533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.987534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.987535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.987544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:57.987550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:57.987554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:57.987586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.987591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.987591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.987593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:57.987595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:57.987630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:57.987634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.987641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:57.987650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:57.987667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:57.987684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462790822:2446], now have 1 active actors on pipe
2025-10-02T09:37:57.987690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556343462791004:4791], now have 1 active actors on pipe
2025-10-02T09:37:57.987695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.987697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.987699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.987708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:57.987707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3837
2025-10-02T09:37:57.987720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:57.987722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:57.987713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3837
2025-10-02T09:37:57.987728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:57.987729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:57.987732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:57.987734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:57.987750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.987753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:57.987754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:57.987765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.987771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.987794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:57.987801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:57.987803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:57.987804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:57.987810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:57.987818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:57.987826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.987932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:57.987938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:57.987948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:57.988016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3838 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0
2025-10-02T09:37:57.988297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ede09-cf287454-41c4404b-404453b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:57.990767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Write session: try to update token
2025-10-02T09:37:57.990782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:57.996736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:57.996749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:57.996750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:57.996751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:57.996754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.996756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.996758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556343387199613:12661]
2025-10-02T09:37:57.996776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:57.996778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:57.996780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:57.996781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:57.996781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:57.996782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:57.996919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.009364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3838 sessionId: src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.011581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.066234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757758311:3784]
2025-10-02T09:37:58.066438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3837, pipe: [1:7556556347757758311:3784]
2025-10-02T09:37:58.104742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.105140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.105150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.105161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758311:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.105300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.105340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.105362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757758311:3784]
2025-10-02T09:37:58.105396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.105488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3838 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0
2025-10-02T09:37:58.105637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3838 sessionId: src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0 is DEAD
2025-10-02T09:37:58.105766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.105777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Write session will restart in 0.008704s
2025-10-02T09:37:58.105791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Write session: Do CDS request
2025-10-02T09:37:58.105796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.114288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.115185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.115279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.115291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3839
2025-10-02T09:37:58.115413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.115437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.115445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.115449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.115809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3839 sessionId:  describe result for acl check
2025-10-02T09:37:58.115841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.115846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.115848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.115852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.116329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.116462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.116587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.116594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.116600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.116632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.116654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682167097:12663]
2025-10-02T09:37:58.117084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.117320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.117540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.117577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.117583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.117583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.117584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.117584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.117585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.117585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.117586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.117586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.117587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.117587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.117588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.117591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.117597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.117601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.117603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.117607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.117609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.117613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.117616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.117620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.117623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.117628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.117634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.117638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.117642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.117646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.117650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.117654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.117658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.117662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.117671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.117679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.117688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.117692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.117699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.117701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.117704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.117706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.117708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.117710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.117713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.117716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.117718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.117720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.117723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.117738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.117895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.122588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.122599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.122602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757758456:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.122607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.125203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.126680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.126691Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.126693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.126694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.126698Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3838 [2:7556556347682167097:12663]
2025-10-02T09:37:58.126704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.126715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.126719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.126721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.126722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.126731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.126737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.126741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.126772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.126776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.126779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.126780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.126782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.126815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.126820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.126826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.126832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.126846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.126864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758495:4829], now have 1 active actors on pipe
2025-10-02T09:37:58.126871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758312:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.126876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.126881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.126883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.126892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.126904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.126907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.126898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3838
2025-10-02T09:37:58.126911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.126899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3838
2025-10-02T09:37:58.126913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.126918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.126920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.126944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.126950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.126957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.126965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.126973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.126982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.126989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.126991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.126992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.126997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.127005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.127020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.127133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.127140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.127149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.127218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3839 partition: 0 MaxSeqNo: 36 sessionId: src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0
2025-10-02T09:37:58.127449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e5216c-6bc3b411-387e2f1c-48ac31b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.130045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Write session: try to update token
2025-10-02T09:37:58.130060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.136034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.136047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.136048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.136049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.136052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.136054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.136056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682167092:12663]
2025-10-02T09:37:58.136074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.136080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.136081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.136082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.136090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.136092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.136191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.143679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3839 sessionId: src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.145949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.205479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757758503:3784]
2025-10-02T09:37:58.205675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3838, pipe: [1:7556556347757758503:3784]
2025-10-02T09:37:58.244522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.244748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.244757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.244769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758503:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.244957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.245001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.245010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757758503:3784]
2025-10-02T09:37:58.245038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.245131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0
2025-10-02T09:37:58.245282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3839 sessionId: src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0 is DEAD
2025-10-02T09:37:58.245437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.245447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Write session will restart in 0.006361s
2025-10-02T09:37:58.245467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Write session: Do CDS request
2025-10-02T09:37:58.245471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.253168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.253229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.253239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3840
2025-10-02T09:37:58.253379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.253403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.253411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.253414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.253775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3840 sessionId:  describe result for acl check
2025-10-02T09:37:58.253805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.253810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.253811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.253815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.254240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.255637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.256405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.256662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.256784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.256793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.256816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.256855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.256880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682167282:12666]
2025-10-02T09:37:58.257250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.257444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.257471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.257536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.257545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.257548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757758647:4878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.257552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.257662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.257692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.257696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.257697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.257697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.257698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.257698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.257699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.257699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.257700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.257700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.257701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.257701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.257704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.257710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.257712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.257714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.257716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.257718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.257720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.257722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.257724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.257726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.257728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.257730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.257734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.257737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.257741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.257743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.257746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.257748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.257751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.257753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.257755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.257758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.257760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.257763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.257765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.257767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.257770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.257773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.257776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.257781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.257786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.257789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.257791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.257794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.257796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.257799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.257816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.265484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.266917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.266929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.266930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.266932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.266936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3839 [2:7556556347682167282:12666]
2025-10-02T09:37:58.266943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.266957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.266962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.266963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.266964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.266973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.266979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.266984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.267019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.267024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.267026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.267028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.267029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.267065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.267070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.267077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.267082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.267094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.267112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758686:4878], now have 1 active actors on pipe
2025-10-02T09:37:58.267121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758504:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.267126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.267128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.267130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.267140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.267150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.267151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.267153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.267154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.267162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.267164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.267180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.267187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.267188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.267164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3839
2025-10-02T09:37:58.267164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3839
2025-10-02T09:37:58.267198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.267203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.267230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|108dcef4-9af09be0-cefada82-fc8d207_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.267237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.267239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.267241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.267247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.267254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.267266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.267382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.267389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.267400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.267482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3840 partition: 0 MaxSeqNo: 36 sessionId: src_id|108dcef4-9af09be0-cefada82-fc8d207_0
2025-10-02T09:37:58.267691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c24d6-7f5fa927-a9669f09-f9b27c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|108dcef4-9af09be0-cefada82-fc8d207_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.270246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Write session: try to update token
2025-10-02T09:37:58.270261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.277022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.277033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.277034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.277035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.277040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.277043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.277045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682167276:12666]
2025-10-02T09:37:58.277064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.277067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.277068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.277069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.277071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.277076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.277235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.283946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3840 sessionId: src_id|108dcef4-9af09be0-cefada82-fc8d207_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.286207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.345233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757758708:3784]
2025-10-02T09:37:58.345414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3839, pipe: [1:7556556347757758708:3784]
2025-10-02T09:37:58.386236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.386426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.386436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.386447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758708:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.386564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.386632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.386635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757758708:3784]
2025-10-02T09:37:58.386657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.386722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3840 reason: status is not ok: tablet will be restarted right now sessionId: src_id|108dcef4-9af09be0-cefada82-fc8d207_0
2025-10-02T09:37:58.386871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3840 sessionId: src_id|108dcef4-9af09be0-cefada82-fc8d207_0 is DEAD
2025-10-02T09:37:58.387004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.387013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Write session will restart in 0.009148s
2025-10-02T09:37:58.387036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Write session: Do CDS request
2025-10-02T09:37:58.387040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.395513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.397115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.397200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.397209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3841
2025-10-02T09:37:58.397319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.397341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.397348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.397352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.397658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3841 sessionId:  describe result for acl check
2025-10-02T09:37:58.397687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.397692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.397694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.397698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.397773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.397879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.397885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.397892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.397919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.397943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682167513:12681]
2025-10-02T09:37:58.398081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.398314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.398493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.398523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.398780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.398836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.398842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.398843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.398843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.398844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.398845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.398846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.398847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.398847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.398848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.398849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.398850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.398854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.398863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.398866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.398869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.398872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.398876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.398880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.398883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.398887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.398890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.398897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.398901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.398910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.398920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.398928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.398931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.398937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.398939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.398942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.398948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.398951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.398953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.398958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.398961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.398963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.398966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.398971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.398974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.398977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.398980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.398986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.398988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.398991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.398994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.398996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.398998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.399015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.399951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.405111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.405120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.405123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757758867:4286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.405128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.406841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.408496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.408507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.408508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.408510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.408514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3840 [2:7556556347682167513:12681]
2025-10-02T09:37:58.408520Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.408529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.408534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.408535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.408536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.408544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.408548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.408553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.408586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.408591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.408592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.408594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.408595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.408629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.408634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.408641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.408648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.408663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.408680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758721:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.408687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758905:4286], now have 1 active actors on pipe
2025-10-02T09:37:58.408692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.408694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.408695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.408706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.408707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3840
2025-10-02T09:37:58.408709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3840
2025-10-02T09:37:58.408718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.408719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.408721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.408723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.408735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.408741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.408767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.408773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.408780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.408788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.408814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.408817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.408821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.408823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.408824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.408829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.408834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.408850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.408956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.408962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.408973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.409043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3841 partition: 0 MaxSeqNo: 36 sessionId: src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0
2025-10-02T09:37:58.409240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|108dcef4-9af09be0-cefada82-fc8d207_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.411738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Write session: try to update token
2025-10-02T09:37:58.411751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.418333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.418346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.418347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.418348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.418351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.418353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.418355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682167508:12681]
2025-10-02T09:37:58.418373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.418377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.418379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.418380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.418380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.418382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.418482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.424072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3841 sessionId: src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.426265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.486547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757758924:3784]
2025-10-02T09:37:58.486694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3840, pipe: [1:7556556347757758924:3784]
2025-10-02T09:37:58.528041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.528448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.528458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.528471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758924:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.528599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.528630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.528658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.528672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757758924:3784]
2025-10-02T09:37:58.528734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3841 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0
2025-10-02T09:37:58.528898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3841 sessionId: src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0 is DEAD
2025-10-02T09:37:58.529025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.529037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Write session will restart in 0.006294s
2025-10-02T09:37:58.529056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Write session: Do CDS request
2025-10-02T09:37:58.529061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.536200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.536266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.536279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3842
2025-10-02T09:37:58.536376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.536400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.536408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.536411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.536750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3842 sessionId:  describe result for acl check
2025-10-02T09:37:58.536775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.536777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.536778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.536784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.537208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.538769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.540397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.540649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.540745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.540756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.540758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757759070:4908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.540762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.540760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.540767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.540773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.540811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.540835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682167699:12684]
2025-10-02T09:37:58.541185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.541347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.541373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.541559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.541592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.541597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.541597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.541598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.541598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.541599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.541599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.541600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.541601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.541601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.541604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.541611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.541613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.541615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.541617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.541620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.541622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.541623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.541626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.541628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.541630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.541632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.541636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.541640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.541643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.541646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.541649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.541652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.541654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.541657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.541659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.541664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.541667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.541669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.541673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.541675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.541677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.541679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.541682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.541684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.541686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.541688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.541691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.541693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.541695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.541713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.549457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.550791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.550803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.550805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.550807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.550811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3841 [2:7556556347682167699:12684]
2025-10-02T09:37:58.550818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.550828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.550833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.550835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.550836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.550845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.550848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.550852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.550885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.550890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.550891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.550893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.550895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.550931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.550936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.550942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.550947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.550959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.550975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757758926:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.550981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759108:4908], now have 1 active actors on pipe
2025-10-02T09:37:58.550986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.550992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.550993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.551003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.551016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.551017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.551024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.551025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.551029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.551032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.551027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3841
2025-10-02T09:37:58.551049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.551030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3841
2025-10-02T09:37:58.551056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.551058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.551071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.551078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.551107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b05b7aaa-99502165-6e865325-c3fe249e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.551116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.551123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.551124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.551129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.551134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.551149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.551253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.551258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.551266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.551332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3842 partition: 0 MaxSeqNo: 36 sessionId: src_id|b05b7aaa-99502165-6e865325-c3fe249e_0
2025-10-02T09:37:58.551550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73cd1ad0-38025e68-3dff1a3f-c2c1c7d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b05b7aaa-99502165-6e865325-c3fe249e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.553956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Write session: try to update token
2025-10-02T09:37:58.553967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.560298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.560311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.560312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.560313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.560316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.560318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.560319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682167693:12684]
2025-10-02T09:37:58.560339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.560340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.560343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.560344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.560345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.560345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.560470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.566327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3842 sessionId: src_id|b05b7aaa-99502165-6e865325-c3fe249e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.568481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.628922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757759119:3784]
2025-10-02T09:37:58.629321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3841, pipe: [1:7556556347757759119:3784]
2025-10-02T09:37:58.670047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.670414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.670423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.670436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759119:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.670659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.670685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.670689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757759119:3784]
2025-10-02T09:37:58.670715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.670796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3842 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b05b7aaa-99502165-6e865325-c3fe249e_0
2025-10-02T09:37:58.670943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3842 sessionId: src_id|b05b7aaa-99502165-6e865325-c3fe249e_0 is DEAD
2025-10-02T09:37:58.671076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.671087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Write session will restart in 0.008866s
2025-10-02T09:37:58.671111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Write session: Do CDS request
2025-10-02T09:37:58.671116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.679790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.681244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.681307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.681321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3843
2025-10-02T09:37:58.681423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.681445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.681453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.681456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.681800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3843 sessionId:  describe result for acl check
2025-10-02T09:37:58.681813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.681829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.681834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.681835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.681839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.681927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.681934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.681940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.681968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.681992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682167883:12686]
2025-10-02T09:37:58.682248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.682385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.682538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.682565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.682948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.683011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.683017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.683018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.683019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.683020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.683020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.683021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.683022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.683023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.683024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.683025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.683026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.683030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.683040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.683043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.683046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.683049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.683052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.683055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.683058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.683065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.683072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.683079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.683085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.683091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.683101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.683109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.683116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.683120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.683127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.683131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.683139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.683147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.683154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.683158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.683164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.683168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.683175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.683180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.683187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.683196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.683203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.683207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.683214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.683218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.683225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.683231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.683263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.683602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.688349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.688359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.688361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757759268:4943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.688366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.691069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.692393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.692405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.692406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.692408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.692411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3842 [2:7556556347682167883:12686]
2025-10-02T09:37:58.692417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.692427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.692429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.692431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.692432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.692440Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.692446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.692450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.692483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.692488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.692489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.692490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.692492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.692529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.692534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.692540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.692545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.692555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.692573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759120:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.692579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759307:4943], now have 1 active actors on pipe
2025-10-02T09:37:58.692584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.692590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.692592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.692602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.692613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.692613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.692615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.692616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.692627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.692615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3842
2025-10-02T09:37:58.692631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.692620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3842
2025-10-02T09:37:58.692654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.692660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.692670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.692678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.692685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.692693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6d12d11-418c9081-84749961-9b74aef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.692697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.692699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.692700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.692705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.692714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.692728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.692840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.692848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.692858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.692912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3843 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6d12d11-418c9081-84749961-9b74aef8_0
2025-10-02T09:37:58.693163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b7aaa-99502165-6e865325-c3fe249e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6d12d11-418c9081-84749961-9b74aef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.695771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Write session: try to update token
2025-10-02T09:37:58.695782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.702104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.702119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.702121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.702122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.702127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.702130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.702134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682167878:12686]
2025-10-02T09:37:58.702156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.702156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.702159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.702161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.702163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.702164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.702302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.708062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3843 sessionId: src_id|f6d12d11-418c9081-84749961-9b74aef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.710350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.770733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757759315:3784]
2025-10-02T09:37:58.770916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3842, pipe: [1:7556556347757759315:3784]
2025-10-02T09:37:58.810774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.811253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.811263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.811277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759315:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.811413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.811503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757759315:3784]
2025-10-02T09:37:58.811549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.811655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.811737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6d12d11-418c9081-84749961-9b74aef8_0
2025-10-02T09:37:58.811894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3843 sessionId: src_id|f6d12d11-418c9081-84749961-9b74aef8_0 is DEAD
2025-10-02T09:37:58.812034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.812045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Write session will restart in 0.009457s
2025-10-02T09:37:58.812059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Write session: Do CDS request
2025-10-02T09:37:58.812063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.820586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:37:58.822160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.822285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.822296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3844
2025-10-02T09:37:58.822408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.822430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.822436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.822440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.822612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:37:58.822730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:37:58.822736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:37:58.822742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:37:58.822758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3844 sessionId:  describe result for acl check
2025-10-02T09:37:58.822772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:37:58.822781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:37:58.822786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:37:58.822787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:37:58.822796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556556347682168069:12688]
2025-10-02T09:37:58.822791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:37:58.823196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:37:58.823289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:37:58.823459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:37:58.823481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:37:58.823653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:37:58.823681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.823685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.823685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.823686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.823686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.823687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.823687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.823688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.823688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.823689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.823689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.823690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.823693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.823699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.823701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.823703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.823705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.823707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.823710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.823711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.823713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.823716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.823717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.823719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.823723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.823727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:37:58.823730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.823733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:37:58.823735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.823738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:37:58.823740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.823743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:37:58.823745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.823747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:37:58.823749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.823752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:37:58.823754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.823757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:37:58.823759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.823762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:37:58.823764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.823766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:37:58.823768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.823771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.823774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.823780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.823784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.823786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.823803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:37:58.824927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:37:58.829155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:37:58.829166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:37:58.829168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556556347757759465:4949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:37:58.829174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:37:58.831234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:37:58.832741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:37:58.832753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:37:58.832754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:37:58.832756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:37:58.832760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3843 [2:7556556347682168069:12688]
2025-10-02T09:37:58.832766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:37:58.832775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:37:58.832780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.832781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.832782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.832791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:37:58.832797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:37:58.832812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:37:58.832844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.832850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.832852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.832855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:37:58.832856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:37:58.832896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:37:58.832902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.832908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:37:58.832913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:37:58.832926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:37:58.832940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759316:2446], now have 1 active actors on pipe
2025-10-02T09:37:58.832945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759504:4949], now have 1 active actors on pipe
2025-10-02T09:37:58.832949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.832950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.832951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.832959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:37:58.832970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:37:58.832971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:37:58.832972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:37:58.832973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:37:58.832980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:37:58.832981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:37:58.832994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.832988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3843
2025-10-02T09:37:58.832996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3843
2025-10-02T09:37:58.833002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:37:58.833004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:37:58.833025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.833030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.833046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:37:58.833053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:37:58.833056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:37:58.833060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:37:58.833065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:37:58.833074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:37:58.833083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.833203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.833207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.833215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:37:58.833274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3844 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0
2025-10-02T09:37:58.833514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d12d11-418c9081-84749961-9b74aef8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:37:58.835990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Write session: try to update token
2025-10-02T09:37:58.836000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:37:58.842130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:37:58.842144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:37:58.842145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:37:58.842146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:37:58.842149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.842152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.842153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556556347682168064:12688]
2025-10-02T09:37:58.842171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:37:58.842174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:37:58.842175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:37:58.842177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:37:58.842180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:37:58.842182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:37:58.842311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:37:58.849632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3844 sessionId: src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:37:58.851898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:37:58.911526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556556347757759512:3784]
2025-10-02T09:37:58.911731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3843, pipe: [1:7556556347757759512:3784]
2025-10-02T09:37:58.952019Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:37:58.952381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:37:58.952390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:37:58.952404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556556347757759512:3784], now have 1 active actors on pipe
2025-10-02T09:37:58.952512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:37:58.952623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:37:58.952629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 39 consumer shared/user session shared/user_1_39_1223468248787352148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556556347757759512:3784]
2025-10-02T09:37:58.952667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:37:58.952735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3844 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0
2025-10-02T09:37:58.952902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3844 sessionId: src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0 is DEAD
2025-10-02T09:37:58.953035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:37:58.953048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Write session will restart in 0.007200s
2025-10-02T09:37:58.953068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Write session: Do CDS request
2025-10-02T09:37:58.953073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:37:58.961167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f555034-c9aa8327-626fba1d-b7b77bcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.961272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:37:58.961283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3845
2025-10-02T09:37:58.961366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:37:58.961387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:37:58.961395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:37:58.961398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:37:58.961440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9854287477/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/m5cl/0001dc/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9854287477/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/m5cl/0001dc/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-10-02T09:28:10.544046Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1759397290544042
2025-10-02T09:28:10.637683Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553825337423291:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:10.637733Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:10.642564Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553825228028240:2155];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:10.642612Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/tmpQljryy/pdisk_1.dat
2025-10-02T09:28:10.644533Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:10.641901Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:10.681461Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:10.682267Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:10.694037Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11985, node 1
2025-10-02T09:28:10.702829Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexNt4Cok.tmp
2025-10-02T09:28:10.702840Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexNt4Cok.tmp
2025-10-02T09:28:10.702904Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexNt4Cok.tmp
2025-10-02T09:28:10.702944Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:10.707051Z INFO: TTestServer started on Port 25619 GrpcPort 11985
TClient is connected to server localhost:25619
PQClient connected to localhost:11985
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:10.738264Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:10.738297Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:10.740014Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:10.744566Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T09:28:10.746399Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:10.746423Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
waiting...
2025-10-02T09:28:10.747554Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:28:10.747778Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:28:10.866401Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:10.945105Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:11.002767Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553829522995737:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.002788Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553829522995762:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.002798Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.004205Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:11.005592Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553829522995794:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.005624Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.005830Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553829522995796:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.005847Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:11.007944Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553829522995766:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T09:28:11.065895Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:11.066193Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553829632391490:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:11.066278Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=OGNlZGVmZGYtNGM4ZTNmMjUtNzkyZWQzYjgtYjBkMTFmNjA=, ActorId: [1:7556553829632391438:2320], ActorState: ExecuteState, TraceId: 01k6j4090n4cn01p32v61ev37z, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:11.066704Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:11.089700Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:11.091860Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553829522995861:2173] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:11.096526Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553829522995875:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:11.096607Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NmM0MTM5YWMtM2E0ZTk5NjctMThiY2EwOTAtMjdlNTcyMzI=, ActorId: [2:7556553829522995734:2294], ActorState: ExecuteState, TraceId: 01k6j408zt2hvtnpagsq1j5bfc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:11.096733Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:11.110828Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11985", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:11.150980Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6j4093s2gb673xsnresffcn, Database: , SessionId: ydb://session/3?node_id=1&id=Nzc4ZmE5ZmMtYTMyNzc3M2MtYjI3MDY3NWMtN2ZlMTI0ODM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553829632391880:2938] 
2025-10-02T09:28:11.639184Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:11.644306Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:15.637907Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553825337423291:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:15.637938Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:15.642515Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553825228028240:2155];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:15.642545Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:16.263231Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11985
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:16.279856Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11985
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:16.285849Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553851107228885:3252] connected; active server actors: 1
2025-10-02T09:28:16.286018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:16.286178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:16.286427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:16.288638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.289061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.289105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:16.289117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.289129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:16.289189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553851107228883:3251], now have 1 active actors on pipe
2025-10-02T09:28:16.289199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553851107228904:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.289244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:16.289351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:16.290038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:16.292674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553851107228940:3297], now have 1 active actors on pipe
2025-10-02T09:28:16.292747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:16.293609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:16.293794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.293823Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:16.293873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.293943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553850997832850:2398]
2025-10-02T09:28:16.294567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.294579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.294583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553850997832850:2398]
2025-10-02T09:28:16.294589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:16.294857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:16.294870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.294891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.294893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.294897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:16.294899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.294901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.294903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:16.294910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.294999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:16.295028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.295976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:16.296002Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397296342, TxId 281474976720677
2025-10-02T09:28:16.296009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.296010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.296024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.296054Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.296324Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6j40e4w9sxv0p0p498606z7, Database: , SessionId: ydb://session/3?node_id=1&id=NGM4YmIxMTAtNjhjNjMxMDMtYzM5ZWMxMTUtODg3M2JlOWU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:16.296425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.296463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.296471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.296472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.296473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.296476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.296536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:16.296551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.296574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:16.297396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:16.297412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:16.297728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397296342
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397296342
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11985
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:16.302033Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:16.395175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.395189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.395192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.495546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.495564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.495567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.595871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.595885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.595887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.696230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.696247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.696249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.796606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.796621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.796624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11985
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:16.803132Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:16.896949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.896967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.896970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.997438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.997453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.997458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.097606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.097630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.097633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.197990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.198006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.198009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.298315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.298329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.298331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11985
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:17.304868Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:17.306304Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:17.306523Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:17.306530Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11985
2025-10-02T09:28:17.308657Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:17.307140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.307156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:17.308892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:17.308920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:44100
2025-10-02T09:28:17.308925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:44100 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.308929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.309324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:17.309355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.309357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.309358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.309363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.309893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.337426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:17.337555Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553855402196442:2481] connected; active server actors: 1
2025-10-02T09:28:17.337590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:17.337596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.337930Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553855402196442:2481] disconnected; active server actors: 1
2025-10-02T09:28:17.337944Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553855402196442:2481] disconnected no session
2025-10-02T09:28:17.354070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.354085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:17.354090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553855402196411:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.354099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.354372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:17.354327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553855402196465:2481], now have 1 active actors on pipe
2025-10-02T09:28:17.354458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.354470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.354513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:17.354529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.354550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.354556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.354569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.354588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.354611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.354793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.354808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.354828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.354948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0
2025-10-02T09:28:17.355303Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397297355 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:17.355342Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.355462Z :INFO: [] MessageGroupId [src] SessionId [src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:17.355472Z :INFO: [] MessageGroupId [src] SessionId [src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0] Write session will now close
2025-10-02T09:28:17.355478Z :DEBUG: [] MessageGroupId [src] SessionId [src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0] Write session: aborting
2025-10-02T09:28:17.355614Z :INFO: [] MessageGroupId [src] SessionId [src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:17.355619Z :DEBUG: [] MessageGroupId [src] SessionId [src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0] Write session: destroy
2025-10-02T09:28:17.355794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0 grpc read done: success: 0 data: 
2025-10-02T09:28:17.355811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0 grpc read failed
2025-10-02T09:28:17.355818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0 grpc closed
2025-10-02T09:28:17.355822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f4c9a587-9221ed6a-5264fb7f-6f1ea782_0 is DEAD
2025-10-02T09:28:17.356109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:17.356229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553855402196465:2481] destroyed
2025-10-02T09:28:17.356245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:17.356251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.356254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.356256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.398692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.398708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.398712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-02T09:28:17.409388Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:25559 } ]
2025-10-02T09:28:17.499047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.499062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.499065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.599408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.599424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.599427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.699758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.699773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.699776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.800094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.800106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.800108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.900443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.900454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.900456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.000795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.000817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.000820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.101142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.101153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.101155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.201502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.201523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.201525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.301823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.301835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.301837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.402178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.402193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.402195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.502566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.502583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.502587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.602910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.602928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.602931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.703276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.703292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.703295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.803593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.803610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.803613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.903978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.903997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.904001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.004300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.004317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.004319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.104638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.104657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.104660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.205038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.205054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.205057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.305354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.305367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.305370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.405714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.405726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.405728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.506055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.506067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.506070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.606422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.606441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.606443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.706776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.706789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.706800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.807108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.807119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.807121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.907489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.907502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.907504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.007830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.007843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.007846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.108195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.108210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.108213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.208529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.208544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.208547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.308857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.308872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.308875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.409241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.409257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.409260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.509616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.509630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.509632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.609966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.609981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.609983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.710348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.710366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.710370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.810663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.810677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.810680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.911020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.911037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.911040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.011347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.011362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.011365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.111710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.111722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.111724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.212071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.212086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.212090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.295070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:21.312416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.312432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.312436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.412794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.412823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.412826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.513101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.513116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.513118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.613629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.613645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.613648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.713828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.713841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.713843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.814169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.814185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.814187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.914548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.914563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.914566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.014877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.014893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.014895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.115244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.115259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.115262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.215590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.215612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.215614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.315948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.315964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.315968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.416259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.416277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.416280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:22.467316257 3234025 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:25559: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:22.516630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.516644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.516646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.617002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.617018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.617022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.717368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.717384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.717388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.817711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.817726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.817729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.918057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.918072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.918075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.018391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.018407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.018410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.118750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.118764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.118766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.219123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.219141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.219144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.319485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.319503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.319507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.419820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.419834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.419836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.520180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.520196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.520200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.621508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.621531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.621534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.722124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.722140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.722143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.824874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.824895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.824898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.924667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.924685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.924688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.025012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.025028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.025030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.125368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.125400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.125403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.225673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.225692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.225695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.326077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.326098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.326101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.426427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.426445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.426448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.527596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.527614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.527617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.628154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.628170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.628173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.728482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.728508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.728512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.828868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.828885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.828888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.929206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.929226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.929229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.029543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.029565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.029568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.129908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.129927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.129930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.230257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.230276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.230280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.330610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.330634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.330638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.430946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.430964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.430967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.531302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.531321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.531324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.631646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.631661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.631664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:25.671572Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T09:28:25.671589Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:25.732001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.732016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.732018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.832348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.832364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.832368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.932722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.932738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.932741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.036545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.036561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.036564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.135974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.135991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.135994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.236322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.236336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.236339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.295265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:26.336664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.336678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.336681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.437031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.437056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.437058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.537384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.537401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.537413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.637708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.637732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.637735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.738044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.738064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.738067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.838449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.838462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.838464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.938789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.938803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.938805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.039094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.039108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.039110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.140604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.140622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.140625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.240874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.240894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.240898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.344865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.344885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.344888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.445162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.445179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.445181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.552859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.552881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.552884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.652981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.652997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.653000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.753355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.753368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.753370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.853726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.853744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.853746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.954064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.954084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.954087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.054447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.054462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.054465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.154808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.154840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.154843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.255139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.255154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.255163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.355513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.355540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.355543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.455835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.455850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.455853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.556178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.556192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.556195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.656550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.656569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.656571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.756904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.756918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.756921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.857273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.857299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.857302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.957583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.957597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.957600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.057969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.057986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.057989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.159415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.159433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.159436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.260969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.260984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.260987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.361054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.361069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.361073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.461391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.461407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.461409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.561734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.561747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.561750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.662105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.662132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.662136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.762470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.762486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.762489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.862859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.862878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.862881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.963176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.963199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.963203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.063534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.063550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.063553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.163898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.163915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.163918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.264334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.264350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.264353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.364585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.364603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.364607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.464946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.464964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.464968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.565287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.565304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.565307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.665642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.665658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.665660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.765964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.765980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.765984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.866537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.866558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.866561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.966678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.966697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.966701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.067033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.067057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.067059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.167396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.167412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.167414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.267746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.267762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.267765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.295495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:31.368095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.368111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.368115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.468419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.468436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.468439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.568826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.568847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.568850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.671704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.671723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.671726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.772066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.772083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.772086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.872419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.872437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.872440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.972774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.972791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.972794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.073132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.073151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.073153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.173493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.173509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.173513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.273828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.273849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.273852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:32.363020426 3233888 chttp2_transport.cc:1143]             ipv4:127.0.0.1:25559: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:32.374171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.374190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.374193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.474528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.474542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.474546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.574843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.574859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.574862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.675257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.675276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.675279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.775602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.775618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.775621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.875960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.875977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.875980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.976264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.976277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.976279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.076706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.076724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.076726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.177009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.177036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.177040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.277359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.277382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.277385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.377786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.377804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.377808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.478085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.478102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.478105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.580871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.580891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.580895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.680862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.680879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.680910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.781159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.781174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.781177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.881519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.881538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.881542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.982264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.982282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.982287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.082732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.082750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.082753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.183069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.183101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.183106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.284521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.284542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.284545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.384849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.384869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.384874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.485168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.485187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.485189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.585523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.585541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.585544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.685875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.685896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.685898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.786236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.786253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.786255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.886610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.886627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.886630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.986924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.986943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.986947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.087254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.087269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.087272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.187620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.187638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.187640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.287927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.287943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.287946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.388328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.388349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.388353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.488686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.488703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.488706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.588989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.589005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.589008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.689377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.689392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.689394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.789728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.789739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.789741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.890093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.890110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.890113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.990441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.990457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.990460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.090823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.090844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.090846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.191142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.191174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.191177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.291517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.291533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.291536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.295634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:36.392888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.392907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.392910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.496890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.496911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.496914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.597171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.597190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.597193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.697494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.697508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.697511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.797839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.797852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.797854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.898186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.898202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.898205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.998548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.998565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.998568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.098878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.098895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.098898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.199278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.199298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.199301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.299643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.299658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.299661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.400076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.400093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.400096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.501337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.501356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.501359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.601695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.601710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.601713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.704861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.704889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.704893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.804979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.804996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.804999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.905337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.905354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.905357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.005653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.005669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.005672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.106022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.106036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.106038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.206356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.206370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.206372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.308027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.308042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.308044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.408610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.408626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.408629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.508966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.508981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.508983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.609340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.609357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.609360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.709703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.709720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.709723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.810028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.810045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.810048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.910372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.910389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.910392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.010672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.010687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.010690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.112953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.112997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.113002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.213447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.213465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.213468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.313842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.313862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.313865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.414169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.414187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.414190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.514558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.514575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.514585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.617492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.617513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.617516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.717798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.717817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.717820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.820906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.820923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.820927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.921069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.921104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.921116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.021401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.021446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.021450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.121754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.121768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.121770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.222122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.222137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.222140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.322570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.322586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.322589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.422842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.422860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.422863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.523257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.523274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.523277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.623531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.623557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.623560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.723883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.723901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.723904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.824271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.824300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.824304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.924540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.924559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.924562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.024911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.024926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.024928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.125257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.125270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.125272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.225627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.225641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.225643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.295811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:41.325976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.325990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.325997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.426329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.426342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.426345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.526667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.526689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.526690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.627043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.627059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.627062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.727412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.727429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.727433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.827766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.827785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.827789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.928109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.928129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.928132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.028434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.028447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.028450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.128839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.128858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.128861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.229153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.229168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.229170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.329476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.329502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.329505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.429875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.429893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.429896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.530671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.530691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.530695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.631103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.631117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.631120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.731415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.731428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.731431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.831750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.831765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.831768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.932130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.932144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.932147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.032434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.032450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.032452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.132838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.132852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.132864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.233188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.233203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.233206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.333539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.333554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.333556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.433901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.433918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.433921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.538907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.538928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.538931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.639227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.639248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.639251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.739556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.739571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.739573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.839934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.839960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.839963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.940239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.940259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.940263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.040623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.040652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.040655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.141073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.141090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.141093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.241334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.241352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.241356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.341669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.341687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.341690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.442037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.442054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.442057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.542365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.542383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.542385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.642717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.642735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.642738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.743071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.743090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.743093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.843397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.843416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.843419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.943781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.943797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.943800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.044143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.044160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.044163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.144507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.144523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.144527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.244850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.244870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.244873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.345200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.345219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.345223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.445487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.445503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.445507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.545918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.545936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.545939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.646206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.646235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.646238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.746597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.746609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.746612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.846959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.846975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.846978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.947290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.947312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.947316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.047645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.047659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.047662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.148024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.148050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.148053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.248347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.248366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.248369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.286209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:28:46.286252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:46.286585Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:28:46.286885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:28:46.287085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:28:46.287195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-02T09:28:46.296002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:46.348679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.348693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.348695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.449067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.449083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.449086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.549435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.549454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.549457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.649783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.649797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.649800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.750086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.750100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.750103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.850488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.850518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.850521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.950824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.950839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.950842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.051185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.051201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.051205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.151527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.151540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.151543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.251879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.251895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.251898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.352263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.352281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.352283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:47.369245757 3234025 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:25559: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:28:47.452591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.452611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.452614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.552918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.552937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.552939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.653312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.653329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.653332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.753635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.753654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.753657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.853986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.854007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.854010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.954324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.954342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.954345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.054669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.054687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.054691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.155005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.155021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.155024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.256916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.256934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.256937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.358049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.358065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.358068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.458156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.458174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.458177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.558485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.558500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.558502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.658840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.658852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.658855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.759210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.759225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.759228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.859561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.859576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.859579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.959895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.959907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.959909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.060230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.060244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.060247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.160606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.160621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.160623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.260950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.260966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.260969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.361542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.361558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.361561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.461675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.461691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.461694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.562036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.562054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.562057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.662370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.662390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.662393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.762752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.762771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.762774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.863082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.863097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.863100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.963445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.963460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.963463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.063781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.063797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.063800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.164145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.164163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.164166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.264489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.264506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.264509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.364872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.364890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.364893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.465209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.465224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.465227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.565559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.565575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.565578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.665887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.665901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.665904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.766249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.766264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.766267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.866612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.866630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.866633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.966951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.966966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.966970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.067295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.067309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.067312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.167662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.167678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.167681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.267986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.268000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.268003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.296237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:51.368357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.368369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.368372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.468719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.468734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.468738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.569071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.569089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.569093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.669404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.669420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.669423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.769772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.769791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.769794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.870135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.870153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.870156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.970481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.970497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.970500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.070807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.070821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.070825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.171210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.171229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.171233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.271497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.271511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.271513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.371869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.371894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.371897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.472255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.472272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.472275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.572573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.572590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.572593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.672946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.672970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.672974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.773284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.773299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.773301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.873649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.873676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.873680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.976947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.976963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.976966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.078349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.078365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.078368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.180881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.180897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.180901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.281228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.281247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.281252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.381543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.381565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.381567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.481907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.481924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.481927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.582260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.582290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.582293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.682608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.682633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.682636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.782943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.782958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.782961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.883317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.883336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.883339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.983651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.983669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.983672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.084023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.084038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.084041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.184375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.184392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.184396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.284958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.284974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.284977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.385071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.385088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.385091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.485427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.485445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.485448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.585797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.585815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.585819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.686126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.686143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.686147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.786481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.786496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.786498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.886815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.886826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.886828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.987184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.987200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.987202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.087542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.087558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.087561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.187847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.187860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.187863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.288883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.288897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.288901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.389101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.389120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.389122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.489456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.489477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.489480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.589797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.589816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.589819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-02T09:28:55.645059Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:25559 } ]
2025-10-02T09:28:55.690138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.690157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.690160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.790511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.790537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.790540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.890843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.890861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.890864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.991216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.991234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.991237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.091558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.091575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.091577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.191894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.191923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.191926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.292266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.292287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.292290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.296395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:56.392616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.392637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.392640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.492977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.492995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.492998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.593317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.593335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.593338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.693672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.693691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.693693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.794016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.794033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.794036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.894415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.894445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.894449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.994736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.994755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.994758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.095072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.095102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.095105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.195394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.195411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.195413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.295795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.295816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.295819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.396132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.396148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.396150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.496482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.496502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.496504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.596838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.596855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.596858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.697157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.697176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.697179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.797548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.797567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.797571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.897906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.897926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.897929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.998240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.998270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.998273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.098602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.098624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.098627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.198961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.198977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.198980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.299311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.299327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.299330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.400643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.400657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.400660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.501071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.501091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.501095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.601365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.601379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.601382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.701716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.701730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.701733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.802130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.802145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.802149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.902454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.902470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.902473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.002793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.002810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.002813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.103315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.103331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.103334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.203507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.203524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.203527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.303849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.303865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.303868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.404190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.404209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.404212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.504548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.504561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.504563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.604892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.604911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.604914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.705247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.705261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.705263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.805571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.805591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.805594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.905961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.905978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.905981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.006291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.006313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.006316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.108720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.108741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.108744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.209093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.209110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.209113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.309425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.309443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.309446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.409767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.409782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.409785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.510094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.510112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.510116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.610483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.610499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.610502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.712959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.712975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.712978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.813234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.813251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.813254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.913576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.913591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.913593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.013891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.013906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.013910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.114275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.114294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.114296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.214631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.214649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.214651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.296600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:01.314998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.315015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.315018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.415348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.415366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.415369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.515720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.515738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.515741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.616010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.616024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.616028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.716358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.716371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.716374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.816741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.816758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.816761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.917069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.917085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.917088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.017441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.017458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.017460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.117795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.117821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.117823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.218165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.218184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.218187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.318465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.318478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.318480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.418858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.418875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.418879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.519234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.519253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.519257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.619574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.619590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.619601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.719933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.719951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.719955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.820232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.820249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.820252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.920603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.920619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.920622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.020987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.021005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.021009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.121323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.121337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.121339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.221687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.221703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.221707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.321999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.322014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.322017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:29:03.422376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.422391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.422395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.522749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.522765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.522768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.623101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.623129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.623133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.723426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.723439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.723441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.823781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.823795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.823798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.924139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.924156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.924159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.024508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.024523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.024526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.124864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.124881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.124884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.225311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.225333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.225337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.325544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.325560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.325564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.425909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.425925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.425929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.526286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.526318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.526321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.626602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.626616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.626619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.726919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.726939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.726942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.827306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.827320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.827322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.927659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.927672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.927674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.028014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.028029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.028032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.128357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.128373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.128376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.228690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.228708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.228711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.329089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.329110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.329114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.429415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.429434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.429438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.529765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.529779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.529782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.630114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.630127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.630130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.730458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.730476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.730479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.830822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.830838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.830842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.931275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.931291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.931294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.031564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.031580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.031583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.131836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.131851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.131854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.232233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.232247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.232249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.296776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:06.332584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.332599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.332602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.433262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.433280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.433283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.534597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.534615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.534620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.634535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.634554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.634558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.735005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.735020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.735023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.835301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.835317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.835321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.935705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.935720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.935723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.036098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.036114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.036117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.136419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.136434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.136436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.236771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.236786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.236790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.337080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.337098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.337100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.437477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.437494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.437497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.537835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.537850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.537853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.638166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.638181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.638184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.738520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.738536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.738538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.838901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.838918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.838931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.939200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.939214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.939218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.039821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.039837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.039840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.139938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.139953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.139954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.240296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.240319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.240323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.340657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.340675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.340678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.441010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.441024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.441028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.541355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.541373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.541376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.641723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.641739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.641742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.742024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.742036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.742039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.842410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.842425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.842428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.942752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.942765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.942767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.043109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.043132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.043135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.143468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.143494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.143498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.243807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.243834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.243837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.344193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.344208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.344211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.444522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.444539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.444541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.544845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.544867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.544869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.645235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.645263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.645265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.745537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.745570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.745573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.845940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.845958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.845974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.946279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.946293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.946297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.048892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.048912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.048915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.149003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.149020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.149023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.249386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.249406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.249409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.349688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.349705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.349708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.450072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.450087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.450090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.550408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.550420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.550422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.650766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.650781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.650784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.751154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.751179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.751182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.851510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.851527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.851530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:29:10.899848407 3238696 chttp2_transport.cc:1143]             ipv4:127.0.0.1:25559: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:29:10.951787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.951801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.951804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.052188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.052201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.052203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.152534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.152554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.152557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.252902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.252921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.252925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.296998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:11.353224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.353242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.353246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.453623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.453644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.453648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.553919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.553935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.553937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.654268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.654285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.654288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.754988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.755011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.755014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.860867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.860889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.860892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.960982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.961001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.961004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.061345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.061360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.061362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.161939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.161955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.161957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.262056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.262089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.262092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.362406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.362424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.362427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.462742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.462758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.462760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.563104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.563141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.563143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.663476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.663490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.663493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.764415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.764432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.764435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.864693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.864709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.864713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.965015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.965029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.965032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.065380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.065396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.065399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.165770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.165787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.165790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.266100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.266116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.266119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.366437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.366450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.366453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.466789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.466804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.466807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.567167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.567184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.567187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.667467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.667482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.667485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.767863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.767876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.767878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.868197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.868213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.868216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.968531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.968549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.968552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.068950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.068968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.068971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.169258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.169276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.169286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.269624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.269653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.269657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.369977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.369994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.369997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.470321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.470336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.470340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.570686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.570704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.570707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.670966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.670981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.670984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.771363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.771377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.771379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.871718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.871732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.871735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.972076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.972094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.972097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.072431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.072445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.072448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.172752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.172769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.172772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.273173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.273191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.273195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.373474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.373486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.373488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.473830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.473848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.473851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.574194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.574213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.574216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.674533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.674562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.674565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.774859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.774876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.774879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.875297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.875317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.875321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.975587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.975599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.975601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.075941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.075956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.075959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.176288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.176303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.176306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.276648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.276664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.276667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.286370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:29:16.286399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T09:29:16.286814Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:29:16.287072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:29:16.287126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:29:16.297162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:16.377020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.377037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.377041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.477332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.477349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.477352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.577712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.577730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.577734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.678034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.678048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.678051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.778434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.778455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.778460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.878724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.878742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.878747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.979094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.979114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.979116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.079482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.079500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.079503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.179831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.179847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.179850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.281705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.281722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.281725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.384695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.384711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.384715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.485263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.485278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.485281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.585857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.585877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.585880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.686123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.686134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.686137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.787114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.787135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.787138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.886882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.886898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.886901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.987232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.987247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.987250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.087550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.087563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.087565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.187945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.187962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.187965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.288291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.288316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.288320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.388654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.388669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.388672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.488986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.489001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.489004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.589317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.589333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.589337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.689711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.689726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.689729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.795839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.795855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.795858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.893443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.893459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.893463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.993962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.993979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.993981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.096883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.096900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.096903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.196585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.196604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.196606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.297110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.297132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.297135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.397288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.397303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.397306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.497631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.497647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.497650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.597951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.597967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.597970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.700893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.700907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.700910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.801265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.801280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.801283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.901543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.901558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.901560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.001938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.001956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.001959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.102292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.102310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.102312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.202686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.202706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.202709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.303029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.303047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.303050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.403368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.403384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.403387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.503663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.503677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.503680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.604079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.604095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.604099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.704876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.704891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.704894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.805283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.805302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.805306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.905584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.905599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.905602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.006709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.006724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.006727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.106867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.106884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.106888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.207292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.207311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.207315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.297369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:21.307563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.307578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.307581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.407922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.407940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.407943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.508254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.508268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.508270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.608618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.608634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.608637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.708957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.708973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.708976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.809354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.809383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.809387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.909665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.909680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.909683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.010061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.010075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.010078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.110424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.110437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.110441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.210721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.210736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.210738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.311104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.311119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.311123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.411389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.411421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.411424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.511728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.511744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.511747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.612150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.612167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.612171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.712538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.712565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.712568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.812855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.812876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.812880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.913201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.913225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.913228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.013598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.013628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.013631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.115118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.115140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.115144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.216914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.216930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.216933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.317163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.317181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.317184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.417523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.417540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.417543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.517879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.517894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.517898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.618190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.618208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.618211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.718563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.718578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.718581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.818929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.818948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.818951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.919287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.919303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.919306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.019620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.019634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.019641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.119983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.120002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.120005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.220335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.220353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.220356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.320697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.320714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.320718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.421022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.421036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.421039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.521446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.521464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.521467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.621751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.621770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.621773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.722084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.722101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.722104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.822448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.822464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.822467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.922817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.922838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.922843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.023154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.023171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.023174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.123662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.123682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.123684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.223867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.223886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.223889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.324232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.324255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.324257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.424517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.424531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.424534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.524896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.524915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.524919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.625245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.625261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.625264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.725613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.725630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.725633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.825968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.825987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.825990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.926302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.926319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.926322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.026701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.026719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.026723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.127004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.127019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.127022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.227375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.227411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.227414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.297620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:26.327733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.327750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.327753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.428058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.428075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.428086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.532925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.532943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.532946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.633384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.633399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.633402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.733723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.733739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.733742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.834092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.834110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.834113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.934454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.934472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.934484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.034801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.034816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.034819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.135157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.135175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.135177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.235481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.235494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.235496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.336610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.336624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.336627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.436719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.436734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.436737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.537045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.537061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.537063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.637535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.637555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.637559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.737772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.737790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.737794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.838118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.838139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.838142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.938490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.938508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.938512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.038809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.038833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.038837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.139183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.139199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.139202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.239494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.239514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.239517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.339870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.339888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.339891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.440234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.440249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.440251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.540544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.540561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.540564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.640956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.640970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.640972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.743270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.743290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.743293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.843690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.843704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.843707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.944044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.944063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.944066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.044363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.044377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.044379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.144763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.144781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.144784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.252876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.252894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.252897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.353112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.353129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.353132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.453490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.453515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.453518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.554206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.554223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.554226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.655795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.655810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.655813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.756082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.756100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.756103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.856425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.856443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.856447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.956793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.956822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.956826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.057310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.057332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.057335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.157441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.157459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.157462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.257822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.257844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.257848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.358269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.358286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.358288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.458540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.458556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.458568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.558906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.558925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.558928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.659228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.659243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.659247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.759600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.759616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.759619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.859949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.859965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.859968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.960299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.960318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.960321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.060659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.060675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.060678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.161001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.161018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.161021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.261344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.261363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.261366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.297736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:31.361685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.361699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.361701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.462079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.462096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.462099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.562374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.562392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.562395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.662747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.662765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.662768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.763309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.763334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.763338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.863476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.863494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.863497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.963816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.963832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.963835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.064185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.064205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.064208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.164510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.164527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.164530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.264879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.264894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.264897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.365205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.365219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.365222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.465576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.465592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.465595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.565948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.565963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.565966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.666270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.666287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.666289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.766611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.766625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.766628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.866986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.867014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.867016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.967309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.967325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.967328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.069021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.069036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.069039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.169643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.169661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.169664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.269944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.269960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.269964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.370278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.370296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.370299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-02T09:29:33.433880Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:25559 } ]
2025-10-02T09:29:33.470621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.470636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.470639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.570970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.570985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.570988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.671593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.671610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.671612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.771690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.771709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.771712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.872043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.872061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.872063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.972378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.972396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.972400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.072712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.072734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.072737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.173111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.173130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.173133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.273468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.273486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.273489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.373753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.373778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.373790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.474124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.474140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.474143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.574497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.574513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.574515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.674850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.674871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.674873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.775214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.775234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.775237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.875569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.875591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.875594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.975913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.975930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.975932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.076246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.076261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.076264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.176611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.176626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.176628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.276963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.276983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.276985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.377294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.377307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.377309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.477649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.477664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.477666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.578008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.578020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.578022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.678364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.678377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.678379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.778718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.778732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.778734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.879106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.879122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.879124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.979412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.979426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.979428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.079757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.079777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.079780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.180137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.180152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.180156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.281052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.281068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.281071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.297943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:36.381333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.381348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.381349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.481669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.481682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.481684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.582024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.582037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.582038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.682398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.682412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.682415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.782760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.782778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.782782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.883134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.883150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.883153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.983445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.983461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.983463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.083813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.083827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.083830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.184156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.184168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.184170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.284499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.284517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.284520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.384846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.384859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.384861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.485197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.485210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.485212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.585571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.585588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.585590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.685934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.685952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.685956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.786272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.786290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.786292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.886621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.886634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.886636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.986963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.986977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.986979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.087618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.087634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.087638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.188168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.188184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.188188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.288547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.288562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.288564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.388869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.388886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.388889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.489245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.489261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.489263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.589605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.589620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.589622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.689959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.689973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.689976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.790319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.790337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.790340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.890683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.890703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.890707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.991021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.991037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.991040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.091372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.091388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.091399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.191717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.191731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.191734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.292056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.292071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.292074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.392409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.392423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.392427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.492789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.492820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.492823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.593128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.593144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.593146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.693471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.693486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.693488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.793802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.793819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.793822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.894197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.894212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.894215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.994549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.994564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.994566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.094888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.094904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.094907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.195232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.195245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.195247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.295609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.295626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.295629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.395937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.395954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.395957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.496316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.496337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.496340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.596659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.596673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.596677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.696992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.697006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.697010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.797357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.797374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.797377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.900865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.900881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.900884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.001109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.001123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.001125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.101485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.101501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.101504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:29:41.201828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.201843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.201846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.393954Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720848, task: 1, CA Id [1:7556554216179454186:3366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-02T09:29:41.426829Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720848, task: 1, CA Id [1:7556554216179454186:3366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-02T09:29:41.565495Z :RecreateObserver INFO: Random seed for debugging is 1759397381565489
2025-10-02T09:29:41.625015Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556554212290892528:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:29:41.625134Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:29:41.626070Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556554213416556628:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:29:41.626117Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/tmpW6pA7Y/pdisk_1.dat
2025-10-02T09:29:41.626314Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:29:41.626494Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:29:41.627883Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:29:41.627968Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:29:41.638919Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:29:41.642751Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:29:41.642767Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:29:41.643880Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:29:41.644124Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 27431, node 3
2025-10-02T09:29:41.649091Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexLEqhyP.tmp
2025-10-02T09:29:41.649108Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexLEqhyP.tmp
2025-10-02T09:29:41.649164Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000140/r3tmp/yandexLEqhyP.tmp
2025-10-02T09:29:41.649212Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:29:41.651836Z INFO: TTestServer started on Port 21406 GrpcPort 27431
TClient is connected to server localhost:21406
PQClient connected to localhost:27431
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:29:41.663340Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:29:41.726230Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:29:41.726259Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:29:41.727727Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:29:41.835968Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:29:41.895082Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556554213416556849:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:29:41.895102Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556554213416556838:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:29:41.895120Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:29:41.896295Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:29:41.899797Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556554213416556852:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T09:29:41.926635Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:29:41.928784Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556554212290893507:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:29:41.929330Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=MTM3YTNkMWMtYTlmYzY2OC04NWQ0OTUzZi0xZmExOTJiNQ==, ActorId: [3:7556554212290893465:2322], ActorState: ExecuteState, TraceId: 01k6j431s40rzsraeqjx6pady6, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:29:41.929469Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:29:41.930060Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:29:41.944295Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:29:41.963550Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:27431", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:29:41.978320Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556554213416556975:2175] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:29:41.990345Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k6j431trbyhea0w32719fnjy, Database: , SessionId: ydb://session/3?node_id=3&id=ZDhkZDA1NDktYmEwY2Q3NC03NDMxYTA3My1jNmZjYTE2OQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556554212290893954:2985] 
2025-10-02T09:29:42.626181Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:29:42.627708Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:29:46.624940Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556554212290892528:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:29:46.624976Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:29:46.626449Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556554213416556628:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:29:46.626479Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:29:47.120845Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:27431
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:29:47.138031Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27431
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:29:47.144035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.144583Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556554238060698300:3313] connected; active server actors: 1
2025-10-02T09:29:47.144876Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:29:47.145010Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:29:47.145122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.145193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:29:47.145205Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.145213Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:29:47.145306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554238060698299:3312], now have 1 active actors on pipe
2025-10-02T09:29:47.145503Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:29:47.145538Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:29:47.145506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:29:47.145521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556554239186361154:2384], now have 1 active actors on pipe
2025-10-02T09:29:47.146899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:29:47.148486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554238060698364:3363], now have 1 active actors on pipe
2025-10-02T09:29:47.148544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:29:47.149360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:29:47.149517Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.149533Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:29:47.149595Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.149641Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556554238060698375:2464]
2025-10-02T09:29:47.150341Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.150351Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.150356Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556554238060698375:2464]
2025-10-02T09:29:47.150363Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:29:47.150625Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:29:47.150637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.150654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.150662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.150665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:29:47.150667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.150669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.150670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:29:47.150676Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.150748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:29:47.150777Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:47.151657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:29:47.151695Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397387195, TxId 281474976710677
2025-10-02T09:29:47.151705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.151708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.151736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.151789Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:47.152360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:47.152417Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:47.152428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.152430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.152431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.152437Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:47.152541Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:29:47.152564Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.152604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:29:47.153455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:29:47.153481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:29:47.153974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:29:47.158502Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710678. Ctx: { TraceId: 01k6j436w61841p6ajnp0mm7jr, Database: , SessionId: ydb://session/3?node_id=3&id=NmVlM2NkODItNzdjZDVkN2YtNDdiODQyMjQtYTg2NGZmZTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759397387195
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759397387195
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:27431
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:29:47.164649Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:29:47.250589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.250608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.250610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.350939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.350962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.350968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.451281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.451293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.451295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.551664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.551679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.551683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.652028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.652047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.652049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27431
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:29:47.665856Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-02T09:29:47.752357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.752376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.752380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.852735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.852758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.852761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.953049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.953063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.953065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.053396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.053415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.053417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.153702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.153714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.153721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27431
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:29:48.167530Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:29:48.168637Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:29:48.168821Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:29:48.168826Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:27431
2025-10-02T09:29:48.169099Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:29:48.169177Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.169189Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:29:48.169338Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:29:48.169370Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40424
2025-10-02T09:29:48.169379Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40424 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.169382Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.169725Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:29:48.169756Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.169762Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.169764Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.169769Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.170306Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.187101Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:29:48.187213Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554242355665909:2502] connected; active server actors: 1
2025-10-02T09:29:48.187297Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:29:48.187306Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.187393Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554242355665909:2502] disconnected; active server actors: 1
2025-10-02T09:29:48.187403Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554242355665909:2502] disconnected no session
2025-10-02T09:29:48.203171Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.203191Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:29:48.203196Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556554242355665878:2502] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.203205Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.203359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:29:48.203380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554242355665929:2502], now have 1 active actors on pipe
2025-10-02T09:29:48.203392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.203400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.203438Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:29:48.203454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.203463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.203466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.203479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.203496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.203521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.203571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.203580Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.203595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.203644Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0
2025-10-02T09:29:48.204018Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397388204 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:48.204068Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.204163Z :INFO: [] MessageGroupId [src] SessionId [src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0] Write session: close. Timeout = 0 ms
2025-10-02T09:29:48.204169Z :INFO: [] MessageGroupId [src] SessionId [src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0] Write session will now close
2025-10-02T09:29:48.204175Z :DEBUG: [] MessageGroupId [src] SessionId [src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0] Write session: aborting
2025-10-02T09:29:48.204319Z :INFO: [] MessageGroupId [src] SessionId [src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:29:48.204324Z :DEBUG: [] MessageGroupId [src] SessionId [src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0] Write session: destroy
2025-10-02T09:29:48.204467Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0 grpc read done: success: 0 data: 
2025-10-02T09:29:48.204478Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0 grpc read failed
2025-10-02T09:29:48.204487Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0 grpc closed
2025-10-02T09:29:48.204492Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d8513a1f-c4ecf9d-4615bdbe-9babefef_0 is DEAD
2025-10-02T09:29:48.204744Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:29:48.204794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556554242355665929:2502] destroyed
2025-10-02T09:29:48.204822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:29:48.204832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.204839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.204840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:29:48.254121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.254137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.254140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.354493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.354510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.354514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.454816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.454831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.454833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.555180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.555198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.555201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.655509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.655528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.655531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.755878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.755895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.755899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.856229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.856247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.856250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.956573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.956593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.956596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.056889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.056908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.056911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.157267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.157282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.157284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-02T09:29:49.207830Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:27494 } ]
2025-10-02T09:29:49.207853Z :ERROR: [/Root] [] [7a26da1d-918d9050-4bd2f276-ab17ebd2] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:27494 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:27494 " }
Session2 was created
2025-10-02T09:29:49.257631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.257642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.257644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.358127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.358142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.358144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.458299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.458312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.458323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.559128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.559155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.559157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.659543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.659560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.659563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.759922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.759937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.759940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.860275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.860293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.860296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.960632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.960650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.960652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.061417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.061432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.061435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.161845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.161862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.161865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:29:50.208737Z :INFO: [/Root] [] [21b3d3e6-e7156989-104f2916-542e435b] Open read subsessions to databases: { name: dc1, endpoint: localhost:27431, path: /Root }, { name: dc2, endpoint: localhost:27431, path: /Root }, { name: dc3, endpoint: localhost:27431, path: /Root }
2025-10-02T09:29:50.211004Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Starting read session
2025-10-02T09:29:50.211023Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Starting single session
2025-10-02T09:29:50.211260Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211265Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211270Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:29:50.211841Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Starting read session
2025-10-02T09:29:50.211849Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Starting single session
2025-10-02T09:29:50.211868Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211871Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211874Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:29:50.211929Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Starting read session
2025-10-02T09:29:50.211932Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Starting single session
2025-10-02T09:29:50.211947Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211949Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.211952Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:29:50.212305Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] Successfully connected. Initializing session
2025-10-02T09:29:50.212428Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] Successfully connected. Initializing session
2025-10-02T09:29:50.212464Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] Successfully connected. Initializing session
2025-10-02T09:29:50.212541Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:50.212555Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T09:29:50.212589Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:50.212591Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T09:29:50.212597Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:50.212599Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-02T09:29:50.214848Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.214925Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 read init: from# ipv6:[::1]:50932, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.215022Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 auth for : user
2025-10-02T09:29:50.215054Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.215074Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 read init: from# ipv6:[::1]:50932, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.215113Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 auth for : user
2025-10-02T09:29:50.215129Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.215144Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 read init: from# ipv6:[::1]:50932, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:50.215173Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 auth for : user
2025-10-02T09:29:50.215345Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 Handle describe topics response
2025-10-02T09:29:50.215367Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 auth is DEAD
2025-10-02T09:29:50.215388Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:50.215743Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] Got InitResponse. ReadSessionId: shared/user_3_1_426972930095474597_v1
2025-10-02T09:29:50.215752Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.215817Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:29:50.215916Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] Got InitResponse. ReadSessionId: shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.215926Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.215972Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:29:50.216042Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600683:2543] connected; active server actors: 1
2025-10-02T09:29:50.215637Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:50.215677Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 Handle describe topics response
2025-10-02T09:29:50.215687Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 auth is DEAD
2025-10-02T09:29:50.215699Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:50.215850Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:50.215874Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 Handle describe topics response
2025-10-02T09:29:50.215883Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 auth is DEAD
2025-10-02T09:29:50.215891Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:50.216000Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:50.216024Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:29:50.216035Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 got read request: guid# 637dda1f-f76f5975-8bab782d-3b72df45
2025-10-02T09:29:50.216065Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:29:50.216072Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 got read request: guid# de13b906-1bf5ac71-273ed006-fad00a4a
2025-10-02T09:29:50.216174Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556554250945600683:2543] session shared/user_3_1_426972930095474597_v1
2025-10-02T09:29:50.216191Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:29:50.216199Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] Got InitResponse. ReadSessionId: shared/user_3_2_9384292902798165414_v1
2025-10-02T09:29:50.216205Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:50.216202Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:29:50.216213Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_426972930095474597_v1" (Sender=[3:7556554250945600674:2543], Pipe=[3:7556554250945600683:2543], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:50.216217Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:50.216227Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600684:2545] connected; active server actors: 1
2025-10-02T09:29:50.216230Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600685:2544] connected; active server actors: 1
2025-10-02T09:29:50.216235Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556554250945600684:2545] session shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.216239Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_14245647284111329869_v1" (Sender=[3:7556554250945600676:2545], Pipe=[3:7556554250945600684:2545], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:50.216244Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556554250945600685:2544] session shared/user_3_2_9384292902798165414_v1
2025-10-02T09:29:50.216253Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:29:50.216247Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_9384292902798165414_v1" (Sender=[3:7556554250945600675:2544], Pipe=[3:7556554250945600685:2544], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:50.216256Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:29:50.216264Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_14245647284111329869_v1" (Sender=[3:7556554250945600676:2545], Pipe=[3:7556554250945600684:2545], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:50.216279Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_14245647284111329869_v1" sender [3:7556554250945600676:2545] lock partition 0 for ReadingSession "shared/user_3_3_14245647284111329869_v1" (Sender=[3:7556554250945600676:2545], Pipe=[3:7556554250945600684:2545], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T09:29:50.216296Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-02T09:29:50.216305Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-02T09:29:50.216352Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:29:50.216397Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 got read request: guid# 2fd31ca-88d70d1-e4fc7ff9-d755f403
2025-10-02T09:29:50.216610Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_14245647284111329869_v1" ClientId: "user" PipeClient { RawX1: 7556554250945600684 RawX2: 4503612512274929 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:29:50.216629Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:29:50.216676Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7556554250945600687:2552]
2025-10-02T09:29:50.216697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554250945600687:2552], now have 1 active actors on pipe
2025-10-02T09:29:50.216707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.216713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.216726Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_14245647284111329869_v1 on pipe: [3:7556554250945600687:2552]
2025-10-02T09:29:50.216749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.216755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.216757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.216788Z node 3 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.216796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.216845Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:50.217017Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_14245647284111329869_v1:1 with generation 1
2025-10-02T09:29:50.217679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:50.217707Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:50.217719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.217725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.217727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.217732Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:29:50.217744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:29:50.217786Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397390161 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:29:50.217798Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:29:50.217814Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:29:50.218103Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218113Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:29:50.218121Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218139Z :NOTICE: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-02T09:29:50.218147Z :DEBUG: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] [] Abort session to cluster
2025-10-02T09:29:50.218371Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218377Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:29:50.218382Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218387Z :NOTICE: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-02T09:29:50.218391Z :DEBUG: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] [] Abort session to cluster
2025-10-02T09:29:50.218450Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218457Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T09:29:50.218460Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218465Z :NOTICE: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-02T09:29:50.218468Z :DEBUG: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] [] Abort session to cluster
2025-10-02T09:29:50.218396Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:29:50.218403Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 grpc read failed
2025-10-02T09:29:50.218408Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 grpc closed
2025-10-02T09:29:50.218412Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_9384292902798165414_v1 is DEAD
2025-10-02T09:29:50.218565Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218570Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T09:29:50.218573Z :INFO: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218578Z :NOTICE: [/Root] [/Root] [577b51ba-1ec6cc9c-e8abcc7b-847aa783] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:29:50.218663Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218667Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:29:50.218628Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600685:2544] disconnected; active server actors: 1
2025-10-02T09:29:50.218670Z :INFO: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218682Z :NOTICE: [/Root] [/Root] [8298cb03-5f06d39b-da53a7a8-d794a060] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:29:50.218637Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600685:2544] client user disconnected session shared/user_3_2_9384292902798165414_v1
2025-10-02T09:29:50.218645Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:50.218655Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-02T09:29:50.218660Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-02T09:29:50.218664Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000006s
2025-10-02T09:29:50.218609Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:29:50.218613Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 grpc read failed
2025-10-02T09:29:50.218615Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 grpc closed
2025-10-02T09:29:50.218618Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_426972930095474597_v1 is DEAD
2025-10-02T09:29:50.218687Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:29:50.218689Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 grpc read failed
2025-10-02T09:29:50.218692Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 closed
2025-10-02T09:29:50.218753Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Closing read session. Close timeout: 0.000000s
2025-10-02T09:29:50.218758Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:29:50.218761Z :INFO: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:50.218766Z :NOTICE: [/Root] [/Root] [be8b4325-b1e37e72-9415eeb1-394acba3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:29:50.218765Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600683:2543] disconnected; active server actors: 1
2025-10-02T09:29:50.218772Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600683:2543] client user disconnected session shared/user_3_1_426972930095474597_v1
2025-10-02T09:29:50.218775Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:50.218781Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-02T09:29:50.218784Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:29:50.218786Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000003s
2025-10-02T09:29:50.218828Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_14245647284111329869_v1 is DEAD
2025-10-02T09:29:50.218973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.218984Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556554250945600687:2552] destroyed
2025-10-02T09:29:50.219008Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600684:2545] disconnected; active server actors: 1
2025-10-02T09:29:50.218995Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.219015Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556554250945600684:2545] client user disconnected session shared/user_3_3_14245647284111329869_v1
2025-10-02T09:29:50.262175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.262189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.262192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.363185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.363202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.363205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:27:59.501708Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1759397279501699
2025-10-02T09:27:59.576293Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553775725419316:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.576479Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:27:59.579715Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.579930Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553775815755731:2173];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.579950Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/tmp17A3ap/pdisk_1.dat
2025-10-02T09:27:59.581010Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.614198Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.627978Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.628357Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3485, node 1
2025-10-02T09:27:59.637999Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandexNGqQfC.tmp
2025-10-02T09:27:59.638012Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandexNGqQfC.tmp
2025-10-02T09:27:59.638074Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandexNGqQfC.tmp
2025-10-02T09:27:59.638115Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:27:59.642438Z INFO: TTestServer started on Port 2240 GrpcPort 3485
TClient is connected to server localhost:2240
PQClient connected to localhost:3485
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:27:59.679537Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.679573Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.681015Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:27:59.682787Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.682805Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.683502Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T09:27:59.683749Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:27:59.683999Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:27:59.795593Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.884900Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553775725420220:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.884904Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553775725420201:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.884920Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885028Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553775725420230:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885042Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885600Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553775725420260:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885618Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885654Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553775725420262:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885661Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.885784Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:27:59.890698Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556553775725420229:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-02T09:27:59.908092Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.913804Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:27:59.937173Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:27:59.959745Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3485", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:27:59.981351Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556553775725420682:2937] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:00.008785Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6j3zy79emn5cc9rdq0q5fxe, Database: , SessionId: ydb://session/3?node_id=1&id=NDMzNzA5NDgtZjlhYmZlZWUtMjQwZDRkNjktOGU3MTg1MzA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553780020388029:2961] 
2025-10-02T09:28:00.578425Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:00.580988Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:04.576137Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553775725419316:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.576178Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:04.580242Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553775815755731:2173];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.580300Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:05.256630Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3485
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.277099Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3485
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:05.283212Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553801495225071:3285] connected; active server actors: 1
2025-10-02T09:28:05.283338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:05.283431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:05.283654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:05.287014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:05.287453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:05.287490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:05.287500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.287512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:05.287636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553801495225070:3284], now have 1 active actors on pipe
2025-10-02T09:28:05.287648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553801495225091:2461], now have 1 active actors on pipe
2025-10-02T09:28:05.287728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:05.287812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.288675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.290052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553801495225127:3330], now have 1 active actors on pipe
2025-10-02T09:28:05.290145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.290950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.291132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:05.291156Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:05.291231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:05.291299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553801585560332:2404]
2025-10-02T09:28:05.291981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:05.291991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:05.291996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553801585560332:2404]
2025-10-02T09:28:05.292001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:05.292296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:05.292307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.292328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.292333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:05.292337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.292339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.292340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.292342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.292348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:05.292447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.292486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.293480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.293512Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397285338, TxId 281474976720682
2025-10-02T09:28:05.293520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.293522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.293542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.293579Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:05.294072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:05.294134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:05.294143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.294145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.294147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.294151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.294254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:05.294274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.294313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.295439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.295460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.295930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.297077Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720683. Ctx: { TraceId: 01k6j403d2e2cvj5xnzxxs5nt8, Database: , SessionId: ydb://session/3?node_id=1&id=YzkwNGQ4YTEtNzBmYTZhNjUtZjJhYTZkYmUtNjIzZmVmYTc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759397285338
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759397285338
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3485
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.303159Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.392259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.392272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.392275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.492575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.492592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.492595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.592986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.593005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.593008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.693318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.693355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.693358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.793655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.793671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.793675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3485
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.804346Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.894044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.894061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.894064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.994374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.994390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.994394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.094716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.094733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.094735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.195074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.195092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.195095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.295417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.295431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.295442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3485
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.305841Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:06.306996Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:06.307249Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.307256Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3485
2025-10-02T09:28:06.307834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.307848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:06.309718Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.309972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.310013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:59076
2025-10-02T09:28:06.310022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59076 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.310026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.310441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:06.310488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.310493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.310495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.310501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.311044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.336638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.336762Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805790192630:2496] connected; active server actors: 1
2025-10-02T09:28:06.336797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:06.336823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.336901Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805790192630:2496] disconnected; active server actors: 1
2025-10-02T09:28:06.336908Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805790192630:2496] disconnected no session
2025-10-02T09:28:06.353207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.353238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.353241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553805790192599:2496] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.353250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.353493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553805790192653:2496], now have 1 active actors on pipe
2025-10-02T09:28:06.353564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.353626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.353639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.353684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f101f2cd-fb37514f-176838c0-65425ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:06.353704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.353709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.353711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.353726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.353741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.353765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.353962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.353976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.353999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.354093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f101f2cd-fb37514f-176838c0-65425ee5_0
2025-10-02T09:28:06.354477Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286354 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.354520Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f101f2cd-fb37514f-176838c0-65425ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.354670Z :INFO: [] MessageGroupId [src] SessionId [src|f101f2cd-fb37514f-176838c0-65425ee5_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:06.354677Z :INFO: [] MessageGroupId [src] SessionId [src|f101f2cd-fb37514f-176838c0-65425ee5_0] Write session will now close
2025-10-02T09:28:06.354686Z :DEBUG: [] MessageGroupId [src] SessionId [src|f101f2cd-fb37514f-176838c0-65425ee5_0] Write session: aborting
2025-10-02T09:28:06.354844Z :INFO: [] MessageGroupId [src] SessionId [src|f101f2cd-fb37514f-176838c0-65425ee5_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.354850Z :DEBUG: [] MessageGroupId [src] SessionId [src|f101f2cd-fb37514f-176838c0-65425ee5_0] Write session: destroy
2025-10-02T09:28:06.355016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f101f2cd-fb37514f-176838c0-65425ee5_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.355023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f101f2cd-fb37514f-176838c0-65425ee5_0 grpc read failed
2025-10-02T09:28:06.355030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f101f2cd-fb37514f-176838c0-65425ee5_0 grpc closed
2025-10-02T09:28:06.355034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f101f2cd-fb37514f-176838c0-65425ee5_0 is DEAD
2025-10-02T09:28:06.355329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.355447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553805790192653:2496] destroyed
2025-10-02T09:28:06.355467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.355475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.355478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.355481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-10-02T09:28:06.395782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.395809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.395812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.496129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.496144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.496146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.596477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.596499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.596502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.696861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.696878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.696881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.797191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.797213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.797216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.898052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.898075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.898079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.998392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.998407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.998409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.098748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.098764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.098767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.199157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.199194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.199197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.299709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.299725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.299729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-10-02T09:28:07.399812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.399825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.399827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.500148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.500165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.500168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.600533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.600550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.600553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.700874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.700890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.700893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.801219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.801241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.801244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.901570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.901589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.901592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.002245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.002261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.002265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.102792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.102810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.102813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.204862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.204880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.204883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.305032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.305050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.305054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.405379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.405395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.405397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.505731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.505747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.505749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.606088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.606105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.606108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.706443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.706458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.706462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.806811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.806834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.806836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.907128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.907144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.907147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.007505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.007523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.007526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.107865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.107880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.107883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.208220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.208236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.208238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.308528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.308544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.308548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.408872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.408889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.408892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.509273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.509291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.509293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.609623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.609639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.609643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.709972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.709994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.709997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.810334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.810355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.810358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.910672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.910690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.910694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.011040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.011061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.011063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.111367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.111393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.111396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.211732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.211750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.211753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.292668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:10.312075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.312093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.312096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.412425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.412445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.412447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.512771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.512785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.512788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.613140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.613155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.613176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.713441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.713458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.713461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.813799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.813814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.813817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.914165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.914181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.914184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.014525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.014542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.014545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.114884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.114900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.114903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.215243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.215261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.215264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.315574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.315587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.315589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.415932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.415946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.415948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.516262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.516275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.516278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.616634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.616654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.616656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.716994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.717008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.717010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.817348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.817360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.817363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.917678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.917692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.917703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.018066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.018083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.018086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.118402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.118420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.118423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.218752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.218765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.218767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.319106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.319119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.319121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.419464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.419477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.419480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.519809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.519823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.519826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.620164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.620178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.620181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.720487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.720507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.720510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.820878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.820897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.820900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.921240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.921257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.921260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.021606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.021625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.021628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.121940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.121959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.121962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.222294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.222312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.222315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.322731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.322754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.322758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.422997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.423015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.423017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.523356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.523373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.523376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.625393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.625408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.625412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.725569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.725586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.725588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.828871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.828892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.828894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.928843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.928858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.928862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.029188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.029205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.029208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.129533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.129550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.129553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.229895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.229911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.229915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.330229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.330248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.330250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.430599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.430616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.430619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.530918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.530932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.530935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.601580Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T09:28:14.601592Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:14.631286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.631302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.631304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.731616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.731630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.731633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.832000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.832011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.832013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.932317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.932331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.932333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.032716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.032729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.032733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.133039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.133054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.133057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.233383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.233399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.233401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.292864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:15.333772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.333786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.333789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.434135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.434151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.434154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.534466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.534482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.534485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.634818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.634840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.634842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.735186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.735202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.735204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.835527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.835546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.835549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.935881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.935896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.935899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.036223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.036240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.036243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.136551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.136565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.136568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.236935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.236952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.236954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.337291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.337306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.337309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.437600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.437611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.437613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.540965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.540983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.540987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.641426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.641444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.641448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.741758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.741771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.741774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.842133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.842148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.842151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.942485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.942500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.942503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.042846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.042860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.042864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.143188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.143205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.143208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.243529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.243543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.243545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.343875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.343890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.343893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.444246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.444272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.444276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.544601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.544615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.544618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.644968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.644987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.644989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.745322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.745340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.745344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.845644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.845656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.845658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.945984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.946003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.946005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.046337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.046356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.046358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.146681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.146692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.146694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.247052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.247065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.247067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.347411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.347424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.347426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.447764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.447779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.447781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.548112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.548127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.548129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.648442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.648466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.648468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.748833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.748849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.748852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.849187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.849204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.849207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.949521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.949539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.949542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.049887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.049905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.049908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.150219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.150235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.150239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.250585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.250605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.250608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.350947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.350965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.350968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.451268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.451284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.451287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.551613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.551629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.551633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.651981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.651997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.651999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.752341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.752357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.752359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.852675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.852692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.852694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.953044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.953059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.953061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.053392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.053412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.053414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.153731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.153745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.153748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.254093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.254108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.254111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.293037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:20.354425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.354439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.354441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.454803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.454828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.454831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.555161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.555192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.555195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.655518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.655533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.655536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.755874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.755893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.755896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.856209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.856222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.856224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.956557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.956575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.956578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.056901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.056923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.056926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.157288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.157306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.157309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.257615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.257633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.257636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.357973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.357989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.357992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.458330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.458347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.458350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.558687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.558704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.558707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.659040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.659061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.659064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.759394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.759413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.759416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.859732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.859750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.859754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.960117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.960134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.960137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.060433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.060450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.060452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.161469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.161488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.161492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.262495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.262514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.262517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.365028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.365049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.365054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.465453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.465472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.465475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.565805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.565823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.565826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.666076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.666094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.666097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.766503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.766522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.766525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.866843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.866862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.866865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.967187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.967213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.967215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.067533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.067548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.067551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.167874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.167892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.167895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.269139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.269155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.269158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.369621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.369637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.369640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.473107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.473122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.473125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.576891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.576910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.576914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.676816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.676831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.676835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.777173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.777190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.777193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.880479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.880508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.880510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.980385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.980401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.980403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.080829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.080849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.080853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.181146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.181162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.181166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.281487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.281503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.281506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.381843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.381860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.381864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.482369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.482384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.482388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.582551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.582567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.582570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.684904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.684920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.684924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.785304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.785331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.785334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.885645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.885662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.885665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.985990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.986006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.986009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.086305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.086322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.086325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.186698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.186719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.186722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.287028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.287044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.287047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.297124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:25.387387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.387405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.387408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.487730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.487748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.487750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.588105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.588122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.588125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.688463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.688481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.688484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.788835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.788856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.788859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.892960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.892979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.892982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.993096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.993113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.993116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.096857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.096876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.096878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.196884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.196899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.196903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.297230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.297249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.297252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.397576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.397591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.397593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.497952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.497973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.497976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.598273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.598290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.598292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.698639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.698659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.698662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.799037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.799058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.799061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.899340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.899358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.899361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.999682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.999699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.999701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.100061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.100080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.100082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.200402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.200422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.200424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.304864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.304887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.304890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.405192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.405208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.405211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.505718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.505737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.505740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.605889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.605905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.605918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.706265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.706284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.706287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.806596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.806612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.806615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.906949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.906965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.906968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.007303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.007331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.007334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.107667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.107686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.107689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.207977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.207993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.207995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.308335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.308354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.308357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.408695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.408710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.408713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.509070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.509099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.509103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.609435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.609452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.609455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.709795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.709814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.709818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.810121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.810140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.810144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.910472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.910489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.910492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.010852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.010869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.010873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.111241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.111255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.111258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.211531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.211547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.211549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.312876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.312893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.312896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.413265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.413280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.413284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.513603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.513617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.513620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.613924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.613942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.613944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.714318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.714339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.714342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.814668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.814683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.814686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.915027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.915046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.915049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.015343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.015362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.015365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.115735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.115760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.115764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.216081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.216100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.216103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.297505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:30.316903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.316923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.316926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.416774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.416792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.416795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.517135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.517154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.517157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.617466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.617485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.617489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.717859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.717879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.717882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.819698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.819715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.819719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.920083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.920101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.920105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.020418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.020434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.020436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.120792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.120821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.120824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.221113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.221128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.221132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.321459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.321477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.321480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.421837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.421854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.421857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.522190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.522205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.522209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.622549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.622569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.622572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.722919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.722937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.722941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.823252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.823268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.823272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.923612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.923628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.923631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.024914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.024932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.024935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.125326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.125344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.125347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.225703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.225719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.225722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.326033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.326052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.326055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.426369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.426390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.426392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.526728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.526743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.526746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.627075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.627090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.627092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.727438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.727453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.727456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.827815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.827834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.827838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.928126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.928140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.928142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.028487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.028503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.028506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.128853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.128871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.128874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.230459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.230475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.230478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.330575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.330599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.330604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.430897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.430913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.430916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.531319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.531335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.531338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.631723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.631739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.631743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.731978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.731995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.732006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.832347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.832361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.832364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.932683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.932699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.932703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.033035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.033050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.033053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.133408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.133431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.133434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.233732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.233747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.233750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.336296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.336317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.336319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.436457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.436471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.436474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.536849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.536863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.536865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.637188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.637201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.637203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.737561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.737578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.737582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.837884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.837899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.837902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.938253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.938267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.938271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.038603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.038617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.038619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.138979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.138996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.138998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.239317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.239336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.239339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.283815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:28:35.283871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:35.284343Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:28:35.284721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:28:35.284884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:28:35.284962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-02T09:28:35.297715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:35.339670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.339686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.339689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.440017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.440034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.440037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.540368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.540382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.540386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.640822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.640839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.640842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.741073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.741090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.741093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.841418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.841433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.841435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.941754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.941769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.941773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.042130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.042148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.042151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.142475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.142488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.142492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.242885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.242902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.242906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.343199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.343216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.343220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.443539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.443554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.443558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.543879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.543895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.543898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.644898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.644918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.644921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.745103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.745122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.745124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.845445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.845462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.845464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.945786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.945811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.945814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.046154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.046171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.046173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.146508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.146524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.146528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.246859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.246877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.246880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.347183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.347199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.347203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.447564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.447580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.447583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.547892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.547908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.547911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.648265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.648281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.648284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.748627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.748643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.748647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.848956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.848973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.848976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.949304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.949317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.949319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.049662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.049676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.049678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.150020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.150035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.150037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.250372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.250391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.250394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.350715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.350733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.350736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.451095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.451112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.451115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.551405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.551421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.551427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.651782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.651798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.651801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.752155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.752174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.752177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.852492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.852508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.852511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.952854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.952877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.952881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.053208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.053226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.053229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.153519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.153532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.153535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.253894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.253907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.253909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.354234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.354247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.354250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.454621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.454638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.454641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.555312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.555329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.555333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.655292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.655307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.655309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.755656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.755670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.755672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.855989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.856003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.856006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.956353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.956370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.956373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.056900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.056918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.056921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.157057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.157072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.157075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.257408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.257422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.257425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.298028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:40.357767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.357791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.357794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.458127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.458144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.458147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.558466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.558482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.558486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.658821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.658846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.658850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.759198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.759213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.759216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.859527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.859553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.859556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.959868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.959881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.959883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.060231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.060247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.060249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.160588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.160604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.160607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.260945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.260960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.260963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.361280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.361294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.361296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.461640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.461657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.461660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.906890Z :SimpleHandlers INFO: Random seed for debugging is 1759397321906884
2025-10-02T09:28:41.977359Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556553955707066577:2082];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:41.977683Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:41.978728Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553954603522675:2159];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:41.978788Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/tmpa6mKN1/pdisk_1.dat
2025-10-02T09:28:41.979457Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:41.980168Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:41.980486Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:41.980750Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:41.992358Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:41.995042Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7556553954603522535:2073] 1759397321978143 != 1759397321978140
2025-10-02T09:28:41.995794Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:41.995809Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:41.996972Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:41.997172Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 22050, node 3
2025-10-02T09:28:42.003573Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandex8FzXGO.tmp
2025-10-02T09:28:42.003586Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandex8FzXGO.tmp
2025-10-02T09:28:42.003646Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001e2/r3tmp/yandex8FzXGO.tmp
2025-10-02T09:28:42.003690Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:42.006151Z INFO: TTestServer started on Port 13099 GrpcPort 22050
TClient is connected to server localhost:13099
PQClient connected to localhost:22050
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:42.020369Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:28:42.078784Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:42.078815Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:42.080363Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:42.148550Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:42.275157Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:42.323357Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553960002034792:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:42.323386Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553960002034773:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:42.323411Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:42.324175Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:42.329187Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556553960002034800:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-10-02T09:28:42.329767Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:42.341288Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556553958898490218:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:42.341413Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=NGQ1MWVmNmUtM2Q0ODUzMGItZDI2OWU5NzYtYmVmYjkwZDE=, ActorId: [4:7556553958898490193:2295], ActorState: ExecuteState, TraceId: 01k6j417jx77jj36jpy5eh9e46, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:42.341658Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:42.359746Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:42.390514Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:42.403085Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556553960002035234:2921] txid# 281474976710665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:22050", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:42.441042Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k6j417nj9hngsh4h78c79m55, Database: , SessionId: ydb://session/3?node_id=3&id=NmE4NzI4MzEtMTA3NzE1NGMtYTNhMzBkZGYtN2QzMmI2NWY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553960002035371:3010] 
2025-10-02T09:28:42.979200Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:42.980227Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:46.977410Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556553955707066577:2082];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:46.977446Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:46.978946Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553954603522675:2159];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:46.978989Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:47.661319Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:22050
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:47.686960Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:22050
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:47.694621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.694794Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553981476872449:3353] connected; active server actors: 1
2025-10-02T09:28:47.694998Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:47.695086Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:47.695293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.695343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:47.695355Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.695367Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:47.695375Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:47.695445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556553980373327135:2379], now have 1 active actors on pipe
2025-10-02T09:28:47.695462Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:28:47.695458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553981476872448:3352], now have 1 active actors on pipe
2025-10-02T09:28:47.695577Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:47.696434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:47.700320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553981476872508:3400], now have 1 active actors on pipe
2025-10-02T09:28:47.700372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:47.701237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:47.701386Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.701400Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:47.701445Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.701479Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556553981476872530:2473]
2025-10-02T09:28:47.702102Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.702110Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.702115Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556553981476872530:2473]
2025-10-02T09:28:47.702121Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:47.702319Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:47.702327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.702339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.702343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.702346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:47.702347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.702348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.702350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:47.702354Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.702398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:47.702418Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:47.703250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:47.703286Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397327744, TxId 281474976710682
2025-10-02T09:28:47.703291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.703292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.703312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.703350Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:47.703803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:47.703849Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:47.703859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.703861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.703863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.703867Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:47.703959Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:47.703978Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.704021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:47.705003Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:47.705027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:47.705407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:47.718722Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710683. Ctx: { TraceId: 01k6j41cthaze1s3abk6fgwhan, Database: , SessionId: ydb://session/3?node_id=3&id=YmYwNWEyNzQtZmI1YjI4ZjItZDI4NWJkY2EtZDBhYzdkMzE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759397327744
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759397327744
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:22050
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:47.733315Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:47.802776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.802793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.802797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.903092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.903110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.903114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.003480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.003498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.003501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.103820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.103837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.103839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.205172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.205190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.205192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:22050
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:48.234811Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:48.305571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.305585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.305588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.408862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.408881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.408884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.508787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.508815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.508817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.609132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.609148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.609151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.709497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.709512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.709515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:22050
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:48.736580Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:48.737819Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:48.738062Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:48.738067Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:22050
2025-10-02T09:28:48.738411Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:48.738508Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.738521Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:48.738763Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:48.738800Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36842
2025-10-02T09:28:48.738820Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36842 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.738827Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.739218Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:48.739252Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.739254Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.739256Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.739261Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.739877Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.762125Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:48.762286Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840065:2514] connected; active server actors: 1
2025-10-02T09:28:48.762546Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:48.762558Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.763053Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840065:2514] disconnected; active server actors: 1
2025-10-02T09:28:48.763063Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840065:2514] disconnected no session
2025-10-02T09:28:48.780277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.780298Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:48.780303Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553985771840029:2514] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.780320Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.780467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:48.780473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553985771840085:2514], now have 1 active actors on pipe
2025-10-02T09:28:48.780480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.780485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.780511Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2e7bff01-840bb88b-2184dd34-66bccb1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:48.780521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.780525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.780526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.780536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.780555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.780568Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.780608Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.780621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.780654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.780696Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2e7bff01-840bb88b-2184dd34-66bccb1b_0
2025-10-02T09:28:48.780964Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397328780 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.781024Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2e7bff01-840bb88b-2184dd34-66bccb1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.781115Z :INFO: [] MessageGroupId [src] SessionId [src|2e7bff01-840bb88b-2184dd34-66bccb1b_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:48.781125Z :INFO: [] MessageGroupId [src] SessionId [src|2e7bff01-840bb88b-2184dd34-66bccb1b_0] Write session will now close
2025-10-02T09:28:48.781131Z :DEBUG: [] MessageGroupId [src] SessionId [src|2e7bff01-840bb88b-2184dd34-66bccb1b_0] Write session: aborting
2025-10-02T09:28:48.781272Z :INFO: [] MessageGroupId [src] SessionId [src|2e7bff01-840bb88b-2184dd34-66bccb1b_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:48.781277Z :DEBUG: [] MessageGroupId [src] SessionId [src|2e7bff01-840bb88b-2184dd34-66bccb1b_0] Write session: destroy
2025-10-02T09:28:48.781400Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2e7bff01-840bb88b-2184dd34-66bccb1b_0 grpc read done: success: 0 data: 
2025-10-02T09:28:48.781410Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2e7bff01-840bb88b-2184dd34-66bccb1b_0 grpc read failed
2025-10-02T09:28:48.781418Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|2e7bff01-840bb88b-2184dd34-66bccb1b_0 grpc closed
2025-10-02T09:28:48.781422Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2e7bff01-840bb88b-2184dd34-66bccb1b_0 is DEAD
2025-10-02T09:28:48.781683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:48.781728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553985771840085:2514] destroyed
2025-10-02T09:28:48.781741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:48.781745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.781747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.781749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Session was created
2025-10-02T09:28:48.809861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.809880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.809883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:48.845002Z :INFO: [/Root] [] [6300de33-bec83492-5f575e3-cd2da8ee] Open read subsessions to databases: { name: dc1, endpoint: localhost:22050, path: /Root }, { name: dc2, endpoint: localhost:22050, path: /Root }, { name: dc3, endpoint: localhost:22050, path: /Root }
2025-10-02T09:28:48.846526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-02T09:28:48.846535Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Starting read session
2025-10-02T09:28:48.846547Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Starting single session
2025-10-02T09:28:48.846638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-02T09:28:48.846664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:22050
2025-10-02T09:28:48.846774Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.846778Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.846782Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:48.847245Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Starting read session
2025-10-02T09:28:48.847250Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Starting single session
2025-10-02T09:28:48.847263Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.847266Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.847268Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:48.847317Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Starting read session
2025-10-02T09:28:48.847319Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Starting single session
2025-10-02T09:28:48.847345Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.847346Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.847348Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:48.893479Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] Successfully connected. Initializing session
2025-10-02T09:28:48.893494Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] Successfully connected. Initializing session
2025-10-02T09:28:48.893510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.893587Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Successfully connected. Initializing session
2025-10-02T09:28:48.893767Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:48.893770Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.893777Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:48.893778Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T09:28:48.893807Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:48.893808Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T09:28:48.893813Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:48.893814Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-02T09:28:48.893909Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.893939Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:49716
2025-10-02T09:28:48.893948Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49716 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.893950Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.895993Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.895999Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.896052Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 read init: from# ipv6:[::1]:49716, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.896052Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 read init: from# ipv6:[::1]:49716, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.896123Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.896127Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 auth for : user
2025-10-02T09:28:48.896139Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read init: from# ipv6:[::1]:49716, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:48.896157Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 auth for : user
2025-10-02T09:28:48.896165Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 auth for : user
2025-10-02T09:28:48.896328Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Handle describe topics response
2025-10-02T09:28:48.896348Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 auth is DEAD
2025-10-02T09:28:48.896366Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 Handle describe topics response
2025-10-02T09:28:48.896377Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 auth is DEAD
2025-10-02T09:28:48.896386Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 Handle describe topics response
2025-10-02T09:28:48.896391Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 auth is DEAD
2025-10-02T09:28:48.896397Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:48.896444Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:48.896466Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.896470Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.896471Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.896475Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.896483Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:48.896592Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:48.896603Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:48.896612Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:48.896704Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got InitResponse. ReadSessionId: shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.896714Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.896717Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:48.896778Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.896851Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] Got InitResponse. ReadSessionId: shared/user_3_1_18337986455714894690_v1
2025-10-02T09:28:48.896861Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.896883Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] Got InitResponse. ReadSessionId: shared/user_3_2_8112064939204738106_v1
2025-10-02T09:28:48.896886Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:48.896886Z :DEBUG: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.896884Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:48.896895Z :DEBUG: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.896896Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# 557ab11-2bd1c2b5-af6a5950-3edb8668
2025-10-02T09:28:48.896944Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840111:2532] connected; active server actors: 1
2025-10-02T09:28:48.896975Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840110:2534] connected; active server actors: 1
2025-10-02T09:28:48.896981Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840112:2533] connected; active server actors: 1
2025-10-02T09:28:48.897000Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556553985771840111:2532] session shared/user_3_1_18337986455714894690_v1
2025-10-02T09:28:48.897013Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:48.897029Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:48.897031Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:48.897046Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_18337986455714894690_v1" (Sender=[3:7556553985771840099:2532], Pipe=[3:7556553985771840111:2532], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:48.897052Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:48.897055Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 got read request: guid# 13c788b8-79c9b289-f078bfa9-e66a88ff
2025-10-02T09:28:48.897063Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:48.897066Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 got read request: guid# 86b1fa8c-df214018-5f3ff8ec-991f467c
2025-10-02T09:28:48.897068Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.897074Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556553985771840112:2533] session shared/user_3_2_8112064939204738106_v1
2025-10-02T09:28:48.897088Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_8112064939204738106_v1" (Sender=[3:7556553985771840100:2533], Pipe=[3:7556553985771840112:2533], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:48.897097Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556553985771840110:2534] session shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.897117Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_9903131344634173367_v1" (Sender=[3:7556553985771840101:2534], Pipe=[3:7556553985771840110:2534], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:48.897130Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:48.897141Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_9903131344634173367_v1" (Sender=[3:7556553985771840101:2534], Pipe=[3:7556553985771840110:2534], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:48.897156Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_9903131344634173367_v1" sender [3:7556553985771840101:2534] lock partition 0 for ReadingSession "shared/user_3_3_9903131344634173367_v1" (Sender=[3:7556553985771840101:2534], Pipe=[3:7556553985771840110:2534], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T09:28:48.897185Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-02T09:28:48.897197Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000063s
2025-10-02T09:28:48.897412Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_9903131344634173367_v1" ClientId: "user" PipeClient { RawX1: 7556553985771840110 RawX2: 4503612512274918 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:48.897431Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:28:48.897484Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7556553985771840121:2543]
2025-10-02T09:28:48.897493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553985771840121:2543], now have 1 active actors on pipe
2025-10-02T09:28:48.897501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.897506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.897522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_9903131344634173367_v1 on pipe: [3:7556553985771840121:2543]
2025-10-02T09:28:48.897541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.897544Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_9903131344634173367_v1:1 with generation 1
2025-10-02T09:28:48.897545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.897547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.897570Z node 3 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.897575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.897596Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.898193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.898215Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.898224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.898225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.898226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.898230Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:48.898238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:48.898278Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397328809 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:48.898290Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:48.898306Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 sending to client partition status
2025-10-02T09:28:48.898550Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T09:28:48.898641Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:48.898753Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T09:28:48.898768Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840138:2531] connected; active server actors: 1
2025-10-02T09:28:48.898818Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:48.898833Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:48.898838Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:48.898855Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:48.898861Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.898943Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840138:2531] disconnected; active server actors: 1
2025-10-02T09:28:48.898950Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840138:2531] disconnected no session
2025-10-02T09:28:48.901321Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.901330Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:48.901332Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553985771840109:2531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.901337Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.901437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:48.901449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553985771840152:2531], now have 1 active actors on pipe
2025-10-02T09:28:48.901453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.901456Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.901470Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.901476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.901479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.901480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.901486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.901494Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.901507Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.901537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.901542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.901549Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.901568Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0
2025-10-02T09:28:48.901745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397328901 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.901765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.901843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:48.901870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.901877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T09:28:48.901976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 2 to 2
2025-10-02T09:28:48.901982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.901985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-02T09:28:48.902017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 3 to 3
2025-10-02T09:28:48.902021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-02T09:28:48.902014Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 4 to 4
2025-10-02T09:28:48.902059Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-02T09:28:48.902108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 5 to 5
2025-10-02T09:28:48.902113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-02T09:28:48.902139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 6 to 6
2025-10-02T09:28:48.902144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-02T09:28:48.902151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 7 to 7
2025-10-02T09:28:48.902156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-02T09:28:48.902148Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 8 to 8
2025-10-02T09:28:48.902163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902172Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-02T09:28:48.902183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:48.902191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-10-02T09:28:48.902194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 9 to 9
2025-10-02T09:28:48.902194Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-02T09:28:48.902207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 10 to 10
2025-10-02T09:28:48.902198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-02T09:28:48.902219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 11 to 11
2025-10-02T09:28:48.902223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-02T09:28:48.902243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 12 to 12
2025-10-02T09:28:48.902249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-02T09:28:48.902256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 13 to 13
2025-10-02T09:28:48.902260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-02T09:28:48.902268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 14 to 14
2025-10-02T09:28:48.902273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-02T09:28:48.902265Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 2 size 82 offset: -1
2025-10-02T09:28:48.902296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902297Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902300Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 192 offset: -1
2025-10-02T09:28:48.902303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.902315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.902316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.902334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:48.902348Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-10-02T09:28:48.902379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.902399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1759397328901
2025-10-02T09:28:48.902427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902444Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.902451Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-10-02T09:28:48.902451Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-02T09:28:48.902486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 4
2025-10-02T09:28:48.902488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902495Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902502Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902532Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902538Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902569Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 7 size 303 offset: -1
2025-10-02T09:28:48.902581Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 8 size 413 offset: -1
2025-10-02T09:28:48.902587Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 5
2025-10-02T09:28:48.902592Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902596Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902597Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902603Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902603Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 6
2025-10-02T09:28:48.902606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 7
2025-10-02T09:28:48.902608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902620Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 11 size 523 offset: -1
2025-10-02T09:28:48.902622Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902633Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902648Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902672Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 13 size 633 offset: -1
2025-10-02T09:28:48.902716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 14 size 743 offset: -1
2025-10-02T09:28:48.902725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902733Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902743Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 15 to 15
2025-10-02T09:28:48.902751Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902763Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 8
2025-10-02T09:28:48.902770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-02T09:28:48.902769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 9
2025-10-02T09:28:48.902777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 10
2025-10-02T09:28:48.902780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 11
2025-10-02T09:28:48.902785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902789Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902795Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.902811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 16 to 16
2025-10-02T09:28:48.902827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-02T09:28:48.902833Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902859Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.902872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 17 to 17
2025-10-02T09:28:48.902877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-02T09:28:48.902870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902889Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.902894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 18 size 853 offset: -1
2025-10-02T09:28:48.902901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 18 to 18
2025-10-02T09:28:48.902911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-02T09:28:48.902908Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 19 size 963 offset: -1
2025-10-02T09:28:48.902916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902918Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 20 size 1073 offset: -1
2025-10-02T09:28:48.902926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902931Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size 1183 offset: -1
2025-10-02T09:28:48.902934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 19 to 19
2025-10-02T09:28:48.902934Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-02T09:28:48.902945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 20 to 20
2025-10-02T09:28:48.902952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-02T09:28:48.902969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 21 to 21
2025-10-02T09:28:48.902961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.902976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-02T09:28:48.902971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.902987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 22 to 22
2025-10-02T09:28:48.902974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.902977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.902979Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-02T09:28:48.902982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902984Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 23 to 23
2025-10-02T09:28:48.902986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.902988Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-02T09:28:48.903034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-02T09:28:48.903050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 13
2025-10-02T09:28:48.903059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 14
2025-10-02T09:28:48.903060Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903068Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.903069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 15
2025-10-02T09:28:48.903088Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-10-02T09:28:48.903092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 27 size 1293 offset: -1
2025-10-02T09:28:48.903104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.903115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.903117Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.903129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:48.903130Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903167Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.903173Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-02T09:28:48.903176Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-02T09:28:48.903176Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.903180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.903188Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
2025-10-02T09:28:48.903188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.903190Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.903191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:48.903201Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 2ee24264-ff6ad469-fa960bf5-a5ed1d8a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.903203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:28:48.903223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-10-02T09:28:48.903236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 24 to 24
2025-10-02T09:28:48.903234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T09:28:48.903235Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 2ee24264-ff6ad469-fa960bf5-a5ed1d8a
2025-10-02T09:28:48.903243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903242Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-10-02T09:28:48.903255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-02T09:28:48.903246Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T09:28:48.903249Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903249Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-10-02T09:28:48.903253Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T09:28:48.903256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1631 count 4 nextOffset 5 batches 1
2025-10-02T09:28:48.903259Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T09:28:48.903262Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2306 count 5 nextOffset 6 batches 1
2025-10-02T09:28:48.903265Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T09:28:48.903268Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3091 count 6 nextOffset 7 batches 1
2025-10-02T09:28:48.903270Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T09:28:48.903273Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3986 count 7 nextOffset 8 batches 1
2025-10-02T09:28:48.903276Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T09:28:48.903279Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 4991 count 8 nextOffset 9 batches 1
2025-10-02T09:28:48.903282Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T09:28:48.903285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903287Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6106 count 9 nextOffset 10 batches 1
2025-10-02T09:28:48.903292Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T09:28:48.903294Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 7331 count 10 nextOffset 11 batches 1
2025-10-02T09:28:48.903302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.903317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903325Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 25 to 25
2025-10-02T09:28:48.903339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-02T09:28:48.903352Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,10 HeadOffset 1 endOffset 1 curOffset 11 d0000000000_00000000000000000001_00000_0000000010_00000? size 7070 WTime 1759397328902
2025-10-02T09:28:48.903356Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903371Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.903382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 26 to 26
2025-10-02T09:28:48.903377Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 142 bytes (142)
2025-10-02T09:28:48.903380Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 142 (8388608)
2025-10-02T09:28:48.903389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903387Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-02T09:28:48.903390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 28 size 1403 offset: -1
2025-10-02T09:28:48.903402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 29 size 1513 offset: -1
2025-10-02T09:28:48.903410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903412Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903417Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 31 size 1623 offset: -1
2025-10-02T09:28:48.903424Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-10-02T09:28:48.903434Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 27 to 27
2025-10-02T09:28:48.903448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-02T09:28:48.903454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 28 to 28
2025-10-02T09:28:48.903480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-02T09:28:48.903485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903500Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.903512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 29 to 29
2025-10-02T09:28:48.903516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-02T09:28:48.903512Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 10 size 7070
2025-10-02T09:28:48.903521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 16
2025-10-02T09:28:48.903534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 30 to 30
2025-10-02T09:28:48.903526Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-02T09:28:48.903529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 31 to 31
2025-10-02T09:28:48.903534Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-02T09:28:48.903537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 32 to 32
2025-10-02T09:28:48.903542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-02T09:28:48.903575Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 17
2025-10-02T09:28:48.903588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 18
2025-10-02T09:28:48.903594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903596Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903601Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 35 size 1733 offset: -1
2025-10-02T09:28:48.903604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903614Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:48.903617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903629Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903630Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:48.903633Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.903639Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 19
2025-10-02T09:28:48.903641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 20
2025-10-02T09:28:48.903661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903676Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.903687Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:48.903693Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:48.903697Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T09:28:48.903701Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:48.903714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 33 to 33
2025-10-02T09:28:48.903702Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T09:28:48.903706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-02T09:28:48.903712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 37 size 1843 offset: -1
2025-10-02T09:28:48.903737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 34 to 34
2025-10-02T09:28:48.903713Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 21
2025-10-02T09:28:48.903748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-02T09:28:48.903722Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.903730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 35 to 35
2025-10-02T09:28:48.903732Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-02T09:28:48.903735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903744Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 1 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.903747Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-02T09:28:48.903761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-02T09:28:48.903751Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903753Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903753Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T09:28:48.903753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 38 size 1953 offset: -1
2025-10-02T09:28:48.903766Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397328901 queuesize 0 startOffset 0
2025-10-02T09:28:48.903767Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903772Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903778Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 39 size 2063 offset: -1
2025-10-02T09:28:48.903782Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.903788Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-02T09:28:48.903800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903800Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 40 size 2173 offset: -1
2025-10-02T09:28:48.903806Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903809Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 43 size 2283 offset: -1
2025-10-02T09:28:48.903833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903838Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903839Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.903849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903854Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.903862Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.903866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.903880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 22
2025-10-02T09:28:48.903883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 23
2025-10-02T09:28:48.903886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 24
2025-10-02T09:28:48.903888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 25
2025-10-02T09:28:48.903890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 26
2025-10-02T09:28:48.903901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903907Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903910Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903913Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903918Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.903922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.903933Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1759397328901 CreateTimestampMS: 1759397328901 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-02T09:28:48.903969Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-02T09:28:48.903981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 36 to 36
2025-10-02T09:28:48.903979Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 2ee24264-ff6ad469-fa960bf5-a5ed1d8a has messages 1
2025-10-02T09:28:48.903989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.903987Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-02T09:28:48.903992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.903996Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.903997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 37 to 37
2025-10-02T09:28:48.903996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904001Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.904005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 47 size 2393 offset: -1
2025-10-02T09:28:48.904012Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 48 size 2503 offset: -1
2025-10-02T09:28:48.904022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 49 size 2613 offset: -1
2025-10-02T09:28:48.904031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 50 size 2723 offset: -1
2025-10-02T09:28:48.904044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904052Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size 2833 offset: -1
2025-10-02T09:28:48.904062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 38 to 38
2025-10-02T09:28:48.904078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-02T09:28:48.904077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904082Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904084Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904102Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 2ee24264-ff6ad469-fa960bf5-a5ed1d8a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171
2025-10-02T09:28:48.904105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 39 to 39
2025-10-02T09:28:48.904107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904108Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 2ee24264-ff6ad469-fa960bf5-a5ed1d8a
2025-10-02T09:28:48.904119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904109Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-02T09:28:48.904111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 40 to 40
2025-10-02T09:28:48.904154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-02T09:28:48.904168Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.904190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 41 to 41
2025-10-02T09:28:48.904186Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-02T09:28:48.904198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904231Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 171, now ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-02T09:28:48.904238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 42 to 42
2025-10-02T09:28:48.904219Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-02T09:28:48.904255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-02T09:28:48.904259Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-02T09:28:48.904258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 28
2025-10-02T09:28:48.904262Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 29
2025-10-02T09:28:48.904268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 30
2025-10-02T09:28:48.904272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 31
2025-10-02T09:28:48.904280Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 43 to 43
2025-10-02T09:28:48.904295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 57 size 2943 offset: -1
2025-10-02T09:28:48.904301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-02T09:28:48.904301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904302Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 44 to 44
2025-10-02T09:28:48.904307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 58 size 3053 offset: -1
2025-10-02T09:28:48.904310Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-02T09:28:48.904310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904333Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 171 to budget
2025-10-02T09:28:48.904314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904340Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 171, ReadSizeServerDelta = 524117
2025-10-02T09:28:48.904342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-02T09:28:48.904316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 60 size 3163 offset: -1
2025-10-02T09:28:48.904336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904392Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.904342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 61 size 3273 offset: -1
2025-10-02T09:28:48.904345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904405Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-02T09:28:48.904347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 62 size 3383 offset: -1
2025-10-02T09:28:48.904352Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904362Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 45 to 45
2025-10-02T09:28:48.904377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904379Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-02T09:28:48.904382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-02T09:28:48.904384Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 46 to 46
2025-10-02T09:28:48.904386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-02T09:28:48.901000Z WriteTime: 2025-10-02T09:28:48.901000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.904390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 32
2025-10-02T09:28:48.904397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 33
2025-10-02T09:28:48.904400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 34
2025-10-02T09:28:48.904475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-02T09:28:48.904403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 35
2025-10-02T09:28:48.904404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 36
2025-10-02T09:28:48.904408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904494Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-10-02T09:28:48.904506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.904512Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.904421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 1
2025-10-02T09:28:48.904426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904429Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 47 to 47
2025-10-02T09:28:48.904438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904456Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-02T09:28:48.904460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 67 size 3493 offset: -1
2025-10-02T09:28:48.904463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904474Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904480Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 68 size 3603 offset: -1
2025-10-02T09:28:48.904484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 69 size 3713 offset: -1
2025-10-02T09:28:48.904493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 70 size 3823 offset: -1
2025-10-02T09:28:48.904501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904511Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size 3933 offset: -1
2025-10-02T09:28:48.904514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904547Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.904550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.904552Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.904554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.904637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 48 to 48
2025-10-02T09:28:48.904585Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171 } }
2025-10-02T09:28:48.904590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-02T09:28:48.904644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 38
2025-10-02T09:28:48.904646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-02T09:28:48.904595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 39
2025-10-02T09:28:48.904602Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 10 size 7070 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.904652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 49 to 49
2025-10-02T09:28:48.904613Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 40
2025-10-02T09:28:48.904615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 41
2025-10-02T09:28:48.904618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.904627Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6949 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.904627Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 10 parts 0 suffix '63' size 7070
2025-10-02T09:28:48.904628Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# df2e1020-f31c5a4c-b3e8e193-86f6233
2025-10-02T09:28:48.904632Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904632Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904636Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904636Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T09:28:48.904639Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904642Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-02T09:28:48.904644Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904647Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-02T09:28:48.904649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-02T09:28:48.904651Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-02T09:28:48.904652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.904653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904656Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-02T09:28:48.904658Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-02T09:28:48.904663Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904665Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-02T09:28:48.904667Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904671Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-02T09:28:48.904672Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904676Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-02T09:28:48.904678Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.904681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904682Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-02T09:28:48.904701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.904706Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 11 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-02T09:28:48.904708Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 11
2025-10-02T09:28:48.904713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.904714Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 11, WTime# 1759397328901, sizeLag# 7070
2025-10-02T09:28:48.904715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-02T09:28:48.904716Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.904722Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 51427d0a-bea53c0b-ee16f6b9-7d760dba, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 8484, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.904727Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-02T09:28:48.904730Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 8484 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 11 ClientCommitOffset 0 committedOffset 0 Guid 51427d0a-bea53c0b-ee16f6b9-7d760dba
2025-10-02T09:28:48.904741Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904757Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1367 count 1 nextOffset 12 batches 1
2025-10-02T09:28:48.904762Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-02T09:28:48.904767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2812 count 2 nextOffset 13 batches 1
2025-10-02T09:28:48.904769Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-02T09:28:48.904773Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4367 count 3 nextOffset 14 batches 1
2025-10-02T09:28:48.904774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-02T09:28:48.904780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 6032 count 4 nextOffset 15 batches 1
2025-10-02T09:28:48.904783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-02T09:28:48.904786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 7807 count 5 nextOffset 16 batches 1
2025-10-02T09:28:48.904793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 50 to 50
2025-10-02T09:28:48.904789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-02T09:28:48.904793Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 9692 count 6 nextOffset 17 batches 1
2025-10-02T09:28:48.904813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-02T09:28:48.904795Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T09:28:48.904799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 11687 count 7 nextOffset 18 batches 1
2025-10-02T09:28:48.904817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T09:28:48.904820Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 13792 count 8 nextOffset 19 batches 1
2025-10-02T09:28:48.904823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T09:28:48.904827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 16007 count 9 nextOffset 20 batches 1
2025-10-02T09:28:48.904830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T09:28:48.904834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 18332 count 10 nextOffset 21 batches 1
2025-10-02T09:28:48.904834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T09:28:48.904840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 20767 count 11 nextOffset 22 batches 1
2025-10-02T09:28:48.904842Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T09:28:48.904858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 51 to 51
2025-10-02T09:28:48.904846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 23312 count 12 nextOffset 23 batches 1
2025-10-02T09:28:48.904846Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904848Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T09:28:48.904869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904851Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 25967 count 13 nextOffset 24 batches 1
2025-10-02T09:28:48.904886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-02T09:28:48.904855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T09:28:48.904858Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 28732 count 14 nextOffset 25 batches 1
2025-10-02T09:28:48.904861Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T09:28:48.904864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 31607 count 15 nextOffset 26 batches 1
2025-10-02T09:28:48.904867Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T09:28:48.904871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 34592 count 16 nextOffset 27 batches 1
2025-10-02T09:28:48.904872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904874Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-02T09:28:48.904882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 37687 count 17 nextOffset 28 batches 1
2025-10-02T09:28:48.904884Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904886Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-02T09:28:48.904889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 40892 count 18 nextOffset 29 batches 1
2025-10-02T09:28:48.904922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 52 to 52
2025-10-02T09:28:48.904892Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-02T09:28:48.904931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904896Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 44207 count 19 nextOffset 30 batches 1
2025-10-02T09:28:48.904933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-02T09:28:48.904899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-02T09:28:48.904903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 47632 count 20 nextOffset 31 batches 1
2025-10-02T09:28:48.904905Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-02T09:28:48.904908Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 51167 count 21 nextOffset 32 batches 1
2025-10-02T09:28:48.904912Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-02T09:28:48.904915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 54812 count 22 nextOffset 33 batches 1
2025-10-02T09:28:48.904918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-02T09:28:48.904922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 58567 count 23 nextOffset 34 batches 1
2025-10-02T09:28:48.904925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-02T09:28:48.904929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 62432 count 24 nextOffset 35 batches 1
2025-10-02T09:28:48.904932Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-02T09:28:48.904936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 66407 count 25 nextOffset 36 batches 1
2025-10-02T09:28:48.904938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.904941Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.904969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.904980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 53 to 53
2025-10-02T09:28:48.904984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.904988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-02T09:28:48.904988Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 54 to 54
2025-10-02T09:28:48.905026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-02T09:28:48.905032Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 55 to 55
2025-10-02T09:28:48.905067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-02T09:28:48.905076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 56 to 56
2025-10-02T09:28:48.905081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-02T09:28:48.905078Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,25 HeadOffset 11 endOffset 11 curOffset 36 d0000000000_00000000000000000011_00000_0000000025_00000? size 65669 WTime 1759397328905
2025-10-02T09:28:48.905112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 57 to 57
2025-10-02T09:28:48.905118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905111Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.905120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-02T09:28:48.905117Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.905120Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 7212 bytes (7212)
2025-10-02T09:28:48.905122Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 7212 (8388608)
2025-10-02T09:28:48.905129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 58 to 58
2025-10-02T09:28:48.905123Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-02T09:28:48.905144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 59 to 59
2025-10-02T09:28:48.905137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-02T09:28:48.905147Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 3
2025-10-02T09:28:48.905153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-02T09:28:48.905152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 4
2025-10-02T09:28:48.905159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 60 to 60
2025-10-02T09:28:48.905157Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-02T09:28:48.905157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 5
2025-10-02T09:28:48.905160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905161Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 6
2025-10-02T09:28:48.905165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 7
2025-10-02T09:28:48.905183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 61 to 61
2025-10-02T09:28:48.905169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 8
2025-10-02T09:28:48.905173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 9
2025-10-02T09:28:48.905177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 10
2025-10-02T09:28:48.905190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-02T09:28:48.905184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 62 to 62
2025-10-02T09:28:48.905193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 77 size 4043 offset: -1
2025-10-02T09:28:48.905197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 78 size 4153 offset: -1
2025-10-02T09:28:48.905223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-02T09:28:48.905206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 79 size 4263 offset: -1
2025-10-02T09:28:48.905214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905216Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 80 size 4373 offset: -1
2025-10-02T09:28:48.905223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size 4483 offset: -1
2025-10-02T09:28:48.905246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 63 to 63
2025-10-02T09:28:48.905233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-02T09:28:48.905236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905242Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-02T09:28:48.905249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905257Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 64 to 64
2025-10-02T09:28:48.905259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 64
2025-10-02T09:28:48.905263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905267Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905268Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905278Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.905285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.905289Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 25 size 65669
2025-10-02T09:28:48.905292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 2
2025-10-02T09:28:48.905293Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 65 to 65
2025-10-02T09:28:48.905300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905304Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 65
2025-10-02T09:28:48.905306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905307Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905307Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905311Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-02T09:28:48.905347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 43
2025-10-02T09:28:48.905349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 44
2025-10-02T09:28:48.905352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 45
2025-10-02T09:28:48.905354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 46
2025-10-02T09:28:48.905375Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 12 size 8484 endOffset 11 max time lag 0ms effective offset 1
2025-10-02T09:28:48.905387Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 7070 count 10 last offset 1, current partition end offset: 11
2025-10-02T09:28:48.905394Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-02T09:28:48.905402Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 10 parts_count 0 source 1 size 7070 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.905410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905411Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-02T09:28:48.905417Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.905436Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 10 parts 0 suffix '63'
2025-10-02T09:28:48.905466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 66 to 66
2025-10-02T09:28:48.905466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 66
2025-10-02T09:28:48.905474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905490Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 67 to 67
2025-10-02T09:28:48.905490Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 10 count 10 size 7050 from pos 0 cbcount 10
2025-10-02T09:28:48.905499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 67
2025-10-02T09:28:48.905506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 68 to 68
2025-10-02T09:28:48.905512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 68
2025-10-02T09:28:48.905520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 69 to 69
2025-10-02T09:28:48.905524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 69
2025-10-02T09:28:48.905534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.905538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 3
2025-10-02T09:28:48.905515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:48.905543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 70 to 70
2025-10-02T09:28:48.905531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 87 size 4593 offset: -1
2025-10-02T09:28:48.905552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 70
2025-10-02T09:28:48.905540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905543Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905548Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 88 size 4703 offset: -1
2025-10-02T09:28:48.905550Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905552Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 89 size 4813 offset: -1
2025-10-02T09:28:48.905560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 90 size 4923 offset: -1
2025-10-02T09:28:48.905569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size 5033 offset: -1
2025-10-02T09:28:48.905585Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905602Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905606Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905610Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 71 to 71
2025-10-02T09:28:48.905613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 71
2025-10-02T09:28:48.905621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905628Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905638Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-02T09:28:48.905651Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 48
2025-10-02T09:28:48.905653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 49
2025-10-02T09:28:48.905660Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905683Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 11 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328901 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1759397328902 CreateTimestampMS: 1759397328902 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551387 RealReadOffset: 10 WaitQuotaTimeMs: 0 EndOffset: 11 StartOffset: 0 } Cookie: 1 }
2025-10-02T09:28:48.905717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 72 to 72
2025-10-02T09:28:48.905769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 72
2025-10-02T09:28:48.905721Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 11
2025-10-02T09:28:48.905776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 73 to 73
2025-10-02T09:28:48.905727Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 11 ReadOffset 11 ReadGuid 51427d0a-bea53c0b-ee16f6b9-7d760dba has messages 1
2025-10-02T09:28:48.905781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 73
2025-10-02T09:28:48.905730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 74 to 74
2025-10-02T09:28:48.905735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 50
2025-10-02T09:28:48.905797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 51
2025-10-02T09:28:48.905800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 74
2025-10-02T09:28:48.905752Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 51427d0a-bea53c0b-ee16f6b9-7d760dba, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6638
2025-10-02T09:28:48.905757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905758Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 51427d0a-bea53c0b-ee16f6b9-7d760dba
2025-10-02T09:28:48.905760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 75 to 75
2025-10-02T09:28:48.905827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 75
2025-10-02T09:28:48.905768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 97 size 5143 offset: -1
2025-10-02T09:28:48.905772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 98 size 5253 offset: -1
2025-10-02T09:28:48.905842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 76 to 76
2025-10-02T09:28:48.905780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 99 size 5363 offset: -1
2025-10-02T09:28:48.905789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905790Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.905791Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 76
2025-10-02T09:28:48.905795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905806Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905809Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 77 to 77
2025-10-02T09:28:48.905907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905813Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 77
2025-10-02T09:28:48.905815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 78 to 78
2025-10-02T09:28:48.905852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905858Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905888Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905917Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 52
2025-10-02T09:28:48.905933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 78
2025-10-02T09:28:48.905920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 53
2025-10-02T09:28:48.905923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 54
2025-10-02T09:28:48.905926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 79 to 79
2025-10-02T09:28:48.905928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905929Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905933Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.905933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 103 size 5473 offset: -1
2025-10-02T09:28:48.905966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 79
2025-10-02T09:28:48.905936Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.905937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 80 to 80
2025-10-02T09:28:48.905942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 104 size 5583 offset: -1
2025-10-02T09:28:48.905975Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 6638, now ReadSizeBudget = 0, ReadSizeServerDelta = 517650
2025-10-02T09:28:48.905946Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906002Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 517650
2025-10-02T09:28:48.906005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 80
2025-10-02T09:28:48.905951Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.905952Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905957Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.905963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.905966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.905971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 107 size 5693 offset: -1
2025-10-02T09:28:48.905975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 108 size 5803 offset: -1
2025-10-02T09:28:48.905981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 109 size 5913 offset: -1
2025-10-02T09:28:48.905989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905993Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906059Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-10)
2025-10-02T09:28:48.906070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 81 to 81
2025-10-02T09:28:48.906076Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 6638 to budget
2025-10-02T09:28:48.905994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906081Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 6638, ReadSizeServerDelta = 517650
2025-10-02T09:28:48.905996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.905997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.905999Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906001Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 81
2025-10-02T09:28:48.906002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 55
2025-10-02T09:28:48.906010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 56
2025-10-02T09:28:48.906013Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 57
2025-10-02T09:28:48.906015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 58
2025-10-02T09:28:48.906114Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.906016Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906128Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-02T09:28:48.906027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906146Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (2-2)
2025-10-02T09:28:48.906038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906151Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (3-3)
2025-10-02T09:28:48.906153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 82 to 82
2025-10-02T09:28:48.906157Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (4-4)
2025-10-02T09:28:48.906041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 112 size 6023 offset: -1
2025-10-02T09:28:48.906162Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (5-5)
2025-10-02T09:28:48.906042Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906045Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (6-6)
2025-10-02T09:28:48.906179Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (7-7)
2025-10-02T09:28:48.906180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 82
2025-10-02T09:28:48.906182Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (8-8)
2025-10-02T09:28:48.906047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 113 size 6133 offset: -1
2025-10-02T09:28:48.906049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 83 to 83
2025-10-02T09:28:48.906050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906052Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 114 size 6243 offset: -1
2025-10-02T09:28:48.906200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906189Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (9-9)
2025-10-02T09:28:48.906202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 83
2025-10-02T09:28:48.906208Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (10-10)
2025-10-02T09:28:48.906055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 84 to 84
2025-10-02T09:28:48.906058Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 115 size 6353 offset: -1
2025-10-02T09:28:48.906059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 84
2025-10-02T09:28:48.906062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906107Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 59
2025-10-02T09:28:48.906132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> event from dataHandler: 2025-10-02T09:28:48.906136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906157Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 118 size 6463 offset: -1
2025-10-02T09:28:48.906184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 60
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-02T09:28:48.901000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.902000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.906214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 61
2025-10-02T09:28:48.906216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906326Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 10, size 6160 bytes
2025-10-02T09:28:48.906231Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906248Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 25 size 65669 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.906334Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.906253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906255Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 120 size 6573 offset: -1
2025-10-02T09:28:48.906263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906264Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 25 parts 0 suffix '63' size 65669
2025-10-02T09:28:48.906264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906268Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 121 size 6683 offset: -1
2025-10-02T09:28:48.906271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.906273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906276Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906277Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 65500 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.906281Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906285Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-02T09:28:48.906287Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906290Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-02T09:28:48.906291Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906294Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-02T09:28:48.906296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906296Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-02T09:28:48.906301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906304Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-02T09:28:48.906306Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906308Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6638 } }
2025-10-02T09:28:48.906309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-02T09:28:48.906310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-02T09:28:48.906316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906318Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-02T09:28:48.906320Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-02T09:28:48.906325Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-02T09:28:48.906329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-02T09:28:48.906333Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906337Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-02T09:28:48.906339Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-02T09:28:48.906343Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-02T09:28:48.906349Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906351Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-02T09:28:48.906353Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-02T09:28:48.906357Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-02T09:28:48.906362Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-02T09:28:48.906367Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906370Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-02T09:28:48.906371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-02T09:28:48.906376Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-02T09:28:48.906382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-02T09:28:48.906386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-02T09:28:48.906390Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-02T09:28:48.906397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.906400Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-02T09:28:48.906417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.906427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.906428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (23)
2025-10-02T09:28:48.906432Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# be5332fc-70d90217-d4e8bcf5-6dcd4c91
2025-10-02T09:28:48.906439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-02T09:28:48.906455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4117 count 1 nextOffset 37 batches 1
2025-10-02T09:28:48.906456Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906459Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-02T09:28:48.906463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 8312 count 2 nextOffset 38 batches 1
2025-10-02T09:28:48.906466Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-02T09:28:48.906470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 12617 count 3 nextOffset 39 batches 1
2025-10-02T09:28:48.906473Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-02T09:28:48.906476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 17032 count 4 nextOffset 40 batches 1
2025-10-02T09:28:48.906479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-02T09:28:48.906482Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 21557 count 5 nextOffset 41 batches 1
2025-10-02T09:28:48.906484Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-02T09:28:48.906488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 26192 count 6 nextOffset 42 batches 1
2025-10-02T09:28:48.906490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-02T09:28:48.906493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 30937 count 7 nextOffset 43 batches 1
2025-10-02T09:28:48.906496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-02T09:28:48.906499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 35792 count 8 nextOffset 44 batches 1
2025-10-02T09:28:48.906502Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-02T09:28:48.906506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 40757 count 9 nextOffset 45 batches 1
2025-10-02T09:28:48.906508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-02T09:28:48.906511Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 45832 count 10 nextOffset 46 batches 1
2025-10-02T09:28:48.906514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-02T09:28:48.906518Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 51017 count 11 nextOffset 47 batches 1
2025-10-02T09:28:48.906520Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-02T09:28:48.906523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 56312 count 12 nextOffset 48 batches 1
2025-10-02T09:28:48.906526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-02T09:28:48.906529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 61717 count 13 nextOffset 49 batches 1
2025-10-02T09:28:48.906531Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-02T09:28:48.906535Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 67232 count 14 nextOffset 50 batches 1
2025-10-02T09:28:48.906538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-02T09:28:48.906539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906541Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 72857 count 15 nextOffset 51 batches 1
2025-10-02T09:28:48.906544Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-02T09:28:48.906547Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 78592 count 16 nextOffset 52 batches 1
2025-10-02T09:28:48.906549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-02T09:28:48.906553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 84437 count 17 nextOffset 53 batches 1
2025-10-02T09:28:48.906555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-02T09:28:48.906559Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 90392 count 18 nextOffset 54 batches 1
2025-10-02T09:28:48.906561Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-02T09:28:48.906565Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 96457 count 19 nextOffset 55 batches 1
2025-10-02T09:28:48.906568Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-02T09:28:48.906571Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 102632 count 20 nextOffset 56 batches 1
2025-10-02T09:28:48.906574Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-02T09:28:48.906577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 108917 count 21 nextOffset 57 batches 1
2025-10-02T09:28:48.906579Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-02T09:28:48.906580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 115312 count 22 nextOffset 58 batches 1
2025-10-02T09:28:48.906585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-02T09:28:48.906588Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 121817 count 23 nextOffset 59 batches 1
2025-10-02T09:28:48.906590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.906599Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 11 EndOffset 11 newEndOffset 36 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-02T09:28:48.906603Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 11 endOffset 36
2025-10-02T09:28:48.906613Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 11, endOffset# 36, WTime# 1759397328902, sizeLag# 65669
2025-10-02T09:28:48.906615Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.906626Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 363e59f4-607c60ac-20c39c28-70d34f97, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 30, size# 78802, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.906637Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 30 maxSize 78802 maxTimeLagMs 0 readTimestampMs 0 readOffset 11 EndOffset 36 ClientCommitOffset 0 committedOffset 0 Guid 363e59f4-607c60ac-20c39c28-70d34f97
2025-10-02T09:28:48.906667Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906690Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,23 HeadOffset 36 endOffset 36 curOffset 59 d0000000000_00000000000000000036_00000_0000000023_00000? size 121143 WTime 1759397328906
2025-10-02T09:28:48.906692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.906738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 85 to 85
2025-10-02T09:28:48.906748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 85
2025-10-02T09:28:48.906750Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906793Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.906800Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.906801Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.906803Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 72881 bytes (72881)
2025-10-02T09:28:48.906816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 86 to 86
2025-10-02T09:28:48.906828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906806Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 72881 (8388608)
2025-10-02T09:28:48.906830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 86
2025-10-02T09:28:48.906816Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.906825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.906829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 12
2025-10-02T09:28:48.906844Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 13
2025-10-02T09:28:48.906849Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 14
2025-10-02T09:28:48.906857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 15
2025-10-02T09:28:48.906863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 16
2025-10-02T09:28:48.906875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 17
2025-10-02T09:28:48.906879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 18
2025-10-02T09:28:48.906881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 87 to 87
2025-10-02T09:28:48.906882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 19
2025-10-02T09:28:48.906895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 20
2025-10-02T09:28:48.906898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 87
2025-10-02T09:28:48.906891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 21
2025-10-02T09:28:48.906896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 22
2025-10-02T09:28:48.906901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 23
2025-10-02T09:28:48.906901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 24
2025-10-02T09:28:48.906907Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 25
2025-10-02T09:28:48.906913Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-02T09:28:48.906917Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 27
2025-10-02T09:28:48.906937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 88 to 88
2025-10-02T09:28:48.906918Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.906921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 28
2025-10-02T09:28:48.906943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.906921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.906924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 29
2025-10-02T09:28:48.906928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 30
2025-10-02T09:28:48.906946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 88
2025-10-02T09:28:48.906932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 31
2025-10-02T09:28:48.906936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 32
2025-10-02T09:28:48.906943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 33
2025-10-02T09:28:48.906947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 34
2025-10-02T09:28:48.906950Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 35
2025-10-02T09:28:48.906954Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-02T09:28:48.906958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906965Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.906983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.906987Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.907005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 89 to 89
2025-10-02T09:28:48.906997Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 23 size 121143
2025-10-02T09:28:48.907011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 89
2025-10-02T09:28:48.906999Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 62
2025-10-02T09:28:48.907037Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 63
2025-10-02T09:28:48.907041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 64
2025-10-02T09:28:48.907043Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 65
2025-10-02T09:28:48.907050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 66
2025-10-02T09:28:48.907052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907069Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 30 size 78802 endOffset 36 max time lag 0ms effective offset 11
2025-10-02T09:28:48.907076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907080Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907082Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 65669 count 25 last offset 11, current partition end offset: 36
2025-10-02T09:28:48.907087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 90 to 90
2025-10-02T09:28:48.907084Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-02T09:28:48.907085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907090Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 25 parts_count 0 source 1 size 65669 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.907095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 90
2025-10-02T09:28:48.907099Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-02T09:28:48.907100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907102Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 25 parts 0 suffix '63'
2025-10-02T09:28:48.907105Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.907105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907109Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907151Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907165Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907169Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 91 to 91
2025-10-02T09:28:48.907183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 91
2025-10-02T09:28:48.907179Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 92 to 92
2025-10-02T09:28:48.907212Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907217Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 25 count 25 size 65647 from pos 0 cbcount 25
2025-10-02T09:28:48.907230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 92
2025-10-02T09:28:48.907266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 11
2025-10-02T09:28:48.907294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 4
2025-10-02T09:28:48.907290Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907300Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 127 size 6793 offset: -1
2025-10-02T09:28:48.907305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 93 to 93
2025-10-02T09:28:48.907306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 128 size 6903 offset: -1
2025-10-02T09:28:48.907325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 93
2025-10-02T09:28:48.907313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 129 size 7013 offset: -1
2025-10-02T09:28:48.907323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907324Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 94 to 94
2025-10-02T09:28:48.907324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 130 size 7123 offset: -1
2025-10-02T09:28:48.907332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 94
2025-10-02T09:28:48.907334Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 131 size 7233 offset: -1
2025-10-02T09:28:48.907351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 5
2025-10-02T09:28:48.907389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 95 to 95
2025-10-02T09:28:48.907406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 95
2025-10-02T09:28:48.907414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 67
2025-10-02T09:28:48.907433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 68
2025-10-02T09:28:48.907436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 69
2025-10-02T09:28:48.907438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 70
2025-10-02T09:28:48.907447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 6
2025-10-02T09:28:48.907511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 96 to 96
2025-10-02T09:28:48.907519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 96
2025-10-02T09:28:48.907515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907529Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 136 size 7343 offset: -1
2025-10-02T09:28:48.907545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907550Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 137 size 7453 offset: -1
2025-10-02T09:28:48.907554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907560Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 138 size 7563 offset: -1
2025-10-02T09:28:48.907563Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907565Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 139 size 7673 offset: -1
2025-10-02T09:28:48.907570Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 36 Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328902 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1759397328904 CreateTimestampMS: 1759397328903 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550910 RealReadOffset: 35 WaitQuotaTimeMs: 0 EndOffset: 36 StartOffset: 0 } Cookie: 11 }
2025-10-02T09:28:48.907600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 97 to 97
2025-10-02T09:28:48.907573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 97
2025-10-02T09:28:48.907632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 7
2025-10-02T09:28:48.907648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 98 to 98
2025-10-02T09:28:48.907654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 98
2025-10-02T09:28:48.907647Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907657Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 99 to 99
2025-10-02T09:28:48.907663Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 36
2025-10-02T09:28:48.907668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 71
2025-10-02T09:28:48.907696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907670Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 ReadOffset 36 ReadGuid 363e59f4-607c60ac-20c39c28-70d34f97 has messages 1
2025-10-02T09:28:48.907699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 99
2025-10-02T09:28:48.907675Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 8
2025-10-02T09:28:48.907708Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 363e59f4-607c60ac-20c39c28-70d34f97, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 64533
2025-10-02T09:28:48.907716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907716Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 363e59f4-607c60ac-20c39c28-70d34f97
2025-10-02T09:28:48.907718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 100 to 100
2025-10-02T09:28:48.907725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 141 size 7783 offset: -1
2025-10-02T09:28:48.907729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907736Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 100
2025-10-02T09:28:48.907743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 72
2025-10-02T09:28:48.907747Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907770Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 101 to 101
2025-10-02T09:28:48.907775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 143 size 7893 offset: -1
2025-10-02T09:28:48.907785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 101
2025-10-02T09:28:48.907787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907790Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 9
2025-10-02T09:28:48.907793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 73
2025-10-02T09:28:48.907833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 102 to 102
2025-10-02T09:28:48.907800Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907816Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.907843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 102
2025-10-02T09:28:48.907824Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907840Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 145 size 8003 offset: -1
2025-10-02T09:28:48.907844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 103 to 103
2025-10-02T09:28:48.907845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907849Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 103
2025-10-02T09:28:48.907854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 74
2025-10-02T09:28:48.907863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.907869Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 10
2025-10-02T09:28:48.907881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 147 size 8113 offset: -1
2025-10-02T09:28:48.907887Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.907898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 104 to 104
2025-10-02T09:28:48.907889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.907894Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.907906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 104
2025-10-02T09:28:48.907920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 105 to 105
2025-10-02T09:28:48.907933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 105
2025-10-02T09:28:48.907943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.907951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 11
2025-10-02T09:28:48.907920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.907935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.907949Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.907962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 106 to 106
2025-10-02T09:28:48.907974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.907977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 106
2025-10-02T09:28:48.907979Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.908004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 107 to 107
2025-10-02T09:28:48.908017Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 23 size 121143 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.908031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 107
2025-10-02T09:28:48.908031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 108 to 108
2025-10-02T09:28:48.908036Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 23 parts 0 suffix '63' size 121143
2025-10-02T09:28:48.908038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 75
2025-10-02T09:28:48.908049Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.908060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 108
2025-10-02T09:28:48.908053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.908065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120980 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.908091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 12
2025-10-02T09:28:48.908074Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908081Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-02T09:28:48.908085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 109 to 109
2025-10-02T09:28:48.908088Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-02T09:28:48.908089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.908091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-02T09:28:48.908096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-02T09:28:48.908115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908101Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-02T09:28:48.908108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908135Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 64533, now ReadSizeBudget = 0, ReadSizeServerDelta = 459755
2025-10-02T09:28:48.908130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 109
2025-10-02T09:28:48.908111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-02T09:28:48.908118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908122Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-02T09:28:48.908123Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908171Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 459755
2025-10-02T09:28:48.908127Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-02T09:28:48.908129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908133Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-02T09:28:48.908135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908138Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-02T09:28:48.908195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.908141Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.908204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 13
2025-10-02T09:28:48.908145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-02T09:28:48.908148Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908151Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-02T09:28:48.908216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 110 to 110
2025-10-02T09:28:48.908223Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-35)
2025-10-02T09:28:48.908153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-02T09:28:48.908233Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 64533 to budget
2025-10-02T09:28:48.908159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908237Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 64533, ReadSizeServerDelta = 459755
2025-10-02T09:28:48.908162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-02T09:28:48.908240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 110
2025-10-02T09:28:48.908164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-02T09:28:48.908169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-02T09:28:48.908175Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908178Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-02T09:28:48.908180Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 111 to 111
2025-10-02T09:28:48.908183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-02T09:28:48.908185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908188Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-02T09:28:48.908271Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.908190Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908191Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-02T09:28:48.908279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908281Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-10-02T09:28:48.908283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 111
2025-10-02T09:28:48.908290Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (12-12)
2025-10-02T09:28:48.908292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.908196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908199Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-02T09:28:48.908298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (13-13)
2025-10-02T09:28:48.908311Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (14-14)
2025-10-02T09:28:48.908201Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908205Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-02T09:28:48.908316Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (15-15)
2025-10-02T09:28:48.908298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 14
2025-10-02T09:28:48.908320Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (16-16)
2025-10-02T09:28:48.908323Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (17-17)
2025-10-02T09:28:48.908326Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (18-18)
2025-10-02T09:28:48.908207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.908210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.908334Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (19-19)
2025-10-02T09:28:48.908345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 112 to 112
2025-10-02T09:28:48.908348Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (20-20)
2025-10-02T09:28:48.908210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-02T09:28:48.908352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (21-21)
2025-10-02T09:28:48.908242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.908355Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (22-22)
2025-10-02T09:28:48.908248Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 36 EndOffset 36 newEndOffset 59 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-02T09:28:48.908359Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (23-23)
2025-10-02T09:28:48.908362Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (24-24)
2025-10-02T09:28:48.908251Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 36 endOffset 59
2025-10-02T09:28:48.908365Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (25-25)
2025-10-02T09:28:48.908257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.908369Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (26-26)
2025-10-02T09:28:48.908356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908259Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 36, endOffset# 59, WTime# 1759397328904, sizeLag# 121143
2025-10-02T09:28:48.908373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 112
2025-10-02T09:28:48.908259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-02T09:28:48.908261Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.908382Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (27-27)
2025-10-02T09:28:48.908270Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 3c079327-85a043f-48e46fbe-8bfcc1f9, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 27, size# 145371, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.908385Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (28-28)
2025-10-02T09:28:48.908280Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 113 to 113
2025-10-02T09:28:48.908387Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (29-29)
2025-10-02T09:28:48.908402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908280Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-02T09:28:48.908405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 113
2025-10-02T09:28:48.908310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 6647 count 1 nextOffset 60 batches 1
2025-10-02T09:28:48.908409Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (30-30)
2025-10-02T09:28:48.908311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.908413Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (31-31)
2025-10-02T09:28:48.908317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-02T09:28:48.908416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (32-32)
2025-10-02T09:28:48.908321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 13372 count 2 nextOffset 61 batches 1
2025-10-02T09:28:48.908418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 114 to 114
2025-10-02T09:28:48.908324Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 27 maxSize 145371 maxTimeLagMs 0 readTimestampMs 0 readOffset 36 EndOffset 59 ClientCommitOffset 0 committedOffset 0 Guid 3c079327-85a043f-48e46fbe-8bfcc1f9
2025-10-02T09:28:48.908324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-02T09:28:48.908329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 20207 count 3 nextOffset 62 batches 1
2025-10-02T09:28:48.908420Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (33-33)
2025-10-02T09:28:48.908332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-02T09:28:48.908435Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 23} (34-34)
2025-10-02T09:28:48.908335Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 27152 count 4 nextOffset 63 batches 1
2025-10-02T09:28:48.908438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 24} (35-35)
2025-10-02T09:28:48.908438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 114
2025-10-02T09:28:48.908352Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-02T09:28:48.908357Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 34207 count 5 nextOffset 64 batches 1
2025-10-02T09:28:48.908455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.908360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-02T09:28:48.908459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 15
2025-10-02T09:28:48.908364Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 41372 count 6 nextOffset 65 batches 1
2025-10-02T09:28:48.908367Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-02T09:28:48.908371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 48647 count 7 nextOffset 66 batches 1
2025-10-02T09:28:48.908373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-02T09:28:48.908373Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 56032 count 8 nextOffset 67 batches 1
2025-10-02T09:28:48.908380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-02T09:28:48.908385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 63527 count 9 nextOffset 68 batches 1
2025-10-02T09:28:48.908388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-02T09:28:48.908493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 115 to 115
2025-10-02T09:28:48.908392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 71132 count 10 nextOffset 69 batches 1
2025-10-02T09:28:48.908395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-02T09:28:48.908399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 78847 count 11 nextOffset 70 batches 1
2025-10-02T09:28:48.908401Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 64533 } }
2025-10-02T09:28:48.908402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-02T09:28:48.908406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 86672 count 12 nextOffset 71 batches 1
2025-10-02T09:28:48.908409Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-02T09:28:48.908412Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# bb6d677c-4b772105-850bcfdc-3145c7ae
>>> event from dataHandler: 2025-10-02T09:28:48.908534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 115
2025-10-02T09:28:48.908412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 94607 count 13 nextOffset 72 batches 1
2025-10-02T09:28:48.908415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-02T09:28:48.908562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 116 to 116
2025-10-02T09:28:48.908417Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 102652 count 14 nextOffset 73 batches 1
2025-10-02T09:28:48.908422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-02T09:28:48.908425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 110807 count 15 nextOffset 74 batches 1
2025-10-02T09:28:48.908576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 116
2025-10-02T09:28:48.908428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.908478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908557Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 117 to 117
2025-10-02T09:28:48.908563Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 59,15 HeadOffset 59 endOffset 59 curOffset 74 d0000000000_00000000000000000059_00000_0000000015_00000? size 110389 WTime 1759397328908
2025-10-02T09:28:48.908606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 117
2025-10-02T09:28:48.908621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 118 to 118
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-10-02T09:28:48.902000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.908630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 118
2025-10-02T09:28:48.908621Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.908629Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908630Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.908633Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.908635Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.908639Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 194024 bytes (194024)
2025-10-02T09:28:48.908642Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 4, size 194024 (8388608)
2025-10-02T09:28:48.908664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 119 to 119
2025-10-02T09:28:48.908660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 37
2025-10-02T09:28:48.908668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 38
2025-10-02T09:28:48.908674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 39
2025-10-02T09:28:48.908680Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 25, size 63525 bytes
2025-10-02T09:28:48.908680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 119
2025-10-02T09:28:48.908688Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.908683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 150 size 8223 offset: -1
2025-10-02T09:28:48.908703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 120 to 120
2025-10-02T09:28:48.908701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 40
2025-10-02T09:28:48.908714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 120
2025-10-02T09:28:48.908714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-02T09:28:48.908723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 42
2025-10-02T09:28:48.908730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 121 to 121
2025-10-02T09:28:48.908728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 43
2025-10-02T09:28:48.908738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 44
2025-10-02T09:28:48.908743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 121
2025-10-02T09:28:48.908743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 45
2025-10-02T09:28:48.908752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-02T09:28:48.908758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 122 to 122
2025-10-02T09:28:48.908753Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 122
2025-10-02T09:28:48.908757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 47
2025-10-02T09:28:48.908762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 48
2025-10-02T09:28:48.908765Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 49
2025-10-02T09:28:48.908769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 123 to 123
2025-10-02T09:28:48.908777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 50
2025-10-02T09:28:48.908778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 51
2025-10-02T09:28:48.908783Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 52
2025-10-02T09:28:48.908788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 53
2025-10-02T09:28:48.908846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 123
2025-10-02T09:28:48.908793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 54
2025-10-02T09:28:48.908816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 55
2025-10-02T09:28:48.908822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 56
2025-10-02T09:28:48.908860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.908870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 16
2025-10-02T09:28:48.908826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 57
2025-10-02T09:28:48.908831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 58
2025-10-02T09:28:48.908832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 59
2025-10-02T09:28:48.908838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908840Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 124 to 124
2025-10-02T09:28:48.908844Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908850Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 124
2025-10-02T09:28:48.908855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.908859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.908922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 125 to 125
2025-10-02T09:28:48.908860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908867Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.908872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 125
2025-10-02T09:28:48.908879Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 59 partNo 0 count 15 size 110389
2025-10-02T09:28:48.908881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908886Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 76
2025-10-02T09:28:48.908890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908891Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.908895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.908899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.908901Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.908938Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 77
2025-10-02T09:28:48.908941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 78
2025-10-02T09:28:48.908943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 79
2025-10-02T09:28:48.908946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 80
2025-10-02T09:28:48.908975Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 36 count 27 size 145371 endOffset 59 max time lag 0ms effective offset 36
2025-10-02T09:28:48.908978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 126 to 126
2025-10-02T09:28:48.908989Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 121143 count 23 last offset 36, current partition end offset: 59
2025-10-02T09:28:48.909001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.908996Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-02T09:28:48.909004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 126
2025-10-02T09:28:48.908998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909005Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 36 partno 0 count 23 parts_count 0 source 1 size 121143 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.909009Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-02T09:28:48.909014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.909019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 17
2025-10-02T09:28:48.909017Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.909029Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 127 to 127
2025-10-02T09:28:48.909043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 127
2025-10-02T09:28:48.909033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909035Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 23 parts 0 suffix '63'
2025-10-02T09:28:48.909045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 128 to 128
2025-10-02T09:28:48.909051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 128
2025-10-02T09:28:48.909104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.909107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 18
2025-10-02T09:28:48.909121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 129 to 129
2025-10-02T09:28:48.909116Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 36 totakecount 23 count 23 size 121121 from pos 0 cbcount 23
2025-10-02T09:28:48.909133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 129
2025-10-02T09:28:48.909122Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909129Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909144Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 130 to 130
2025-10-02T09:28:48.909156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 155 size 8333 offset: -1
2025-10-02T09:28:48.909172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 130
2025-10-02T09:28:48.909177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.909180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 19
2025-10-02T09:28:48.909183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 156 size 8443 offset: -1
2025-10-02T09:28:48.909192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 157 size 8553 offset: -1
2025-10-02T09:28:48.909202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 158 size 8663 offset: -1
2025-10-02T09:28:48.909206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 131 to 131
2025-10-02T09:28:48.909212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909214Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 159 size 8773 offset: -1
2025-10-02T09:28:48.909237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 131
2025-10-02T09:28:48.909237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 36
2025-10-02T09:28:48.909255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909270Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909282Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909298Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909318Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 132 to 132
2025-10-02T09:28:48.909343Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 132
2025-10-02T09:28:48.909367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 81
2025-10-02T09:28:48.909376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 82
2025-10-02T09:28:48.909379Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 83
2025-10-02T09:28:48.909379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 133 to 133
2025-10-02T09:28:48.909382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 84
2025-10-02T09:28:48.909385Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 85
2025-10-02T09:28:48.909390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909402Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 133
2025-10-02T09:28:48.909410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.909427Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 20
2025-10-02T09:28:48.909433Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 134 to 134
2025-10-02T09:28:48.909446Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 134
2025-10-02T09:28:48.909471Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 135 to 135
2025-10-02T09:28:48.909488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 135
2025-10-02T09:28:48.909497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 165 size 8883 offset: -1
2025-10-02T09:28:48.909523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.909507Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 21
2025-10-02T09:28:48.909509Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 166 size 8993 offset: -1
2025-10-02T09:28:48.909516Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 167 size 9103 offset: -1
2025-10-02T09:28:48.909541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 136 to 136
2025-10-02T09:28:48.909526Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909532Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 168 size 9213 offset: -1
2025-10-02T09:28:48.909536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909541Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 169 size 9323 offset: -1
2025-10-02T09:28:48.909545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909551Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 136
2025-10-02T09:28:48.909553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909568Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 137 to 137
2025-10-02T09:28:48.909580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909581Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909589Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909594Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 137
2025-10-02T09:28:48.909602Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 59 Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328903 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328904 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1759397328906 CreateTimestampMS: 1759397328905 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550974 RealReadOffset: 58 WaitQuotaTimeMs: 0 EndOffset: 59 StartOffset: 0 } Cookie: 36 }
2025-10-02T09:28:48.909626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.909603Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 86
2025-10-02T09:28:48.909607Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 87
2025-10-02T09:28:48.909610Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 88
2025-10-02T09:28:48.909612Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 89
2025-10-02T09:28:48.909615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 90
2025-10-02T09:28:48.909631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 22
2025-10-02T09:28:48.909626Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 138 to 138
2025-10-02T09:28:48.909641Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 138
2025-10-02T09:28:48.909682Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 59
2025-10-02T09:28:48.909692Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 59 ReadOffset 59 ReadGuid 3c079327-85a043f-48e46fbe-8bfcc1f9 has messages 1
2025-10-02T09:28:48.909706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 139 to 139
2025-10-02T09:28:48.909718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 139
2025-10-02T09:28:48.909714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909715Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 3c079327-85a043f-48e46fbe-8bfcc1f9, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 120101
2025-10-02T09:28:48.909722Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 3c079327-85a043f-48e46fbe-8bfcc1f9
2025-10-02T09:28:48.909727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.909736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.909745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 23
2025-10-02T09:28:48.909743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 175 size 9433 offset: -1
2025-10-02T09:28:48.909752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 140 to 140
2025-10-02T09:28:48.909758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 176 size 9543 offset: -1
2025-10-02T09:28:48.909761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 177 size 9653 offset: -1
2025-10-02T09:28:48.909770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 178 size 9763 offset: -1
2025-10-02T09:28:48.909779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 140
2025-10-02T09:28:48.909778Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 179 size 9873 offset: -1
2025-10-02T09:28:48.909787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909791Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.909800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 141 to 141
2025-10-02T09:28:48.909792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.909794Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909797Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 141
2025-10-02T09:28:48.909799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909800Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.909836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 24
2025-10-02T09:28:48.909802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.909808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.909837Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 59 count 15 size 110389 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.909846Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 91
2025-10-02T09:28:48.909849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 92
2025-10-02T09:28:48.909852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.909860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 142 to 142
2025-10-02T09:28:48.909854Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.909854Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 59 partno 0 count 15 parts 0 suffix '63' size 110389
2025-10-02T09:28:48.909860Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 110250 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.909867Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909870Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.909879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 142
2025-10-02T09:28:48.909872Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-02T09:28:48.909875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909878Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-02T09:28:48.909901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 143 to 143
2025-10-02T09:28:48.909880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.909880Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909883Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-02T09:28:48.909912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909885Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 143
2025-10-02T09:28:48.909887Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-02T09:28:48.909889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909892Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-02T09:28:48.909927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 144 to 144
2025-10-02T09:28:48.909895Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-02T09:28:48.909899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-02T09:28:48.909901Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-02T09:28:48.909905Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-02T09:28:48.909953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 144
2025-10-02T09:28:48.909908Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909910Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-02T09:28:48.909911Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.909973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 25
2025-10-02T09:28:48.909913Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-02T09:28:48.909915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909916Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-02T09:28:48.909985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 145 to 145
2025-10-02T09:28:48.909917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909919Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-02T09:28:48.909920Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.910002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 145
2025-10-02T09:28:48.909922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-02T09:28:48.909924Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.909927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-02T09:28:48.909940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.910020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 146 to 146
2025-10-02T09:28:48.909944Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 59 EndOffset 59 newEndOffset 74 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-02T09:28:48.909946Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 59 endOffset 74
2025-10-02T09:28:48.909948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.909949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (16)
2025-10-02T09:28:48.909950Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 59, endOffset# 74, WTime# 1759397328906, sizeLag# 110389
2025-10-02T09:28:48.909951Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.910040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.909958Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 52079b8c-bfcbff22-4d003f22-8cca0103, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 132466, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.909959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-02T09:28:48.909963Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 146
2025-10-02T09:28:48.909976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 8297 count 1 nextOffset 75 batches 1
2025-10-02T09:28:48.909979Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-02T09:28:48.909982Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 16672 count 2 nextOffset 76 batches 1
2025-10-02T09:28:48.909985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-02T09:28:48.909991Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 25157 count 3 nextOffset 77 batches 1
2025-10-02T09:28:48.909993Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-02T09:28:48.909997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 33752 count 4 nextOffset 78 batches 1
2025-10-02T09:28:48.910000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-02T09:28:48.910003Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 42457 count 5 nextOffset 79 batches 1
2025-10-02T09:28:48.910096Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 120101, now ReadSizeBudget = 0, ReadSizeServerDelta = 404187
2025-10-02T09:28:48.910006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-02T09:28:48.910010Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 51272 count 6 nextOffset 80 batches 1
2025-10-02T09:28:48.910013Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-02T09:28:48.910017Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 60197 count 7 nextOffset 81 batches 1
2025-10-02T09:28:48.910128Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 404187
2025-10-02T09:28:48.910021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-02T09:28:48.910024Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 69232 count 8 nextOffset 82 batches 1
2025-10-02T09:28:48.910027Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-02T09:28:48.910031Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 78377 count 9 nextOffset 83 batches 1
2025-10-02T09:28:48.910032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910035Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-02T09:28:48.910037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 87632 count 10 nextOffset 84 batches 1
2025-10-02T09:28:48.910040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-02T09:28:48.910041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910043Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 96997 count 11 nextOffset 85 batches 1
2025-10-02T09:28:48.910046Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 132466 maxTimeLagMs 0 readTimestampMs 0 readOffset 59 EndOffset 74 ClientCommitOffset 0 committedOffset 0 Guid 52079b8c-bfcbff22-4d003f22-8cca0103
2025-10-02T09:28:48.910046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-02T09:28:48.910050Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 106472 count 12 nextOffset 86 batches 1
2025-10-02T09:28:48.910052Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-02T09:28:48.910056Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 116057 count 13 nextOffset 87 batches 1
2025-10-02T09:28:48.910058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-02T09:28:48.910170Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (36-58)
2025-10-02T09:28:48.910179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 147 to 147
2025-10-02T09:28:48.910184Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 120101 to budget
2025-10-02T09:28:48.910189Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 120101, ReadSizeServerDelta = 404187
2025-10-02T09:28:48.910059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 125752 count 14 nextOffset 88 batches 1
2025-10-02T09:28:48.910199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910061Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-02T09:28:48.910203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 147
2025-10-02T09:28:48.910063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 135557 count 15 nextOffset 89 batches 1
2025-10-02T09:28:48.910065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-02T09:28:48.910067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 74 PartNo 0 PackedSize 145472 count 16 nextOffset 90 batches 1
2025-10-02T09:28:48.910068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.910093Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 148 to 148
2025-10-02T09:28:48.910109Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910184Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910237Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.910242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 148
2025-10-02T09:28:48.910248Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (36-36)
2025-10-02T09:28:48.910254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (37-37)
2025-10-02T09:28:48.910258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 149 to 149
2025-10-02T09:28:48.910261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (38-38)
2025-10-02T09:28:48.910266Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (39-39)
2025-10-02T09:28:48.910270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 149
2025-10-02T09:28:48.910275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (40-40)
2025-10-02T09:28:48.910282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 150 to 150
2025-10-02T09:28:48.910260Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910285Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (41-41)
2025-10-02T09:28:48.910276Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 74,16 HeadOffset 74 endOffset 74 curOffset 90 d0000000000_00000000000000000074_00000_0000000016_00000? size 145022 WTime 1759397328910
2025-10-02T09:28:48.910289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910291Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (42-42)
2025-10-02T09:28:48.910292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 150
2025-10-02T09:28:48.910297Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (43-43)
2025-10-02T09:28:48.910290Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 120101 } }
2025-10-02T09:28:48.910302Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# fc37fc5a-fb8b6e29-9c92ff03-13fd1e28
2025-10-02T09:28:48.910310Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (44-44)
2025-10-02T09:28:48.910314Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (45-45)
2025-10-02T09:28:48.910318Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (46-46)
2025-10-02T09:28:48.910322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (47-47)
2025-10-02T09:28:48.910325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 151 to 151
2025-10-02T09:28:48.910327Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (48-48)
2025-10-02T09:28:48.910332Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (49-49)
2025-10-02T09:28:48.910332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910323Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 151
2025-10-02T09:28:48.910336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (50-50)
2025-10-02T09:28:48.910361Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.910374Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.910375Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.910377Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.910381Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (51-51)
2025-10-02T09:28:48.910379Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.910380Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910383Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 5 keys were taken away. Let's read 304413 bytes (304413)
2025-10-02T09:28:48.910385Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 5, size 304413 (8388608)
2025-10-02T09:28:48.910399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 60
2025-10-02T09:28:48.910407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 61
2025-10-02T09:28:48.910407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910413Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (52-52)
2025-10-02T09:28:48.910411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 62
2025-10-02T09:28:48.910417Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (53-53)
2025-10-02T09:28:48.910412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910421Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (54-54)
2025-10-02T09:28:48.910416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 63
2025-10-02T09:28:48.910417Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910420Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 64
2025-10-02T09:28:48.910429Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (55-55)
2025-10-02T09:28:48.910425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 65
2025-10-02T09:28:48.910429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 66
2025-10-02T09:28:48.910434Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (56-56)
2025-10-02T09:28:48.910440Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (57-57)
2025-10-02T09:28:48.910434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 67
2025-10-02T09:28:48.910435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910445Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (58-58)
2025-10-02T09:28:48.910438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 68
2025-10-02T09:28:48.910443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 69
2025-10-02T09:28:48.910446Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 70
2025-10-02T09:28:48.910450Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910453Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 71
2025-10-02T09:28:48.910459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 72
2025-10-02T09:28:48.910460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 73
2025-10-02T09:28:48.910467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910471Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 182 size 9983 offset: -1
2025-10-02T09:28:48.910483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910487Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 183 size 10093 offset: -1
2025-10-02T09:28:48.910492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 74
2025-10-02T09:28:48.910496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910509Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910511Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910524Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910529Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-02T09:28:48.910545Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.910555Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 74 partNo 0 count 16 size 145022
2025-10-02T09:28:48.910559Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910566Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910596Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 93
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-10-02T09:28:48.903000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-10-02T09:28:48.904000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.906000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.910610Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 94
2025-10-02T09:28:48.910616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 95
2025-10-02T09:28:48.910619Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910621Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 96
2025-10-02T09:28:48.910627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 97
2025-10-02T09:28:48.910632Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910644Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 59 count 18 size 132466 endOffset 74 max time lag 0ms effective offset 59
2025-10-02T09:28:48.910655Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 23, size 119163 bytes
2025-10-02T09:28:48.910662Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.910656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910660Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 110389 count 15 last offset 59, current partition end offset: 74
2025-10-02T09:28:48.910662Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-02T09:28:48.910666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.910668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910673Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910673Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 189 size 10203 offset: -1
2025-10-02T09:28:48.910679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910679Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 190 size 10313 offset: -1
2025-10-02T09:28:48.910684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.910691Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 59 partno 0 count 15 parts_count 0 source 1 size 110389 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.910695Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-02T09:28:48.910700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910700Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 59 partno 0 count 15 parts 0 suffix '63'
2025-10-02T09:28:48.910702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 191 size 10423 offset: -1
2025-10-02T09:28:48.910711Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910713Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 193 size 10533 offset: -1
2025-10-02T09:28:48.910731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 194 size 10643 offset: -1
2025-10-02T09:28:48.910740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910745Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.910764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.910768Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.910831Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910920Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 59 totakecount 15 count 15 size 110367 from pos 0 cbcount 15
2025-10-02T09:28:48.910945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 152 to 152
2025-10-02T09:28:48.910954Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910960Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.910961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.910976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 152
2025-10-02T09:28:48.910965Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910970Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.910972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.910987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 59
2025-10-02T09:28:48.910997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 98
2025-10-02T09:28:48.911010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 99
2025-10-02T09:28:48.911014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 100
2025-10-02T09:28:48.911022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 101
2025-10-02T09:28:48.911024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 102
2025-10-02T09:28:48.911032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911047Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911058Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 199 size 10753 offset: -1
2025-10-02T09:28:48.911071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 200 size 10863 offset: -1
2025-10-02T09:28:48.911091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 201 size 10973 offset: -1
2025-10-02T09:28:48.911105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 202 size 11083 offset: -1
2025-10-02T09:28:48.911119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 203 size 11193 offset: -1
2025-10-02T09:28:48.911133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911135Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 74 Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1759397328908 CreateTimestampMS: 1759397328905 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 73 WaitQuotaTimeMs: 0 EndOffset: 74 StartOffset: 0 } Cookie: 59 }
2025-10-02T09:28:48.911138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911175Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911178Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 103
2025-10-02T09:28:48.911193Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 74
2025-10-02T09:28:48.911196Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 74 ReadOffset 74 ReadGuid 52079b8c-bfcbff22-4d003f22-8cca0103 has messages 1
2025-10-02T09:28:48.911197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 104
2025-10-02T09:28:48.911200Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 105
2025-10-02T09:28:48.911206Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 153 to 153
2025-10-02T09:28:48.911221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 153
2025-10-02T09:28:48.911223Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 52079b8c-bfcbff22-4d003f22-8cca0103, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 109723
2025-10-02T09:28:48.911230Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 52079b8c-bfcbff22-4d003f22-8cca0103
2025-10-02T09:28:48.911240Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911257Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 154 to 154
2025-10-02T09:28:48.911275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 154
2025-10-02T09:28:48.911270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 207 size 11303 offset: -1
2025-10-02T09:28:48.911278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911282Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 208 size 11413 offset: -1
2025-10-02T09:28:48.911284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 209 size 11523 offset: -1
2025-10-02T09:28:48.911294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 155 to 155
2025-10-02T09:28:48.911296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 155
2025-10-02T09:28:48.911367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 156 to 156
2025-10-02T09:28:48.911361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 106
2025-10-02T09:28:48.911383Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.911387Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 156
2025-10-02T09:28:48.911406Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 157 to 157
2025-10-02T09:28:48.911416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911417Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911420Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 211 size 11633 offset: -1
2025-10-02T09:28:48.911423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 157
2025-10-02T09:28:48.911427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 107
2025-10-02T09:28:48.911443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 158 to 158
2025-10-02T09:28:48.911473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 158
2025-10-02T09:28:48.911473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 213 size 11743 offset: -1
2025-10-02T09:28:48.911497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 159 to 159
2025-10-02T09:28:48.911499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 159
2025-10-02T09:28:48.911535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 160 to 160
2025-10-02T09:28:48.911548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 160
2025-10-02T09:28:48.911549Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911568Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 109723, now ReadSizeBudget = 0, ReadSizeServerDelta = 414565
2025-10-02T09:28:48.911583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911595Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 414565
2025-10-02T09:28:48.911612Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 108
2025-10-02T09:28:48.911630Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911640Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (59-73)
2025-10-02T09:28:48.911637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911654Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 109723 to budget
2025-10-02T09:28:48.911658Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 109723, ReadSizeServerDelta = 414565
2025-10-02T09:28:48.911657Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 161 to 161
2025-10-02T09:28:48.911661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 215 size 11853 offset: -1
2025-10-02T09:28:48.911678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911688Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.911689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911698Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (59-59)
2025-10-02T09:28:48.911683Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.911690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.911694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 109
2025-10-02T09:28:48.911697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 161
2025-10-02T09:28:48.911713Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (60-60)
2025-10-02T09:28:48.911711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.911721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 162 to 162
2025-10-02T09:28:48.911728Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (61-61)
2025-10-02T09:28:48.911732Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (62-62)
2025-10-02T09:28:48.911732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 162
2025-10-02T09:28:48.911741Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 74 count 16 size 145022 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.911746Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 163 to 163
2025-10-02T09:28:48.911753Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.911759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.911764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 217 size 11963 offset: -1
2025-10-02T09:28:48.911767Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (63-63)
2025-10-02T09:28:48.911773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (64-64)
2025-10-02T09:28:48.911764Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 74 partno 0 count 16 parts 0 suffix '63' size 145022
2025-10-02T09:28:48.911776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 163
2025-10-02T09:28:48.911768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.911775Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 144880 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.911777Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (65-65)
2025-10-02T09:28:48.911779Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911784Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-02T09:28:48.911801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 164 to 164
2025-10-02T09:28:48.911796Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (66-66)
2025-10-02T09:28:48.911786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-02T09:28:48.911791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-02T09:28:48.911821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 164
2025-10-02T09:28:48.911797Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-02T09:28:48.911804Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-02T09:28:48.911809Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911812Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-02T09:28:48.911851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 165 to 165
2025-10-02T09:28:48.911817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911857Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (67-67)
2025-10-02T09:28:48.911820Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-02T09:28:48.911821Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-02T09:28:48.911827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-02T09:28:48.911872Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (68-68)
2025-10-02T09:28:48.911832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911875Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (69-69)
2025-10-02T09:28:48.911876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911880Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (70-70)
2025-10-02T09:28:48.911884Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (71-71)
2025-10-02T09:28:48.911883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 165
2025-10-02T09:28:48.911835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-02T09:28:48.911837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911887Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (72-72)
2025-10-02T09:28:48.911837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-02T09:28:48.911841Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-02T09:28:48.911927Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (73-73)
2025-10-02T09:28:48.911847Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911850Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-02T09:28:48.911852Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-02T09:28:48.911857Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911861Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-02T09:28:48.911863Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.911866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-02T09:28:48.911869Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.911895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.911897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (18)
2025-10-02T09:28:48.911900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.911909Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-02T09:28:48.911914Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 74 EndOffset 74 newEndOffset 90 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-02T09:28:48.911966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 166 to 166
2025-10-02T09:28:48.911916Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 74 endOffset 90
2025-10-02T09:28:48.911923Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 74, endOffset# 90, WTime# 1759397328908, sizeLag# 145022
2025-10-02T09:28:48.911925Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.911926Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 10057 count 1 nextOffset 91 batches 1
2025-10-02T09:28:48.911991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 166
2025-10-02T09:28:48.911931Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-02T09:28:48.911932Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# e24f80cd-b46402bd-f6d1c855-d84923d7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 174026, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.911935Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 20192 count 2 nextOffset 92 batches 1
2025-10-02T09:28:48.911938Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-02T09:28:48.911939Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 174026 maxTimeLagMs 0 readTimestampMs 0 readOffset 74 EndOffset 90 ClientCommitOffset 0 committedOffset 0 Guid e24f80cd-b46402bd-f6d1c855-d84923d7
2025-10-02T09:28:48.911941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 30437 count 3 nextOffset 93 batches 1
2025-10-02T09:28:48.912021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 167 to 167
2025-10-02T09:28:48.911944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-02T09:28:48.911947Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.911948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 40792 count 4 nextOffset 94 batches 1
2025-10-02T09:28:48.912033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 167
2025-10-02T09:28:48.911951Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-02T09:28:48.911954Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 51257 count 5 nextOffset 95 batches 1
2025-10-02T09:28:48.911957Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-02T09:28:48.911961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 61832 count 6 nextOffset 96 batches 1
2025-10-02T09:28:48.911965Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-02T09:28:48.912070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 168 to 168
2025-10-02T09:28:48.911965Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.911968Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 72517 count 7 nextOffset 97 batches 1
>>> event from dataHandler: 2025-10-02T09:28:48.912079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 168
2025-10-02T09:28:48.911971Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-02T09:28:48.911974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 83312 count 8 nextOffset 98 batches 1
2025-10-02T09:28:48.911977Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-02T09:28:48.911982Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 94217 count 9 nextOffset 99 batches 1
2025-10-02T09:28:48.911985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-02T09:28:48.911988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 105232 count 10 nextOffset 100 batches 1
2025-10-02T09:28:48.911991Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-10-02T09:28:48.911994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 116357 count 11 nextOffset 101 batches 1
2025-10-02T09:28:48.911996Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-10-02T09:28:48.912000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 127592 count 12 nextOffset 102 batches 1
2025-10-02T09:28:48.912003Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-10-02T09:28:48.912006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 138937 count 13 nextOffset 103 batches 1
2025-10-02T09:28:48.912009Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.912012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 150392 count 14 nextOffset 104 batches 1
2025-10-02T09:28:48.912015Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-10-02T09:28:48.912019Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 161957 count 15 nextOffset 105 batches 1
2025-10-02T09:28:48.912022Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-10-02T09:28:48.912026Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 173632 count 16 nextOffset 106 batches 1
2025-10-02T09:28:48.912029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-10-02T09:28:48.912034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 185417 count 17 nextOffset 107 batches 1
2025-10-02T09:28:48.912037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-10-02T09:28:48.912040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 197312 count 18 nextOffset 108 batches 1
2025-10-02T09:28:48.912042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.912054Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912097Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 109723 } }
2025-10-02T09:28:48.912181Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 15, size 109065 bytes
2025-10-02T09:28:48.912104Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# abefd603-1bf26c37-2355dd9c-1c873889
2025-10-02T09:28:48.912149Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912190Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.912192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 90,18 HeadOffset 90 endOffset 90 curOffset 108 d0000000000_00000000000000000090_00000_0000000018_00000? size 196798 WTime 1759397328911
2025-10-02T09:28:48.912263Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 169 to 169
2025-10-02T09:28:48.912312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 169
2025-10-02T09:28:48.912355Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.912373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 170 to 170
2025-10-02T09:28:48.912363Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.912365Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.912367Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912367Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.912369Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.912379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912372Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.912399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 170
2025-10-02T09:28:48.912374Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 6 keys were taken away. Let's read 449435 bytes (449435)
2025-10-02T09:28:48.912377Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 6, size 449435 (8388608)
2025-10-02T09:28:48.912386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.912395Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 75
2025-10-02T09:28:48.912414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 76
2025-10-02T09:28:48.912417Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 77
2025-10-02T09:28:48.912423Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 78
2025-10-02T09:28:48.912427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 79
2025-10-02T09:28:48.912435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 80
2025-10-02T09:28:48.912439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 81
2025-10-02T09:28:48.912440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 82
2025-10-02T09:28:48.912451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 171 to 171
2025-10-02T09:28:48.912449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 83
2025-10-02T09:28:48.912452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 84
2025-10-02T09:28:48.912455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 85
2025-10-02T09:28:48.912472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 171
2025-10-02T09:28:48.912463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 86
2025-10-02T09:28:48.912467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 87
2025-10-02T09:28:48.912470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912474Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 88
2025-10-02T09:28:48.912484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 89
2025-10-02T09:28:48.912485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 90
2025-10-02T09:28:48.912494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912497Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 172 to 172
2025-10-02T09:28:48.912517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912523Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.912532Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 90 partNo 0 count 18 size 196798
2025-10-02T09:28:48.912562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 110
2025-10-02T09:28:48.912556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 172
2025-10-02T09:28:48.912565Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 111
2025-10-02T09:28:48.912568Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 112
2025-10-02T09:28:48.912575Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 113
2025-10-02T09:28:48.912578Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 173 to 173
2025-10-02T09:28:48.912583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 114
2025-10-02T09:28:48.912586Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 173
2025-10-02T09:28:48.912604Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 74 count 19 size 174026 endOffset 90 max time lag 0ms effective offset 74
2025-10-02T09:28:48.912607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.912612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912618Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 145022 count 16 last offset 74, current partition end offset: 90
2025-10-02T09:28:48.912620Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-02T09:28:48.912623Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912628Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912633Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 223 size 12073 offset: -1
2025-10-02T09:28:48.912634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 224 size 12183 offset: -1
2025-10-02T09:28:48.912650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.912657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 225 size 12293 offset: -1
2025-10-02T09:28:48.912657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 174 to 174
2025-10-02T09:28:48.912669Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 74 partno 0 count 16 parts_count 0 source 1 size 145022 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.912672Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-02T09:28:48.912677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 174
2025-10-02T09:28:48.912680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912679Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 74 partno 0 count 16 parts 0 suffix '63'
2025-10-02T09:28:48.912683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 226 size 12403 offset: -1
2025-10-02T09:28:48.912687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 227 size 12513 offset: -1
2025-10-02T09:28:48.912697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.912711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.912729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912730Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 175 to 175
2025-10-02T09:28:48.912753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.912740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.912741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.912746Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.912756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 175
2025-10-02T09:28:48.912761Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.912851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 26
2025-10-02T09:28:48.912840Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 176 to 176
2025-10-02T09:28:48.912875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 176
2025-10-02T09:28:48.912895Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 177 to 177
2025-10-02T09:28:48.912951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.912954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 177
2025-10-02T09:28:48.912949Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 74 totakecount 16 count 16 size 145000 from pos 0 cbcount 16
2025-10-02T09:28:48.912978Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.912979Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.912986Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.912988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 178 to 178
2025-10-02T09:28:48.913015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 74
2025-10-02T09:28:48.913017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 178
2025-10-02T09:28:48.913022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 115
2025-10-02T09:28:48.913031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 116
2025-10-02T09:28:48.913035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 117
2025-10-02T09:28:48.913039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 118
2025-10-02T09:28:48.913041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913042Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 119
2025-10-02T09:28:48.913045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913060Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 179 to 179
2025-10-02T09:28:48.913076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 179
2025-10-02T09:28:48.913070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913081Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 233 size 12623 offset: -1
2025-10-02T09:28:48.913086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913093Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 234 size 12733 offset: -1
2025-10-02T09:28:48.913097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 180 to 180
2025-10-02T09:28:48.913099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 235 size 12843 offset: -1
2025-10-02T09:28:48.913125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 236 size 12953 offset: -1
2025-10-02T09:28:48.913119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913120Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 180
2025-10-02T09:28:48.913125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 237 size 13063 offset: -1
2025-10-02T09:28:48.913129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913140Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913154Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 181 to 181
2025-10-02T09:28:48.913212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913175Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 90 Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328905 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328906 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1759397328909 CreateTimestampMS: 1759397328907 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551198 RealReadOffset: 89 WaitQuotaTimeMs: 0 EndOffset: 90 StartOffset: 0 } Cookie: 74 }
2025-10-02T09:28:48.913175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 181
2025-10-02T09:28:48.913177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913192Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913248Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 90
2025-10-02T09:28:48.913256Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 90 ReadOffset 90 ReadGuid e24f80cd-b46402bd-f6d1c855-d84923d7 has messages 1
2025-10-02T09:28:48.913270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 182 to 182
2025-10-02T09:28:48.913276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 182
2025-10-02T09:28:48.913275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 120
2025-10-02T09:28:48.913285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 121
2025-10-02T09:28:48.913289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 122
2025-10-02T09:28:48.913292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 123
2025-10-02T09:28:48.913296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 124
2025-10-02T09:28:48.913311Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# e24f80cd-b46402bd-f6d1c855-d84923d7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 144309
2025-10-02T09:28:48.913320Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# e24f80cd-b46402bd-f6d1c855-d84923d7
2025-10-02T09:28:48.913337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 183 to 183
2025-10-02T09:28:48.913343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 183
2025-10-02T09:28:48.913345Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913377Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 184 to 184
2025-10-02T09:28:48.913386Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 184
2025-10-02T09:28:48.913420Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.913429Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913442Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 185 to 185
2025-10-02T09:28:48.913450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 185
2025-10-02T09:28:48.913469Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 243 size 13173 offset: -1
2025-10-02T09:28:48.913475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 244 size 13283 offset: -1
2025-10-02T09:28:48.913483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 245 size 13393 offset: -1
2025-10-02T09:28:48.913489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 246 size 13503 offset: -1
2025-10-02T09:28:48.913501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 247 size 13613 offset: -1
2025-10-02T09:28:48.913512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 186 to 186
2025-10-02T09:28:48.913517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 186
2025-10-02T09:28:48.913579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 187 to 187
2025-10-02T09:28:48.913583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 187
2025-10-02T09:28:48.913576Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913581Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913591Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.913597Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 27
2025-10-02T09:28:48.913607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913610Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913612Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 125
2025-10-02T09:28:48.913652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 188 to 188
2025-10-02T09:28:48.913628Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 126
2025-10-02T09:28:48.913665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913630Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 127
2025-10-02T09:28:48.913632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 128
2025-10-02T09:28:48.913669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 188
2025-10-02T09:28:48.913640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913654Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913672Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 189 to 189
2025-10-02T09:28:48.913678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 253 size 13723 offset: -1
2025-10-02T09:28:48.913715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 189
2025-10-02T09:28:48.913690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 254 size 13833 offset: -1
2025-10-02T09:28:48.913698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.913746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 28
2025-10-02T09:28:48.913703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 255 size 13943 offset: -1
2025-10-02T09:28:48.913705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913710Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 256 size 14054 offset: -1
2025-10-02T09:28:48.913713Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913764Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 144309, now ReadSizeBudget = 0, ReadSizeServerDelta = 379979
2025-10-02T09:28:48.913715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 190 to 190
2025-10-02T09:28:48.913792Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 379979
2025-10-02T09:28:48.913719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 190
2025-10-02T09:28:48.913720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913726Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913730Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 129
2025-10-02T09:28:48.913738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 130
2025-10-02T09:28:48.913743Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913759Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913846Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (74-89)
2025-10-02T09:28:48.913788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 258 size 14164 offset: -1
2025-10-02T09:28:48.913794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913865Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 144309 to budget
2025-10-02T09:28:48.913797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913877Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 144309, ReadSizeServerDelta = 379979
2025-10-02T09:28:48.913801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 259 size 14274 offset: -1
2025-10-02T09:28:48.913808Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913821Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913826Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913832Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 131
2025-10-02T09:28:48.913847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 261 size 14384 offset: -1
2025-10-02T09:28:48.913866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913869Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.913872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.913885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 132
2025-10-02T09:28:48.913903Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.913909Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913922Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 90 count 18 size 196798 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.913936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.913958Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.913947Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 196650 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.913950Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 90 partno 0 count 18 parts 0 suffix '63' size 196798
2025-10-02T09:28:48.913960Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.913971Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (74-74)
2025-10-02T09:28:48.913961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.913963Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.913966Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-02T09:28:48.913980Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (75-75)
2025-10-02T09:28:48.913970Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.913975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-02T09:28:48.913988Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (76-76)
2025-10-02T09:28:48.913977Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.913992Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (77-77)
2025-10-02T09:28:48.913991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 191 to 191
2025-10-02T09:28:48.913980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-02T09:28:48.914008Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (78-78)
2025-10-02T09:28:48.914011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.913982Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914014Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (79-79)
2025-10-02T09:28:48.914015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 191
2025-10-02T09:28:48.913985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-02T09:28:48.913988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.913992Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-02T09:28:48.914018Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (80-80)
2025-10-02T09:28:48.914032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.914038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (81-81)
2025-10-02T09:28:48.914044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 29
2025-10-02T09:28:48.913995Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.913998Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-02T09:28:48.914000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914000Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.914062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 192 to 192
2025-10-02T09:28:48.914004Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-02T09:28:48.914006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914009Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-02T09:28:48.914011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (82-82)
2025-10-02T09:28:48.914016Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-02T09:28:48.914018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (83-83)
2025-10-02T09:28:48.914100Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (84-84)
2025-10-02T09:28:48.914022Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-02T09:28:48.914073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 192
2025-10-02T09:28:48.914028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-10-02T09:28:48.914030Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-10-02T09:28:48.914035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914036Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.914106Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (85-85)
2025-10-02T09:28:48.914040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-10-02T09:28:48.914141Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (86-86)
2025-10-02T09:28:48.914042Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914044Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-10-02T09:28:48.914146Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (87-87)
2025-10-02T09:28:48.914046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 193 to 193
2025-10-02T09:28:48.914048Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-10-02T09:28:48.914049Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914053Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-10-02T09:28:48.914159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 193
2025-10-02T09:28:48.914055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.914158Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (88-88)
2025-10-02T09:28:48.914057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-10-02T09:28:48.914058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.914177Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (89-89)
2025-10-02T09:28:48.914062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-10-02T09:28:48.914181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 194 to 194
2025-10-02T09:28:48.914079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.914088Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 90 EndOffset 90 newEndOffset 108 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-02T09:28:48.914189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.914191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 194
2025-10-02T09:28:48.914092Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 90 endOffset 108
2025-10-02T09:28:48.914093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (23)
2025-10-02T09:28:48.914103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-10-02T09:28:48.914116Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 144309 } }
2025-10-02T09:28:48.914209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 195 to 195
2025-10-02T09:28:48.914121Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 12037 count 1 nextOffset 109 batches 1
2025-10-02T09:28:48.914125Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-10-02T09:28:48.914228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914126Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 90, endOffset# 108, WTime# 1759397328909, sizeLag# 196798
2025-10-02T09:28:48.914231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 195
2025-10-02T09:28:48.914128Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.914129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 24152 count 2 nextOffset 110 batches 1
2025-10-02T09:28:48.914131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-10-02T09:28:48.914134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 36377 count 3 nextOffset 111 batches 1
2025-10-02T09:28:48.914135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-10-02T09:28:48.914249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 196 to 196
2025-10-02T09:28:48.914138Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 48712 count 4 nextOffset 112 batches 1
2025-10-02T09:28:48.914138Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 60067ed4-49348347-e3bb93b9-7ea60f2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 21, size# 236157, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.914139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-10-02T09:28:48.914142Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 61157 count 5 nextOffset 113 batches 1
2025-10-02T09:28:48.914271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 196
2025-10-02T09:28:48.914143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-10-02T09:28:48.914145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 73712 count 6 nextOffset 114 batches 1
2025-10-02T09:28:48.914147Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-10-02T09:28:48.914149Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 86377 count 7 nextOffset 115 batches 1
2025-10-02T09:28:48.914151Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-10-02T09:28:48.914300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 197 to 197
2025-10-02T09:28:48.914154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 99152 count 8 nextOffset 116 batches 1
2025-10-02T09:28:48.914156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-10-02T09:28:48.914160Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 112037 count 9 nextOffset 117 batches 1
2025-10-02T09:28:48.914162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-10-02T09:28:48.914324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 125032 count 10 nextOffset 118 batches 1
2025-10-02T09:28:48.914327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 197
2025-10-02T09:28:48.914167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-10-02T09:28:48.914169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 138137 count 11 nextOffset 119 batches 1
2025-10-02T09:28:48.914171Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-10-02T09:28:48.914173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 151352 count 12 nextOffset 120 batches 1
2025-10-02T09:28:48.914175Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-10-02T09:28:48.914179Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 164677 count 13 nextOffset 121 batches 1
2025-10-02T09:28:48.914348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 198 to 198
2025-10-02T09:28:48.914181Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# 15ff6d8e-44380ba1-375a18cf-8955f6d8
2025-10-02T09:28:48.914183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-10-02T09:28:48.914186Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914186Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 178112 count 14 nextOffset 122 batches 1
2025-10-02T09:28:48.914189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-10-02T09:28:48.914192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 191657 count 15 nextOffset 123 batches 1
2025-10-02T09:28:48.914370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 198
2025-10-02T09:28:48.914196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-10-02T09:28:48.914199Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 205312 count 16 nextOffset 124 batches 1
2025-10-02T09:28:48.914202Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-10-02T09:28:48.914207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 219077 count 17 nextOffset 125 batches 1
2025-10-02T09:28:48.914210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-10-02T09:28:48.914401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 199 to 199
2025-10-02T09:28:48.914213Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 232952 count 18 nextOffset 126 batches 1
2025-10-02T09:28:48.914216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-10-02T09:28:48.914218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> event from dataHandler: 2025-10-02T09:28:48.914421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 246937 count 19 nextOffset 127 batches 1
2025-10-02T09:28:48.914221Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-10-02T09:28:48.914223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 261033 count 20 nextOffset 128 batches 1
2025-10-02T09:28:48.914224Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-10-02T09:28:48.914227Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 275239 count 21 nextOffset 129 batches 1
2025-10-02T09:28:48.914424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 199
2025-10-02T09:28:48.914229Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-10-02T09:28:48.914232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 289555 count 22 nextOffset 130 batches 1
2025-10-02T09:28:48.914234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-10-02T09:28:48.914237Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 303981 count 23 nextOffset 131 batches 1
2025-10-02T09:28:48.914239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.914263Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 21 maxSize 236157 maxTimeLagMs 0 readTimestampMs 0 readOffset 90 EndOffset 108 ClientCommitOffset 0 committedOffset 0 Guid 60067ed4-49348347-e3bb93b9-7ea60f2
2025-10-02T09:28:48.914466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 200 to 200
2025-10-02T09:28:48.914281Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914330Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-10-02T09:28:48.905000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-10-02T09:28:48.906000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.909000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.914363Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914396Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914439Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914510Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914537Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 16, size 143616 bytes
2025-10-02T09:28:48.914544Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.914520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 200
2025-10-02T09:28:48.914545Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 201 to 201
2025-10-02T09:28:48.914590Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 201
2025-10-02T09:28:48.914632Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914677Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.914694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 30
2025-10-02T09:28:48.914718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 202 to 202
2025-10-02T09:28:48.914713Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914741Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 202
2025-10-02T09:28:48.914768Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 203 to 203
2025-10-02T09:28:48.914797Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 203
2025-10-02T09:28:48.914830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 204 to 204
2025-10-02T09:28:48.914850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 204
2025-10-02T09:28:48.914842Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 205 to 205
2025-10-02T09:28:48.914881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914875Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 205
2025-10-02T09:28:48.914907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 206 to 206
2025-10-02T09:28:48.914912Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.914940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 206
2025-10-02T09:28:48.914962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 207 to 207
2025-10-02T09:28:48.914978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.914980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 207
2025-10-02T09:28:48.914970Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 208 to 208
2025-10-02T09:28:48.915019Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 208
2025-10-02T09:28:48.915054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 209 to 209
2025-10-02T09:28:48.915056Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915073Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 108,23 HeadOffset 108 endOffset 108 curOffset 131 d0000000000_00000000000000000108_00000_0000000023_00000? size 303307 WTime 1759397328914
2025-10-02T09:28:48.915070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 209
2025-10-02T09:28:48.915110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 210 to 210
2025-10-02T09:28:48.915105Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 210
2025-10-02T09:28:48.915160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 211 to 211
2025-10-02T09:28:48.915178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 211
2025-10-02T09:28:48.915185Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 212 to 212
2025-10-02T09:28:48.915225Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 212
2025-10-02T09:28:48.915259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 213 to 213
2025-10-02T09:28:48.915277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915269Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 213
2025-10-02T09:28:48.915288Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.915300Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.915304Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.915305Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915307Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.915309Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.915311Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.915306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 214 to 214
2025-10-02T09:28:48.915313Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.915316Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 7 keys were taken away. Let's read 646233 bytes (646233)
2025-10-02T09:28:48.915318Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 7, size 646233 (8388608)
2025-10-02T09:28:48.915330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915333Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915340Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 263 size 14494 offset: -1
2025-10-02T09:28:48.915342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 91
2025-10-02T09:28:48.915358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 214
2025-10-02T09:28:48.915353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 92
2025-10-02T09:28:48.915357Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 93
2025-10-02T09:28:48.915360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 94
2025-10-02T09:28:48.915364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 95
2025-10-02T09:28:48.915368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 96
2025-10-02T09:28:48.915374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 97
2025-10-02T09:28:48.915381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 215 to 215
2025-10-02T09:28:48.915377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 98
2025-10-02T09:28:48.915386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 99
2025-10-02T09:28:48.915390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 100
2025-10-02T09:28:48.915402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915393Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 101
2025-10-02T09:28:48.915405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 215
2025-10-02T09:28:48.915394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 102
2025-10-02T09:28:48.915401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 103
2025-10-02T09:28:48.915401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 104
2025-10-02T09:28:48.915412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915416Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 105
2025-10-02T09:28:48.915426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915427Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 106
2025-10-02T09:28:48.915431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915431Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 107
2025-10-02T09:28:48.915442Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 108
2025-10-02T09:28:48.915447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915452Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915477Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.915499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.915513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 31
2025-10-02T09:28:48.915481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915488Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 108 partNo 0 count 23 size 303307
2025-10-02T09:28:48.915492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 133
2025-10-02T09:28:48.915538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 134
2025-10-02T09:28:48.915542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 135
2025-10-02T09:28:48.915545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 136
2025-10-02T09:28:48.915547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 137
2025-10-02T09:28:48.915550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 216 to 216
2025-10-02T09:28:48.915582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 216
2025-10-02T09:28:48.915574Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 90 count 21 size 236157 endOffset 108 max time lag 0ms effective offset 90
2025-10-02T09:28:48.915593Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 196798 count 18 last offset 90, current partition end offset: 108
2025-10-02T09:28:48.915602Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-02T09:28:48.915610Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 90 partno 0 count 18 parts_count 0 source 1 size 196798 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.915619Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-02T09:28:48.915624Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.915634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 217 to 217
2025-10-02T09:28:48.915654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915652Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 90 partno 0 count 18 parts 0 suffix '63'
2025-10-02T09:28:48.915656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 217
2025-10-02T09:28:48.915669Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915675Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 218 to 218
2025-10-02T09:28:48.915688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 218
2025-10-02T09:28:48.915718Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 90 totakecount 18 count 18 size 196776 from pos 0 cbcount 18
2025-10-02T09:28:48.915739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 219 to 219
2025-10-02T09:28:48.915756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 219
2025-10-02T09:28:48.915759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 90
2025-10-02T09:28:48.915774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.915787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 32
2025-10-02T09:28:48.915768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.915773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.915781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 269 size 14604 offset: -1
2025-10-02T09:28:48.915782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.915785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 220 to 220
2025-10-02T09:28:48.915787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.915789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 270 size 14714 offset: -1
2025-10-02T09:28:48.915792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.915792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 271 size 14824 offset: -1
2025-10-02T09:28:48.915846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 220
2025-10-02T09:28:48.915805Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915827Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 272 size 14934 offset: -1
2025-10-02T09:28:48.915831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 273 size 15044 offset: -1
2025-10-02T09:28:48.915838Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.915902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 33
2025-10-02T09:28:48.915850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915856Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 221 to 221
2025-10-02T09:28:48.915864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.915870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.915872Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.915875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.915948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 221
2025-10-02T09:28:48.915877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.915882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 138
2025-10-02T09:28:48.915884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 139
2025-10-02T09:28:48.915886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 140
2025-10-02T09:28:48.915888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 141
2025-10-02T09:28:48.915890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 142
2025-10-02T09:28:48.915901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915907Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915911Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915913Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.915974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 222 to 222
2025-10-02T09:28:48.915917Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.915989Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 108 Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328907 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1759397328911 CreateTimestampMS: 1759397328908 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551134 RealReadOffset: 107 WaitQuotaTimeMs: 0 EndOffset: 108 StartOffset: 0 } Cookie: 90 }
2025-10-02T09:28:48.916022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 222
2025-10-02T09:28:48.916037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.916041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 34
2025-10-02T09:28:48.916039Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916049Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916055Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 223 to 223
2025-10-02T09:28:48.916066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916073Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916088Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 108
2025-10-02T09:28:48.916094Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 108 ReadOffset 108 ReadGuid 60067ed4-49348347-e3bb93b9-7ea60f2 has messages 1
2025-10-02T09:28:48.916101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 223
2025-10-02T09:28:48.916115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916119Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 60067ed4-49348347-e3bb93b9-7ea60f2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 195991
2025-10-02T09:28:48.916121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 224 to 224
2025-10-02T09:28:48.916126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 279 size 15154 offset: -1
2025-10-02T09:28:48.916126Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 60067ed4-49348347-e3bb93b9-7ea60f2
2025-10-02T09:28:48.916130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 280 size 15264 offset: -1
2025-10-02T09:28:48.916161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 224
2025-10-02T09:28:48.916137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916142Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 281 size 15374 offset: -1
2025-10-02T09:28:48.916143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 225 to 225
2025-10-02T09:28:48.916147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 282 size 15484 offset: -1
2025-10-02T09:28:48.916149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 283 size 15594 offset: -1
2025-10-02T09:28:48.916156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916161Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 225
2025-10-02T09:28:48.916171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916184Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 226 to 226
2025-10-02T09:28:48.916186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916190Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 226
2025-10-02T09:28:48.916191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 143
2025-10-02T09:28:48.916202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 144
2025-10-02T09:28:48.916204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 145
2025-10-02T09:28:48.916206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 146
2025-10-02T09:28:48.916208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 147
2025-10-02T09:28:48.916321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 227 to 227
2025-10-02T09:28:48.916211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 227
2025-10-02T09:28:48.916221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916253Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916258Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 228 to 228
2025-10-02T09:28:48.916261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916277Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 289 size 15704 offset: -1
2025-10-02T09:28:48.916282Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 228
2025-10-02T09:28:48.916285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 290 size 15814 offset: -1
2025-10-02T09:28:48.916287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916290Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 291 size 15924 offset: -1
2025-10-02T09:28:48.916293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 229 to 229
2025-10-02T09:28:48.916296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 292 size 16034 offset: -1
2025-10-02T09:28:48.916298Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916298Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.916299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 293 size 16144 offset: -1
2025-10-02T09:28:48.916306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 229
2025-10-02T09:28:48.916307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.916519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 35
2025-10-02T09:28:48.916327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916526Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 195991, now ReadSizeBudget = 0, ReadSizeServerDelta = 328297
2025-10-02T09:28:48.916330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916330Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 230 to 230
2025-10-02T09:28:48.916333Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 148
2025-10-02T09:28:48.916559Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 328297
2025-10-02T09:28:48.916341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 149
2025-10-02T09:28:48.916343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 150
2025-10-02T09:28:48.916345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 151
2025-10-02T09:28:48.916347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 152
2025-10-02T09:28:48.916347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 230
2025-10-02T09:28:48.916364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916388Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916610Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (90-107)
2025-10-02T09:28:48.916620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 231 to 231
2025-10-02T09:28:48.916400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916627Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 195991 to budget
2025-10-02T09:28:48.916403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 299 size 16254 offset: -1
2025-10-02T09:28:48.916636Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 195991, ReadSizeServerDelta = 328297
2025-10-02T09:28:48.916405Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 231
2025-10-02T09:28:48.916407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 300 size 16364 offset: -1
2025-10-02T09:28:48.916411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 301 size 16475 offset: -1
2025-10-02T09:28:48.916418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916667Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.916422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 302 size 16585 offset: -1
2025-10-02T09:28:48.916425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 303 size 16695 offset: -1
2025-10-02T09:28:48.916679Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (90-90)
2025-10-02T09:28:48.916431Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.916433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916687Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (91-91)
2025-10-02T09:28:48.916689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 36
2025-10-02T09:28:48.916696Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (92-92)
2025-10-02T09:28:48.916701Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (93-93)
2025-10-02T09:28:48.916434Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916434Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916439Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 232 to 232
2025-10-02T09:28:48.916727Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (94-94)
2025-10-02T09:28:48.916743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 232
2025-10-02T09:28:48.916443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916445Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916749Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (95-95)
2025-10-02T09:28:48.916453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916763Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (96-96)
2025-10-02T09:28:48.916454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 233 to 233
2025-10-02T09:28:48.916458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916768Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (97-97)
2025-10-02T09:28:48.916777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 233
2025-10-02T09:28:48.916461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 153
2025-10-02T09:28:48.916484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 154
2025-10-02T09:28:48.916822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.916830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 37
2025-10-02T09:28:48.916832Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (98-98)
2025-10-02T09:28:48.916486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 155
2025-10-02T09:28:48.916842Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (99-99)
2025-10-02T09:28:48.916497Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (100-100)
2025-10-02T09:28:48.916501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916851Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (101-101)
2025-10-02T09:28:48.916505Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916856Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (102-102)
2025-10-02T09:28:48.916539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 234 to 234
2025-10-02T09:28:48.916860Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (103-103)
2025-10-02T09:28:48.916539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 156
2025-10-02T09:28:48.916541Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 157
2025-10-02T09:28:48.916867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (104-104)
2025-10-02T09:28:48.916544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916545Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916872Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (105-105)
2025-10-02T09:28:48.916546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916549Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 309 size 16805 offset: -1
2025-10-02T09:28:48.916550Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916555Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 234
2025-10-02T09:28:48.916556Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 310 size 16915 offset: -1
2025-10-02T09:28:48.916561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 311 size 17025 offset: -1
2025-10-02T09:28:48.916567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916571Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916575Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916576Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 235 to 235
2025-10-02T09:28:48.916579Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916584Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 235
2025-10-02T09:28:48.916585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.916594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 38
2025-10-02T09:28:48.916595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916598Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 315 size 17135 offset: -1
2025-10-02T09:28:48.916601Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916602Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916605Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 316 size 17245 offset: -1
2025-10-02T09:28:48.916609Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916610Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916614Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916619Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 236 to 236
2025-10-02T09:28:48.917009Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (106-106)
2025-10-02T09:28:48.916621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.917020Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (107-107)
2025-10-02T09:28:48.917022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916622Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 236
2025-10-02T09:28:48.916624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 158
2025-10-02T09:28:48.916630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 159
2025-10-02T09:28:48.916633Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 160
2025-10-02T09:28:48.916635Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 161
2025-10-02T09:28:48.916636Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 162
2025-10-02T09:28:48.916639Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916643Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916673Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 237 to 237
2025-10-02T09:28:48.916675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 319 size 17355 offset: -1
2025-10-02T09:28:48.916683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.917088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 237
2025-10-02T09:28:48.916685Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 320 size 17465 offset: -1
2025-10-02T09:28:48.916688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.916691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.917103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 39
2025-10-02T09:28:48.916692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916694Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 321 size 17575 offset: -1
2025-10-02T09:28:48.916698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 322 size 17685 offset: -1
2025-10-02T09:28:48.916707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 323 size 17795 offset: -1
2025-10-02T09:28:48.916714Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 238 to 238
2025-10-02T09:28:48.916716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916717Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.917144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916720Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 238
2025-10-02T09:28:48.916721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.917171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 239 to 239
2025-10-02T09:28:48.916738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916745Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.917194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 239
2025-10-02T09:28:48.916751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 163
2025-10-02T09:28:48.916759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 164
2025-10-02T09:28:48.916761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 165
2025-10-02T09:28:48.917213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.916763Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 166
2025-10-02T09:28:48.917217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 40
2025-10-02T09:28:48.916765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 167
2025-10-02T09:28:48.916769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.916793Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916795Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 195991 } }
2025-10-02T09:28:48.916797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916819Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# c73d669-5b4cd66e-b55efdfc-4f97fbb7
2025-10-02T09:28:48.916828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> event from dataHandler: 2025-10-02T09:28:48.917229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 240 to 240
2025-10-02T09:28:48.916828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.917279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 240
2025-10-02T09:28:48.916834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916836Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.916845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 329 size 17905 offset: -1
2025-10-02T09:28:48.916852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.917292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 241 to 241
2025-10-02T09:28:48.916858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 330 size 18015 offset: -1
2025-10-02T09:28:48.916862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 331 size 18125 offset: -1
2025-10-02T09:28:48.916874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 332 size 18235 offset: -1
2025-10-02T09:28:48.916882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 333 size 18345 offset: -1
2025-10-02T09:28:48.917319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.916893Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 241
2025-10-02T09:28:48.916899Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.916901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916904Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916909Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-10-02T09:28:48.907000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.911000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.917346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.917368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 41
2025-10-02T09:28:48.916920Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.916923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.917377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 242 to 242
2025-10-02T09:28:48.916925Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916927Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916930Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.917400Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 18, size 195228 bytes
2025-10-02T09:28:48.916935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.916937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.917406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917408Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.916940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.917410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 242
2025-10-02T09:28:48.916943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.916946Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.917421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 243 to 243
2025-10-02T09:28:48.916948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.916979Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917009Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 108 count 23 size 303307 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.917022Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 168
2025-10-02T09:28:48.917028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 169
2025-10-02T09:28:48.917031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 170
2025-10-02T09:28:48.917034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 171
2025-10-02T09:28:48.917036Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 108 partno 0 count 23 parts 0 suffix '63' size 303307
2025-10-02T09:28:48.917037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 172
2025-10-02T09:28:48.917040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.917051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.917448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917051Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 303144 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.917470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 243
2025-10-02T09:28:48.917054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.917056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.917478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.917486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 42
2025-10-02T09:28:48.917057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917058Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.917062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.917063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-10-02T09:28:48.917067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 244 to 244
2025-10-02T09:28:48.917069Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-10-02T09:28:48.917072Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917074Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-10-02T09:28:48.917075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 244
2025-10-02T09:28:48.917077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 245 to 245
2025-10-02T09:28:48.917080Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-10-02T09:28:48.917082Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-10-02T09:28:48.917087Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917089Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-10-02T09:28:48.917091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-10-02T09:28:48.917576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 245
2025-10-02T09:28:48.917096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-10-02T09:28:48.917101Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917104Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-10-02T09:28:48.917106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917110Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-10-02T09:28:48.917582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.917110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.917608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 43
2025-10-02T09:28:48.917112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-10-02T09:28:48.917615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 246 to 246
2025-10-02T09:28:48.917117Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917122Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-10-02T09:28:48.917129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-10-02T09:28:48.917134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-10-02T09:28:48.917139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917144Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-10-02T09:28:48.917146Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 246
2025-10-02T09:28:48.917148Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 247 to 247
2025-10-02T09:28:48.917149Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-10-02T09:28:48.917151Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917155Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-10-02T09:28:48.917157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-10-02T09:28:48.917163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917166Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-10-02T09:28:48.917700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 247
2025-10-02T09:28:48.917172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-10-02T09:28:48.917174Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-10-02T09:28:48.917178Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917181Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-10-02T09:28:48.917183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.917187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-10-02T09:28:48.917188Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.917217Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 108 EndOffset 108 newEndOffset 131 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-02T09:28:48.917733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 248 to 248
2025-10-02T09:28:48.917219Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 108 endOffset 131
2025-10-02T09:28:48.917223Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.917235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (36)
2025-10-02T09:28:48.917251Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-10-02T09:28:48.917255Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 108, endOffset# 131, WTime# 1759397328911, sizeLag# 303307
2025-10-02T09:28:48.917257Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.917263Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 60078ef7-e52accd1-550c49e8-22dc0be8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 27, size# 363968, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.917759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917269Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 248
2025-10-02T09:28:48.917289Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 14568 count 1 nextOffset 132 batches 1
2025-10-02T09:28:48.917293Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 27 maxSize 363968 maxTimeLagMs 0 readTimestampMs 0 readOffset 108 EndOffset 131 ClientCommitOffset 0 committedOffset 0 Guid 60078ef7-e52accd1-550c49e8-22dc0be8
2025-10-02T09:28:48.917295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-10-02T09:28:48.917299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 29214 count 2 nextOffset 133 batches 1
2025-10-02T09:28:48.917302Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-10-02T09:28:48.917307Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 43970 count 3 nextOffset 134 batches 1
2025-10-02T09:28:48.917310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-10-02T09:28:48.917785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 249 to 249
2025-10-02T09:28:48.917313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 58836 count 4 nextOffset 135 batches 1
2025-10-02T09:28:48.917316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-10-02T09:28:48.917320Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 73812 count 5 nextOffset 136 batches 1
2025-10-02T09:28:48.917323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-10-02T09:28:48.917326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 88898 count 6 nextOffset 137 batches 1
2025-10-02T09:28:48.917329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-10-02T09:28:48.917333Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 104094 count 7 nextOffset 138 batches 1
2025-10-02T09:28:48.917336Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
2025-10-02T09:28:48.917812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 249
2025-10-02T09:28:48.917338Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917340Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 119400 count 8 nextOffset 139 batches 1
2025-10-02T09:28:48.917343Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-10-02T09:28:48.917348Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 134816 count 9 nextOffset 140 batches 1
2025-10-02T09:28:48.917350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-10-02T09:28:48.917354Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 150342 count 10 nextOffset 141 batches 1
2025-10-02T09:28:48.917357Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-10-02T09:28:48.917360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 165978 count 11 nextOffset 142 batches 1
2025-10-02T09:28:48.917363Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-10-02T09:28:48.917366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 181724 count 12 nextOffset 143 batches 1
2025-10-02T09:28:48.917369Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-10-02T09:28:48.917845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 250 to 250
2025-10-02T09:28:48.917372Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 197580 count 13 nextOffset 144 batches 1
2025-10-02T09:28:48.917375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-10-02T09:28:48.917379Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 213546 count 14 nextOffset 145 batches 1
2025-10-02T09:28:48.917381Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-10-02T09:28:48.917885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 229622 count 15 nextOffset 146 batches 1
2025-10-02T09:28:48.917888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 250
2025-10-02T09:28:48.917389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
2025-10-02T09:28:48.917392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 245808 count 16 nextOffset 147 batches 1
2025-10-02T09:28:48.917395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-10-02T09:28:48.917399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 262104 count 17 nextOffset 148 batches 1
2025-10-02T09:28:48.917402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-10-02T09:28:48.917405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 278510 count 18 nextOffset 149 batches 1
2025-10-02T09:28:48.917408Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-10-02T09:28:48.917911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 251 to 251
2025-10-02T09:28:48.917411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 295027 count 19 nextOffset 150 batches 1
2025-10-02T09:28:48.917414Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-10-02T09:28:48.917417Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 311654 count 20 nextOffset 151 batches 1
2025-10-02T09:28:48.917420Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-10-02T09:28:48.917424Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 328391 count 21 nextOffset 152 batches 1
2025-10-02T09:28:48.917427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-10-02T09:28:48.917430Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 345238 count 22 nextOffset 153 batches 1
2025-10-02T09:28:48.917937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-10-02T09:28:48.917940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 251
2025-10-02T09:28:48.917436Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 362195 count 23 nextOffset 154 batches 1
2025-10-02T09:28:48.917439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-10-02T09:28:48.917442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 379262 count 24 nextOffset 155 batches 1
2025-10-02T09:28:48.917445Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-10-02T09:28:48.917445Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917448Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 396439 count 25 nextOffset 156 batches 1
2025-10-02T09:28:48.917451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-10-02T09:28:48.917454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 413726 count 26 nextOffset 157 batches 1
2025-10-02T09:28:48.917457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-10-02T09:28:48.917460Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 431123 count 27 nextOffset 158 batches 1
2025-10-02T09:28:48.917968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 252 to 252
2025-10-02T09:28:48.917463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-10-02T09:28:48.917466Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 448630 count 28 nextOffset 159 batches 1
2025-10-02T09:28:48.917469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-10-02T09:28:48.917472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 466247 count 29 nextOffset 160 batches 1
2025-10-02T09:28:48.917476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-10-02T09:28:48.917479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 483974 count 30 nextOffset 161 batches 1
2025-10-02T09:28:48.917482Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-10-02T09:28:48.917485Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 501811 count 31 nextOffset 162 batches 1
2025-10-02T09:28:48.917994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.917487Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 252
2025-10-02T09:28:48.917489Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-10-02T09:28:48.917527Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917569Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917606Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917640Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917682Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 253 to 253
2025-10-02T09:28:48.917760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917794Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917823Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917848Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917886Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917930Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.917970Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918013Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 253
2025-10-02T09:28:48.918056Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 254 to 254
2025-10-02T09:28:48.918104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 254
2025-10-02T09:28:48.918129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 255 to 255
2025-10-02T09:28:48.918146Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 255
2025-10-02T09:28:48.918208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 256 to 256
2025-10-02T09:28:48.918210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 518812 count 32 nextOffset 163 batches 1
2025-10-02T09:28:48.918224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918224Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-10-02T09:28:48.918227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 256
2025-10-02T09:28:48.918247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 536901 count 33 nextOffset 164 batches 2
2025-10-02T09:28:48.918254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-10-02T09:28:48.918258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 555068 count 34 nextOffset 165 batches 2
2025-10-02T09:28:48.918262Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-10-02T09:28:48.918265Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.918266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 573345 count 35 nextOffset 166 batches 2
2025-10-02T09:28:48.918269Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-10-02T09:28:48.918272Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 131 PartNo 0 PackedSize 591732 count 36 nextOffset 167 batches 2
2025-10-02T09:28:48.918275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.918268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 257 to 257
2025-10-02T09:28:48.918318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 257
2025-10-02T09:28:48.918338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 258 to 258
2025-10-02T09:28:48.918355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 258
2025-10-02T09:28:48.918351Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 131,36 HeadOffset 131 endOffset 131 curOffset 167 d0000000000_00000000000000000131_00000_0000000036_00000? size 591672 WTime 1759397328917
2025-10-02T09:28:48.918374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 259 to 259
2025-10-02T09:28:48.918390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 259
2025-10-02T09:28:48.918414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 260 to 260
2025-10-02T09:28:48.918430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 260
2025-10-02T09:28:48.918447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 261 to 261
2025-10-02T09:28:48.918464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 261
2025-10-02T09:28:48.918488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 262 to 262
2025-10-02T09:28:48.918518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 262
2025-10-02T09:28:48.918537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 263 to 263
2025-10-02T09:28:48.918564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 263
2025-10-02T09:28:48.918596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 264 to 264
2025-10-02T09:28:48.918614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 264
2025-10-02T09:28:48.918636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 265 to 265
2025-10-02T09:28:48.918652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 265
2025-10-02T09:28:48.918677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 266 to 266
2025-10-02T09:28:48.918706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 266
2025-10-02T09:28:48.918731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 267 to 267
2025-10-02T09:28:48.918750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 267
2025-10-02T09:28:48.918778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 268 to 268
2025-10-02T09:28:48.918766Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.918793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 268
2025-10-02T09:28:48.918774Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.918777Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.918779Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.918781Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.918784Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.918786Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.918817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 269 to 269
2025-10-02T09:28:48.918788Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.918790Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 949540 bytes (949540)
2025-10-02T09:28:48.918793Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 8, size 949540 (8388608)
2025-10-02T09:28:48.918809Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 109
2025-10-02T09:28:48.918826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 110
2025-10-02T09:28:48.918834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 269
2025-10-02T09:28:48.918832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 111
2025-10-02T09:28:48.918835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918839Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 339 size 18455 offset: -1
2025-10-02T09:28:48.918858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 270 to 270
2025-10-02T09:28:48.918864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 340 size 18565 offset: -1
2025-10-02T09:28:48.918872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 341 size 18675 offset: -1
2025-10-02T09:28:48.918883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 270
2025-10-02T09:28:48.918890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 342 size 18785 offset: -1
2025-10-02T09:28:48.918898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918900Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918904Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 343 size 18895 offset: -1
2025-10-02T09:28:48.918913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 271 to 271
2025-10-02T09:28:48.918913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 112
2025-10-02T09:28:48.918921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 113
2025-10-02T09:28:48.918928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 114
2025-10-02T09:28:48.918929Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918932Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918934Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 115
2025-10-02T09:28:48.918932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 271
2025-10-02T09:28:48.918939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 116
2025-10-02T09:28:48.918943Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 117
2025-10-02T09:28:48.918946Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918950Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 118
2025-10-02T09:28:48.918955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 119
2025-10-02T09:28:48.918960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 272 to 272
2025-10-02T09:28:48.918961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 120
2025-10-02T09:28:48.918968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918972Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.918972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 272
2025-10-02T09:28:48.918976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.918988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.918992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 121
2025-10-02T09:28:48.918996Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.918998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 122
2025-10-02T09:28:48.919003Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 123
2025-10-02T09:28:48.919003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 273 to 273
2025-10-02T09:28:48.919007Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 124
2025-10-02T09:28:48.919011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 125
2025-10-02T09:28:48.919019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 126
2025-10-02T09:28:48.919023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 127
2025-10-02T09:28:48.919027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 128
2025-10-02T09:28:48.919040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 273
2025-10-02T09:28:48.919035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 129
2025-10-02T09:28:48.919038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 130
2025-10-02T09:28:48.919046Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 131
2025-10-02T09:28:48.919046Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 274 to 274
2025-10-02T09:28:48.919056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919058Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919066Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.919077Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 131 partNo 0 count 36 size 591672
2025-10-02T09:28:48.919083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 274
2025-10-02T09:28:48.919089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919101Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 275 to 275
2025-10-02T09:28:48.919159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 173
2025-10-02T09:28:48.919170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 174
2025-10-02T09:28:48.919168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 175
2025-10-02T09:28:48.919173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 176
2025-10-02T09:28:48.919176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 177
2025-10-02T09:28:48.919172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 275
2025-10-02T09:28:48.919182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919193Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919201Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919205Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 108 count 27 size 363968 endOffset 131 max time lag 0ms effective offset 108
2025-10-02T09:28:48.919215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 276 to 276
2025-10-02T09:28:48.919207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919218Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 303307 count 23 last offset 108, current partition end offset: 131
2025-10-02T09:28:48.919221Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-02T09:28:48.919226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 349 size 19005 offset: -1
2025-10-02T09:28:48.919231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 276
2025-10-02T09:28:48.919239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 350 size 19115 offset: -1
2025-10-02T09:28:48.919253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919255Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 351 size 19225 offset: -1
2025-10-02T09:28:48.919266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 277 to 277
2025-10-02T09:28:48.919266Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 108 partno 0 count 23 parts_count 0 source 1 size 303307 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.919274Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-02T09:28:48.919278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 277
2025-10-02T09:28:48.919281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919284Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 108 partno 0 count 23 parts 0 suffix '63'
2025-10-02T09:28:48.919286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 353 size 19335 offset: -1
2025-10-02T09:28:48.919303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 278 to 278
2025-10-02T09:28:48.919300Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 354 size 19445 offset: -1
2025-10-02T09:28:48.919308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 278
2025-10-02T09:28:48.919313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919338Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919345Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.919392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.919400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 44
2025-10-02T09:28:48.919443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 279 to 279
2025-10-02T09:28:48.919469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 279
2025-10-02T09:28:48.919471Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.919497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 280 to 280
2025-10-02T09:28:48.919518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 280
2025-10-02T09:28:48.919544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 281 to 281
2025-10-02T09:28:48.919563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 281
2025-10-02T09:28:48.919582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 282 to 282
2025-10-02T09:28:48.919600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 282
2025-10-02T09:28:48.919630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 283 to 283
2025-10-02T09:28:48.919659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 283
2025-10-02T09:28:48.919646Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 108 totakecount 23 count 23 size 303285 from pos 0 cbcount 23
2025-10-02T09:28:48.919688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 284 to 284
2025-10-02T09:28:48.919706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 284
2025-10-02T09:28:48.919717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 285 to 285
2025-10-02T09:28:48.919709Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 285
2025-10-02T09:28:48.919751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 286 to 286
2025-10-02T09:28:48.919745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 108
2025-10-02T09:28:48.919758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 286
2025-10-02T09:28:48.919768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 287 to 287
2025-10-02T09:28:48.919763Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 178
2025-10-02T09:28:48.919774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 287
2025-10-02T09:28:48.919774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 179
2025-10-02T09:28:48.919783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 288 to 288
2025-10-02T09:28:48.919782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 180
2025-10-02T09:28:48.919790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 181
2025-10-02T09:28:48.919793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 288
2025-10-02T09:28:48.919788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 182
2025-10-02T09:28:48.919790Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 289 to 289
2025-10-02T09:28:48.919800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919806Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919809Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.919818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 289
2025-10-02T09:28:48.919831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 290 to 290
2025-10-02T09:28:48.919856Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919871Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.919877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 290
2025-10-02T09:28:48.919881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 291 to 291
2025-10-02T09:28:48.919898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 359 size 19555 offset: -1
2025-10-02T09:28:48.919907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919912Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 360 size 19665 offset: -1
2025-10-02T09:28:48.919915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 361 size 19775 offset: -1
2025-10-02T09:28:48.919922Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 362 size 19885 offset: -1
2025-10-02T09:28:48.919924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919930Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 291
2025-10-02T09:28:48.919933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 363 size 19995 offset: -1
2025-10-02T09:28:48.919935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919949Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919951Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.919954Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.919978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 292 to 292
2025-10-02T09:28:48.919958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919966Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919969Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919969Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 131 Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328908 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328909 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328909 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328909 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328909 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1759397328913 CreateTimestampMS: 1759397328909 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550974 RealReadOffset: 130 WaitQuotaTimeMs: 0 EndOffset: 131 StartOffset: 0 } Cookie: 108 }
2025-10-02T09:28:48.919971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919972Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.919974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.919997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.919977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 292
2025-10-02T09:28:48.919986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 183
2025-10-02T09:28:48.919990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 184
2025-10-02T09:28:48.919992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 185
2025-10-02T09:28:48.919993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 186
2025-10-02T09:28:48.919995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 187
2025-10-02T09:28:48.920019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920022Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920046Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920049Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 293 to 293
2025-10-02T09:28:48.920056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920062Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920066Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 369 size 20105 offset: -1
2025-10-02T09:28:48.920070Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 370 size 20215 offset: -1
2025-10-02T09:28:48.920077Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 293
2025-10-02T09:28:48.920080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 371 size 20325 offset: -1
2025-10-02T09:28:48.920082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920084Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 372 size 20435 offset: -1
2025-10-02T09:28:48.920086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920088Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 373 size 20545 offset: -1
2025-10-02T09:28:48.920091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 294 to 294
2025-10-02T09:28:48.920095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 294
2025-10-02T09:28:48.920111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920113Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.920187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 45
2025-10-02T09:28:48.920117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920123Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 188
2025-10-02T09:28:48.920125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 189
2025-10-02T09:28:48.920126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 190
2025-10-02T09:28:48.920128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 191
2025-10-02T09:28:48.920129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 192
2025-10-02T09:28:48.920132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920134Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 295 to 295
2025-10-02T09:28:48.920137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920139Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920148Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920155Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920158Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920161Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 295
2025-10-02T09:28:48.920171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 379 size 20655 offset: -1
2025-10-02T09:28:48.920176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 380 size 20765 offset: -1
2025-10-02T09:28:48.920181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 381 size 20875 offset: -1
2025-10-02T09:28:48.920187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 382 size 20985 offset: -1
2025-10-02T09:28:48.920192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 383 size 21095 offset: -1
2025-10-02T09:28:48.920197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.920313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 46
2025-10-02T09:28:48.920207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920213Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920213Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 131
2025-10-02T09:28:48.920215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920219Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920221Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 131 ReadOffset 131 ReadGuid 60078ef7-e52accd1-550c49e8-22dc0be8 has messages 1
2025-10-02T09:28:48.920221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 296 to 296
2025-10-02T09:28:48.920231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 193
2025-10-02T09:28:48.920233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 194
2025-10-02T09:28:48.920235Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 195
2025-10-02T09:28:48.920237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 196
2025-10-02T09:28:48.920238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 197
2025-10-02T09:28:48.920242Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.920245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920248Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920250Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920253Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920259Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 60078ef7-e52accd1-550c49e8-22dc0be8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 302268
2025-10-02T09:28:48.920268Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 60078ef7-e52accd1-550c49e8-22dc0be8
2025-10-02T09:28:48.920382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 296
2025-10-02T09:28:48.920369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 389 size 21205 offset: -1
2025-10-02T09:28:48.920397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 390 size 21315 offset: -1
2025-10-02T09:28:48.920402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 391 size 21425 offset: -1
2025-10-02T09:28:48.920437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 297 to 297
2025-10-02T09:28:48.920408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 392 size 21535 offset: -1
2025-10-02T09:28:48.920413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 393 size 21645 offset: -1
2025-10-02T09:28:48.920422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 297
2025-10-02T09:28:48.920430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920438Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920441Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 298 to 298
2025-10-02T09:28:48.920447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 198
2025-10-02T09:28:48.920467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 199
2025-10-02T09:28:48.920469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 200
2025-10-02T09:28:48.920531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 298
2025-10-02T09:28:48.920546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 299 to 299
2025-10-02T09:28:48.920565Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 201
2025-10-02T09:28:48.920573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 202
2025-10-02T09:28:48.920577Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.920579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920582Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920586Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 299
2025-10-02T09:28:48.920636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write 1 messages with Id from 300 to 300
2025-10-02T09:28:48.920632Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920641Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920644Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.920646Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920673Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 399 size 21755 offset: -1
2025-10-02T09:28:48.920683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: try to update token
2025-10-02T09:28:48.920690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Send 1 message(s) (0 left), first sequence number is 300
2025-10-02T09:28:48.920694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 400 size 21865 offset: -1
2025-10-02T09:28:48.920696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 401 size 21975 offset: -1
2025-10-02T09:28:48.920701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 402 size 22085 offset: -1
2025-10-02T09:28:48.920706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 403 size 22195 offset: -1
2025-10-02T09:28:48.920711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920725Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920730Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920736Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 203
2025-10-02T09:28:48.920748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 204
2025-10-02T09:28:48.920749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 205
2025-10-02T09:28:48.920751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 206
2025-10-02T09:28:48.920752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 207
2025-10-02T09:28:48.920755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920759Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920762Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920779Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.920784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 409 size 22305 offset: -1
2025-10-02T09:28:48.920789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920790Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 410 size 22415 offset: -1
2025-10-02T09:28:48.920793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 411 size 22525 offset: -1
2025-10-02T09:28:48.920798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920799Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 412 size 22635 offset: -1
2025-10-02T09:28:48.920817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 413 size 22745 offset: -1
2025-10-02T09:28:48.920822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920825Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920842Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 208
2025-10-02T09:28:48.920852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 209
2025-10-02T09:28:48.920854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 210
2025-10-02T09:28:48.920856Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 211
2025-10-02T09:28:48.920859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.920885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 418 size 22855 offset: -1
2025-10-02T09:28:48.920894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920896Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920900Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 419 size 22965 offset: -1
2025-10-02T09:28:48.920903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 420 size 23075 offset: -1
2025-10-02T09:28:48.920910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.920911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.920915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 421 size 23185 offset: -1
2025-10-02T09:28:48.920948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.920961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 47
2025-10-02T09:28:48.920918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920923Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.920933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.920934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.921010Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 302268, now ReadSizeBudget = 0, ReadSizeServerDelta = 222020
2025-10-02T09:28:48.921014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921024Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 48
2025-10-02T09:28:48.921050Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 222020
2025-10-02T09:28:48.921046Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 131 count 36 size 591672 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.921064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.921066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.921073Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 131 partno 0 count 36 parts 0 suffix '63' size 591672
2025-10-02T09:28:48.921077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 591354 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.921081Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-10-02T09:28:48.921097Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.921100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-10-02T09:28:48.921102Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-10-02T09:28:48.921108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-10-02T09:28:48.921112Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921113Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-10-02T09:28:48.921122Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (108-130)
2025-10-02T09:28:48.921118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921121Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-10-02T09:28:48.921141Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 302268 to budget
2025-10-02T09:28:48.921123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-10-02T09:28:48.921128Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921150Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 302268, ReadSizeServerDelta = 222020
2025-10-02T09:28:48.921131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-10-02T09:28:48.921132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-10-02T09:28:48.921137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921140Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-10-02T09:28:48.921141Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-10-02T09:28:48.921147Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-10-02T09:28:48.921152Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-10-02T09:28:48.921158Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-10-02T09:28:48.921165Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921187Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.921167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-10-02T09:28:48.921170Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-10-02T09:28:48.921174Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-10-02T09:28:48.921200Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (108-108)
2025-10-02T09:28:48.921179Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-10-02T09:28:48.921184Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921209Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (109-109)
2025-10-02T09:28:48.921186Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-10-02T09:28:48.921189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921223Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (110-110)
2025-10-02T09:28:48.921191Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-10-02T09:28:48.921194Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921229Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (111-111)
2025-10-02T09:28:48.921196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-10-02T09:28:48.921237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 49
2025-10-02T09:28:48.921240Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (112-112)
2025-10-02T09:28:48.921198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921270Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (113-113)
2025-10-02T09:28:48.921201Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-10-02T09:28:48.921275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (114-114)
2025-10-02T09:28:48.921202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.921284Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (115-115)
2025-10-02T09:28:48.921203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921206Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-10-02T09:28:48.921208Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-10-02T09:28:48.921212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921215Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-10-02T09:28:48.921217Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921219Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-10-02T09:28:48.921221Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921224Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-10-02T09:28:48.921226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 50
2025-10-02T09:28:48.921229Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-10-02T09:28:48.921231Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-10-02T09:28:48.921235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921237Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-10-02T09:28:48.921239Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921242Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-10-02T09:28:48.921243Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921347Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (116-116)
2025-10-02T09:28:48.921356Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (117-117)
2025-10-02T09:28:48.921244Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-10-02T09:28:48.921249Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921251Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-10-02T09:28:48.921254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-10-02T09:28:48.921361Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (118-118)
2025-10-02T09:28:48.921258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921261Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-10-02T09:28:48.921264Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.921265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.921381Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (119-119)
2025-10-02T09:28:48.921266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-10-02T09:28:48.921394Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (120-120)
2025-10-02T09:28:48.921290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.921399Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (121-121)
2025-10-02T09:28:48.921295Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 131 EndOffset 131 newEndOffset 167 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-02T09:28:48.921298Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 131 endOffset 167
2025-10-02T09:28:48.921305Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 131, endOffset# 167, WTime# 1759397328913, sizeLag# 591672
2025-10-02T09:28:48.921307Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.921403Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (122-122)
2025-10-02T09:28:48.921312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.921314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (44)
2025-10-02T09:28:48.921420Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (123-123)
2025-10-02T09:28:48.921322Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 85e2feb6-799da8fa-e335a964-d83d620a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 43, size# 222020, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.921328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
2025-10-02T09:28:48.921337Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 302268 } }
2025-10-02T09:28:48.921345Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# ce9153f2-27431e6c-32286977-88744880
2025-10-02T09:28:48.921345Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 18529 count 1 nextOffset 168 batches 1
2025-10-02T09:28:48.921350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-10-02T09:28:48.921351Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 43 maxSize 222020 maxTimeLagMs 0 readTimestampMs 0 readOffset 131 EndOffset 167 ClientCommitOffset 0 committedOffset 0 Guid 85e2feb6-799da8fa-e335a964-d83d620a
2025-10-02T09:28:48.921354Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 37136 count 2 nextOffset 169 batches 1
2025-10-02T09:28:48.921357Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-10-02T09:28:48.921362Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 55853 count 3 nextOffset 170 batches 1
2025-10-02T09:28:48.921365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-10-02T09:28:48.921368Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 74680 count 4 nextOffset 171 batches 1
2025-10-02T09:28:48.921370Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-10-02T09:28:48.921375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 93617 count 5 nextOffset 172 batches 1
2025-10-02T09:28:48.921378Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-10-02T09:28:48.921382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 112664 count 6 nextOffset 173 batches 1
2025-10-02T09:28:48.921386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-10-02T09:28:48.921388Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.921389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 131821 count 7 nextOffset 174 batches 1
2025-10-02T09:28:48.921392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-10-02T09:28:48.921395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 151088 count 8 nextOffset 175 batches 1
2025-10-02T09:28:48.921398Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-10-02T09:28:48.921403Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 170465 count 9 nextOffset 176 batches 1
2025-10-02T09:28:48.921407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-10-02T09:28:48.921410Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 189952 count 10 nextOffset 177 batches 1
2025-10-02T09:28:48.921413Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-10-02T09:28:48.921416Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 209549 count 11 nextOffset 178 batches 1
2025-10-02T09:28:48.921419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-10-02T09:28:48.921422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 229256 count 12 nextOffset 179 batches 1
2025-10-02T09:28:48.921425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-10-02T09:28:48.921428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 249073 count 13 nextOffset 180 batches 1
2025-10-02T09:28:48.921431Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-10-02T09:28:48.921435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 269000 count 14 nextOffset 181 batches 1
2025-10-02T09:28:48.921437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-10-02T09:28:48.921441Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 289037 count 15 nextOffset 182 batches 1
2025-10-02T09:28:48.921444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-10-02T09:28:48.921447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 309184 count 16 nextOffset 183 batches 1
2025-10-02T09:28:48.921450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
2025-10-02T09:28:48.921454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 329441 count 17 nextOffset 184 batches 1
2025-10-02T09:28:48.921457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-10-02T09:28:48.921460Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 349808 count 18 nextOffset 185 batches 1
2025-10-02T09:28:48.921461Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921464Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-10-02T09:28:48.921467Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 370285 count 19 nextOffset 186 batches 1
2025-10-02T09:28:48.921470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-10-02T09:28:48.921474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 390872 count 20 nextOffset 187 batches 1
2025-10-02T09:28:48.921476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-10-02T09:28:48.921480Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 411569 count 21 nextOffset 188 batches 1
2025-10-02T09:28:48.921483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-10-02T09:28:48.921487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 432376 count 22 nextOffset 189 batches 1
2025-10-02T09:28:48.921490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-10-02T09:28:48.921493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 453293 count 23 nextOffset 190 batches 1
2025-10-02T09:28:48.921496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-10-02T09:28:48.921569Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (124-124)
2025-10-02T09:28:48.921499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 474320 count 24 nextOffset 191 batches 1
2025-10-02T09:28:48.921503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-10-02T09:28:48.921506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 495457 count 25 nextOffset 192 batches 1
2025-10-02T09:28:48.921578Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (125-125)
2025-10-02T09:28:48.921509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-10-02T09:28:48.921523Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921584Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (126-126)
2025-10-02T09:28:48.921590Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (127-127)
2025-10-02T09:28:48.921596Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (128-128)
2025-10-02T09:28:48.921602Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (129-129)
2025-10-02T09:28:48.921608Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (130-130)
2025-10-02T09:28:48.921601Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921644Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-02T09:28:48.923945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.925272Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 590094, now ReadSizeBudget = 0, ReadSizeServerDelta = -65806
2025-10-02T09:28:48.954847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 51
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-10-02T09:28:48.908000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.913000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.954992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.954999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 52
2025-10-02T09:28:48.955014Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (131-163)
2025-10-02T09:28:48.955031Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 590094 to budget
2025-10-02T09:28:48.955032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 53
2025-10-02T09:28:48.955038Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 590094, ReadSizeServerDelta = -65806
2025-10-02T09:28:48.955050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 54
2025-10-02T09:28:48.955067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 55
2025-10-02T09:28:48.955077Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 23, size 301323 bytes
2025-10-02T09:28:48.955086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 56
2025-10-02T09:28:48.955118Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.955131Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.955139Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (131-131)
2025-10-02T09:28:48.955156Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (132-132)
2025-10-02T09:28:48.955167Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (133-133)
2025-10-02T09:28:48.921674Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955172Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (134-134)
2025-10-02T09:28:48.921703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955200Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (135-135)
2025-10-02T09:28:48.955219Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (136-136)
2025-10-02T09:28:48.955220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 57
2025-10-02T09:28:48.955224Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (137-137)
2025-10-02T09:28:48.955277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921750Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 58
2025-10-02T09:28:48.955294Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (138-138)
2025-10-02T09:28:48.921791Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 515962 count 26 nextOffset 193 batches 1
2025-10-02T09:28:48.955313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 59
2025-10-02T09:28:48.921806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-10-02T09:28:48.921815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 537351 count 27 nextOffset 194 batches 2
2025-10-02T09:28:48.921817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-10-02T09:28:48.955329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.921819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 558818 count 28 nextOffset 195 batches 2
2025-10-02T09:28:48.955332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 60
2025-10-02T09:28:48.921821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-10-02T09:28:48.955335Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (139-139)
2025-10-02T09:28:48.921823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 580395 count 29 nextOffset 196 batches 2
2025-10-02T09:28:48.955341Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (140-140)
2025-10-02T09:28:48.921825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-10-02T09:28:48.921827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 602082 count 30 nextOffset 197 batches 2
2025-10-02T09:28:48.955347Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (141-141)
2025-10-02T09:28:48.955354Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (142-142)
2025-10-02T09:28:48.955347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 61
2025-10-02T09:28:48.921829Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-10-02T09:28:48.955360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (143-143)
2025-10-02T09:28:48.921831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 623879 count 31 nextOffset 198 batches 2
2025-10-02T09:28:48.921833Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-10-02T09:28:48.955372Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (144-144)
2025-10-02T09:28:48.921835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 645786 count 32 nextOffset 199 batches 2
2025-10-02T09:28:48.955378Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (145-145)
2025-10-02T09:28:48.921837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-10-02T09:28:48.955388Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (146-146)
2025-10-02T09:28:48.955378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 62
2025-10-02T09:28:48.921839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 667803 count 33 nextOffset 200 batches 2
2025-10-02T09:28:48.921842Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-10-02T09:28:48.921843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 689930 count 34 nextOffset 201 batches 2
2025-10-02T09:28:48.955408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 63
2025-10-02T09:28:48.955437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (147-147)
2025-10-02T09:28:48.921846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-10-02T09:28:48.955443Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (148-148)
2025-10-02T09:28:48.921850Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 712167 count 35 nextOffset 202 batches 2
2025-10-02T09:28:48.921852Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-10-02T09:28:48.955450Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (149-149)
2025-10-02T09:28:48.955450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 64
2025-10-02T09:28:48.955458Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (150-150)
2025-10-02T09:28:48.921853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 734514 count 36 nextOffset 203 batches 2
2025-10-02T09:28:48.921855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-10-02T09:28:48.955467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (151-151)
2025-10-02T09:28:48.921856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 756971 count 37 nextOffset 204 batches 2
2025-10-02T09:28:48.921858Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-10-02T09:28:48.955474Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (152-152)
2025-10-02T09:28:48.921860Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 779538 count 38 nextOffset 205 batches 2
2025-10-02T09:28:48.955482Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (153-153)
2025-10-02T09:28:48.955476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 65
2025-10-02T09:28:48.955493Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (154-154)
2025-10-02T09:28:48.955501Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (155-155)
2025-10-02T09:28:48.921862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-10-02T09:28:48.921862Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955508Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (156-156)
2025-10-02T09:28:48.921864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 802215 count 39 nextOffset 206 batches 2
2025-10-02T09:28:48.921866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-10-02T09:28:48.955516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (157-157)
2025-10-02T09:28:48.921867Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 825002 count 40 nextOffset 207 batches 2
2025-10-02T09:28:48.921869Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-10-02T09:28:48.955522Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (158-158)
2025-10-02T09:28:48.921871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 847899 count 41 nextOffset 208 batches 2
2025-10-02T09:28:48.921874Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-10-02T09:28:48.955530Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 22} (159-159)
2025-10-02T09:28:48.955540Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 23} (160-160)
2025-10-02T09:28:48.955541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.955544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 66
2025-10-02T09:28:48.955549Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 24} (161-161)
2025-10-02T09:28:48.921876Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 870906 count 42 nextOffset 209 batches 2
2025-10-02T09:28:48.955562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.921877Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-10-02T09:28:48.955568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 67
2025-10-02T09:28:48.921880Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 894023 count 43 nextOffset 210 batches 2
2025-10-02T09:28:48.921882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-10-02T09:28:48.921884Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 917250 count 44 nextOffset 211 batches 2
2025-10-02T09:28:48.955562Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 25} (162-162)
2025-10-02T09:28:48.955586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.921885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.955591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 68
2025-10-02T09:28:48.921946Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.921982Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922096Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.922225Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922233Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 167,44 HeadOffset 167 endOffset 167 curOffset 211 d0000000000_00000000000000000167_00000_0000000044_00000? size 916756 WTime 1759397328921
2025-10-02T09:28:48.922258Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922295Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 69
2025-10-02T09:28:48.922325Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922361Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922393Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922427Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922464Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 70
2025-10-02T09:28:48.922537Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922640Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922799Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.955657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.922800Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.955660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 71
2025-10-02T09:28:48.922802Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.922803Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.922804Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.922805Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.955674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.922807Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.955678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 72
2025-10-02T09:28:48.922809Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.922810Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.922811Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000131_00000_0000000036_00000?
2025-10-02T09:28:48.922812Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 1541212 bytes (1541212)
2025-10-02T09:28:48.922814Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 9, size 1541212 (8388608)
2025-10-02T09:28:48.955692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 73
2025-10-02T09:28:48.955699Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 26} (163-163)
2025-10-02T09:28:48.922828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.955711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-02T09:28:48.955715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 74
2025-10-02T09:28:48.922830Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.922837Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922839Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 132
2025-10-02T09:28:48.922844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 133
2025-10-02T09:28:48.955729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.922848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 134
2025-10-02T09:28:48.955732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 75
2025-10-02T09:28:48.922852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 135
2025-10-02T09:28:48.922856Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 136
2025-10-02T09:28:48.922860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 137
2025-10-02T09:28:48.922864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 138
2025-10-02T09:28:48.922864Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 139
2025-10-02T09:28:48.955750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 76
2025-10-02T09:28:48.922869Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 140
2025-10-02T09:28:48.922871Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 141
2025-10-02T09:28:48.922876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.922880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.955771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 77
2025-10-02T09:28:48.922882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922884Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.922884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 142
2025-10-02T09:28:48.922887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 143
2025-10-02T09:28:48.955801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.955804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 78
2025-10-02T09:28:48.922890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 144
2025-10-02T09:28:48.922895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 145
2025-10-02T09:28:48.955823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.955826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 79
2025-10-02T09:28:48.922895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 146
2025-10-02T09:28:48.922902Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 147
2025-10-02T09:28:48.922906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 148
2025-10-02T09:28:48.922909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 149
2025-10-02T09:28:48.922913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 150
2025-10-02T09:28:48.922915Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922917Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 151
2025-10-02T09:28:48.955853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 80
2025-10-02T09:28:48.922921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 152
2025-10-02T09:28:48.922924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 153
2025-10-02T09:28:48.922928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 154
2025-10-02T09:28:48.922931Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 155
2025-10-02T09:28:48.922935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 156
2025-10-02T09:28:48.922938Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 157
2025-10-02T09:28:48.922942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 158
2025-10-02T09:28:48.922945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 159
2025-10-02T09:28:48.922946Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.955885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 81
2025-10-02T09:28:48.922949Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 160
2025-10-02T09:28:48.922952Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.922953Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.922956Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 161
2025-10-02T09:28:48.955900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922959Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 82
2025-10-02T09:28:48.922960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 162
2025-10-02T09:28:48.922963Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 163
2025-10-02T09:28:48.922966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 164
2025-10-02T09:28:48.922969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 165
2025-10-02T09:28:48.955917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.955923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 83
2025-10-02T09:28:48.922973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 166
2025-10-02T09:28:48.922976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 167
2025-10-02T09:28:48.922979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.922980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.955937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922984Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 84
2025-10-02T09:28:48.922986Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.922990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.955954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.922993Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 85
2025-10-02T09:28:48.922995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.922995Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.922996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.922998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923001Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.923001Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923007Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 167 partNo 0 count 44 size 916756
2025-10-02T09:28:48.955985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 86
2025-10-02T09:28:48.923008Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923016Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.956001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.956003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 87
2025-10-02T09:28:48.923037Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 212
2025-10-02T09:28:48.923039Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 213
2025-10-02T09:28:48.923041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923042Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 214
2025-10-02T09:28:48.956018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 215
2025-10-02T09:28:48.956022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 88
2025-10-02T09:28:48.923044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923047Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 216
2025-10-02T09:28:48.923070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-10-02T09:28:48.957994Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 914836, now ReadSizeBudget = 0, ReadSizeServerDelta = -390548
2025-10-02T09:28:48.923074Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 131 count 43 size 222020 endOffset 167 max time lag 0ms effective offset 131
2025-10-02T09:28:48.923076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923081Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 591672 count 36 last offset 131, current partition end offset: 167
2025-10-02T09:28:48.923083Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-02T09:28:48.923089Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 131 partno 0 count 36 parts_count 0 source 1 size 591672 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.923097Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-02T09:28:48.923100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923102Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.958754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923131Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 131 partno 0 count 36 parts 0 suffix '63'
2025-10-02T09:28:48.923206Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.958763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 89
2025-10-02T09:28:48.923220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923493Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.923648Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 131 totakecount 36 count 32 size 518789 from pos 0 cbcount 32
2025-10-02T09:28:48.958785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923688Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 163 totakecount 36 count 4 size 72837 from pos 0 cbcount 4
2025-10-02T09:28:48.958807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 90
2025-10-02T09:28:48.923706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 427 size 23295 offset: -1
2025-10-02T09:28:48.923719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 428 size 23405 offset: -1
2025-10-02T09:28:48.958831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.958838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 91
2025-10-02T09:28:48.923725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 429 size 23515 offset: -1
2025-10-02T09:28:48.923733Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 430 size 23625 offset: -1
2025-10-02T09:28:48.923741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.958853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.958875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 92
2025-10-02T09:28:48.923746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 431 size 23735 offset: -1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-10-02T09:28:48.909000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-10-02T09:28:48.910000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-02T09:28:48.958889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.958898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 93
2025-10-02T09:28:48.958912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.958920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 94
2025-10-02T09:28:48.923748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.958935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923753Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.958937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 95
2025-10-02T09:28:48.923755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.958951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 131
2025-10-02T09:28:48.958954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 96
2025-10-02T09:28:48.923792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.958968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.958972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 97
2025-10-02T09:28:48.923805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923837Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.923852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 217
2025-10-02T09:28:48.958987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 218
2025-10-02T09:28:48.958990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 98
2025-10-02T09:28:48.923856Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 219
2025-10-02T09:28:48.923858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 220
2025-10-02T09:28:48.923860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 221
2025-10-02T09:28:48.923868Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.959003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.959008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 99
2025-10-02T09:28:48.923874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.923905Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923911Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.959024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.959029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 100
2025-10-02T09:28:48.923917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.923926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959039Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 33, size 533973 bytes
2025-10-02T09:28:48.923932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 437 size 23845 offset: -1
2025-10-02T09:28:48.923935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 438 size 23955 offset: -1
2025-10-02T09:28:48.959054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 101 offsets: 100 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.923941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 101
2025-10-02T09:28:48.923942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 439 size 24065 offset: -1
2025-10-02T09:28:48.923947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 102 offsets: 101 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 102
2025-10-02T09:28:48.923951Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 440 size 24175 offset: -1
2025-10-02T09:28:48.923953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923954Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959080Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (164-166)
2025-10-02T09:28:48.923957Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 441 size 24285 offset: -1
2025-10-02T09:28:48.959092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 103 offsets: 102 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923959Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 103
2025-10-02T09:28:48.923960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959093Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.923964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.923966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 104 offsets: 103 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.959114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 104
2025-10-02T09:28:48.923970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959120Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 27} (164-164)
2025-10-02T09:28:48.923973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 105 offsets: 104 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.959132Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 28} (165-165)
2025-10-02T09:28:48.959135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 105
2025-10-02T09:28:48.959133Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (167-193)
2025-10-02T09:28:48.959159Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 914836 to budget
2025-10-02T09:28:48.959160Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 29} (166-166)
2025-10-02T09:28:48.923977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.923980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.959171Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 914836, ReadSizeServerDelta = -390548
2025-10-02T09:28:48.923983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.923986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923987Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.959160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 106 offsets: 105 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.923988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
>>> event from dataHandler: 2025-10-02T09:28:48.959209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 106
2025-10-02T09:28:48.923991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.923995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 222
2025-10-02T09:28:48.923997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 223
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-10-02T09:28:48.911000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-02T09:28:48.924000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 224
2025-10-02T09:28:48.959248Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.924002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 225
2025-10-02T09:28:48.924004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 226
2025-10-02T09:28:48.959268Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (167-167)
2025-10-02T09:28:48.959275Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 3, size 54483 bytes
2025-10-02T09:28:48.959284Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.959285Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (168-168)
2025-10-02T09:28:48.924007Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 167 Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1759397328916 CreateTimestampMS: 1759397328909 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328909 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328910 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328911 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1759397328917 CreateTimestampMS: 1759397328912 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550674 RealReadOffset: 166 WaitQuotaTimeMs: 0 EndOffset: 167 StartOffset: 0 } Cookie: 131 }
2025-10-02T09:28:48.924007Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.924013Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.959300Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (169-169)
2025-10-02T09:28:48.924015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.959327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 107 offsets: 106 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.924067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.959331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 107
2025-10-02T09:28:48.924070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.959336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (170-170)
2025-10-02T09:28:48.924073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924087Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.924102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959356Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (171-171)
2025-10-02T09:28:48.924104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 447 size 24395 offset: -1
2025-10-02T09:28:48.924110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959363Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (172-172)
2025-10-02T09:28:48.924111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 448 size 24505 offset: -1
2025-10-02T09:28:48.924115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959373Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (173-173)
2025-10-02T09:28:48.924116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 449 size 24615 offset: -1
2025-10-02T09:28:48.924121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 108 offsets: 107 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-02T09:28:48.959404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 108
2025-10-02T09:28:48.924123Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959388Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (174-174)
2025-10-02T09:28:48.924127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 450 size 24725 offset: -1
2025-10-02T09:28:48.924130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 451 size 24835 offset: -1
2025-10-02T09:28:48.924136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 109 offsets: 108 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 109
2025-10-02T09:28:48.924141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 110 offsets: 109 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 110
2025-10-02T09:28:48.959448Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (175-175)
2025-10-02T09:28:48.924155Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962271Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (176-176)
2025-10-02T09:28:48.924157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962282Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (177-177)
2025-10-02T09:28:48.924161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962290Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (178-178)
2025-10-02T09:28:48.924163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.961809Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 879837, now ReadSizeBudget = 0, ReadSizeServerDelta = -355549
2025-10-02T09:28:48.962304Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (179-179)
2025-10-02T09:28:48.924164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 111 offsets: 110 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962313Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (180-180)
2025-10-02T09:28:48.962314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 111
2025-10-02T09:28:48.924164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924166Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962326Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (181-181)
2025-10-02T09:28:48.962328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 112 offsets: 111 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 112
2025-10-02T09:28:48.924167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 227
2025-10-02T09:28:48.924174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 228
2025-10-02T09:28:48.962342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 113 offsets: 112 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 229
2025-10-02T09:28:48.962352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 113
2025-10-02T09:28:48.962352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (182-182)
2025-10-02T09:28:48.924177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 230
2025-10-02T09:28:48.924178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 231
2025-10-02T09:28:48.962371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 114 offsets: 113 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924181Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 114
2025-10-02T09:28:48.924183Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 115 offsets: 114 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 115
2025-10-02T09:28:48.924202Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.924205Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924207Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 167
2025-10-02T09:28:48.924210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 116 offsets: 115 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 116
2025-10-02T09:28:48.924215Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 167 ReadOffset 167 ReadGuid 85e2feb6-799da8fa-e335a964-d83d620a has messages 1
2025-10-02T09:28:48.924216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924231Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 117 offsets: 116 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 117
2025-10-02T09:28:48.924245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 457 size 24945 offset: -1
2025-10-02T09:28:48.924249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 458 size 25055 offset: -1
2025-10-02T09:28:48.924256Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924257Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 118 offsets: 117 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 459 size 25165 offset: -1
2025-10-02T09:28:48.962449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 118
2025-10-02T09:28:48.924262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 460 size 25275 offset: -1
2025-10-02T09:28:48.924266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924267Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 461 size 25385 offset: -1
2025-10-02T09:28:48.924272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924273Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 119 offsets: 118 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 119
2025-10-02T09:28:48.924275Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962475Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (183-183)
2025-10-02T09:28:48.962483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 120 offsets: 119 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 120
2025-10-02T09:28:48.924277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962490Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (184-184)
2025-10-02T09:28:48.924280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (185-185)
2025-10-02T09:28:48.924281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962508Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (186-186)
2025-10-02T09:28:48.924283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 121 offsets: 120 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.924285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 121
2025-10-02T09:28:48.924287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (187-187)
2025-10-02T09:28:48.924288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924290Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962525Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (188-188)
2025-10-02T09:28:48.962525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 122 offsets: 121 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 122
2025-10-02T09:28:48.924293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 123 offsets: 122 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.924297Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 123
2025-10-02T09:28:48.924298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 124 offsets: 123 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.924301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962540Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (189-189)
2025-10-02T09:28:48.962585Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (190-190)
2025-10-02T09:28:48.962572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 124
2025-10-02T09:28:48.962592Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (191-191)
2025-10-02T09:28:48.924302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 232
2025-10-02T09:28:48.962599Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (192-192)
2025-10-02T09:28:48.962603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 125 offsets: 124 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 125
2025-10-02T09:28:48.924308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 233
2025-10-02T09:28:48.924310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 234
2025-10-02T09:28:48.924312Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 235
2025-10-02T09:28:48.924313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 236
2025-10-02T09:28:48.962616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 126 offsets: 125 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 126
2025-10-02T09:28:48.962619Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (193-193)
2025-10-02T09:28:48.962630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 127 offsets: 126 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 127
2025-10-02T09:28:48.924326Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 85e2feb6-799da8fa-e335a964-d83d620a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 590094
2025-10-02T09:28:48.924333Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 85e2feb6-799da8fa-e335a964-d83d620a
2025-10-02T09:28:48.924480Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.962641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 128 offsets: 127 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 128
2025-10-02T09:28:48.924485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 129 offsets: 128 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.924507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 129
2025-10-02T09:28:48.924559Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.924562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 130 offsets: 129 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.924571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 130
2025-10-02T09:28:48.924575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924637Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 131 offsets: 130 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.962688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 131
2025-10-02T09:28:48.924643Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 467 size 25495 offset: -1
2025-10-02T09:28:48.924647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 132 offsets: 131 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 468 size 25605 offset: -1
2025-10-02T09:28:48.924652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 132
2025-10-02T09:28:48.924653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 469 size 25715 offset: -1
2025-10-02T09:28:48.924658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 470 size 25825 offset: -1
2025-10-02T09:28:48.962720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 133 offsets: 132 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 133
2025-10-02T09:28:48.924663Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 471 size 25935 offset: -1
2025-10-02T09:28:48.962734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 134 offsets: 133 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 134
2025-10-02T09:28:48.924675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 135 offsets: 134 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 135
2025-10-02T09:28:48.924682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 136 offsets: 135 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 136
2025-10-02T09:28:48.924694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 137 offsets: 136 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924707Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 137
2025-10-02T09:28:48.924709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924711Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.924715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 138 offsets: 137 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.924720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 138
2025-10-02T09:28:48.924736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 237
2025-10-02T09:28:48.924739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 238
2025-10-02T09:28:48.962811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 139 offsets: 138 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 139
2025-10-02T09:28:48.924741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 239
2025-10-02T09:28:48.924744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 240
2025-10-02T09:28:48.924746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 241
2025-10-02T09:28:48.924862Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.962823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 140 offsets: 139 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 140
2025-10-02T09:28:48.924867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924871Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924873Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.924875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 141 offsets: 140 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.962842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 141
2025-10-02T09:28:48.924906Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.924926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924930Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924933Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 142 offsets: 141 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 142
2025-10-02T09:28:48.924937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.924941Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.962865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 143 offsets: 142 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 143
2025-10-02T09:28:48.924952Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 477 size 26045 offset: -1
2025-10-02T09:28:48.924957Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 478 size 26155 offset: -1
2025-10-02T09:28:48.924963Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 144 offsets: 143 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 144
2025-10-02T09:28:48.924964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 479 size 26265 offset: -1
2025-10-02T09:28:48.962895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 145 offsets: 144 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924967Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.962897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 145
2025-10-02T09:28:48.924969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 480 size 26375 offset: -1
2025-10-02T09:28:48.924975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 481 size 26485 offset: -1
2025-10-02T09:28:48.962906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 146 offsets: 145 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.924981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.962915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 146
2025-10-02T09:28:48.924982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.924988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 147 offsets: 146 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 147
2025-10-02T09:28:48.924993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.924994Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.962940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 148 offsets: 147 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 148
2025-10-02T09:28:48.925000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925003Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.962954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 149 offsets: 148 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 149
2025-10-02T09:28:48.925009Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.962973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 150 offsets: 149 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 242
2025-10-02T09:28:48.962977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 150
2025-10-02T09:28:48.925034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 243
2025-10-02T09:28:48.925037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 244
2025-10-02T09:28:48.925039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 245
2025-10-02T09:28:48.962993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 151 offsets: 150 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.962996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 151
2025-10-02T09:28:48.925040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 246
2025-10-02T09:28:48.925046Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925054Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.963006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 152 offsets: 151 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925061Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.963008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 152
2025-10-02T09:28:48.925080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 487 size 26595 offset: -1
2025-10-02T09:28:48.925106Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.963028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 153 offsets: 152 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.963031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 153
2025-10-02T09:28:48.925108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 488 size 26705 offset: -1
2025-10-02T09:28:48.925115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925176Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925179Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925183Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 489 size 26815 offset: -1
2025-10-02T09:28:48.925195Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925196Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925200Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 490 size 26925 offset: -1
2025-10-02T09:28:48.925203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 491 size 27035 offset: -1
2025-10-02T09:28:48.925212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.963079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 154 offsets: 153 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.963083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 154
2025-10-02T09:28:48.925216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.925218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.925221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.963098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 155 offsets: 154 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.963099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 155
2025-10-02T09:28:48.925241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925242Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.963114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 156 offsets: 155 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.963117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 156
2025-10-02T09:28:48.925266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 247
2025-10-02T09:28:48.925268Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925271Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 248
2025-10-02T09:28:48.963129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 157 offsets: 156 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 249
2025-10-02T09:28:48.963131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 157
2025-10-02T09:28:48.925276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 250
2025-10-02T09:28:48.925279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 251
2025-10-02T09:28:48.925307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.963151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 158 offsets: 157 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.963154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 158
2025-10-02T09:28:48.963169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 159 offsets: 158 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.963170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 159
2025-10-02T09:28:48.925309Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925312Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.925317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925327Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 167 count 44 size 916756 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.925330Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.963189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 160 offsets: 159 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
>>> event from dataHandler: 2025-10-02T09:28:48.963191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 160
2025-10-02T09:28:48.925334Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925336Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.925339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 497 size 27145 offset: -1
2025-10-02T09:28:48.963217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 161 offsets: 160 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925339Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 167 partno 0 count 44 parts 0 suffix '63' size 916756
2025-10-02T09:28:48.925342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.963219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 161
2025-10-02T09:28:48.925343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 498 size 27255 offset: -1
2025-10-02T09:28:48.925348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 499 size 27365 offset: -1
2025-10-02T09:28:48.925355Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.963242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 162 offsets: 161 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 162
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-10-02T09:28:48.912000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.920000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-10-02T09:28:48.913000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.925357Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925359Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 500 size 27475 offset: -1
2025-10-02T09:28:48.925361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 501 size 27585 offset: -1
2025-10-02T09:28:48.925367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.925368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.925372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.925381Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 916388 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.925386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925390Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-10-02T09:28:48.925392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925393Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-10-02T09:28:48.925394Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-10-02T09:28:48.925398Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-10-02T09:28:48.965487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 163 offsets: 162 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 163
2025-10-02T09:28:48.925403Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-10-02T09:28:48.925407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925410Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-10-02T09:28:48.925411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925414Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925416Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-10-02T09:28:48.925418Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 164 offsets: 163 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 164
2025-10-02T09:28:48.925421Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-10-02T09:28:48.925423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-10-02T09:28:48.925428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-10-02T09:28:48.925435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925438Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-10-02T09:28:48.965526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 165 offsets: 164 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-10-02T09:28:48.965528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 165
2025-10-02T09:28:48.925445Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925448Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-10-02T09:28:48.925450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925452Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-10-02T09:28:48.925454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-10-02T09:28:48.925459Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-10-02T09:28:48.965551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 166 offsets: 165 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 166
2025-10-02T09:28:48.925468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-10-02T09:28:48.925470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-10-02T09:28:48.925474Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-10-02T09:28:48.965565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 167 offsets: 166 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 167
2025-10-02T09:28:48.925481Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925486Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-10-02T09:28:48.925488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-10-02T09:28:48.965584Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 27, size 534897 bytes
2025-10-02T09:28:48.925495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-10-02T09:28:48.925500Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 168 offsets: 167 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-10-02T09:28:48.965602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 168
2025-10-02T09:28:48.925505Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-10-02T09:28:48.925512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925515Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-10-02T09:28:48.925517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925520Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-10-02T09:28:48.925522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-10-02T09:28:48.925527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 169 offsets: 168 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.965632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 169
2025-10-02T09:28:48.925531Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-10-02T09:28:48.965633Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (194-210)
2025-10-02T09:28:48.925533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965647Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.925547Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-10-02T09:28:48.925549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-10-02T09:28:48.965644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 170 offsets: 169 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925554Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 170
2025-10-02T09:28:48.925557Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-10-02T09:28:48.925560Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925563Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-10-02T09:28:48.965662Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (194-194)
2025-10-02T09:28:48.925564Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-10-02T09:28:48.965671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 171 offsets: 170 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965671Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (195-195)
2025-10-02T09:28:48.925572Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-10-02T09:28:48.925574Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-10-02T09:28:48.965675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 171
2025-10-02T09:28:48.965685Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (196-196)
2025-10-02T09:28:48.925580Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925583Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-10-02T09:28:48.965690Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (197-197)
2025-10-02T09:28:48.965698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 172 offsets: 171 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925585Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.965700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 172
2025-10-02T09:28:48.925585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925588Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-10-02T09:28:48.925590Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-10-02T09:28:48.925595Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-10-02T09:28:48.965713Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (198-198)
2025-10-02T09:28:48.925601Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925603Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-10-02T09:28:48.965717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 173 offsets: 172 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 173
2025-10-02T09:28:48.925606Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-10-02T09:28:48.925607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.965722Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (199-199)
2025-10-02T09:28:48.925609Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-10-02T09:28:48.925611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925613Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-10-02T09:28:48.965729Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (200-200)
2025-10-02T09:28:48.925614Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.925618Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-10-02T09:28:48.965731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 174 offsets: 173 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.965733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 174
2025-10-02T09:28:48.965735Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 22} (201-201)
2025-10-02T09:28:48.925653Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 167 EndOffset 167 newEndOffset 211 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-02T09:28:48.925655Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 167 endOffset 211
2025-10-02T09:28:48.925656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.925657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (35)
2025-10-02T09:28:48.925661Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 167, endOffset# 211, WTime# 1759397328917, sizeLag# 916756
2025-10-02T09:28:48.925662Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:48.965746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 175 offsets: 174 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.925665Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.965750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 175
2025-10-02T09:28:48.925669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-10-02T09:28:48.925701Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 23369 count 1 nextOffset 212 batches 1
2025-10-02T09:28:48.925706Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-10-02T09:28:48.925709Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 46816 count 2 nextOffset 213 batches 1
2025-10-02T09:28:48.925711Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-10-02T09:28:48.925713Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.965763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 176 offsets: 175 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 176
2025-10-02T09:28:48.965769Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 23} (202-202)
2025-10-02T09:28:48.925714Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 70373 count 3 nextOffset 214 batches 1
2025-10-02T09:28:48.925715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-10-02T09:28:48.925719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 94040 count 4 nextOffset 215 batches 1
2025-10-02T09:28:48.965780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 177 offsets: 176 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925721Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-10-02T09:28:48.965782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 177
2025-10-02T09:28:48.925723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 117817 count 5 nextOffset 216 batches 1
2025-10-02T09:28:48.925725Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-10-02T09:28:48.925729Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 141704 count 6 nextOffset 217 batches 1
2025-10-02T09:28:48.965788Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 24} (203-203)
2025-10-02T09:28:48.925730Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-10-02T09:28:48.925732Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 165701 count 7 nextOffset 218 batches 1
2025-10-02T09:28:48.965794Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 25} (204-204)
2025-10-02T09:28:48.925736Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-10-02T09:28:48.965799Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 26} (205-205)
2025-10-02T09:28:48.925738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 189808 count 8 nextOffset 219 batches 1
2025-10-02T09:28:48.925740Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-10-02T09:28:48.965795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 178 offsets: 177 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965806Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 27} (206-206)
2025-10-02T09:28:48.925743Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 214025 count 9 nextOffset 220 batches 1
2025-10-02T09:28:48.925745Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-10-02T09:28:48.925747Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 238352 count 10 nextOffset 221 batches 1
2025-10-02T09:28:48.965807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 178
2025-10-02T09:28:48.925749Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-10-02T09:28:48.925752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 262789 count 11 nextOffset 222 batches 1
2025-10-02T09:28:48.925754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-10-02T09:28:48.925756Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 287336 count 12 nextOffset 223 batches 1
2025-10-02T09:28:48.965822Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 28} (207-207)
2025-10-02T09:28:48.925758Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-10-02T09:28:48.965828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 179 offsets: 178 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 179
2025-10-02T09:28:48.925760Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 311993 count 13 nextOffset 224 batches 1
2025-10-02T09:28:48.925762Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-10-02T09:28:48.965834Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 29} (208-208)
2025-10-02T09:28:48.925764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 336760 count 14 nextOffset 225 batches 1
2025-10-02T09:28:48.925766Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-10-02T09:28:48.925768Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 361637 count 15 nextOffset 226 batches 1
2025-10-02T09:28:48.965842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 180 offsets: 179 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925769Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-10-02T09:28:48.965844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 180
2025-10-02T09:28:48.925770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.965846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 30} (209-209)
2025-10-02T09:28:48.925771Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 386624 count 16 nextOffset 227 batches 1
2025-10-02T09:28:48.925773Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-10-02T09:28:48.925775Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 411721 count 17 nextOffset 228 batches 1
2025-10-02T09:28:48.925776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
2025-10-02T09:28:48.965855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 181 offsets: 180 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.925778Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 436928 count 18 nextOffset 229 batches 1
2025-10-02T09:28:48.925780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-10-02T09:28:48.925782Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 462245 count 19 nextOffset 230 batches 1
2025-10-02T09:28:48.965856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 181
2025-10-02T09:28:48.925783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-10-02T09:28:48.925785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 487672 count 20 nextOffset 231 batches 1
2025-10-02T09:28:48.925787Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-10-02T09:28:48.925825Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925859Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925888Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925916Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925941Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925968Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.925994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926049Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.965883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 182 offsets: 181 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.965888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 182
2025-10-02T09:28:48.926079Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926108Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926138Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 512622 count 21 nextOffset 232 batches 1
2025-10-02T09:28:48.926156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-10-02T09:28:48.926167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 538301 count 22 nextOffset 233 batches 2
2025-10-02T09:28:48.926168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-10-02T09:28:48.965903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 183 offsets: 182 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.926171Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 564058 count 23 nextOffset 234 batches 2
2025-10-02T09:28:48.965905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 183
2025-10-02T09:28:48.926173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-10-02T09:28:48.926177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 589925 count 24 nextOffset 235 batches 2
2025-10-02T09:28:48.926179Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-10-02T09:28:48.926183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 615902 count 25 nextOffset 236 batches 2
2025-10-02T09:28:48.926185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-10-02T09:28:48.965919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 184 offsets: 183 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.926190Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 641989 count 26 nextOffset 237 batches 2
2025-10-02T09:28:48.926193Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926194Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-10-02T09:28:48.926198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 668186 count 27 nextOffset 238 batches 2
2025-10-02T09:28:48.968456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 184
2025-10-02T09:28:48.965948Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 31} (210-210)
2025-10-02T09:28:48.926201Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-10-02T09:28:48.926203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 694493 count 28 nextOffset 239 batches 2
2025-10-02T09:28:48.926205Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-10-02T09:28:48.926207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 720910 count 29 nextOffset 240 batches 2
2025-10-02T09:28:48.926210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-10-02T09:28:48.926214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 747437 count 30 nextOffset 241 batches 2
2025-10-02T09:28:48.926215Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-10-02T09:28:48.926218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 774074 count 31 nextOffset 242 batches 2
2025-10-02T09:28:48.926220Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-10-02T09:28:48.926222Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 800821 count 32 nextOffset 243 batches 2
2025-10-02T09:28:48.926222Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926224Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-10-02T09:28:48.926226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 827678 count 33 nextOffset 244 batches 2
2025-10-02T09:28:48.926228Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-10-02T09:28:48.926232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 854645 count 34 nextOffset 245 batches 2
2025-10-02T09:28:48.926234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-10-02T09:28:48.926236Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 881722 count 35 nextOffset 246 batches 2
2025-10-02T09:28:48.926238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.926286Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926340Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926382Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.968518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 185 offsets: 184 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.968523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 185
2025-10-02T09:28:48.926494Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926590Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926640Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.926681Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 211,35 HeadOffset 211 endOffset 211 curOffset 246 d0000000000_00000000000000000211_00000_0000000035_00000? size 881352 WTime 1759397328926
2025-10-02T09:28:48.926721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.968539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 186 offsets: 185 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927237Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.927238Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.927240Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.968541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 186
2025-10-02T09:28:48.927242Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.927244Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.927245Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.927246Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.927247Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.927248Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000131_00000_0000000036_00000?
2025-10-02T09:28:48.968567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 187 offsets: 186 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927249Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000167_00000_0000000044_00000?
2025-10-02T09:28:48.927251Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 10 keys were taken away. Let's read 2457968 bytes (2457968)
2025-10-02T09:28:48.927255Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 10, size 2457968 (8388608)
2025-10-02T09:28:48.927262Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.968570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 187
2025-10-02T09:28:48.927268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927273Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927283Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.968594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 188 offsets: 187 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927294Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.968606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 188
2025-10-02T09:28:48.927296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927297Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.968620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 189 offsets: 188 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.968622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 189
2025-10-02T09:28:48.927312Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 168
2025-10-02T09:28:48.927326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 169
2025-10-02T09:28:48.927329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 170
2025-10-02T09:28:48.927333Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 171
2025-10-02T09:28:48.927335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 172
2025-10-02T09:28:48.927339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 173
2025-10-02T09:28:48.927341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 174
2025-10-02T09:28:48.927343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 190 offsets: 189 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 190
2025-10-02T09:28:48.927347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 175
2025-10-02T09:28:48.927349Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 176
2025-10-02T09:28:48.927353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 177
2025-10-02T09:28:48.927356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927357Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 178
2025-10-02T09:28:48.968667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 191 offsets: 190 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 179
2025-10-02T09:28:48.968673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 191
2025-10-02T09:28:48.927361Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 180
2025-10-02T09:28:48.927367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 181
2025-10-02T09:28:48.927370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 182
2025-10-02T09:28:48.927374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 183
2025-10-02T09:28:48.927377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 184
2025-10-02T09:28:48.968687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 192 offsets: 191 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 185
2025-10-02T09:28:48.968691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 192
2025-10-02T09:28:48.927384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 186
2025-10-02T09:28:48.927389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 187
2025-10-02T09:28:48.927392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 188
2025-10-02T09:28:48.927396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 189
2025-10-02T09:28:48.927399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 190
2025-10-02T09:28:48.927404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 191
2025-10-02T09:28:48.927407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 192
2025-10-02T09:28:48.927411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 193
2025-10-02T09:28:48.927414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 194
2025-10-02T09:28:48.927419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 195
2025-10-02T09:28:48.927423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 196
2025-10-02T09:28:48.927426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 193 offsets: 192 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.968726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 193
2025-10-02T09:28:48.927426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 197
2025-10-02T09:28:48.927429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 198
2025-10-02T09:28:48.927432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 199
2025-10-02T09:28:48.927435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 200
2025-10-02T09:28:48.927438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 201
2025-10-02T09:28:48.927442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 202
2025-10-02T09:28:48.927443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 203
2025-10-02T09:28:48.927446Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 194 offsets: 193 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 204
2025-10-02T09:28:48.968749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 194
2025-10-02T09:28:48.927452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 205
2025-10-02T09:28:48.927455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 206
2025-10-02T09:28:48.927457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 207
2025-10-02T09:28:48.927462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 208
2025-10-02T09:28:48.968769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 195 offsets: 194 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 195
2025-10-02T09:28:48.927469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 209
2025-10-02T09:28:48.927469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 210
2025-10-02T09:28:48.927474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 196 offsets: 195 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 211
2025-10-02T09:28:48.968799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 196
2025-10-02T09:28:48.927479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927483Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.927484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927492Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 211 partNo 0 count 35 size 881352
2025-10-02T09:28:48.968822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 197 offsets: 196 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.968828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 197
2025-10-02T09:28:48.927496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 252
2025-10-02T09:28:48.927512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 198 offsets: 197 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 253
2025-10-02T09:28:48.968844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 198
2025-10-02T09:28:48.927524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 254
2025-10-02T09:28:48.927526Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 255
2025-10-02T09:28:48.927528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 256
2025-10-02T09:28:48.927533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927535Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 199 offsets: 198 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 199
2025-10-02T09:28:48.927543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-10-02T09:28:48.927554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927557Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927563Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927566Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 200 offsets: 199 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 200
2025-10-02T09:28:48.927571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 201 offsets: 200 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.968899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 201
2025-10-02T09:28:48.927605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 507 size 27695 offset: -1
2025-10-02T09:28:48.927710Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.968912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 202 offsets: 201 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.968917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 202
2025-10-02T09:28:48.927714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 508 size 27805 offset: -1
2025-10-02T09:28:48.927718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 509 size 27915 offset: -1
2025-10-02T09:28:48.927727Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.968930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 203 offsets: 202 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.968932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 203
2025-10-02T09:28:48.927740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 510 size 28025 offset: -1
2025-10-02T09:28:48.927743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 511 size 28135 offset: -1
2025-10-02T09:28:48.927748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927750Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.927753Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.968951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 204 offsets: 203 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.968958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 204
2025-10-02T09:28:48.927755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.927757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-10-02T09:28:48.914000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.921000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.968982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 205 offsets: 204 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927765Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927771Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.968986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 205
2025-10-02T09:28:48.927774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.969015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 206 offsets: 205 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.927828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 257
2025-10-02T09:28:48.969017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 206
2025-10-02T09:28:48.927831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 258
2025-10-02T09:28:48.927833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 259
2025-10-02T09:28:48.927835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 260
2025-10-02T09:28:48.927837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 261
2025-10-02T09:28:48.927856Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.927872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.969031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 207 offsets: 206 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.969037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 207
2025-10-02T09:28:48.927883Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927889Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927894Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927898Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.927953Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927962Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.969050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 208 offsets: 207 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.927965Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.969052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 208
2025-10-02T09:28:48.927971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.927972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 517 size 28245 offset: -1
2025-10-02T09:28:48.927975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927976Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.927976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.969062Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 17, size 377927 bytes
2025-10-02T09:28:48.969065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 209 offsets: 208 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.969069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 209
2025-10-02T09:28:48.969083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 210 offsets: 209 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.969085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 210
2025-10-02T09:28:48.969085Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.969098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 211 offsets: 210 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-02T09:28:48.969099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 211
2025-10-02T09:28:48.969107Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (211-232)
2025-10-02T09:28:48.927978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 518 size 28355 offset: -1
2025-10-02T09:28:48.927981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.969112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 212 offsets: 211 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.927983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.969127Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 879837 to budget
2025-10-02T09:28:48.927985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 519 size 28465 offset: -1
2025-10-02T09:28:48.969137Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 879837, ReadSizeServerDelta = -355549
2025-10-02T09:28:48.927985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.969128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 212
2025-10-02T09:28:48.927987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 520 size 28575 offset: -1
2025-10-02T09:28:48.927993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.927993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.927995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 521 size 28685 offset: -1
2025-10-02T09:28:48.927999Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.969158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 213 offsets: 212 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.928004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.969232Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.971884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 213
2025-10-02T09:28:48.928008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928010Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928013Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.971926Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (211-211)
2025-10-02T09:28:48.928037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928042Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.971940Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (212-212)
2025-10-02T09:28:48.971947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 214 offsets: 213 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.971953Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (213-213)
2025-10-02T09:28:48.971956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 214
2025-10-02T09:28:48.928047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 262
2025-10-02T09:28:48.971960Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (214-214)
2025-10-02T09:28:48.928055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 263
2025-10-02T09:28:48.928057Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 264
2025-10-02T09:28:48.928058Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 265
2025-10-02T09:28:48.928060Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 266
2025-10-02T09:28:48.928063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.971986Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (215-215)
2025-10-02T09:28:48.928074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.971994Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (216-216)
2025-10-02T09:28:48.928103Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.972002Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (217-217)
2025-10-02T09:28:48.928116Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972010Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (218-218)
2025-10-02T09:28:48.928121Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 527 size 28795 offset: -1
2025-10-02T09:28:48.928146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 528 size 28905 offset: -1
2025-10-02T09:28:48.928154Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972048Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (219-219)
2025-10-02T09:28:48.928156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 529 size 29015 offset: -1
2025-10-02T09:28:48.928162Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972054Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (220-220)
2025-10-02T09:28:48.928163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 530 size 29125 offset: -1
2025-10-02T09:28:48.928170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972082Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (221-221)
2025-10-02T09:28:48.928174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 531 size 29235 offset: -1
2025-10-02T09:28:48.928177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (222-222)
2025-10-02T09:28:48.928181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (223-223)
2025-10-02T09:28:48.928201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (224-224)
2025-10-02T09:28:48.928205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972108Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (225-225)
2025-10-02T09:28:48.928213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972127Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (226-226)
2025-10-02T09:28:48.928216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928217Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 267
2025-10-02T09:28:48.928264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 268
2025-10-02T09:28:48.928265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928267Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 269
2025-10-02T09:28:48.928269Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 270
2025-10-02T09:28:48.928272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 271
2025-10-02T09:28:48.928281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928302Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 537 size 29345 offset: -1
2025-10-02T09:28:48.928304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928309Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 538 size 29455 offset: -1
2025-10-02T09:28:48.928315Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928321Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 539 size 29565 offset: -1
2025-10-02T09:28:48.928327Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928334Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972209Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (227-227)
2025-10-02T09:28:48.972221Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (228-228)
2025-10-02T09:28:48.972227Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (229-229)
2025-10-02T09:28:48.928338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 540 size 29675 offset: -1
2025-10-02T09:28:48.972232Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (230-230)
2025-10-02T09:28:48.928341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972242Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (231-231)
2025-10-02T09:28:48.928342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 542 size 29785 offset: -1
2025-10-02T09:28:48.972251Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (232-232)
2025-10-02T09:28:48.928356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928379Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928393Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928395Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 272
2025-10-02T09:28:48.928409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 273
2025-10-02T09:28:48.928410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 274
2025-10-02T09:28:48.928414Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 275
2025-10-02T09:28:48.928416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 276
2025-10-02T09:28:48.928425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928427Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928430Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 547 size 29895 offset: -1
2025-10-02T09:28:48.928463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928466Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 548 size 30005 offset: -1
2025-10-02T09:28:48.928469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 549 size 30115 offset: -1
2025-10-02T09:28:48.928473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928478Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928481Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928486Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 550 size 30225 offset: -1
2025-10-02T09:28:48.928496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 215 offsets: 214 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.928498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 215
2025-10-02T09:28:48.928502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 552 size 30335 offset: -1
2025-10-02T09:28:48.928514Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928516Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928518Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928529Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928539Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.972420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 216 offsets: 215 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.928541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.972423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 216
2025-10-02T09:28:48.928547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 277
2025-10-02T09:28:48.928551Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 278
2025-10-02T09:28:48.928553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 279
2025-10-02T09:28:48.928556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 280
2025-10-02T09:28:48.928558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 281
2025-10-02T09:28:48.928577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928582Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928599Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.972447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 217 offsets: 216 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.972453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 217
2025-10-02T09:28:48.928603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928620Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928622Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928623Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 557 size 30445 offset: -1
2025-10-02T09:28:48.972468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 218 offsets: 217 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928633Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 218
2025-10-02T09:28:48.928637Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 558 size 30555 offset: -1
2025-10-02T09:28:48.928641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 559 size 30665 offset: -1
2025-10-02T09:28:48.928650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928651Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 560 size 30775 offset: -1
2025-10-02T09:28:48.928660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 219 offsets: 218 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 561 size 30885 offset: -1
2025-10-02T09:28:48.928668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 219
2025-10-02T09:28:48.928674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 220 offsets: 219 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.972519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 220
2025-10-02T09:28:48.928687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928688Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928692Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 221 offsets: 220 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.972534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 221
2025-10-02T09:28:48.928696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
>>> event from dataHandler: 2025-10-02T09:28:48.972554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 222 offsets: 221 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.972559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 222
2025-10-02T09:28:48.928699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928701Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928704Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928707Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.972572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 223 offsets: 222 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.972574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 223
2025-10-02T09:28:48.928716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 282
2025-10-02T09:28:48.928719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 283
2025-10-02T09:28:48.928719Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 284
2025-10-02T09:28:48.928722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 285
2025-10-02T09:28:48.928725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 286
2025-10-02T09:28:48.928738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928745Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928769Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928772Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928819Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 567 size 30995 offset: -1
2025-10-02T09:28:48.928855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928861Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 568 size 31105 offset: -1
2025-10-02T09:28:48.928866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.972628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 224 offsets: 223 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 569 size 31215 offset: -1
2025-10-02T09:28:48.928874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.972643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 224
2025-10-02T09:28:48.928875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 570 size 31325 offset: -1
2025-10-02T09:28:48.928883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928885Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.928887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 571 size 31435 offset: -1
2025-10-02T09:28:48.928892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928904Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928908Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-10-02T09:28:48.915000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.928924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.972693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 225 offsets: 224 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.972828Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 1490552, now ReadSizeBudget = 0, ReadSizeServerDelta = -966264
2025-10-02T09:28:48.975047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 225
2025-10-02T09:28:48.928929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928931Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.928934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.928941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 287
2025-10-02T09:28:48.928944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 288
2025-10-02T09:28:48.928947Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 289
2025-10-02T09:28:48.928950Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 290
2025-10-02T09:28:48.928951Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 291
2025-10-02T09:28:48.928954Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.975084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 226 offsets: 225 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.975087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 226
2025-10-02T09:28:48.928965Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.928966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 577 size 31545 offset: -1
2025-10-02T09:28:48.975102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 227 offsets: 226 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.975104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 227
2025-10-02T09:28:48.928977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928981Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 578 size 31655 offset: -1
2025-10-02T09:28:48.928985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.928987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.928990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.928991Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 579 size 31765 offset: -1
2025-10-02T09:28:48.975118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 228 offsets: 227 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.928995Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.975132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 228
2025-10-02T09:28:48.928997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 229 offsets: 228 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 229
2025-10-02T09:28:48.929006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 580 size 31875 offset: -1
2025-10-02T09:28:48.929009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975175Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 22, size 536272 bytes
2025-10-02T09:28:48.929016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 581 size 31985 offset: -1
2025-10-02T09:28:48.929018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929033Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929043Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 230 offsets: 229 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 230
2025-10-02T09:28:48.929047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975218Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (233-245)
2025-10-02T09:28:48.929049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929051Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.975239Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.929058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 292
2025-10-02T09:28:48.929075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 293
2025-10-02T09:28:48.929077Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 294
2025-10-02T09:28:48.929080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 295
2025-10-02T09:28:48.929082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 296
2025-10-02T09:28:48.929085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.975257Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (233-233)
2025-10-02T09:28:48.975258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 231 offsets: 230 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 231
2025-10-02T09:28:48.929093Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.929112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.929115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.975275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (234-234)
2025-10-02T09:28:48.929118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.929126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 232 offsets: 231 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 232
2025-10-02T09:28:48.929128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975292Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (235-235)
2025-10-02T09:28:48.929135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 587 size 32095 offset: -1
2025-10-02T09:28:48.929139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (236-236)
2025-10-02T09:28:48.929144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 588 size 32205 offset: -1
2025-10-02T09:28:48.929146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 233 offsets: 232 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 589 size 32315 offset: -1
2025-10-02T09:28:48.929154Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 233
2025-10-02T09:28:48.929155Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 590 size 32425 offset: -1
2025-10-02T09:28:48.929159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 591 size 32535 offset: -1
2025-10-02T09:28:48.929179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.975331Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (237-237)
2025-10-02T09:28:48.929186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.975329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 234 offsets: 233 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 234
2025-10-02T09:28:48.929188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.929189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.929193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.975356Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (238-238)
2025-10-02T09:28:48.929200Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929202Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.975366Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (239-239)
2025-10-02T09:28:48.929204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929205Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.929208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.975374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 235 offsets: 234 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929209Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.975377Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (240-240)
2025-10-02T09:28:48.975378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 235
2025-10-02T09:28:48.929211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.929247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 297
2025-10-02T09:28:48.929256Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 298
2025-10-02T09:28:48.929257Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 299
2025-10-02T09:28:48.929265Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 211 count 35 size 881352 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.929275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 300
2025-10-02T09:28:48.929279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.929284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929287Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 881020 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.929291Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 236 offsets: 235 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.975402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 236
2025-10-02T09:28:48.929295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-10-02T09:28:48.929296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.929297Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929296Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 35 parts 0 suffix '63' size 881352
2025-10-02T09:28:48.975417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 237 offsets: 236 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-10-02T09:28:48.975421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 237
2025-10-02T09:28:48.929299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.975421Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (241-241)
2025-10-02T09:28:48.929300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-10-02T09:28:48.929303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 238 offsets: 237 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975434Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (242-242)
2025-10-02T09:28:48.975440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 238
2025-10-02T09:28:48.975443Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (243-243)
2025-10-02T09:28:48.929305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-10-02T09:28:48.929306Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975450Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (244-244)
2025-10-02T09:28:48.929308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-10-02T09:28:48.929309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 239 offsets: 238 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929312Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-10-02T09:28:48.975460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 239
2025-10-02T09:28:48.975460Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (245-245)
2025-10-02T09:28:48.929313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929315Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-10-02T09:28:48.929318Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 240 offsets: 239 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 240
2025-10-02T09:28:48.929320Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-10-02T09:28:48.975501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 241 offsets: 240 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 241
2025-10-02T09:28:48.929321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-10-02T09:28:48.929324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929327Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-10-02T09:28:48.975524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 242 offsets: 241 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.975526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 242
2025-10-02T09:28:48.929328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929331Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-10-02T09:28:48.929332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 243 offsets: 242 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-10-02T09:28:48.975547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 243
2025-10-02T09:28:48.929335Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929338Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-10-02T09:28:48.929339Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-10-02T09:28:48.929343Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929345Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-10-02T09:28:48.975566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 244 offsets: 243 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 244
2025-10-02T09:28:48.929349Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-10-02T09:28:48.929350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929353Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-10-02T09:28:48.929354Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-10-02T09:28:48.975589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 245 offsets: 244 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 245
2025-10-02T09:28:48.929360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
>>> event from dataHandler: 2025-10-02T09:28:48.929361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929363Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-10-02T09:28:48.975612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 246 offsets: 245 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929364Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 246
2025-10-02T09:28:48.929366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-10-02T09:28:48.929368Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929372Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-10-02T09:28:48.929373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-10-02T09:28:48.975636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 247 offsets: 246 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.929377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 247
2025-10-02T09:28:48.929379Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-10-02T09:28:48.929380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-10-02T09:28:48.916000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.926000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49716", "logtype": "unknown", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-02T09:28:48.929383Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 248 offsets: 247 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.975669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 248
2025-10-02T09:28:48.929392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-10-02T09:28:48.929393Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-10-02T09:28:48.929397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-10-02T09:28:48.975690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 249 offsets: 248 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.929400Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 249
2025-10-02T09:28:48.929402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-10-02T09:28:48.929404Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-10-02T09:28:48.929407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929409Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-10-02T09:28:48.929411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.975712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 250 offsets: 249 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.975715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 250
2025-10-02T09:28:48.929415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-10-02T09:28:48.929416Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-10-02T09:28:48.929420Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-10-02T09:28:48.929423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.929425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
2025-10-02T09:28:48.929442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.929462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.929463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T09:28:48.975744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 251 offsets: 250 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.975746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 251
2025-10-02T09:28:48.929475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-10-02T09:28:48.929487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 27219 count 1 nextOffset 247 batches 1
2025-10-02T09:28:48.975751Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 13, size 341913 bytes
2025-10-02T09:28:48.929491Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-10-02T09:28:48.929493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 54516 count 2 nextOffset 248 batches 1
2025-10-02T09:28:48.929495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-10-02T09:28:48.929497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 81923 count 3 nextOffset 249 batches 1
2025-10-02T09:28:48.975770Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.929499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-10-02T09:28:48.929501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 109440 count 4 nextOffset 250 batches 1
2025-10-02T09:28:48.975765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 252 offsets: 251 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-10-02T09:28:48.975779Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (246-264)
2025-10-02T09:28:48.975782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 252
2025-10-02T09:28:48.929505Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 137067 count 5 nextOffset 251 batches 1
2025-10-02T09:28:48.975787Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 1490552 to budget
2025-10-02T09:28:48.929507Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-10-02T09:28:48.929509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 164804 count 6 nextOffset 252 batches 1
2025-10-02T09:28:48.929512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-10-02T09:28:48.929514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 192651 count 7 nextOffset 253 batches 1
2025-10-02T09:28:48.975799Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (246-246)
2025-10-02T09:28:48.929516Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-10-02T09:28:48.975803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 253 offsets: 252 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929518Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 220608 count 8 nextOffset 254 batches 1
2025-10-02T09:28:48.975807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 253
2025-10-02T09:28:48.975809Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (247-247)
2025-10-02T09:28:48.929520Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-10-02T09:28:48.929523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 248675 count 9 nextOffset 255 batches 1
2025-10-02T09:28:48.929525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-10-02T09:28:48.975819Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (248-248)
2025-10-02T09:28:48.975827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 254 offsets: 253 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 276852 count 10 nextOffset 256 batches 1
2025-10-02T09:28:48.975831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 254
2025-10-02T09:28:48.929529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-10-02T09:28:48.975832Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (249-249)
2025-10-02T09:28:48.929531Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 305139 count 11 nextOffset 257 batches 1
2025-10-02T09:28:48.929534Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-10-02T09:28:48.929537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 333536 count 12 nextOffset 258 batches 1
2025-10-02T09:28:48.929540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-10-02T09:28:48.929543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 362043 count 13 nextOffset 259 batches 1
2025-10-02T09:28:48.929546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-10-02T09:28:48.975850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 255 offsets: 254 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.929549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 390660 count 14 nextOffset 260 batches 1
2025-10-02T09:28:48.975863Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (250-250)
2025-10-02T09:28:48.978310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 255
2025-10-02T09:28:48.929552Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-10-02T09:28:48.929555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 419387 count 15 nextOffset 261 batches 1
2025-10-02T09:28:48.929557Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-10-02T09:28:48.929562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 448224 count 16 nextOffset 262 batches 1
2025-10-02T09:28:48.929566Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-10-02T09:28:48.978329Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (251-251)
2025-10-02T09:28:48.929570Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 477171 count 17 nextOffset 263 batches 1
2025-10-02T09:28:48.929572Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-10-02T09:28:48.978337Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (252-252)
2025-10-02T09:28:48.929573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 506228 count 18 nextOffset 264 batches 1
2025-10-02T09:28:48.978344Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (253-253)
2025-10-02T09:28:48.929575Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-10-02T09:28:48.930150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 534870 count 19 nextOffset 265 batches 1
2025-10-02T09:28:48.930157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-10-02T09:28:48.930169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 564179 count 20 nextOffset 266 batches 2
2025-10-02T09:28:48.930173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-10-02T09:28:48.930178Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 593566 count 21 nextOffset 267 batches 2
2025-10-02T09:28:48.930180Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-10-02T09:28:48.930195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 623063 count 22 nextOffset 268 batches 2
2025-10-02T09:28:48.978364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 256 offsets: 255 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-10-02T09:28:48.978378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 256
2025-10-02T09:28:48.930200Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 652670 count 23 nextOffset 269 batches 2
2025-10-02T09:28:48.930202Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-10-02T09:28:48.978384Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (254-254)
2025-10-02T09:28:48.930205Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 682387 count 24 nextOffset 270 batches 2
2025-10-02T09:28:48.930206Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-10-02T09:28:48.978391Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (255-255)
2025-10-02T09:28:48.978397Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (256-256)
2025-10-02T09:28:48.930209Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 712214 count 25 nextOffset 271 batches 2
2025-10-02T09:28:48.978402Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (257-257)
2025-10-02T09:28:48.978398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 257 offsets: 256 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-10-02T09:28:48.978407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 257
2025-10-02T09:28:48.930214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 742151 count 26 nextOffset 272 batches 2
2025-10-02T09:28:48.978409Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (258-258)
2025-10-02T09:28:48.930216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-10-02T09:28:48.930218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 772198 count 27 nextOffset 273 batches 2
2025-10-02T09:28:48.930220Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-10-02T09:28:48.978418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (259-259)
2025-10-02T09:28:48.930223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 802355 count 28 nextOffset 274 batches 2
2025-10-02T09:28:48.930225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-10-02T09:28:48.978425Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (260-260)
2025-10-02T09:28:48.930227Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 832622 count 29 nextOffset 275 batches 2
2025-10-02T09:28:48.930228Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-10-02T09:28:48.978430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 258 offsets: 257 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 862999 count 30 nextOffset 276 batches 2
2025-10-02T09:28:48.930232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-10-02T09:28:48.978432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 258
2025-10-02T09:28:48.930234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 893486 count 31 nextOffset 277 batches 2
2025-10-02T09:28:48.930236Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-10-02T09:28:48.930237Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 924083 count 32 nextOffset 278 batches 2
2025-10-02T09:28:48.930239Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-10-02T09:28:48.978432Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (261-261)
2025-10-02T09:28:48.978463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 259 offsets: 258 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930241Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 954790 count 33 nextOffset 279 batches 2
2025-10-02T09:28:48.978466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 259
2025-10-02T09:28:48.930243Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-10-02T09:28:48.930244Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 985607 count 34 nextOffset 280 batches 2
2025-10-02T09:28:48.930246Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-10-02T09:28:48.930248Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1016534 count 35 nextOffset 281 batches 2
2025-10-02T09:28:48.930250Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-10-02T09:28:48.978495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 260 offsets: 259 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.978502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 260
2025-10-02T09:28:48.930455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1047108 count 36 nextOffset 282 batches 2
2025-10-02T09:28:48.930461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-10-02T09:28:48.930470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1078287 count 37 nextOffset 283 batches 3
2025-10-02T09:28:48.930473Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-10-02T09:28:48.978522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 261 offsets: 260 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.978524Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (262-262)
2025-10-02T09:28:48.930475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1109544 count 38 nextOffset 284 batches 3
2025-10-02T09:28:48.930479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-10-02T09:28:48.978525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 261
2025-10-02T09:28:48.930481Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1140911 count 39 nextOffset 285 batches 3
2025-10-02T09:28:48.978533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (263-263)
2025-10-02T09:28:48.930483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-10-02T09:28:48.930485Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1172388 count 40 nextOffset 286 batches 3
2025-10-02T09:28:48.978539Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (264-264)
2025-10-02T09:28:48.930487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-10-02T09:28:48.930490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1203975 count 41 nextOffset 287 batches 3
2025-10-02T09:28:48.978550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 262 offsets: 261 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.978552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 262
2025-10-02T09:28:48.930492Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-10-02T09:28:48.930494Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1235672 count 42 nextOffset 288 batches 3
2025-10-02T09:28:48.930498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-10-02T09:28:48.930500Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1267479 count 43 nextOffset 289 batches 3
2025-10-02T09:28:48.930502Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-10-02T09:28:48.930504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1299396 count 44 nextOffset 290 batches 3
2025-10-02T09:28:48.930506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-10-02T09:28:48.978572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 263 offsets: 262 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1331423 count 45 nextOffset 291 batches 3
2025-10-02T09:28:48.978575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 263
2025-10-02T09:28:48.930510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-10-02T09:28:48.930512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1363560 count 46 nextOffset 292 batches 3
2025-10-02T09:28:48.930514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-10-02T09:28:48.930516Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1395807 count 47 nextOffset 293 batches 3
2025-10-02T09:28:48.930517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-10-02T09:28:48.930519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1428164 count 48 nextOffset 294 batches 3
2025-10-02T09:28:48.930521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-10-02T09:28:48.978596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 264 offsets: 263 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.930523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1460631 count 49 nextOffset 295 batches 3
2025-10-02T09:28:48.978599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 264
2025-10-02T09:28:48.930525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-10-02T09:28:48.930529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 246 PartNo 0 PackedSize 1493208 count 50 nextOffset 296 batches 3
2025-10-02T09:28:48.930531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.930724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 246,50 HeadOffset 246 endOffset 246 curOffset 296 d0000000000_00000000000000000246_00000_0000000050_00000? size 1492838 WTime 1759397328930
2025-10-02T09:28:48.931674Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.978617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 265 offsets: 264 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931676Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.978619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 265
2025-10-02T09:28:48.931679Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.931681Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.931687Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.931689Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.931691Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.931693Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.931695Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000131_00000_0000000036_00000?
2025-10-02T09:28:48.931697Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000167_00000_0000000044_00000?
2025-10-02T09:28:48.978647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 266 offsets: 265 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931700Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000211_00000_0000000035_00000?
2025-10-02T09:28:48.978649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 266
2025-10-02T09:28:48.931703Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 11 keys were taken away. Let's read 3339320 bytes (3339320)
2025-10-02T09:28:48.931706Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 11, size 3339320 (8388608)
2025-10-02T09:28:48.931724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 212
2025-10-02T09:28:48.931742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 213
2025-10-02T09:28:48.931746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 214
2025-10-02T09:28:48.931750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 215
2025-10-02T09:28:48.931754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 216
2025-10-02T09:28:48.978669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 267 offsets: 266 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.978672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 267
2025-10-02T09:28:48.931760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.931767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 596 size 32645 offset: -1
2025-10-02T09:28:48.931769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.931773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.931775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 597 size 32755 offset: -1
2025-10-02T09:28:48.931777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 268 offsets: 267 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.978694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 268
2025-10-02T09:28:48.931781Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.931784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 598 size 32865 offset: -1
2025-10-02T09:28:48.931787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.931787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 269 offsets: 268 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.978716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 269
2025-10-02T09:28:48.931790Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-10-02T09:28:48.931794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 217
2025-10-02T09:28:48.931798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 218
2025-10-02T09:28:48.931801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 219
2025-10-02T09:28:48.931805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 220
2025-10-02T09:28:48.978734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 270 offsets: 269 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931809Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 221
2025-10-02T09:28:48.978736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 270
2025-10-02T09:28:48.931812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 222
2025-10-02T09:28:48.931816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 223
2025-10-02T09:28:48.931820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 224
2025-10-02T09:28:48.931824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 225
2025-10-02T09:28:48.931827Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 226
2025-10-02T09:28:48.931831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 227
2025-10-02T09:28:48.931834Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 228
2025-10-02T09:28:48.931838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 229
2025-10-02T09:28:48.931843Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 230
2025-10-02T09:28:48.931851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 231
2025-10-02T09:28:48.931854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 232
2025-10-02T09:28:48.978766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 271 offsets: 270 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 233
2025-10-02T09:28:48.978768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 271
2025-10-02T09:28:48.931861Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 234
2025-10-02T09:28:48.931864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 235
2025-10-02T09:28:48.931868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 236
2025-10-02T09:28:48.931871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 237
2025-10-02T09:28:48.931875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 238
2025-10-02T09:28:48.931878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 239
2025-10-02T09:28:48.931883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 240
2025-10-02T09:28:48.978787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 272 offsets: 271 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 241
2025-10-02T09:28:48.978790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 272
2025-10-02T09:28:48.931892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 242
2025-10-02T09:28:48.931895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 243
>>> event from dataHandler: 2025-10-02T09:28:48.931898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 244
2025-10-02T09:28:48.931902Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 245
2025-10-02T09:28:48.978808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 273 offsets: 272 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 246
2025-10-02T09:28:48.978819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 273
2025-10-02T09:28:48.931907Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931909Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.931913Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931917Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 246 partNo 0 count 50 size 1492838
2025-10-02T09:28:48.931917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931921Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.931922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 274 offsets: 273 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 274
2025-10-02T09:28:48.931926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.931928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.931929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.931930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.931931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.931933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:48.931934Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 275 offsets: 274 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.931935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:48.978872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 275
2025-10-02T09:28:48.931937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931940Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931942Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931948Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931951Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 276 offsets: 275 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.978893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 276
2025-10-02T09:28:48.931953Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-10-02T09:28:48.917000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.929000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.978915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 277 offsets: 276 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.931963Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 277
2025-10-02T09:28:48.931966Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931975Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931981Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931984Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 278 offsets: 277 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.931987Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.978943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 278
2025-10-02T09:28:48.931990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.931995Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.932014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934424Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 246 count 50 size 1492838 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.934442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.934452Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 246 partno 0 count 50 parts 0 suffix '63' size 1492838
2025-10-02T09:28:48.978961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 279 offsets: 278 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.978984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 279
2025-10-02T09:28:48.934461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1492350 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.934467Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-10-02T09:28:48.934475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934477Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
2025-10-02T09:28:48.934478Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934480Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-10-02T09:28:48.979009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 280 offsets: 279 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.979014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 280
2025-10-02T09:28:48.934485Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-10-02T09:28:48.934487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934489Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-10-02T09:28:48.934490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934492Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-10-02T09:28:48.934494Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-10-02T09:28:48.979039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 281 offsets: 280 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-10-02T09:28:48.934503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.980973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 281
2025-10-02T09:28:48.979043Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 19, size 533159 bytes
2025-10-02T09:28:48.934506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-10-02T09:28:48.934507Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-10-02T09:28:48.934511Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-10-02T09:28:48.934515Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-10-02T09:28:48.934519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981015Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (265-282)
2025-10-02T09:28:48.934521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-10-02T09:28:48.981022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 282 offsets: 281 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 282
2025-10-02T09:28:48.934522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981025Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.934532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-10-02T09:28:48.934534Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981035Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 1490552, ReadSizeServerDelta = -966264
2025-10-02T09:28:48.934536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-10-02T09:28:48.934538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-10-02T09:28:48.934545Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934548Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-10-02T09:28:48.934549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934551Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-10-02T09:28:48.934552Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934556Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-10-02T09:28:48.934559Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 283 offsets: 282 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934561Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-10-02T09:28:48.981070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 283
2025-10-02T09:28:48.934562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934564Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-10-02T09:28:48.934565Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-10-02T09:28:48.934568Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-10-02T09:28:48.934571Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 284 offsets: 283 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934572Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-10-02T09:28:48.981093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 284
2025-10-02T09:28:48.934574Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934576Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
2025-10-02T09:28:48.934577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934579Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-10-02T09:28:48.934580Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-10-02T09:28:48.934583Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934586Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-10-02T09:28:48.934588Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934589Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-10-02T09:28:48.934591Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-10-02T09:28:48.934595Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-10-02T09:28:48.934598Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-10-02T09:28:48.934601Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981145Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.934604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-10-02T09:28:48.934605Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934606Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-10-02T09:28:48.934607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934609Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-10-02T09:28:48.934611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934613Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-10-02T09:28:48.934614Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934616Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-10-02T09:28:48.981166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (265-265)
2025-10-02T09:28:48.934617Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934619Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-10-02T09:28:48.934621Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 285 offsets: 284 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934623Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-10-02T09:28:48.981193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 285
2025-10-02T09:28:48.934625Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981193Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (266-266)
2025-10-02T09:28:48.934626Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-10-02T09:28:48.934628Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934630Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-10-02T09:28:48.934632Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 286 offsets: 285 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 286
2025-10-02T09:28:48.934633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-10-02T09:28:48.934635Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981216Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (267-267)
2025-10-02T09:28:48.981240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 287 offsets: 286 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 287
2025-10-02T09:28:48.934636Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-10-02T09:28:48.934638Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934640Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-10-02T09:28:48.934642Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934644Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-10-02T09:28:48.981264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 288 offsets: 287 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934645Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 288
2025-10-02T09:28:48.934651Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-10-02T09:28:48.934653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981260Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (268-268)
2025-10-02T09:28:48.934654Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-10-02T09:28:48.934656Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934658Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-10-02T09:28:48.934659Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.981285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 289 offsets: 288 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934662Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-10-02T09:28:48.981290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 289
2025-10-02T09:28:48.934663Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.934665Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-10-02T09:28:48.934689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.981311Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (269-269)
2025-10-02T09:28:48.981316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 290 offsets: 289 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981320Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (270-270)
2025-10-02T09:28:48.981321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 290
2025-10-02T09:28:48.934696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.934698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-02T09:28:48.934712Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-10-02T09:28:48.981331Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (271-271)
2025-10-02T09:28:48.934728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 296 PartNo 0 PackedSize 32719 count 1 nextOffset 297 batches 1
2025-10-02T09:28:48.934733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-10-02T09:28:48.981339Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (272-272)
2025-10-02T09:28:48.981341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 291 offsets: 290 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 291
2025-10-02T09:28:48.934735Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 296 PartNo 0 PackedSize 65516 count 2 nextOffset 298 batches 1
2025-10-02T09:28:48.934738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-10-02T09:28:48.934740Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 296 PartNo 0 PackedSize 98423 count 3 nextOffset 299 batches 1
2025-10-02T09:28:48.934741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-10-02T09:28:48.934744Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 296 PartNo 0 PackedSize 131440 count 4 nextOffset 300 batches 1
2025-10-02T09:28:48.981364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 292 offsets: 291 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.981368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 292
2025-10-02T09:28:48.934745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.934811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 296,4 HeadOffset 296 endOffset 296 curOffset 300 d0000000000_00000000000000000296_00000_0000000004_00000? size 131380 WTime 1759397328934
2025-10-02T09:28:48.934841Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.934842Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.934843Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.934844Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.934846Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.934847Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.981397Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (273-273)
2025-10-02T09:28:48.934847Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.934848Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.981406Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (274-274)
2025-10-02T09:28:48.934851Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000131_00000_0000000036_00000?
2025-10-02T09:28:48.981408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 293 offsets: 292 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934852Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000167_00000_0000000044_00000?
2025-10-02T09:28:48.981414Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (275-275)
2025-10-02T09:28:48.934853Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000211_00000_0000000035_00000?
2025-10-02T09:28:48.934853Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000246_00000_0000000050_00000?
2025-10-02T09:28:48.981410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 293
2025-10-02T09:28:48.934855Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 12 keys were taken away. Let's read 4832158 bytes (4832158)
2025-10-02T09:28:48.981422Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (276-276)
2025-10-02T09:28:48.934857Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 12, size 4832158 (8388608)
2025-10-02T09:28:48.934868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 247
2025-10-02T09:28:48.981442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 294 offsets: 293 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 248
2025-10-02T09:28:48.981436Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (277-277)
2025-10-02T09:28:48.981444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 294
2025-10-02T09:28:48.934887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 249
2025-10-02T09:28:48.934890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 250
2025-10-02T09:28:48.934895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 251
2025-10-02T09:28:48.981452Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (278-278)
2025-10-02T09:28:48.934898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 252
2025-10-02T09:28:48.934902Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 253
2025-10-02T09:28:48.934902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981461Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (279-279)
2025-10-02T09:28:48.934906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 254
2025-10-02T09:28:48.981470Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (280-280)
2025-10-02T09:28:48.934909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 255
2025-10-02T09:28:48.981464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 295 offsets: 294 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934912Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 295
2025-10-02T09:28:48.934917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934917Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 256
2025-10-02T09:28:48.934922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934922Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 257
2025-10-02T09:28:48.934927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934927Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 258
2025-10-02T09:28:48.981495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 296 offsets: 295 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:48.934931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 296
2025-10-02T09:28:48.934932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 259
2025-10-02T09:28:48.934937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 260
2025-10-02T09:28:48.934941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 261
2025-10-02T09:28:48.934941Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 262
2025-10-02T09:28:48.981516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 297 offsets: 296 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.981518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 297
2025-10-02T09:28:48.934950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934950Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 263
2025-10-02T09:28:48.934955Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934956Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 264
2025-10-02T09:28:48.934960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 298 offsets: 297 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:48.934961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 265
2025-10-02T09:28:48.981539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 298
2025-10-02T09:28:48.934964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 266
2025-10-02T09:28:48.934964Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 267
2025-10-02T09:28:48.934969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 268
2025-10-02T09:28:48.934973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 299 offsets: 298 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-02T09:28:48.981564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 299
2025-10-02T09:28:48.934975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 269
2025-10-02T09:28:48.934978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.934979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 270
2025-10-02T09:28:48.981578Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (281-281)
2025-10-02T09:28:48.934982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 271
2025-10-02T09:28:48.934984Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.981587Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (282-282)
2025-10-02T09:28:48.934985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 272
2025-10-02T09:28:48.981589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session got write response: sequence_numbers: 300 offsets: 299 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-02T09:28:48.934989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 273
2025-10-02T09:28:48.981591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: acknoledged message 300
2025-10-02T09:28:48.934993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 274
2025-10-02T09:28:48.934995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 275
2025-10-02T09:28:48.934999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 276
2025-10-02T09:28:48.935002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 277
2025-10-02T09:28:48.935006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 278
2025-10-02T09:28:48.935009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 279
2025-10-02T09:28:48.935012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 280
2025-10-02T09:28:48.935015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 281
2025-10-02T09:28:48.935019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 282
2025-10-02T09:28:48.935024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 283
2025-10-02T09:28:48.935027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 284
2025-10-02T09:28:48.935032Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 285
2025-10-02T09:28:48.935035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 286
2025-10-02T09:28:48.935038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 287
2025-10-02T09:28:48.935049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 288
2025-10-02T09:28:48.935053Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 289
2025-10-02T09:28:48.935056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 290
2025-10-02T09:28:48.935059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 291
2025-10-02T09:28:48.935062Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 292
2025-10-02T09:28:48.935066Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 293
2025-10-02T09:28:48.935069Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 294
2025-10-02T09:28:48.935072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 295
2025-10-02T09:28:48.935073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 296
2025-10-02T09:28:48.935079Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:48.935087Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 296 partNo 0 count 4 size 131380
2025-10-02T09:28:48.935115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935126Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935171Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935175Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935240Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935248Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935324Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935329Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.935354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.936107Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 296 count 4 size 131380 actorID [3:7556553981476872473:2473]
2025-10-02T09:28:48.936117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:48.936124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 131268 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:48.936127Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.936128Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 296 partno 0 count 4 parts 0 suffix '63' size 131380
2025-10-02T09:28:48.936131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-10-02T09:28:48.936133Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.936134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-10-02T09:28:48.936135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.936137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-10-02T09:28:48.936138Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:48.936141Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-10-02T09:28:48.936170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.936171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.936172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.936176Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:48.936177Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000010_00000?
2025-10-02T09:28:48.936178Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000025_00000?
2025-10-02T09:28:48.936179Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000023_00000?
2025-10-02T09:28:48.936180Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000059_00000_0000000015_00000?
2025-10-02T09:28:48.936181Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000074_00000_0000000016_00000?
2025-10-02T09:28:48.936182Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000090_00000_0000000018_00000?
2025-10-02T09:28:48.936182Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000108_00000_0000000023_00000?
2025-10-02T09:28:48.936183Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000131_00000_0000000036_00000?
2025-10-02T09:28:48.936184Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000167_00000_0000000044_00000?
2025-10-02T09:28:48.936185Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000211_00000_0000000035_00000?
2025-10-02T09:28:48.936186Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000246_00000_0000000050_00000?
2025-10-02T09:28:48.936187Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000296_00000_0000000004_00000?
2025-10-02T09:28:48.936189Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 13 keys were taken away. Let's read 4963538 bytes (4963538)
2025-10-02T09:28:48.936190Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 13, size 4963538 (8388608)
2025-10-02T09:28:48.936194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 297
2025-10-02T09:28:48.936212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 298
2025-10-02T09:28:48.936217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 299
2025-10-02T09:28:48.936220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-10-02T09:28:48.936237Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.936247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.936252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.936256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:48.955397Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 590094 } }
2025-10-02T09:28:48.955472Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# d05055fb-5b8b2280-11e2387-9fa2c779
2025-10-02T09:28:48.955490Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# c672145a-baaeb469-5ead1264-b374d745, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 52, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.955519Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 52 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 167 EndOffset 211 ClientCommitOffset 0 committedOffset 0 Guid c672145a-baaeb469-5ead1264-b374d745
2025-10-02T09:28:48.955588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.955597Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.955638Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 167 count 52 size 524288 endOffset 300 max time lag 0ms effective offset 167
2025-10-02T09:28:48.955660Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 916756 count 44 last offset 167, current partition end offset: 300
2025-10-02T09:28:48.955664Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-02T09:28:48.955673Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 167 partno 0 count 44 parts_count 0 source 1 size 916756 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.955685Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-02T09:28:48.955697Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.955707Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 167 partno 0 count 44 parts 0 suffix '63'
2025-10-02T09:28:48.955975Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 167 totakecount 44 count 26 size 515939 from pos 0 cbcount 26
2025-10-02T09:28:48.956175Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 193 totakecount 44 count 18 size 400771 from pos 0 cbcount 18
>>> event from dataHandler: 2025-10-02T09:28:48.956249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 167
2025-10-02T09:28:48.982263Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Got ReadResponse, serverBytesSize = 131237, now ReadSizeBudget = 0, ReadSizeServerDelta = 393051
2025-10-02T09:28:48.956500Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328912 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1759397328920 CreateTimestampMS: 1759397328913 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328913 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328914 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328915 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328915 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1759397328921 CreateTimestampMS: 1759397328915 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3289774 RealReadOffset: 210 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 167 }
2025-10-02T09:28:48.956774Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 211 endOffset 300
2025-10-02T09:28:48.956788Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 211 ReadGuid c672145a-baaeb469-5ead1264-b374d745 has messages 1
2025-10-02T09:28:48.956816Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 211, endOffset# 300, WTime# 1759397328921, sizeLag# 3289774
2025-10-02T09:28:48.956818Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:48.956837Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# c672145a-baaeb469-5ead1264-b374d745, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 914836
2025-10-02T09:28:48.956849Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# c672145a-baaeb469-5ead1264-b374d745
2025-10-02T09:28:48.957563Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 1
2025-10-02T09:28:48.959546Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 914836 } }
2025-10-02T09:28:48.959599Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# 4c6e7177-917dd1c6-461eda15-75a42d7
2025-10-02T09:28:48.959612Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 2b4464df-f471b7d4-ab85ad5-f8099919, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 106, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.959632Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 106 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 211 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid 2b4464df-f471b7d4-ab85ad5-f8099919
2025-10-02T09:28:48.959684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.959690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.959724Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 211 count 106 size 524288 endOffset 300 max time lag 0ms effective offset 211
2025-10-02T09:28:48.959743Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 881352 count 35 last offset 211, current partition end offset: 300
2025-10-02T09:28:48.959746Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-02T09:28:48.959757Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 211 partno 0 count 35 parts_count 0 source 1 size 881352 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.959770Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-02T09:28:48.959782Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.959790Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 35 parts 0 suffix '63'
2025-10-02T09:28:48.960098Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 211 totakecount 35 count 21 size 512599 from pos 0 cbcount 21
2025-10-02T09:28:48.960256Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 232 totakecount 35 count 14 size 368707 from pos 0 cbcount 14
2025-10-02T09:28:48.960313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 211
2025-10-02T09:28:48.960602Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328915 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1759397328925 CreateTimestampMS: 1759397328916 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328916 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328916 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328916 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328916 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1759397328926 CreateTimestampMS: 1759397328917 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2373297 RealReadOffset: 245 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 211 }
2025-10-02T09:28:48.960892Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 246 endOffset 300
2025-10-02T09:28:48.960910Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 246 ReadGuid 2b4464df-f471b7d4-ab85ad5-f8099919 has messages 1
2025-10-02T09:28:48.960936Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 246, endOffset# 300, WTime# 1759397328926, sizeLag# 2373297
2025-10-02T09:28:48.960940Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:48.960957Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 2b4464df-f471b7d4-ab85ad5-f8099919, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 879837
2025-10-02T09:28:48.960968Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 2b4464df-f471b7d4-ab85ad5-f8099919
2025-10-02T09:28:48.961429Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-10-02T09:28:48.918000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.969382Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 879837 } }
2025-10-02T09:28:48.969446Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# 5dc56f36-5970bd79-ea241888-46411856
2025-10-02T09:28:48.969462Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 9cd3f865-ea1112e1-46908070-d733a80f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 64, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.969484Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 64 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 246 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid 9cd3f865-ea1112e1-46908070-d733a80f
2025-10-02T09:28:48.969535Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.969545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.969580Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 246 count 64 size 524288 endOffset 300 max time lag 0ms effective offset 246
2025-10-02T09:28:48.969601Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 1492838 count 50 last offset 246, current partition end offset: 300
2025-10-02T09:28:48.969604Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-02T09:28:48.969612Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 246 partno 0 count 50 parts_count 0 source 1 size 1492838 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.969620Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-10-02T09:28:48.969630Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.969642Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 246 partno 0 count 50 parts 0 suffix '63'
2025-10-02T09:28:48.969856Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 246 totakecount 50 count 19 size 534847 from pos 0 cbcount 19
2025-10-02T09:28:48.970073Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 265 totakecount 50 count 17 size 512215 from pos 0 cbcount 17
2025-10-02T09:28:48.970310Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 282 totakecount 50 count 14 size 445707 from pos 0 cbcount 14
2025-10-02T09:28:48.970387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 246
2025-10-02T09:28:48.970695Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328917 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1759397328929 CreateTimestampMS: 1759397328918 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328918 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328919 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328920 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328920 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328920 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1759397328930 CreateTimestampMS: 1759397328920 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 1491576 RealReadOffset: 295 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 246 }
2025-10-02T09:28:48.971088Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 296 endOffset 300
2025-10-02T09:28:48.971101Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 296 ReadGuid 9cd3f865-ea1112e1-46908070-d733a80f has messages 1
2025-10-02T09:28:48.971134Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 296, endOffset# 300, WTime# 1759397328930, sizeLag# 1491576
2025-10-02T09:28:48.971138Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:48.971172Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 9cd3f865-ea1112e1-46908070-d733a80f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 1490552
2025-10-02T09:28:48.971186Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 9cd3f865-ea1112e1-46908070-d733a80f
2025-10-02T09:28:48.972269Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 1
2025-10-02T09:28:48.981295Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 1490552 } }
2025-10-02T09:28:48.981379Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# e49fa228-867c8453-c2e347b3-713313d3
2025-10-02T09:28:48.981396Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 performing read request: guid# 4e0d6cda-d0d691fb-18e05f87-bcf68f08, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:48.981419Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 296 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid 4e0d6cda-d0d691fb-18e05f87-bcf68f08
2025-10-02T09:28:48.981478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.981484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.984065Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 18, size 541728 bytes
2025-10-02T09:28:48.981524Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 16 Topic 'rt3.dc1--test-topic' partition 0 user user offset 296 count 4 size 524288 endOffset 300 max time lag 0ms effective offset 296
2025-10-02T09:28:48.981546Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 16 added 1 blobs, size 131380 count 4 last offset 296, current partition end offset: 300
2025-10-02T09:28:48.981549Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 16. Send blob request.
2025-10-02T09:28:48.981562Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 296 partno 0 count 4 parts_count 0 source 1 size 131380 accessed 0 times before, last time 2025-10-02T09:28:48.000000Z
2025-10-02T09:28:48.981572Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 16. All 1 blobs are from cache.
2025-10-02T09:28:48.981584Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.981595Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 296 partno 0 count 4 parts 0 suffix '63'
2025-10-02T09:28:48.981664Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 296 totakecount 4 count 4 size 131357 from pos 0 cbcount 4
2025-10-02T09:28:48.981699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 296
2025-10-02T09:28:48.984097Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (283-295)
2025-10-02T09:28:48.981782Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1759397328934 CreateTimestampMS: 1759397328920 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1759397328934 CreateTimestampMS: 1759397328920 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1759397328934 CreateTimestampMS: 1759397328920 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1759397328934 CreateTimestampMS: 1759397328920 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 296 }
2025-10-02T09:28:48.984109Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (296-299)
2025-10-02T09:28:48.981832Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 300
2025-10-02T09:28:48.984108Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.981838Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid 4e0d6cda-d0d691fb-18e05f87-bcf68f08 has messages 1
2025-10-02T09:28:48.981863Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 read done: guid# 4e0d6cda-d0d691fb-18e05f87-bcf68f08, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 131237
2025-10-02T09:28:48.984123Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 393051
2025-10-02T09:28:48.981870Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 response to read: guid# 4e0d6cda-d0d691fb-18e05f87-bcf68f08
2025-10-02T09:28:48.982092Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 Process answer. Aval parts: 0
2025-10-02T09:28:48.984129Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 131237 to budget
2025-10-02T09:28:48.984138Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (283-283)
2025-10-02T09:28:48.984149Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (284-284)
2025-10-02T09:28:48.984154Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] In ContinueReadingDataImpl, ReadSizeBudget = 131237, ReadSizeServerDelta = 393051
2025-10-02T09:28:48.984160Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (285-285)
2025-10-02T09:28:48.984166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (286-286)
2025-10-02T09:28:48.984195Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 22} (287-287)
2025-10-02T09:28:48.984203Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 23} (288-288)
2025-10-02T09:28:48.984212Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 24} (289-289)
2025-10-02T09:28:48.984220Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 25} (290-290)
2025-10-02T09:28:48.984250Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 26} (291-291)
2025-10-02T09:28:48.984258Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:48.984271Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 27} (292-292)
2025-10-02T09:28:48.984280Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 28} (293-293)
2025-10-02T09:28:48.984288Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 29} (294-294)
2025-10-02T09:28:48.984296Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 30} (295-295)
2025-10-02T09:28:48.984304Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (296-296)
2025-10-02T09:28:48.984311Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (297-297)
2025-10-02T09:28:48.984358Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (298-298)
2025-10-02T09:28:48.984395Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 1, data# { read_request { bytes_size: 131237 } }
2025-10-02T09:28:48.984463Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 got read request: guid# 29d458fd-a7d82a93-4ec643d-5cbecac9
2025-10-02T09:28:48.984491Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (299-299)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-10-02T09:28:48.919000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.930000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:49716", "server": "ipv6:[::1]:49716", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-10-02T09:28:48.920000Z WriteTime: 2025-10-02T09:28:48.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49716", "_ip": "ipv6:[::1]:49716" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-02T09:28:48.987312Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 4, size 130944 bytes
2025-10-02T09:28:48.987322Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] The application data is transferred to the client. Number of messages 13, size 413413 bytes
2025-10-02T09:28:48.987327Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.987332Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Closing read session. Close timeout: 18446744073709.551615s
2025-10-02T09:28:48.987349Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.987350Z :DEBUG: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:48.987355Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Counters: { Errors: 0 CurrentSessionLifetimeMs: 140 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.987545Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Closing read session. Close timeout: 18446744073709.551615s
2025-10-02T09:28:48.987553Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.987557Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Counters: { Errors: 0 CurrentSessionLifetimeMs: 140 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.987673Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Closing read session. Close timeout: 18446744073709.551615s
2025-10-02T09:28:48.987681Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-02T09:28:48.987685Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 140 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.987661Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:28:48.987674Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 grpc read failed
2025-10-02T09:28:48.987680Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 grpc closed
2025-10-02T09:28:48.987686Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_8112064939204738106_v1 is DEAD
2025-10-02T09:28:48.987792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:48.987797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session will now close
2025-10-02T09:28:48.987802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: aborting
2025-10-02T09:28:48.987865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:48.987870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0] Write session: destroy
2025-10-02T09:28:48.987845Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:28:48.987858Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 grpc read failed
2025-10-02T09:28:48.987863Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 grpc closed
2025-10-02T09:28:48.987882Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_18337986455714894690_v1 is DEAD
2025-10-02T09:28:48.987934Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:28:48.987943Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc read failed
2025-10-02T09:28:48.987945Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 grpc closed
2025-10-02T09:28:48.987951Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_9903131344634173367_v1 is DEAD
2025-10-02T09:28:48.988003Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840112:2533] disconnected; active server actors: 1
2025-10-02T09:28:48.988020Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.988019Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840112:2533] client user disconnected session shared/user_3_2_8112064939204738106_v1
2025-10-02T09:28:48.988034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553985771840121:2543] destroyed
2025-10-02T09:28:48.988029Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:48.988036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read done: success: 0 data: 
2025-10-02T09:28:48.988039Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840111:2532] disconnected; active server actors: 1
2025-10-02T09:28:48.988041Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840111:2532] client user disconnected session shared/user_3_1_18337986455714894690_v1
2025-10-02T09:28:48.988049Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-02T09:28:48.988054Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:28:48.988037Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc read failed
2025-10-02T09:28:48.988060Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000008s
2025-10-02T09:28:48.988043Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 grpc closed
2025-10-02T09:28:48.988064Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840110:2534] disconnected; active server actors: 1
2025-10-02T09:28:48.988047Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|79ce1bb8-ff010b9e-1393c020-b9b1171_0 is DEAD
2025-10-02T09:28:48.988059Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.988067Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553985771840110:2534] client user disconnected session shared/user_3_3_9903131344634173367_v1
2025-10-02T09:28:48.988164Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:48.988204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553985771840152:2531] destroyed
2025-10-02T09:28:48.988218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:48.988227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.988232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.988234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.988291Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988300Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.988305Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988310Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988313Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.988316Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988319Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988323Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-02T09:28:48.988326Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988331Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988334Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-02T09:28:48.988336Z :INFO: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988347Z :NOTICE: [/Root] [/Root] [c627251b-a5b14b5b-68ea4992-5ebeda3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:48.988440Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988448Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.988451Z :INFO: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988456Z :NOTICE: [/Root] [/Root] [b4d1e7c9-7a0d0867-5d8c2c9b-f1e87880] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:48.988502Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:48.988505Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:48.988508Z :INFO: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Counters: { Errors: 0 CurrentSessionLifetimeMs: 141 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:48.988513Z :NOTICE: [/Root] [/Root] [6d5db2e6-7b60fb6a-3b077def-81031ba] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:49.010563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.010581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.010583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.110911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.110930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.110933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.211219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.211244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.211246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.311621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.311644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.311647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.177508Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1759397289177501
2025-10-02T09:28:09.271136Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553817093372029:2089];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:09.271524Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:09.275030Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553818166036158:2069];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:09.275054Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/tmpptsLzu/pdisk_1.dat
2025-10-02T09:28:09.280994Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:09.282304Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:09.317712Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:09.322407Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:09.325218Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:09.325242Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:09.327505Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:28:09.327728Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:09.337188Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 1793, node 1
2025-10-02T09:28:09.343107Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexJUDczh.tmp
2025-10-02T09:28:09.343119Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexJUDczh.tmp
2025-10-02T09:28:09.343182Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexJUDczh.tmp
2025-10-02T09:28:09.343223Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:09.347303Z INFO: TTestServer started on Port 11642 GrpcPort 1793
TClient is connected to server localhost:11642
PQClient connected to localhost:1793
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:09.371781Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-02T09:28:09.383682Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:09.383709Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:09.385133Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
2025-10-02T09:28:09.493821Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.615447Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.656750Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372914:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.656796Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657222Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372942:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657227Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372943:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657238Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657321Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372947:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657331Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657777Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372955:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.657801Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.658008Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:09.658081Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553817093372980:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.658091Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.662032Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556553817093372946:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T09:28:09.696257Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.712247Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553818166036503:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.712336Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=OGQ2Y2E0YWEtOWY3YWY0NDEtMjFmMTliODgtNWIyZmQzOTI=, ActorId: [2:7556553818166036476:2295], ActorState: ExecuteState, TraceId: 01k6j407pb15xnszmb72b28p92, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.712792Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:09.720930Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.745462Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.752479Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556553817093373358:2904] txid# 281474976715665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:09.757368Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553817093373373:2362], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.757481Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NWE1NzhhNmUtYjMwZTBkOS0yM2MzMWI0Ni1jZTYyMGQwZA==, ActorId: [1:7556553817093372911:2322], ActorState: ExecuteState, TraceId: 01k6j407np6ykdrbc90weh6xr1, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.757658Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:1793", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:09.783194Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6j407s38bknm0k2ex8f98eb, Database: , SessionId: ydb://session/3?node_id=1&id=ZDE1MzNkOTYtZGZkZmM4MDMtZDg3M2QxZWUtMTVmOTY3NjA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553817093373490:2998] 
2025-10-02T09:28:10.273239Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:10.278887Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:14.271397Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553817093372029:2089];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:14.271431Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:14.275542Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553818166036158:2069];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:14.275579Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:14.953275Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:1793
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.970681Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:1793
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:14.976470Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553838568210539:3329] connected; active server actors: 1
2025-10-02T09:28:14.976578Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:14.976704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:14.977100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:14.978040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.978397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.978430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:14.978439Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.978447Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:14.978501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553838568210538:3328], now have 1 active actors on pipe
2025-10-02T09:28:14.978518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556553839640873411:2377], now have 1 active actors on pipe
2025-10-02T09:28:14.978660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.978667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-10-02T09:28:14.979265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.980337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553838568210615:3387], now have 1 active actors on pipe
2025-10-02T09:28:14.980382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.980810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.980967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.980991Z node 1 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.981042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.981107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556553838568210628:2475]
2025-10-02T09:28:14.981534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.981541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.981546Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7556553838568210628:2475]
2025-10-02T09:28:14.981551Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.981729Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.981741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.981760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.981766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.981769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.981772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.981773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.981774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.981779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.981820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.981849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.982482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.982512Z node 1 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397295026, TxId 281474976715679
2025-10-02T09:28:14.982519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.982521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.982538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.982575Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.982929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.982965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.982975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.982976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.982978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.982982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.983058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:14.983074Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.983110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.983705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.983723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.984112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.984226Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6j40cvyfqmt3jvs92x37bse, Database: , SessionId: ydb://session/3?node_id=1&id=YmIxNDZhZjQtYjAzZWFkMWYtNDU4NmFhZWItZGFiMDY1YTE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759397295026
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759397295026
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:1793
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.988778Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:15.081947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.081961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.081964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.182283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.182294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.182297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.282630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.282652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.282655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.382982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.382992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.382994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.483350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.483360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.483362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1793
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.489724Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:15.583648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.583661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.583664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.683992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.684004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.684007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.784404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.784415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.784417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.884752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.884772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.884774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.985090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.985100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.985102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1793
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.991308Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:15.992323Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:15.992517Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:15.992523Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:1793
2025-10-02T09:28:15.993005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.993016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:15.994140Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.994393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.994433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54388
2025-10-02T09:28:15.994441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54388 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.994450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.994810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:15.994847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.994861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.994862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.994867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.995313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.016192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:16.016316Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145452:2510] connected; active server actors: 1
2025-10-02T09:28:16.016445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:16.016456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.016545Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145452:2510] disconnected; active server actors: 1
2025-10-02T09:28:16.016556Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145452:2510] disconnected no session
2025-10-02T09:28:16.033440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.033459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:16.033462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553842863178125:2510] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.033469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.033617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-02T09:28:16.033628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553847158145471:2510], now have 1 active actors on pipe
2025-10-02T09:28:16.033639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.033645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.033678Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|7095ea4-4f4d162b-4cbe7039-a17cac87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:16.033693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.033697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.033699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.033712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.033729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.033748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.033787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.033795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.033807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.033836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|7095ea4-4f4d162b-4cbe7039-a17cac87_0
2025-10-02T09:28:16.034179Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397296034 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.034227Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|7095ea4-4f4d162b-4cbe7039-a17cac87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.034353Z :INFO: [] MessageGroupId [src] SessionId [src|7095ea4-4f4d162b-4cbe7039-a17cac87_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:16.034363Z :INFO: [] MessageGroupId [src] SessionId [src|7095ea4-4f4d162b-4cbe7039-a17cac87_0] Write session will now close
2025-10-02T09:28:16.034367Z :DEBUG: [] MessageGroupId [src] SessionId [src|7095ea4-4f4d162b-4cbe7039-a17cac87_0] Write session: aborting
2025-10-02T09:28:16.034496Z :INFO: [] MessageGroupId [src] SessionId [src|7095ea4-4f4d162b-4cbe7039-a17cac87_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:16.034501Z :DEBUG: [] MessageGroupId [src] SessionId [src|7095ea4-4f4d162b-4cbe7039-a17cac87_0] Write session: destroy
2025-10-02T09:28:16.034668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|7095ea4-4f4d162b-4cbe7039-a17cac87_0 grpc read done: success: 0 data: 
2025-10-02T09:28:16.034676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|7095ea4-4f4d162b-4cbe7039-a17cac87_0 grpc read failed
2025-10-02T09:28:16.034682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|7095ea4-4f4d162b-4cbe7039-a17cac87_0 grpc closed
2025-10-02T09:28:16.034687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|7095ea4-4f4d162b-4cbe7039-a17cac87_0 is DEAD
2025-10-02T09:28:16.034952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:16.034991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553847158145471:2510] destroyed
2025-10-02T09:28:16.035003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:16.035008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.035010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.035012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:28:16.085427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.085442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.085445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:16.088309Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:1793" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:1793" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:1793" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:28:16.090416Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.090633Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:16.149395Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:16.149598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.149612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:16.150990Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.151143Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:16.151256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.151306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56188
2025-10-02T09:28:16.151317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:56188 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:16.151321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.151711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:16.151738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.151742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.151744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.151748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.152123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.153816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:16.153954Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145502:2523] connected; active server actors: 1
2025-10-02T09:28:16.154104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:16.154115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.154212Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145502:2523] disconnected; active server actors: 1
2025-10-02T09:28:16.154224Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553847158145502:2523] disconnected no session
2025-10-02T09:28:16.157118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.157128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:16.157132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553847158145483:2523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.157139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.157265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-02T09:28:16.157274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553847158145516:2523], now have 1 active actors on pipe
2025-10-02T09:28:16.157282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.157293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.157322Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.157336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.157342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.157344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.157355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.157374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.157390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.157440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.157449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.157469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.157503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0
2025-10-02T09:28:16.157782Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.157801Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397296157 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.157827Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:28:16.157889Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:16.157926Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-10-02T09:28:16.157935Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-10-02T09:28:16.157940Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-10-02T09:28:16.157946Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-10-02T09:28:16.157962Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-10-02T09:28:16.157967Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-10-02T09:28:16.157972Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-10-02T09:28:16.157978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-10-02T09:28:16.157983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-10-02T09:28:16.157988Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-10-02T09:28:16.157992Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-10-02T09:28:16.157997Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-10-02T09:28:16.158002Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-10-02T09:28:16.158006Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-10-02T09:28:16.158011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-10-02T09:28:16.158016Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-10-02T09:28:16.158020Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-10-02T09:28:16.158027Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-10-02T09:28:16.158035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-10-02T09:28:16.158046Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-10-02T09:28:16.158050Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-10-02T09:28:16.158054Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-10-02T09:28:16.158058Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-10-02T09:28:16.158068Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-10-02T09:28:16.158076Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-10-02T09:28:16.158088Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-10-02T09:28:16.158093Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-10-02T09:28:16.158098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-10-02T09:28:16.158103Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-10-02T09:28:16.158108Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-10-02T09:28:16.158113Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-10-02T09:28:16.158119Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-10-02T09:28:16.158125Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-10-02T09:28:16.158133Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-10-02T09:28:16.158142Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-10-02T09:28:16.158149Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-10-02T09:28:16.158154Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-10-02T09:28:16.158160Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-10-02T09:28:16.158166Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-10-02T09:28:16.158171Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-10-02T09:28:16.158175Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-10-02T09:28:16.158181Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-10-02T09:28:16.158188Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-10-02T09:28:16.158193Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-10-02T09:28:16.158199Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-10-02T09:28:16.158204Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-10-02T09:28:16.158211Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-10-02T09:28:16.158216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-10-02T09:28:16.158221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-10-02T09:28:16.158225Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-10-02T09:28:16.158231Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-10-02T09:28:16.158236Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-10-02T09:28:16.158242Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-10-02T09:28:16.158283Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.158291Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Send 23 message(s) (31 left), first sequence number is 1
2025-10-02T09:28:16.158758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.158778Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-10-02T09:28:16.158794Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-10-02T09:28:16.158798Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-10-02T09:28:16.158803Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-10-02T09:28:16.158808Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-10-02T09:28:16.158812Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-10-02T09:28:16.158819Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-10-02T09:28:16.158824Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-10-02T09:28:16.158831Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-10-02T09:28:16.158836Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-10-02T09:28:16.158841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-10-02T09:28:16.158846Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-10-02T09:28:16.158865Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-10-02T09:28:16.158869Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-10-02T09:28:16.158874Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-10-02T09:28:16.158879Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-10-02T09:28:16.158884Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-10-02T09:28:16.158888Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-10-02T09:28:16.158893Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-10-02T09:28:16.158897Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-10-02T09:28:16.158901Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-10-02T09:28:16.158905Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-10-02T09:28:16.158910Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-10-02T09:28:16.158914Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-10-02T09:28:16.158918Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-10-02T09:28:16.158922Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-10-02T09:28:16.158908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.158932Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-10-02T09:28:16.158949Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-10-02T09:28:16.158954Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-10-02T09:28:16.158959Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-10-02T09:28:16.158965Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-10-02T09:28:16.158969Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-10-02T09:28:16.158981Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-10-02T09:28:16.158985Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-10-02T09:28:16.158991Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-10-02T09:28:16.158996Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-10-02T09:28:16.159002Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-10-02T09:28:16.159098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.159108Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Send 44 message(s) (24 left), first sequence number is 24
2025-10-02T09:28:16.159352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.159467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.159480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.159519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:16.159540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.159569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.159590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.159595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.159606Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-10-02T09:28:16.159632Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-10-02T09:28:16.159637Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-10-02T09:28:16.159642Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-10-02T09:28:16.159650Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-10-02T09:28:16.159659Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-10-02T09:28:16.159664Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-10-02T09:28:16.159669Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-10-02T09:28:16.159681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159710Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.159709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159718Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Send 26 message(s) (6 left), first sequence number is 68
2025-10-02T09:28:16.159715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:16.159726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-02T09:28:16.159779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.159781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.159790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:16.159826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.159842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.159848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (23)
2025-10-02T09:28:16.159876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:16.159916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.159927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-02T09:28:16.159935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:28:16.159939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-10-02T09:28:16.159943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T09:28:16.159947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-10-02T09:28:16.159950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T09:28:16.159954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-10-02T09:28:16.159957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T09:28:16.159962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 732 count 5 nextOffset 5 batches 1
2025-10-02T09:28:16.159964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T09:28:16.159967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 872 count 6 nextOffset 6 batches 1
2025-10-02T09:28:16.159970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T09:28:16.159974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1012 count 7 nextOffset 7 batches 1
2025-10-02T09:28:16.159977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T09:28:16.159980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1152 count 8 nextOffset 8 batches 1
2025-10-02T09:28:16.159983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T09:28:16.159988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1292 count 9 nextOffset 9 batches 1
2025-10-02T09:28:16.159991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T09:28:16.159995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1432 count 10 nextOffset 10 batches 1
2025-10-02T09:28:16.159998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T09:28:16.160001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1573 count 11 nextOffset 11 batches 1
2025-10-02T09:28:16.160004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-02T09:28:16.160008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1714 count 12 nextOffset 12 batches 1
2025-10-02T09:28:16.160011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-02T09:28:16.160014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1855 count 13 nextOffset 13 batches 1
2025-10-02T09:28:16.160017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-02T09:28:16.160021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1996 count 14 nextOffset 14 batches 1
2025-10-02T09:28:16.160023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-02T09:28:16.160027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2137 count 15 nextOffset 15 batches 1
2025-10-02T09:28:16.160029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-02T09:28:16.160033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2278 count 16 nextOffset 16 batches 1
2025-10-02T09:28:16.160036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-02T09:28:16.160041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2419 count 17 nextOffset 17 batches 1
2025-10-02T09:28:16.160043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T09:28:16.160047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2560 count 18 nextOffset 18 batches 1
2025-10-02T09:28:16.160049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T09:28:16.160052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2701 count 19 nextOffset 19 batches 1
2025-10-02T09:28:16.160055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T09:28:16.160059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2842 count 20 nextOffset 20 batches 1
2025-10-02T09:28:16.160061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.160061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T09:28:16.160065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2983 count 21 nextOffset 21 batches 1
2025-10-02T09:28:16.160067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T09:28:16.160071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3124 count 22 nextOffset 22 batches 1
2025-10-02T09:28:16.160074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T09:28:16.160076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3265 count 23 nextOffset 23 batches 1
2025-10-02T09:28:16.160079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.160146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,23 HeadOffset 0 endOffset 0 curOffset 23 d0000000000_00000000000000000000_00000_0000000023_00000? size 2566 WTime 1759397296159
2025-10-02T09:28:16.160180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.160187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.160196Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.160212Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 23 size 2566
2025-10-02T09:28:16.160225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-02T09:28:16.160244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.160273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-10-02T09:28:16.160281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.160281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.160283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.160291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160363Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-10-02T09:28:16.160357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160388Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.160400Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Send 6 message(s) (1 left), first sequence number is 94
2025-10-02T09:28:16.160375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-02T09:28:16.160470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.160478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.160483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.160553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-02T09:28:16.160568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:16.160618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:16.160625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:16.160640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:16.160644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.160661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.160666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.160672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-02T09:28:16.160679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.160715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.160723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.160727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 7 size 99 offset: -1
2025-10-02T09:28:16.160749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:16.160754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:16.161110Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:16.161118Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 100
2025-10-02T09:28:16.161292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.161354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.161380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.161387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.161447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 23 size 2566 actorID [1:7556553838568210589:2475]
2025-10-02T09:28:16.161465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-02T09:28:16.161476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.161492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2428 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.161492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.161498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:16.161509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T09:28:16.161514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-02T09:28:16.161519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 23 parts 0 suffix '63' size 2566
2025-10-02T09:28:16.161522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-02T09:28:16.161525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-02T09:28:16.161530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-02T09:28:16.161536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-02T09:28:16.161541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-02T09:28:16.161547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-02T09:28:16.161553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-02T09:28:16.161558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-02T09:28:16.161562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-02T09:28:16.161569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-02T09:28:16.161574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-02T09:28:16.161580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-02T09:28:16.161584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-02T09:28:16.161589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-02T09:28:16.161594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-02T09:28:16.161599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-02T09:28:16.161604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-02T09:28:16.161609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-02T09:28:16.161614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-02T09:28:16.161620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.161623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-02T09:28:16.161647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.161652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.161655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.161689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.161695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (76)
2025-10-02T09:28:16.161709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T09:28:16.161732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 173 count 1 nextOffset 24 batches 1
2025-10-02T09:28:16.161741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T09:28:16.161745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 314 count 2 nextOffset 25 batches 1
2025-10-02T09:28:16.161748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T09:28:16.161751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 455 count 3 nextOffset 26 batches 1
2025-10-02T09:28:16.161754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T09:28:16.161757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 596 count 4 nextOffset 27 batches 1
2025-10-02T09:28:16.161760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-02T09:28:16.161763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 737 count 5 nextOffset 28 batches 1
2025-10-02T09:28:16.161766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-02T09:28:16.161770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 878 count 6 nextOffset 29 batches 1
2025-10-02T09:28:16.161772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-02T09:28:16.161776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1019 count 7 nextOffset 30 batches 1
2025-10-02T09:28:16.161778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-02T09:28:16.161782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1160 count 8 nextOffset 31 batches 1
2025-10-02T09:28:16.161785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-02T09:28:16.161788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1301 count 9 nextOffset 32 batches 1
2025-10-02T09:28:16.161791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-02T09:28:16.161794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1442 count 10 nextOffset 33 batches 1
2025-10-02T09:28:16.161797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-02T09:28:16.161801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1583 count 11 nextOffset 34 batches 1
2025-10-02T09:28:16.161804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-02T09:28:16.161808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1724 count 12 nextOffset 35 batches 1
2025-10-02T09:28:16.161815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-02T09:28:16.161818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1865 count 13 nextOffset 36 batches 1
2025-10-02T09:28:16.161821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-02T09:28:16.161824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2006 count 14 nextOffset 37 batches 1
2025-10-02T09:28:16.161827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-02T09:28:16.161830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2147 count 15 nextOffset 38 batches 1
2025-10-02T09:28:16.161833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-02T09:28:16.161836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2288 count 16 nextOffset 39 batches 1
2025-10-02T09:28:16.161838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-02T09:28:16.161842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2429 count 17 nextOffset 40 batches 1
2025-10-02T09:28:16.161845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-02T09:28:16.161848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2570 count 18 nextOffset 41 batches 1
2025-10-02T09:28:16.161851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-02T09:28:16.161854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2711 count 19 nextOffset 42 batches 1
2025-10-02T09:28:16.161857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-02T09:28:16.161861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2852 count 20 nextOffset 43 batches 1
2025-10-02T09:28:16.161863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-02T09:28:16.161866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2993 count 21 nextOffset 44 batches 1
2025-10-02T09:28:16.161869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-02T09:28:16.161872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3134 count 22 nextOffset 45 batches 1
2025-10-02T09:28:16.161875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-02T09:28:16.161882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3275 count 23 nextOffset 46 batches 1
2025-10-02T09:28:16.161885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-02T09:28:16.161888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3416 count 24 nextOffset 47 batches 1
2025-10-02T09:28:16.161891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-02T09:28:16.161895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3557 count 25 nextOffset 48 batches 1
2025-10-02T09:28:16.161898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-02T09:28:16.161902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3698 count 26 nextOffset 49 batches 1
2025-10-02T09:28:16.161905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-02T09:28:16.161908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3839 count 27 nextOffset 50 batches 1
2025-10-02T09:28:16.161911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-02T09:28:16.161913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 3980 count 28 nextOffset 51 batches 1
2025-10-02T09:28:16.161916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-02T09:28:16.161919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4121 count 29 nextOffset 52 batches 1
2025-10-02T09:28:16.161922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-02T09:28:16.161925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4262 count 30 nextOffset 53 batches 1
2025-10-02T09:28:16.161928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-02T09:28:16.161932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4403 count 31 nextOffset 54 batches 1
2025-10-02T09:28:16.161935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-02T09:28:16.161939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4544 count 32 nextOffset 55 batches 1
2025-10-02T09:28:16.161942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-02T09:28:16.161982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4685 count 33 nextOffset 56 batches 1
2025-10-02T09:28:16.161989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-02T09:28:16.161993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4826 count 34 nextOffset 57 batches 1
2025-10-02T09:28:16.161996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-02T09:28:16.161999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4967 count 35 nextOffset 58 batches 1
2025-10-02T09:28:16.162002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-02T09:28:16.162005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5108 count 36 nextOffset 59 batches 1
2025-10-02T09:28:16.162007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-02T09:28:16.162010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5249 count 37 nextOffset 60 batches 1
2025-10-02T09:28:16.162013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-02T09:28:16.162017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5390 count 38 nextOffset 61 batches 1
2025-10-02T09:28:16.162019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-02T09:28:16.162023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5531 count 39 nextOffset 62 batches 1
2025-10-02T09:28:16.162026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-02T09:28:16.162029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5672 count 40 nextOffset 63 batches 1
2025-10-02T09:28:16.162034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-02T09:28:16.162037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5813 count 41 nextOffset 64 batches 1
2025-10-02T09:28:16.162040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-02T09:28:16.162047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 5954 count 42 nextOffset 65 batches 1
2025-10-02T09:28:16.162050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-02T09:28:16.162055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6095 count 43 nextOffset 66 batches 1
2025-10-02T09:28:16.162062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-02T09:28:16.162065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6236 count 44 nextOffset 67 batches 1
2025-10-02T09:28:16.162069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-02T09:28:16.162076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6377 count 45 nextOffset 68 batches 1
2025-10-02T09:28:16.162079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-02T09:28:16.162082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6518 count 46 nextOffset 69 batches 1
2025-10-02T09:28:16.162088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-02T09:28:16.162091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6659 count 47 nextOffset 70 batches 1
2025-10-02T09:28:16.162094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-02T09:28:16.162097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6800 count 48 nextOffset 71 batches 1
2025-10-02T09:28:16.162104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-02T09:28:16.162107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6941 count 49 nextOffset 72 batches 1
2025-10-02T09:28:16.162114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-02T09:28:16.162118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7082 count 50 nextOffset 73 batches 1
2025-10-02T09:28:16.162124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-02T09:28:16.162128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7223 count 51 nextOffset 74 batches 1
2025-10-02T09:28:16.162130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-02T09:28:16.162136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7364 count 52 nextOffset 75 batches 1
2025-10-02T09:28:16.162139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-02T09:28:16.162143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7505 count 53 nextOffset 76 batches 1
2025-10-02T09:28:16.162149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-02T09:28:16.162153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7646 count 54 nextOffset 77 batches 1
2025-10-02T09:28:16.162159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-02T09:28:16.162163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7787 count 55 nextOffset 78 batches 1
2025-10-02T09:28:16.162169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-02T09:28:16.162173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 7928 count 56 nextOffset 79 batches 1
2025-10-02T09:28:16.162176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-02T09:28:16.162182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8069 count 57 nextOffset 80 batches 1
2025-10-02T09:28:16.162185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-02T09:28:16.162189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8210 count 58 nextOffset 81 batches 1
2025-10-02T09:28:16.162192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-02T09:28:16.162195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8351 count 59 nextOffset 82 batches 1
2025-10-02T09:28:16.162198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-02T09:28:16.162201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8492 count 60 nextOffset 83 batches 1
2025-10-02T09:28:16.162204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-02T09:28:16.162207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8633 count 61 nextOffset 84 batches 1
2025-10-02T09:28:16.162210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-02T09:28:16.162213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8774 count 62 nextOffset 85 batches 1
2025-10-02T09:28:16.162217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-02T09:28:16.162220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 8915 count 63 nextOffset 86 batches 1
2025-10-02T09:28:16.162225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-02T09:28:16.162232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9056 count 64 nextOffset 87 batches 1
2025-10-02T09:28:16.162235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-02T09:28:16.162243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9197 count 65 nextOffset 88 batches 1
2025-10-02T09:28:16.162250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-02T09:28:16.162254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9338 count 66 nextOffset 89 batches 1
2025-10-02T09:28:16.162260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-02T09:28:16.162263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9479 count 67 nextOffset 90 batches 1
2025-10-02T09:28:16.162266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-02T09:28:16.162269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9620 count 68 nextOffset 91 batches 1
2025-10-02T09:28:16.162273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-02T09:28:16.162279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9761 count 69 nextOffset 92 batches 1
2025-10-02T09:28:16.162282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-02T09:28:16.162286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 9902 count 70 nextOffset 93 batches 1
2025-10-02T09:28:16.162292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-02T09:28:16.162295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10043 count 71 nextOffset 94 batches 1
2025-10-02T09:28:16.162300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-02T09:28:16.162303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10184 count 72 nextOffset 95 batches 1
2025-10-02T09:28:16.162310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-02T09:28:16.162313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10325 count 73 nextOffset 96 batches 1
2025-10-02T09:28:16.162316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-02T09:28:16.162319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10466 count 74 nextOffset 97 batches 1
2025-10-02T09:28:16.162326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-02T09:28:16.162330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10607 count 75 nextOffset 98 batches 1
2025-10-02T09:28:16.162336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-02T09:28:16.162340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 10748 count 76 nextOffset 99 batches 1
2025-10-02T09:28:16.162346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.162420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 23,76 HeadOffset 23 endOffset 23 curOffset 99 d0000000000_00000000000000000023_00000_0000000076_00000? size 8300 WTime 1759397296162
2025-10-02T09:28:16.162443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000023_00000?
2025-10-02T09:28:16.162449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2566 bytes (2566)
2025-10-02T09:28:16.162453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2566 (8388608)
2025-10-02T09:28:16.162466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.162473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.162481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 9 size 99 offset: -1
2025-10-02T09:28:16.162512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:28:16.162532Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.162545Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 76 size 8300
2025-10-02T09:28:16.162546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.162553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:16.162558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:16.162600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 23 max time lag 0ms effective offset 0
2025-10-02T09:28:16.162617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2566 count 23 last offset 0, current partition end offset: 23
2025-10-02T09:28:16.162624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.162645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 23 parts_count 0 source 1 size 2566 accessed 0 times before, last time 2025-10-02T09:28:16.000000Z
2025-10-02T09:28:16.162658Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:16.162667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:16.162677Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 23 parts 0 suffix '63'
2025-10-02T09:28:16.162741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 23 count 23 size 2546 from pos 0 cbcount 23
2025-10-02T09:28:16.162770Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.162765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397296159 queuesize 0 startOffset 0
2025-10-02T09:28:16.162963Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } acks { seq_no: 22 written { offset: 21 } } acks { seq_no: 23 written { offset: 22 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:16.162970Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:28:16.162975Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-02T09:28:16.162979Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-02T09:28:16.162985Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-10-02T09:28:16.162989Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-10-02T09:28:16.162992Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-10-02T09:28:16.162995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-10-02T09:28:16.162998Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-10-02T09:28:16.163001Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-10-02T09:28:16.163003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-10-02T09:28:16.163007Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-10-02T09:28:16.163009Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-10-02T09:28:16.163013Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-10-02T09:28:16.163015Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-10-02T09:28:16.163019Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-10-02T09:28:16.163021Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-10-02T09:28:16.163024Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-10-02T09:28:16.163027Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-10-02T09:28:16.163030Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-10-02T09:28:16.163032Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-10-02T09:28:16.163035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-10-02T09:28:16.163038Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-10-02T09:28:16.163040Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-10-02T09:28:16.163042Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-10-02T09:28:16.163045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-10-02T09:28:16.163047Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-10-02T09:28:16.163050Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-10-02T09:28:16.163054Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-10-02T09:28:16.163057Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-10-02T09:28:16.163059Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-10-02T09:28:16.163062Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-10-02T09:28:16.163064Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-10-02T09:28:16.163067Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-10-02T09:28:16.163070Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-10-02T09:28:16.163072Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-10-02T09:28:16.163075Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-10-02T09:28:16.163078Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-10-02T09:28:16.163079Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-10-02T09:28:16.163082Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-10-02T09:28:16.163084Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-10-02T09:28:16.163087Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-10-02T09:28:16.163090Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-10-02T09:28:16.163093Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-10-02T09:28:16.163095Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-10-02T09:28:16.163098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-10-02T09:28:16.163101Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-10-02T09:28:16.163498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 76 size 8300 actorID [1:7556553838568210589:2475]
2025-10-02T09:28:16.163514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.163524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 8056 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.163529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 76 parts 0 suffix '63' size 8300
2025-10-02T09:28:16.163531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-02T09:28:16.163539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-02T09:28:16.163544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-02T09:28:16.163550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-02T09:28:16.163554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-02T09:28:16.163559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-02T09:28:16.163564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-02T09:28:16.163569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-02T09:28:16.163574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-02T09:28:16.163579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-02T09:28:16.163586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-02T09:28:16.163591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-02T09:28:16.163595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-02T09:28:16.163600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-02T09:28:16.163604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-02T09:28:16.163610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-02T09:28:16.163614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-02T09:28:16.163619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-02T09:28:16.163624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-02T09:28:16.163628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-02T09:28:16.163633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-02T09:28:16.163638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-02T09:28:16.163643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-02T09:28:16.163648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-02T09:28:16.163652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-02T09:28:16.163657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-02T09:28:16.163661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-02T09:28:16.163666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-02T09:28:16.163670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-02T09:28:16.163675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-02T09:28:16.163680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-02T09:28:16.163686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-02T09:28:16.163690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-02T09:28:16.163696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-02T09:28:16.163701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-02T09:28:16.163706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-02T09:28:16.163711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-02T09:28:16.163716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-02T09:28:16.163721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-02T09:28:16.163726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-02T09:28:16.163731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-02T09:28:16.163736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-02T09:28:16.163742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-02T09:28:16.163747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-02T09:28:16.163753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-02T09:28:16.163758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-02T09:28:16.163762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-02T09:28:16.163768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-02T09:28:16.163774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-02T09:28:16.163779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-02T09:28:16.163784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-02T09:28:16.163789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-02T09:28:16.163793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-02T09:28:16.163798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-02T09:28:16.163803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-02T09:28:16.163808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-02T09:28:16.163813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-02T09:28:16.163818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-02T09:28:16.163823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-02T09:28:16.163827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-02T09:28:16.163832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-02T09:28:16.163836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-02T09:28:16.163842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-02T09:28:16.163848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-02T09:28:16.163852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-02T09:28:16.163860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-02T09:28:16.163870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-02T09:28:16.163875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-02T09:28:16.163879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-02T09:28:16.163888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-02T09:28:16.163893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-02T09:28:16.163902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-02T09:28:16.163908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-02T09:28:16.163914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-02T09:28:16.163924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-02T09:28:16.163929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.163932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-02T09:28:16.163953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.163961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.163966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.163978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-02T09:28:16.163999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 99 PartNo 0 PackedSize 173 count 1 nextOffset 100 batches 1
2025-10-02T09:28:16.164006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.164039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 99,1 HeadOffset 99 endOffset 99 curOffset 100 d0000000000_00000000000000000099_00000_0000000001_00000? size 161 WTime 1759397296163
2025-10-02T09:28:16.164056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000023_00000?
2025-10-02T09:28:16.164061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000076_00000?
2025-10-02T09:28:16.164063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 10866 bytes (10866)
2025-10-02T09:28:16.164066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 10866 (8388608)
2025-10-02T09:28:16.164139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 2
2025-10-02T09:28:16.164171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.164187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-02T09:28:16.164202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-02T09:28:16.164211Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.164221Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 99 partNo 0 count 1 size 161
2025-10-02T09:28:16.164311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.164319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.164357Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.164466Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:16.164474Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-10-02T09:28:16.164477Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-10-02T09:28:16.164481Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-10-02T09:28:16.164483Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-10-02T09:28:16.164486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-10-02T09:28:16.164489Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-10-02T09:28:16.164491Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-10-02T09:28:16.164494Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-10-02T09:28:16.164496Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-10-02T09:28:16.164499Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-10-02T09:28:16.164502Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-10-02T09:28:16.164505Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-10-02T09:28:16.164508Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-10-02T09:28:16.164510Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-10-02T09:28:16.164513Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-10-02T09:28:16.164515Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-10-02T09:28:16.164517Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-10-02T09:28:16.164520Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-10-02T09:28:16.164522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-10-02T09:28:16.164524Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-10-02T09:28:16.164527Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-10-02T09:28:16.164529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-10-02T09:28:16.164532Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-10-02T09:28:16.164534Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-10-02T09:28:16.164537Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-10-02T09:28:16.164539Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-10-02T09:28:16.164542Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-10-02T09:28:16.164544Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-10-02T09:28:16.164547Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-10-02T09:28:16.164549Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-10-02T09:28:16.164552Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-10-02T09:28:16.164554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-10-02T09:28:16.164556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-10-02T09:28:16.164558Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-10-02T09:28:16.164561Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-10-02T09:28:16.164563Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-10-02T09:28:16.164566Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-10-02T09:28:16.164568Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-10-02T09:28:16.164570Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-10-02T09:28:16.164573Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-10-02T09:28:16.164575Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-10-02T09:28:16.164577Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-10-02T09:28:16.164580Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-10-02T09:28:16.164582Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-10-02T09:28:16.164585Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-10-02T09:28:16.164587Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-10-02T09:28:16.164590Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-10-02T09:28:16.164592Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-10-02T09:28:16.164595Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-10-02T09:28:16.164596Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-10-02T09:28:16.164598Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-10-02T09:28:16.164599Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-10-02T09:28:16.164601Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-10-02T09:28:16.164602Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-10-02T09:28:16.164604Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-10-02T09:28:16.164605Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-10-02T09:28:16.164607Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-10-02T09:28:16.164609Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-10-02T09:28:16.164610Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-10-02T09:28:16.164613Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-10-02T09:28:16.164614Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-10-02T09:28:16.164616Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-10-02T09:28:16.164617Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-10-02T09:28:16.164618Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-10-02T09:28:16.164620Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-10-02T09:28:16.164622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-10-02T09:28:16.164623Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-10-02T09:28:16.164625Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-10-02T09:28:16.164626Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-10-02T09:28:16.164628Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-10-02T09:28:16.164629Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-10-02T09:28:16.164630Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-10-02T09:28:16.164632Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-10-02T09:28:16.164633Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-10-02T09:28:16.164635Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-10-02T09:28:16.164636Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-10-02T09:28:16.164638Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-10-02T09:28:16.164639Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-10-02T09:28:16.164641Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-10-02T09:28:16.164642Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-10-02T09:28:16.164643Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-10-02T09:28:16.164645Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-10-02T09:28:16.164646Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-10-02T09:28:16.164649Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-10-02T09:28:16.164650Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-10-02T09:28:16.164652Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-10-02T09:28:16.164653Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-10-02T09:28:16.164655Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-10-02T09:28:16.164704Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.164703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 99 count 1 size 161 actorID [1:7556553838568210589:2475]
2025-10-02T09:28:16.164718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.164733Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } acks { seq_no: 93 written { offset: 92 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 2000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:16.164725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.164736Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-10-02T09:28:16.164738Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-10-02T09:28:16.164731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:16.164740Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-10-02T09:28:16.164741Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-10-02T09:28:16.164735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-02T09:28:16.164737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 99 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-02T09:28:16.164743Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-10-02T09:28:16.164754Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-10-02T09:28:16.164748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.164757Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-10-02T09:28:16.164750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.164759Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-10-02T09:28:16.164751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.164762Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-10-02T09:28:16.164755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000023_00000?
2025-10-02T09:28:16.164765Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-10-02T09:28:16.164757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000076_00000?
2025-10-02T09:28:16.164768Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-10-02T09:28:16.164758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000099_00000_0000000001_00000?
2025-10-02T09:28:16.164770Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-10-02T09:28:16.164760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11027 bytes (11027)
2025-10-02T09:28:16.164773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-10-02T09:28:16.164762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 11027 (8388608)
2025-10-02T09:28:16.164776Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-10-02T09:28:16.164778Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-10-02T09:28:16.164768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-02T09:28:16.164780Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-10-02T09:28:16.164784Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-10-02T09:28:16.164786Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-10-02T09:28:16.164789Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-10-02T09:28:16.164782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:16.164790Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-10-02T09:28:16.164815Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-10-02T09:28:16.164817Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-10-02T09:28:16.164819Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-10-02T09:28:16.164821Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-10-02T09:28:16.164824Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-10-02T09:28:16.164826Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-10-02T09:28:16.164829Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-10-02T09:28:16.164831Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-10-02T09:28:16.164834Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-10-02T09:28:16.164836Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-10-02T09:28:16.164838Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-10-02T09:28:16.164841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-10-02T09:28:16.164843Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-10-02T09:28:16.164846Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-10-02T09:28:16.164848Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-10-02T09:28:16.164850Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-10-02T09:28:16.164851Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-10-02T09:28:16.164853Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-10-02T09:28:16.164854Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-10-02T09:28:16.164857Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-10-02T09:28:16.164858Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-10-02T09:28:16.164860Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-10-02T09:28:16.164862Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-10-02T09:28:16.164863Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-10-02T09:28:16.164864Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-10-02T09:28:16.164866Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-10-02T09:28:16.164867Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-10-02T09:28:16.164869Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-10-02T09:28:16.164870Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-10-02T09:28:16.164871Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-10-02T09:28:16.164873Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-10-02T09:28:16.164874Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-10-02T09:28:16.164902Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.164915Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 94 written { offset: 93 } } acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:16.164917Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-10-02T09:28:16.164918Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-10-02T09:28:16.164920Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-10-02T09:28:16.164921Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-10-02T09:28:16.164923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-10-02T09:28:16.164924Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-10-02T09:28:16.164927Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-10-02T09:28:16.164928Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-10-02T09:28:16.164930Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-10-02T09:28:16.164931Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-10-02T09:28:16.164933Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-10-02T09:28:16.164934Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-10-02T09:28:16.164950Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:16.164957Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:16.164959Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-10-02T09:28:16.164960Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-10-02T09:28:16.165024Z :INFO: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:28:16.165033Z :INFO: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:28:16.165043Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:28:16.165170Z :INFO: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:16.165175Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:28:16.165285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read done: success: 0 data: 
2025-10-02T09:28:16.165296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc read failed
2025-10-02T09:28:16.165301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 grpc closed
2025-10-02T09:28:16.165306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|f71eae41-60e3e92f-39d03e48-6ed5e203_0 is DEAD
2025-10-02T09:28:16.165531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:16.165574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553847158145516:2523] destroyed
2025-10-02T09:28:16.165585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:16.165603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.165610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.165611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.185837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.185852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.185855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.286153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.286165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.286168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.386470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.386487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.386490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.574373Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1759397296574368
2025-10-02T09:28:16.631423Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556553848743884162:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:16.631640Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:16.633218Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553847277458206:2149];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:16.633327Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/tmph1YKTL/pdisk_1.dat
2025-10-02T09:28:16.633665Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:16.633983Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:16.635359Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:16.635558Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:16.649063Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:16.652752Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:16.652771Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:16.655327Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:16.655555Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 24859, node 3
2025-10-02T09:28:16.662353Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexAAvA5D.tmp
2025-10-02T09:28:16.662374Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexAAvA5D.tmp
2025-10-02T09:28:16.662446Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000152/r3tmp/yandexAAvA5D.tmp
2025-10-02T09:28:16.662497Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:16.665526Z INFO: TTestServer started on Port 28995 GrpcPort 24859
TClient is connected to server localhost:28995
PQClient connected to localhost:24859
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:16.681201Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:28:16.733372Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:16.733405Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:16.734859Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:16.795501Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:16.823854Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:17.014351Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553853038852289:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.014390Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.014494Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553853038852301:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.015152Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:17.017170Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553853038852332:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.017307Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.021368Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:17.021516Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556553853038852303:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-10-02T09:28:17.042991Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:17.053985Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556553851572425793:2303], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:17.054080Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=OGVhMDIyLWNiOTQ2NzEzLWQzNDJlZTc5LWFlNjUyZDU2, ActorId: [4:7556553851572425757:2296], ActorState: ExecuteState, TraceId: 01k6j40ewr77mwtgrj813ptskm, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:17.054241Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:17.068812Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:24859", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:17.099840Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01k6j40exwdq753779s5pxrw9m, Database: , SessionId: ydb://session/3?node_id=3&id=ZGE3NDZjNGQtYzk4Nzg4MzgtNjAyZDhiNDMtNTk2M2E2ODg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:17.103497Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556553853038852827:2979] txid# 281474976710666, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553853038852847:2994] 
2025-10-02T09:28:17.633252Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:17.635580Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:21.631509Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556553848743884162:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:21.631550Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:21.633487Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553847277458206:2149];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:21.633528Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:22.340882Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:24859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.370327Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:24859
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:22.376472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.377094Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553874513689949:3346] connected; active server actors: 1
2025-10-02T09:28:22.377314Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:22.377518Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:22.378043Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:22.378454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.378559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:22.378567Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.378584Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:22.378682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553874513689948:3345], now have 1 active actors on pipe
2025-10-02T09:28:22.378694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556553873047262681:2380], now have 1 active actors on pipe
2025-10-02T09:28:22.378839Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:28:22.378848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.379651Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.380883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553874513690008:3393], now have 1 active actors on pipe
2025-10-02T09:28:22.380933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.382081Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.382257Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.382273Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:22.382335Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.382371Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556553874513690022:2474]
2025-10-02T09:28:22.382972Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.382980Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.382985Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556553874513690022:2474]
2025-10-02T09:28:22.382991Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:22.383251Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:22.383263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.383278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.383280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.383284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:22.383285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.383287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.383288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:22.383295Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.383351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.383380Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:22.384281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.384321Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397302425, TxId 281474976710682
2025-10-02T09:28:22.384326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.384328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.384352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.384394Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:22.385115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:22.385172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:22.385184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.385186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.385188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.385205Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:22.385307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:22.385330Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.385380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.386170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.386194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.386672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.396736Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710683. Ctx: { TraceId: 01k6j40m3d83y7kaeh276hersc, Database: , SessionId: ydb://session/3?node_id=3&id=ZTY3MWYyNzQtNmYzYzExYWYtOTEzYTU4M2UtNDk4OWI4Mzg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759397302425
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759397302425
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:24859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.411436Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:22.483512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.483534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.483538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.583785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.583801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.583804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.684143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.684160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.684163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.784597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.784615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.784624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.884831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.884850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.884854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:24859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.912552Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:22.985195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.985212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.985215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.085531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.085559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.085562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.185897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.185916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.185920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.288908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.288926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.288928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.389206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.389223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.389225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:24859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:23.422101Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:23.426084Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:23.426337Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:23.426345Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:24859
2025-10-02T09:28:23.426674Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:23.426930Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.426948Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:23.427032Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:23.427057Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60910
2025-10-02T09:28:23.427062Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60910 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.427066Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.427485Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:23.427516Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.427518Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.427521Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.427527Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.428068Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.460022Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:23.462227Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553878808657570:2515] connected; active server actors: 1
2025-10-02T09:28:23.462503Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:23.462518Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.462691Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553878808657570:2515] disconnected; active server actors: 1
2025-10-02T09:28:23.462713Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553878808657570:2515] disconnected no session
2025-10-02T09:28:23.482152Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.482173Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:23.482177Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553878808657536:2515] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.482186Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.482622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:23.482644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553878808657589:2515], now have 1 active actors on pipe
2025-10-02T09:28:23.482652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.482660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.482686Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|5b1fb136-9b488393-dbf10971-490f34a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:23.482697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.482703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.482706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.482716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.482731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.482747Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.482805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.482813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.482826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.482855Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|5b1fb136-9b488393-dbf10971-490f34a8_0
2025-10-02T09:28:23.483268Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397303483 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:23.483311Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|5b1fb136-9b488393-dbf10971-490f34a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.484850Z :INFO: [] MessageGroupId [src] SessionId [src|5b1fb136-9b488393-dbf10971-490f34a8_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:23.484864Z :INFO: [] MessageGroupId [src] SessionId [src|5b1fb136-9b488393-dbf10971-490f34a8_0] Write session will now close
2025-10-02T09:28:23.484870Z :DEBUG: [] MessageGroupId [src] SessionId [src|5b1fb136-9b488393-dbf10971-490f34a8_0] Write session: aborting
2025-10-02T09:28:23.485023Z :INFO: [] MessageGroupId [src] SessionId [src|5b1fb136-9b488393-dbf10971-490f34a8_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:23.485030Z :DEBUG: [] MessageGroupId [src] SessionId [src|5b1fb136-9b488393-dbf10971-490f34a8_0] Write session: destroy
2025-10-02T09:28:23.485308Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|5b1fb136-9b488393-dbf10971-490f34a8_0 grpc read done: success: 0 data: 
2025-10-02T09:28:23.485319Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|5b1fb136-9b488393-dbf10971-490f34a8_0 grpc read failed
2025-10-02T09:28:23.485328Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|5b1fb136-9b488393-dbf10971-490f34a8_0 grpc closed
2025-10-02T09:28:23.485342Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|5b1fb136-9b488393-dbf10971-490f34a8_0 is DEAD
2025-10-02T09:28:23.485580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:23.485775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553878808657589:2515] destroyed
2025-10-02T09:28:23.485796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:23.485809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.485812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.485814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.491424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.491439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.491442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-02T09:28:23.554210Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-10-02T09:28:23.591919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.591935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.591937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.692293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.692307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.692309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.792847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.792867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.792870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.892970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.892987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.892990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.993318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.993336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.993339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.093683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.093700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.093703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.194024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.194042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.194045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.294372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.294394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.294398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.395822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.395841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.395844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.496865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.496886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.496889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.596960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.596979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.596982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.697319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.697337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.697341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.797669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.797694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.797697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.898006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.898020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.898022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.998337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.998354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.998357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.098729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.098747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.098750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.199340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.199359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.199362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.300081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.300099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.300103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.400260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.400279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.400282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.500645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.500673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.500677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.600994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.601012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.601015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.701333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.701352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.701355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.801691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.801717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.801720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.902053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.902078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.902081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.002349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.002366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.002370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.102726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.102741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.102744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.203286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.203304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.203308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.303464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.303481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.303485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.403824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.403839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.403842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.504168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.504184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.504187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.604516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.604534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.604537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.704868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.704886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.704889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.805219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.805235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.805238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:27:59.635240Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1759397279635233
2025-10-02T09:27:59.714350Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553775083751929:2080];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.714591Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:27:59.717534Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.718031Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553776786290619:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.718180Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/tmpC6dfws/pdisk_1.dat
2025-10-02T09:27:59.719603Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.741481Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.750294Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.755464Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 4529, node 1
2025-10-02T09:27:59.765470Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandexXwi9U5.tmp
2025-10-02T09:27:59.765483Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandexXwi9U5.tmp
2025-10-02T09:27:59.765540Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandexXwi9U5.tmp
2025-10-02T09:27:59.765580Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:27:59.769451Z INFO: TTestServer started on Port 9404 GrpcPort 4529
TClient is connected to server localhost:9404
PQClient connected to localhost:4529
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:27:59.816447Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.816478Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.817872Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:27:59.819741Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T09:27:59.821222Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.821240Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.822112Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:27:59.822338Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:27:59.920719Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.989586Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:00.017985Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553781081258206:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.018011Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553781081258214:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.018019Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.019719Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:00.020998Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553781081258247:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.021042Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.021203Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553781081258249:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.021232Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.025296Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553781081258220:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T09:28:00.087669Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553781081258252:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:00.092128Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553779378720211:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.092723Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NjRlM2QzNTctYjE1MjcyYjAtZTRlOTBmMzctNmZkZmZiNDY=, ActorId: [1:7556553779378720169:2322], ActorState: ExecuteState, TraceId: 01k6j3zy9671mgzseryhp663tw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.093032Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.093180Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.093337Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553781081258264:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.093418Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZGRhYjU5MDAtMWE2MTBmZDktODRlZTlhZGUtNGJmZWUyYzk=, ActorId: [2:7556553781081258204:2295], ActorState: ExecuteState, TraceId: 01k6j3zy8h9gjvtp9jbdqrem6j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.093535Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.122633Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.151739Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:4529", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:00.195783Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6j3zydb3a6vnt16qs29v5zs, Database: , SessionId: ydb://session/3?node_id=1&id=ZjhjMjc3ZDItMzhjNzYyOTctMzY1OTkwZTEtNWMyNTVmYTQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553779378720590:2929] 
2025-10-02T09:28:00.715851Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:00.719428Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:04.714596Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553775083751929:2080];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.714634Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:04.718158Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553776786290619:2084];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.718201Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:05.311555Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:4529
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
2025-10-02T09:28:05.331252Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4529
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:05.337892Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553800853557588:3239] connected; active server actors: 1
2025-10-02T09:28:05.338020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:05.338181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:05.338538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:05.341835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:05.342361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:05.342427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:05.342442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.342456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:05.342526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800853557586:3237], now have 1 active actors on pipe
2025-10-02T09:28:05.342535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800853557612:2446], now have 1 active actors on pipe
2025-10-02T09:28:05.342705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:05.342891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.349420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.349662Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6j403es6g08by9zs3a3a7dc, Database: , SessionId: ydb://session/3?node_id=1&id=NzI5ZmQzMjktYzNiYzhlNzAtZWU4MzEyNWUtYzhlNmQ2ZTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-02T09:28:05.351969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800853557664:3291], now have 1 active actors on pipe
2025-10-02T09:28:05.352062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.352905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.353126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:05.353148Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:05.353210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:05.353287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553802556095301:2401]
2025-10-02T09:28:05.353982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:05.353986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:05.353991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553802556095301:2401]
2025-10-02T09:28:05.353998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:05.354284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:05.354290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.354313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.354315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:05.354319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.354321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.354323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.354325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.354332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:05.354450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.354484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.355401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.355439Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397285401, TxId 281474976720677
2025-10-02T09:28:05.355443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.355445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.355465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.355508Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:05.356025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:05.356079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:05.356089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.356091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.356093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.356098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.356182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:05.356203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.356238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.357372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.357395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.357797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.454448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.454472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.454475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.554800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.554819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.554821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.655112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.655131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.655134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.755485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.755503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.755505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:4529
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.855839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.855857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.855860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.856358Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.956160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.956182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.956185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.056565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.056585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.056588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.156900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.156920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.156923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.257261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.257280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.257282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4529
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.357597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.357614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.357616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.357952Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:06.359141Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:06.359377Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.359384Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:4529
2025-10-02T09:28:06.359858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.359872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:06.361206Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.361458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.361503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40142
2025-10-02T09:28:06.361513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40142 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.361518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.361940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:06.361993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.362001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.362003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.362008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.362511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.390102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.390217Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805148525154:2481] connected; active server actors: 1
2025-10-02T09:28:06.390249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:06.390262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.390325Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805148525154:2481] disconnected; active server actors: 1
2025-10-02T09:28:06.390332Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805148525154:2481] disconnected no session
2025-10-02T09:28:06.408348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.408364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.408368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553805148525123:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.408378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.408686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553805148525177:2481], now have 1 active actors on pipe
2025-10-02T09:28:06.408762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.408862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.408881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.408925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|1cee7b1-aee302b5-7365a5-693f1410_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:06.408943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.408949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.408952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.408965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.408980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.409002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.409190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.409199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.409215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.409353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|1cee7b1-aee302b5-7365a5-693f1410_0
2025-10-02T09:28:06.409745Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286409 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.409786Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|1cee7b1-aee302b5-7365a5-693f1410_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.409915Z :INFO: [] MessageGroupId [src] SessionId [src|1cee7b1-aee302b5-7365a5-693f1410_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:06.409926Z :INFO: [] MessageGroupId [src] SessionId [src|1cee7b1-aee302b5-7365a5-693f1410_0] Write session will now close
2025-10-02T09:28:06.409932Z :DEBUG: [] MessageGroupId [src] SessionId [src|1cee7b1-aee302b5-7365a5-693f1410_0] Write session: aborting
2025-10-02T09:28:06.410099Z :INFO: [] MessageGroupId [src] SessionId [src|1cee7b1-aee302b5-7365a5-693f1410_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.410103Z :DEBUG: [] MessageGroupId [src] SessionId [src|1cee7b1-aee302b5-7365a5-693f1410_0] Write session: destroy
2025-10-02T09:28:06.410267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|1cee7b1-aee302b5-7365a5-693f1410_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.410277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|1cee7b1-aee302b5-7365a5-693f1410_0 grpc read failed
2025-10-02T09:28:06.410283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|1cee7b1-aee302b5-7365a5-693f1410_0 grpc closed
2025-10-02T09:28:06.410288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|1cee7b1-aee302b5-7365a5-693f1410_0 is DEAD
2025-10-02T09:28:06.410567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.410721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553805148525177:2481] destroyed
2025-10-02T09:28:06.410739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.410746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.410748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.410750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:28:06.457957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.457976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.457978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-02T09:28:06.463975Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-10-02T09:28:06.836347Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1759397286836340
2025-10-02T09:28:06.919193Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556553807426288591:2077];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:06.919222Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:06.923002Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:06.923475Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:06.923793Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553807722047184:2087];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:06.923816Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/tmpearDNl/pdisk_1.dat
2025-10-02T09:28:06.933634Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:06.939419Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:06.944528Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:06.952736Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:06.952767Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:06.955084Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:06.955632Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 14551, node 3
2025-10-02T09:28:06.979694Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandex5HwfZt.tmp
2025-10-02T09:28:06.979710Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandex5HwfZt.tmp
2025-10-02T09:28:06.979771Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001f1/r3tmp/yandex5HwfZt.tmp
2025-10-02T09:28:06.979826Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:06.982928Z INFO: TTestServer started on Port 18341 GrpcPort 14551
TClient is connected to server localhost:18341
PQClient connected to localhost:14551
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:07.009520Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T09:28:07.016133Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715657, at schemeshard: 72057594046644480
waiting...
2025-10-02T09:28:07.020760Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:07.020820Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:07.022136Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
2025-10-02T09:28:07.156861Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:07.157586Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:07.335931Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256801:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.335958Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.336060Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256820:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.336924Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:07.338752Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256852:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.338780Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.338877Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256854:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.338897Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.341830Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256858:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.341850Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.342311Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556553811721256862:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.342322Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.347267Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:07.350657Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556553811721256822:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T09:28:07.385121Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556553812017014783:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:07.385360Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=MmNlMTIzMTUtMzY4ZjU0NGMtMWY1M2ZmMGQtZDA1MWJlYQ==, ActorId: [4:7556553812017014742:2295], ActorState: ExecuteState, TraceId: 01k6j405ej8jhxhkxy7myepd9q, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:07.385492Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:07.386389Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:07.422754Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14551", true, true, 1000);
2025-10-02T09:28:07.457297Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556553811721257306:2959] txid# 281474976715665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:07.466112Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6j405gm1z24wxx64hwy4a8z, Database: , SessionId: ydb://session/3?node_id=3&id=OTY0YTk0Ni03MGUzNzQxNS03MzIwMTE0LTdjNTk0NzA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553811721257362:2992] 
2025-10-02T09:28:07.921772Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:07.925846Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:11.919442Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556553807426288591:2077];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:11.919479Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:11.924046Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553807722047184:2087];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:11.924080Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:12.701322Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14551
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:12.719182Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14551
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:12.725446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.725505Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553833196094456:3337] connected; active server actors: 1
2025-10-02T09:28:12.726267Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:12.726412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.726395Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:12.726477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:12.726493Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.726501Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:12.726592Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553833196094454:3335], now have 1 active actors on pipe
2025-10-02T09:28:12.726788Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:28:12.726810Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:12.726789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:12.726807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556553833491851702:2380], now have 1 active actors on pipe
2025-10-02T09:28:12.727936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:12.729160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553833196094528:3393], now have 1 active actors on pipe
2025-10-02T09:28:12.729212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:12.730040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:12.730186Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.730202Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:12.730262Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.730298Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556553833196094540:2478]
2025-10-02T09:28:12.730939Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.730950Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.730955Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556553833196094540:2478]
2025-10-02T09:28:12.730961Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:12.731232Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:12.731243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.731258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.731265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.731268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:12.731270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.731271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.731273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:12.731279Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.731335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:12.731361Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:12.732215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:12.732246Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397292772, TxId 281474976715682
2025-10-02T09:28:12.732249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.732251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.732269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.732300Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:12.732646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:12.732690Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:12.732702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.732703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.732705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.732709Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:12.732799Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:12.732831Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.732866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:12.733653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:12.733674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:12.734028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:12.735349Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715683. Ctx: { TraceId: 01k6j40ank100fzxj12j8d4bv9, Database: , SessionId: ydb://session/3?node_id=3&id=ODkyZmEyYTYtODk1MWYwYTItZTYyNjhlZjEtMTY2OWNhMjc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715682
    CreateStep: 1759397292772
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715682
    CreateStep: 1759397292772
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14551
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:12.741495Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:12.831332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.831349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.831352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.931675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.931693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.931697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.032037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.032053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.032056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.132396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.132411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.132414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.232731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.232751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.232754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14551
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:13.242882Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:13.333163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.333180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.333182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.433431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.433446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.433449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.533779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.533798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.533801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.634147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.634165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.634168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.734439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.734454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.734457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14551
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:13.745215Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:13.746818Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:13.747066Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:13.747075Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14551
2025-10-02T09:28:13.747448Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:13.747638Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.747651Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:13.747877Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:13.747909Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58550
2025-10-02T09:28:13.747914Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58550 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.747916Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.748481Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:13.748509Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.748510Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.748512Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.748516Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.749074Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.776021Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:13.776186Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062077:2517] connected; active server actors: 1
2025-10-02T09:28:13.776359Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:13.776377Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.776641Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062077:2517] disconnected; active server actors: 1
2025-10-02T09:28:13.776650Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062077:2517] disconnected no session
2025-10-02T09:28:13.798786Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.798802Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:13.798806Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553837491062043:2517] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.798813Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.798971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:13.798990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553837491062098:2517], now have 1 active actors on pipe
2025-10-02T09:28:13.799000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.799006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.799037Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|a731e039-1c4f2415-1b8242c2-71770ca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:13.799054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.799059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.799062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.799072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.799086Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.799101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.799138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.799145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.799157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.799188Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|a731e039-1c4f2415-1b8242c2-71770ca1_0
2025-10-02T09:28:13.799532Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397293799 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:13.799568Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|a731e039-1c4f2415-1b8242c2-71770ca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.799697Z :INFO: [] MessageGroupId [src] SessionId [src|a731e039-1c4f2415-1b8242c2-71770ca1_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:13.799711Z :INFO: [] MessageGroupId [src] SessionId [src|a731e039-1c4f2415-1b8242c2-71770ca1_0] Write session will now close
2025-10-02T09:28:13.799719Z :DEBUG: [] MessageGroupId [src] SessionId [src|a731e039-1c4f2415-1b8242c2-71770ca1_0] Write session: aborting
2025-10-02T09:28:13.799908Z :INFO: [] MessageGroupId [src] SessionId [src|a731e039-1c4f2415-1b8242c2-71770ca1_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:13.799921Z :DEBUG: [] MessageGroupId [src] SessionId [src|a731e039-1c4f2415-1b8242c2-71770ca1_0] Write session: destroy
2025-10-02T09:28:13.800100Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|a731e039-1c4f2415-1b8242c2-71770ca1_0 grpc read done: success: 0 data: 
2025-10-02T09:28:13.800111Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|a731e039-1c4f2415-1b8242c2-71770ca1_0 grpc read failed
2025-10-02T09:28:13.800118Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|a731e039-1c4f2415-1b8242c2-71770ca1_0 grpc closed
2025-10-02T09:28:13.800123Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|a731e039-1c4f2415-1b8242c2-71770ca1_0 is DEAD
2025-10-02T09:28:13.800402Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:13.800492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553837491062098:2517] destroyed
2025-10-02T09:28:13.800506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:13.800512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.800518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.800520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.834851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.834870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.834873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-02T09:28:13.853916Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14551" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14551" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14551" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:28:13.856465Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:13.856716Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:13.913457Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:13.913687Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.913702Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:13.915201Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.915346Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:13.915484Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.915561Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:58564
2025-10-02T09:28:13.915571Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:58564 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:13.915576Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.916040Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:13.916087Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.916099Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.916101Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.916107Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.916533Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.918811Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:13.918984Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062129:2530] connected; active server actors: 1
2025-10-02T09:28:13.919098Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:13.919113Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.919239Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062129:2530] disconnected; active server actors: 1
2025-10-02T09:28:13.919252Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553837491062129:2530] disconnected no session
2025-10-02T09:28:13.921825Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.921840Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:13.921843Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.921853Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.922020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:13.922024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553837491062146:2530], now have 1 active actors on pipe
2025-10-02T09:28:13.922032Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.922038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.922068Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.922085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.922098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.922100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.922112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.922129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.922146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.922210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.922221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.922259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.922295Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0
2025-10-02T09:28:13.922639Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:13.922657Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397293922 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:13.922688Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:28:13.922756Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:13.922902Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:13.922914Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T09:28:13.923185Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.923285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.923326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.923335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.923356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:13.923374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:13.923396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.923402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.923491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:28:13.923503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:13.923515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.923520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.923523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.923549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:13.923603Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-02T09:28:13.923613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.923659Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1759397293923
2025-10-02T09:28:13.923683Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:13.923698Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-10-02T09:28:13.924515Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [3:7556553833196094484:2478]
2025-10-02T09:28:13.924550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:13.924572Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:13.924580Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-02T09:28:13.924584Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:13.924595Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:13.924625Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.924637Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.924642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.924645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.924647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.924656Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:13.924658Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:13.924660Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:13.924669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:28:13.924702Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:13.924704Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:28:13.924724Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:13.924727Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.924733Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-10-02T09:28:13.000000Z
2025-10-02T09:28:13.924743Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:13.924757Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:13.924766Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-10-02T09:28:13.924766Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T09:28:13.924781Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397293923 queuesize 0 startOffset 0
2025-10-02T09:28:13.924922Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:13.925045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:13.925052Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:28:13.925056Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-02T09:28:13.935188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.935203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.935206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.035536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.035552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.035554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.135907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.135922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.135926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.236236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.236251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.236253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.336610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.336623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.336624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.436946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.436970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.436972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.537302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.537315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.537320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.637625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.637639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.637642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.738008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.738026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.738029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.838375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.838391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.838393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.922835Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.938706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.938720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.938723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.960016Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-02T09:28:14.960029Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553837491062110:2530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.039083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.039098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.039100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.139419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.139434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.139437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.239766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.239782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.239785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.340085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.340107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.340110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.440474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.440486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.440489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.540840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.540853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.540855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.641170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.641186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.641189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.741523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.741538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.741542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.841858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.841870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.841871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.942226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.942238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.942241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.042578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.042592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.042595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.142920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.142935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.142939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.243256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.243270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.243274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.343645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.343662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.343665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.444016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.444032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.444036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.544351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.544369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.544373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.644690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.644706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.644709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.745035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.745051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.745053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.845394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.845409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.845412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.945757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.945774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.945778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.046105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.046119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.046123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.146431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.146447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.146449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.246798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.246819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.246822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.347158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.347184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.347188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.447529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.447549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.447552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.547880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.547894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.547897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.648178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.648207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.648212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:17.656977547 3236849 chttp2_transport.cc:1143]             ipv4:127.0.0.1:3264: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:17.731218Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:17.731240Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:17.731245Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:17.748547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.748560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.748568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.848907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.848918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.848920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.949262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.949275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.949277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.049620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.049634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.049636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.149963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.149979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.149982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.250323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.250335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.250338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.350672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.350685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.350687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.451038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.451053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.451055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.551386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.551399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.551401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.651722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.651734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.651736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.752073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.752088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.752091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.852438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.852451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.852453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.952790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.952814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.952815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.053127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.053139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.053142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.153483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.153495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.153497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.253799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.253817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.253819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.354200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.354217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.354220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.454556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.454572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.454575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.554906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.554923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.554926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.655255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.655270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.655273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.755597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.755613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.755615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.855911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.855933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.855935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.956249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.956264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.956267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.056636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.056651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.056653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.156978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.156994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.156996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.257367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.257382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.257385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.357727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.357743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.357746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.458064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.458080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.458083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.558413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.558436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.558439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.658783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.658798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.658802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.759131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.759148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.759152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.859481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.859497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.859500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.959802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.959822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.959825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.060183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.060200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.060203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.160535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.160549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.160552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.260880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.260900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.260903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.361248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.361263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.361266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.461585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.461600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.461602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.561952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.561972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.561975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.662272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.662301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.662304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.762645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.762662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.762665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.862956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.862973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.862976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.937736Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T09:28:21.937753Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:21.963375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.963391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.963393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.063723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.063740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.063744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.164525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.164542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.164546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.265011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.265026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.265029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.365306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.365320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.365323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.467080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.467094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.467096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.566510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.566527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.566530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.666858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.666873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.666876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.731408Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:22.731421Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:22.731428Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:22.767220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.767236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.767239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.867567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.867589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.867600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.967893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.967911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.967914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.068253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.068267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.068268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.168631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.168648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.168651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.269019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.269037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.269040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.369336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.369354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.369356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.469657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.469674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.469678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.570036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.570055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.570059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.672247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.672261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.672263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.772783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.772831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.772835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:23.813367203 3229137 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:3264: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:23.873118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.873133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.873137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.973475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.973492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.973495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.073911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.073940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.073943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.174205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.174223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.174225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.274680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.274697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.274701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.375098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.375116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.375119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.475277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.475294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.475297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.575589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.575607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.575617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.675929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.675945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.675947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.776298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.776314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.776318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.876640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.876658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.876662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.977005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.977035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.977038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.077306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.077325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.077328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.177794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.177838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.177846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.278229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.278246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.278249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.378395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.378415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.378417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.478707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.478721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.478723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.579098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.579117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.579120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.679458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.679475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.679477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.779766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.779781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.779784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.880163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.880181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.880184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.980509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.980528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.980531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.081053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.081069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.081073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.184877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.184897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.184901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.285145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.285160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.285163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.385516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.385533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.385536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.486317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.486335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.486339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.586183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.586198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.586201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.686571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.686589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.686593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.786925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.786942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.786946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.887289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.887305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.887308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.987656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.987670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.987674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.087971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.087987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.087991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.188353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.188376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.188379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.288886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.288912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.288916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.389056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.389071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.389074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.490506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.490522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.490525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.590247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.590261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.590264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.690618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.690639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.690642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.731724Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:27.731741Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:27.731746Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:27.790956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.790973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.790975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.891319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.891338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.891340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.991673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.991691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.991694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.092029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.092050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.092054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.192394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.192414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.192417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.292674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.292693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.292697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.393062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.393079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.393083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.493423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.493443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.493446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.593772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.593790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.593793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.694122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.694142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.694145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.794477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.794493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.794497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.894826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.894842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.894846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.995805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.995831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.995834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.096819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.096837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.096840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.200865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.200883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.200887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.300870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.300886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.300889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.401181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.401196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.401198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.501535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.501549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.501551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.601884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.601898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.601900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.702234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.702250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.702253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.802599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.802616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.802620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.902938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.902953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.902956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.003248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.003263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.003267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.103634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.103647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.103651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.204001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.204017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.204021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.304356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.304374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.304376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.405013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.405043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.405046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.507836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.507857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.507860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.607971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.607988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.607990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.708333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.708348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.708351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.808673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.808689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.808693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.916871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.916891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.916894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.017048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.017069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.017072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.117408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.117426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.117428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.217765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.217784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.217787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.318104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.318119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.318121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.418431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.418448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.418452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.518825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.518840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.518843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.619242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.619261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.619264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.719862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.719881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.719884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.821145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.821164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.821167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.921230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.921248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.921252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.021605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.021623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.021632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.122609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.122632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.122635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.222824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.222847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.222850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.323137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.323165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.323168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.423550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.423567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.423570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.523872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.523888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.523892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.624228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.624244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.624247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.724586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.724605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.724608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.731735Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:32.731750Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:32.731755Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:32.824897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.824913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.824916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.925259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.925273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.925276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.025621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.025635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.025637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.125983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.126000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.126003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.226334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.226351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.226355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.326808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.326827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.326830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.426996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.427015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.427018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.527528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.527548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.527552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.627714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.627733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.627737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.728085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.728104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.728107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.828415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.828433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.828436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.928751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.928764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.928767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.029114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.029130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.029133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.129487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.129504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.129507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.229847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.229865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.229867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.330224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.330243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.330246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.430555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.430572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.430575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.530871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.530886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.530889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.631256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.631272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.631275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.731610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.731624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.731627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.831969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.831986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.831989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.932277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.932294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.932297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.032651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.032666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.032669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.133015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.133028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.133030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.233369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.233387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.233390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.333710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.333728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.333731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.434072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.434089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.434092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.534440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.534456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.534459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.634807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.634829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.634831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.735097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.735113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.735116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.835476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.835489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.835492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.935822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.935836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.935838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.036198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.036216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.036219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.136536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.136559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.136562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.236883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.236901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.236903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:36.312908484 3229096 chttp2_transport.cc:1143]             ipv4:127.0.0.1:3264: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:28:36.340879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.340900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.340904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.441813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.441831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.441834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.542050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.542069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.542071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.644852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.644870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.644872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.744819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.744837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.744840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.845140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.845153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.845155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.945483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.945502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.945505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.045849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.045866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.045869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.146208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.146225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.146229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.246559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.246575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.246577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.347948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.347965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.347969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.448305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.448324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.448327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.548633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.548648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.548651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.648987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.649003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.649005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.731983Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:37.732001Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:37.732004Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:37.749327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.749353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.749356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.849680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.849693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.849695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.949999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.950011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.950013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.050333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.050346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.050349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.150695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.150722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.150724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.251088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.251102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.251105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.351462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.351480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.351483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.451767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.451781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.451783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.552142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.552157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.552160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.652500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.652514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.652516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.752953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.752971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.752977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.853209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.853222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.853224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.953696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.953720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.953722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.053910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.053926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.053929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.154270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.154288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.154291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.254586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.254602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.254605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.354947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.354963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.354966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.455326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.455341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.455344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.555673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.555691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.555694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.655994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.656010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.656013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.756372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.756387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.756389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.856744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.856759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.856761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.957072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.957090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.957093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.057459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.057478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.057481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.157782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.157797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.157800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.258132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.258148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.258150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.358500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.358517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.358520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.458844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.458861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.458864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.559208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.559223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.559226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.659550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.659565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.659567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.760223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.760240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.760243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.860745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.860763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.860766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.961110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.961124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.961126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.061426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.061444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.061447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.161813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.161834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.161837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.262161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.262174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.262177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.362510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.362525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.362528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.462861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.462876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.462878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.563212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.563227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.563229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.663567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.663582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.663584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.763927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.763942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.763945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.864280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.864295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.864298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.964652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.964673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.964676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.064987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.065004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.065007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.165306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.165324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.165327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.265689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.265705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.265708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.366779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.366797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.366799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.466915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.466933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.466936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.567263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.567279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.567282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.667602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.667619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.667622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.726430Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:28:42.726461Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:42.728054Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:28:42.728278Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:28:42.728708Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-02T09:28:42.726849Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:28:42.732171Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:42.732184Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:42.732190Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:42.767959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.767975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.767978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.868327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.868343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.868346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.968676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.968694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.968697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.069016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.069030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.069034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.169340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.169356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.169359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.269705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.269719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.269721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.370035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.370055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.370058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.470394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.470412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.470415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.570858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.570875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.570878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.671085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.671098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.671101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.771489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.771509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.771512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.871836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.871852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.871854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:43.972196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.972227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.972229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.072545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.072566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.072569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.172878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.172895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.172898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.273243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.273257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.273259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.373602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.373622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.373625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.473958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.473973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.473976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.574299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.574317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.574319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.674662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.674690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.674692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.775326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.775348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.775350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.875869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.875885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.875893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.976219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.976244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.976247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.076577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.076594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.076597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.176926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.176945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.176948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.277285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.277300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.277302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.377632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.377654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.377657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.478161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.478178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.478181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.578326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.578344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.578347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.678692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.678706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.678709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.779036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.779061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.779064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.879372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.879386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.879388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.979732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.979748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.979752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.080062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.080073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.080074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.180442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.180455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.180458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.280824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.280842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.280844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.381154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.381171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.381174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.481502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.481521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.481525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.581859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.581876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.581879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.682169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.682188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.682190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.782525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.782544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.782547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.882873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.882894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.882897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.983255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.983271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.983274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.083585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.083600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.083614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.183970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.183988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.183992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.284313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.284330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.284332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.384679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.384698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.384700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.485544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.485565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.485568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.585892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.585911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.585914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.686245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.686263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.686274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.732421Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:47.732439Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:47.732444Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:47.786583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.786602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.786605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.888917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.888933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.888937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.989908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.989930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.989933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.089678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.089695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.089698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.190073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.190090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.190094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.292916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.292932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.292935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.393417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.393443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.393447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.493628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.493645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.493647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.594005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.594021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.594024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.694344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.694359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.694362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.794695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.794710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.794713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.895074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.895090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.895093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.995417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.995432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.995435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.095767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.095786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.095789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.196148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.196171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.196174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.296458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.296476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.296479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.396788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.396818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.396821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.497190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.497208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.497211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.597511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.597532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.597534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.697837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.697855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.697857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.798234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.798250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.798253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.898601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.898620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.898622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.998910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.998926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.998929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.099296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.099311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.099314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.199648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.199666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.199669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.300029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.300046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.300049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.400364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.400384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.400387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.500701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.500720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.500723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.601001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.601017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.601020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.701404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.701419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.701422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.801742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.801759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.801762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.902105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.902122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.902125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.002442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.002456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.002458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.102799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.102813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.102815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.203117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.203135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.203149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.303474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.303491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.303493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:51.389658731 3229156 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:3264: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:28:51.403869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.403890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.403893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.504230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.504247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.504249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.604573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.604589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.604592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.704927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.704945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.704948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.805289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.805307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.805310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.905631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.905649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.905653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.005973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.005988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.005990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.106321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.106336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.106338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.206642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.206661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.206664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.307012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.307034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.307037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.407383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.407400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.407403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.507800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.507817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.507821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.608080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.608098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.608101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.708420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.708448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.708450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.732609Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:52.732638Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:52.732643Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:52.811066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.811085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.811087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.911215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.911232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.911235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.012137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.012156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.012159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.112380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.112400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.112403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.212788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.212818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.212821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.313125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.313141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.313143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.413477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.413494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.413496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.513867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.513893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.513897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.614173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.614189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.614192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.714539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.714560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.714564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.815690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.815716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.815719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.861062Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14551" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14551" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14551" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:28:53.861175Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:53.861198Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:53.861537Z :INFO: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:28:53.861542Z :INFO: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:28:53.861559Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:28:53.861566Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:53.861654Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.861674Z :INFO: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:53.861679Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:28:53.861891Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:53.861951Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.861969Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-02T09:28:53.862018Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 grpc read done: success: 0 data: 
2025-10-02T09:28:53.862031Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 grpc read failed
2025-10-02T09:28:53.862040Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 grpc closed
2025-10-02T09:28:53.862045Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|7398e4cd-8a96555a-49f8337d-de6b592f_0 is DEAD
2025-10-02T09:28:53.862146Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.862176Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:58564
2025-10-02T09:28:53.862181Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:58564 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:53.862185Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.862461Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:53.862533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553837491062146:2530] destroyed
2025-10-02T09:28:53.862552Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:53.862563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.862570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.862573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.862632Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-02T09:28:53.862669Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.862675Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.862677Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.862682Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.863315Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.865897Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.869783Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.869801Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.869805Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.869818Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.870001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554009289757324:3127], now have 1 active actors on pipe
2025-10-02T09:28:53.870015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.870022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.870024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:53.870048Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5e135da-c512725d-a647967b-456faf3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.870056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.870072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.870074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.870087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.870105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.870126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.870178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.870189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.870212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.870250Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0
2025-10-02T09:28:53.870574Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:53.870591Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397333870 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:53.870654Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|c5e135da-c512725d-a647967b-456faf3c_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:28:53.915745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.915763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.915765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.016100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.016117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.016120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.116448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.116466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.116469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.216820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.216837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.216840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.317209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.317226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.317229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.417625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.417639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.417643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.517852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.517872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.517875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.618213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.618229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.618233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.718527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.718542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.718545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.818901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.818917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.818920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.870634Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.875366Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-02T09:28:54.875383Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556554009289757292:3127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.919247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.919263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.919266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.023294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.023313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.023315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.123534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.123557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.123560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.223910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.223928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.223931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.324258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.324287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.324290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.424611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.424631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.424634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.524956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.524972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.524975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.625302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.625317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.625318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.725657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.725673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.725676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.828930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.828960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.828963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.929445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.929463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.929466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.029794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.029812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.029815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.130104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.130122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.130125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.232147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.232165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.232168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.332372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.332388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.332391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.432698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.432713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.432715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.534532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.534550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.534552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.634968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.634986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.634990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.735314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.735330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.735333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.835670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.835690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.835692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.936036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.936053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.936056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.036381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.036402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.036405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.136729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.136747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.136749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.237080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.237100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.237102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.337448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.337465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.337468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.437800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.437818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.437821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.538110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.538127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.538129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.638522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.638559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.638562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.732857Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:57.732876Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:28:57.732881Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:28:57.738841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.738859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.738862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.839196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.839210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.839212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.939558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.939585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.939588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.039866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.039887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.039890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.140230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.140246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.140249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.240580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.240594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.240596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.340948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.340963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.340966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.444885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.444903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.444906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.545488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.545512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.545514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.645617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.645637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.645640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.746887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.746916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.746919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.846875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.846894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.846897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.947097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.947111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.947114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.047934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.047951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.047954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.152864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.152882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.152886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.253900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.253919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.253921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.354201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.354219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.354223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.454518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.454533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.454536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.554900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.554913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.554916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.655268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.655287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.655290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.755607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.755626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.755629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.855970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.855987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.855990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.956295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.956317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.956320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.056702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.056720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.056723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.157033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.157053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.157056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.257381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.257405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.257408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.357722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.357739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.357741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.458068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.458082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.458084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.558405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.558421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.558423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.658777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.658791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.658794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.759137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.759155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.759159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.859484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.859500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.859503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.961305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.961328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.961331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.061737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.061750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.061753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.162061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.162076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.162078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.262412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.262426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.262428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.362789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.362805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.362808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.463664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.463683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.463686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.564006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.564025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.564028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.664352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.664370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.664373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.764651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.764669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.764671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.865046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.865066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.865068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.965385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.965400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.965402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.065750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.065765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.065769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.166104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.166119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.166122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.266462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.266478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.266481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.366814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.366828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.366831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.467173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.467191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.467194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.567479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.567503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.567506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.667862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.667882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.667885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.732952Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:02.732967Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:29:02.732972Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:29:02.768240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.768258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.768261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.868577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.868595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.868597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.968917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.968937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.968940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.069346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.069381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.069390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.169640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.169665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.169693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.269980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.270011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.270022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.370997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.371020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.371037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.471215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.471235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.471243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.571551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.571570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.571576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.671896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.671910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.671918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.772255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.772273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.772276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.872557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.872574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.872576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.972978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.972993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.972995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.073301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.073319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.073322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.173624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.173642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.173645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.273998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.274015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.274018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.374356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.374374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.374377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.474737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.474777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.474780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.575276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.575311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.575315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.675420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.675435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.675437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.775767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.775785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.775788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.876110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.876125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.876128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.976479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.976518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.976522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.076785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.076812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.076815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.177195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.177212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.177216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.277516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.277531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.277534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.377877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.377892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.377894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.478241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.478260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.478263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.578602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.578620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.578624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.678945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.678962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.678965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.779333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.779358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.779361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.879642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.879659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.879661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.980661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.980681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.980684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.080859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.080879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.080882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.181207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.181225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.181227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.281559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.281574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.281576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.381916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.381936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.381938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.484872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.484892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.484895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.585347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.585368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.585371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.688966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.688987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.688990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.788961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.788980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.788983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.889307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.889325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.889328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.989637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.989653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.989660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.090008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.090024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.090027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.190373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.190391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.190395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.290715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.290733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.290735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.391076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.391094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.391097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.491436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.491454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.491457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.591776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.591795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.591798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.692155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.692178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.692182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.733604Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:07.733622Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:29:07.733627Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:29:07.792505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.792525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.792529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.892817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.892833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.892834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.993985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.994002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.994004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.094552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.094572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.094576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.194874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.194895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.194898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.295307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.295328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.295331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.395604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.395621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.395624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.495972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.495992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.495995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.596293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.596312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.596315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.696658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.696673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.696676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.797039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.797054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.797058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.897346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.897359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.897361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.997725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.997743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.997745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.100938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.100957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.100961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.201512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.201531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.201534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.301851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.301866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.301869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.402197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.402211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.402214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.502559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.502580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.502583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.602915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.602931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.602934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.703218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.703236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.703238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.803674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.803692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.803696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.903976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.903994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.903997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.004298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.004316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.004319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.104734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.104749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.104751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.205023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.205043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.205046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.305367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.305385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.305388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.405718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.405732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.405734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.506100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.506119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.506122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.606414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.606433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.606435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.706788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.706803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.706806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.807101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.807126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.807130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.907484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.907499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.907503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.007835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.007854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.007857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.111969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.112079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.112085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.212142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.212159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.212162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.312479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.312496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.312499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.412839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.412854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.412856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.513267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.513283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.513287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.614061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.614079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.614082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.714424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.714442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.714445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.814768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.814791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.814794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.915068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.915089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.915093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.015434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.015451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.015453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.115772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.115785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.115788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.216162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.216181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.216184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.316506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.316522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.316525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.416879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.416897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.416899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.517173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.517189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.517192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.617563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.617581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.617584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.717912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.717938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.717941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.726617Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:29:12.726651Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T09:29:12.729329Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:29:12.733152Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:29:12.733207Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:29:12.733297Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:12.733312Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-02T09:29:12.733318Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-02T09:29:12.818269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.818288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.818291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.918624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.918641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.918644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.020924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.020944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.020947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.128910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.128929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.128932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.229023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.229041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.229044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.329260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.329282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.329285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.429574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.429592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.429596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.529947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.529963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.529965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.630295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.630310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.630312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.730655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.730669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.730672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.831000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.831015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.831018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:29:13.902451Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-02T09:29:13.902730Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:29:13.902745Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-02T09:29:13.903131Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.903247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.903286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.903298Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.903322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:13.903341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:29:13.903362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.903368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.903379Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:29:13.903388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:29:13.903410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.903419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.903421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.903443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:29:13.903487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-02T09:29:13.903495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.903542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1759397353903
2025-10-02T09:29:13.903568Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:13.903582Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-10-02T09:29:13.904568Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [3:7556553833196094484:2478]
2025-10-02T09:29:13.904608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:13.904628Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-02T09:29:13.904645Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:13.904653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:29:13.904668Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T09:29:13.904699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.904705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.904707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.904715Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:13.904723Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:13.904726Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:13.904733Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:13.904741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-10-02T09:29:13.904748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:29:13.904774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:29:13.905004Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:29:13.905142Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:29:13.905157Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:29:13.905161Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-02T09:29:13.931355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.931370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.931373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.031715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.031732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.031735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.132056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.132071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.132072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.232376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.232391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.232393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.332772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.332791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.332794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.433110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.433128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.433131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.533467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.533485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.533488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.633818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.633836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.633839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.734173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.734189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.734191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.834522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.834539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.834542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.934992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.935009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.935012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.035251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.035279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.035283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.135584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.135604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.135607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.235963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.235987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.235991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.336273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.336289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.336291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.436657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.436675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.436678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.536974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.536991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.536994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.637335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.637353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.637356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.737694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.737709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.737711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.838044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.838063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.838066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.938357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.938372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.938374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.038752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.038769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.038772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.139076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.139090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.139092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.239449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.239466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.239469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.339765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.339782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.339785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.440129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.440147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.440150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.540491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.540506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.540509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.640873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.640893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.640896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.741208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.741224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.741227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.844886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.844906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.844910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.945006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.945023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.945026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.045388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.045403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.045406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.145695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.145713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.145716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.247892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.247909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.247912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.349050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.349067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.349070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.449464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.449484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.449487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.550709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.550727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.550730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.652884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.652907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.652910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.733506Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:17.733520Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:17.733524Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:17.733528Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:17.753159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.753175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.753178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.853283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.853302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.853305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.953591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.953607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.953609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.053999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.054018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.054021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.154342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.154360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.154363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.254686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.254705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.254709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.355037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.355054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.355057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.455660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.455677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.455679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.555817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.555835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.555839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.656857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.656875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.656878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.756929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.756947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.756950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.857245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.857263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.857265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.958011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.958025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.958028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.058389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.058409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.058412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.161759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.161795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.161799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.264033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.264054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.264061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.364142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.364161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.364164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.464594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.464619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.464622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.567688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.567705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.567707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.668895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.668914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.668918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.772877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.772898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.772900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.871571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.871590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.871593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.971936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.971954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.971957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.072285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.072304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.072307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.172629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.172645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.172648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.280222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.280239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.280241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.380609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.380628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.380635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.480878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.480892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.480894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.581251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.581267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.581271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.681718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.681735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.681739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.781897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.781916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.781920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.882219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.882238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.882241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.982626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.982644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.982646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.084687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.084712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.084715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.184873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.184890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.184893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.285231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.285250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.285253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.385543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.385558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.385561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.485878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.485893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.485895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.586276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.586299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.586301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.686614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.686632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.686635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.786972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.786989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.786992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.887316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.887336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.887339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.987753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.987784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.987787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.088636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.088652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.088656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.188902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.188919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.188922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.289235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.289251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.289253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.389556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.389573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.389576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.489945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.489962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.489965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.590298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.590316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.590320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.690627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.690644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.690647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.733714Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:22.733733Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:22.733738Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:22.733744Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:22.790950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.790970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.790973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.891339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.891357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.891360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.991698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.991714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.991716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.092051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.092069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.092072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.192437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.192459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.192462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.292762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.292778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.292780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.393108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.393124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.393128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.493462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.493477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.493480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.593824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.593841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.593844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.694152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.694173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.694174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.794509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.794532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.794534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.894833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.894853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.894856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.995215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.995229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.995231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.095584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.095600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.095603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.195923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.195942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.195945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.296283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.296301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.296303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.396633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.396652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.396656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.496928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.496945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.496948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.597333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.597351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.597355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.697685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.697712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.697714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.798034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.798058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.798061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.898372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.898388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.898392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.998743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.998759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.998761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.099057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.099073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.099076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.199459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.199477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.199480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.299811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.299831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.299834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.400147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.400164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.400166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.500516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.500536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.500538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.601713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.601731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.601734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.701732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.701748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.701751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.802270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.802294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.802296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.902434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.902456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.902458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.002790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.002808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.002811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.103116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.103133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.103135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.203478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.203496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.203500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.303805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.303825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.303827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.404187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.404204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.404207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.504537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.504553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.504555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.604903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.604922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.604924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.705199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.705218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.705221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.805590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.805607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.805609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.905944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.905960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.905962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.006304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.006322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.006324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.106645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.106662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.106665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.207002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.207022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.207025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.307342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.307356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.307359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.407688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.407712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.407716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.508055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.508072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.508074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.608404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.608423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.608426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.708753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.708771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.708774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.734021Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:27.734047Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:27.734051Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:27.734056Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:27.809066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.809085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.809088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.909458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.909477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.909480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.009820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.009835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.009838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.110593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.110612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.110615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.212937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.212951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.212954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.312932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.312948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.312951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.413282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.413300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.413303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.513590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.513605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.513607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.613971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.613986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.613987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.714343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.714364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.714367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.814696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.814715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.814718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.915025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.915040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.915042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.015346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.015365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.015368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.115713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.115735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.115738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.216094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.216109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.216123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.316407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.316423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.316426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.417674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.417691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.417693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.517655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.517670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.517673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.618024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.618041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.618044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.718360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.718375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.718377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.818820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.818835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.818839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.919534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.919550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.919554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.019433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.019453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.019455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.119781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.119798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.119801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.220148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.220163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.220166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.320473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.320489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.320492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.420844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.420858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.420861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.521184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.521200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.521203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.621526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.621542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.621545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.721892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.721913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.721916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.822226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.822240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.822242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.922588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.922607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.922609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.022955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.022971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.022974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.123299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.123317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.123320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.223666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.223690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.223693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.324004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.324021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.324024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.424904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.424924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.424927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.525228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.525245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.525248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.625586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.625605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.625608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.726537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.726555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.726558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.826748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.826767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.826770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.927153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.927172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.927175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.027483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.027500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.027502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.127832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.127853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.127855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.228188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.228207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.228210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.328540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.328555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.328557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.428876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.428895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.428898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.529246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.529264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.529266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.629608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.629627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.629630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.729931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.729947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.729951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.734055Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:32.734065Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:32.734068Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:32.734071Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:32.830289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.830303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.830305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.930664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.930682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.930685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.031029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.031053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.031057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.131329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.131349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.131351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.231676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.231696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.231711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.332035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.332056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.332059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.432412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.432439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.432442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.532948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.532965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.532968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.633089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.633105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.633107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.733483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.733500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.733503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.833816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.833833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.833836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.934176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.934196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.934199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.034515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.034534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.034537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.134808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.134824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.134826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.235182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.235201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.235204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.335538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.335556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.335559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.435930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.435947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.435950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.536291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.536309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.536312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.636613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.636631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.636634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.736981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.736996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.736999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.837345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.837362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.837366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.937692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.937711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.937714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.038043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.038058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.038060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.138379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.138394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.138396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.238755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.238770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.238772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.339060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.339084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.339087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.439444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.439462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.439464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.539846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.539866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.539869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.640137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.640155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.640158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.740518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.740546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.740549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.840860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.840876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.840879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.941202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.941221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.941224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.041571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.041590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.041593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.144900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.144917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.144919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.245852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.245869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.245872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.346214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.346231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.346234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.446546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.446563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.446565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.546931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.546950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.546953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.647259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.647279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.647282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.747633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.747652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.747655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.847973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.847989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.847991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.948338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.948353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.948356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.048675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.048696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.048698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.149012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.149029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.149032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.249360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.249377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.249379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.349687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.349713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.349717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.450082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.450102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.450104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.550406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.550424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.550427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.650783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.650799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.650802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.734284Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:37.734300Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:37.734304Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:37.734309Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:37.751135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.751150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.751154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.851481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.851497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.851500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.951824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.951840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.951843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.052173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.052191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.052194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.152506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.152524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.152527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.252874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.252889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.252892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.353239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.353256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.353258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.453593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.453610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.453613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.553997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.554017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.554020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.656867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.656888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.656891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.757175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.757192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.757195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.861049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.861071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.861074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.960983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.961003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.961006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.061288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.061305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.061308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.161781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.161799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.161802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.262690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.262709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.262713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.362873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.362889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.362892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.463255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.463270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.463272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.563548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.563567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.563569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.664044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.664064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.664067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.764334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.764355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.764358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.864675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.864694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.864697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.965026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.965045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.965047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.065363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.065380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.065382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.165735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.165755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.165759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.266062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.266077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.266079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.366397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.366410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.366412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.466799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.466818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.466821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.567123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.567137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.567141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.667488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.667507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.667510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.767829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.767846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.767850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.868192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.868210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.868213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.968546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.968564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.968567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.068860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.068877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.068879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.169246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.169267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.169270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.269594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.269613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.269615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.369892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.369908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.369910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.470334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.470352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.470355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.570619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.570637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.570640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.671017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.671036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.671038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.771345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.771361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.771363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.871716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.871740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.871742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.972048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.972074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.972076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.072408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.072428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.072432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.172779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.172812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.172815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.273065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.273079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.273082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.373466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.373483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.373485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.473811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.473826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.473828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.574156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.574169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.574172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.674515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.674533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.674535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.726719Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:29:42.726754Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-02T09:29:42.726993Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:29:42.727261Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:29:42.727310Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:29:42.734438Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:42.734454Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:42.734458Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:42.734462Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:42.774849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.774864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.774865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.875218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.875232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.875233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.975571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.975588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.975591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.075907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.075923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.075926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.176252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.176273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.176277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.276648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.276663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.276665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.376982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.376997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.377000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.477327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.477344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.477347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.577691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.577709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.577711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.678054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.678073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.678076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.778605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.778623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.778626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.878771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.878790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.878792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:29:43.979111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.979136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.979139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.079428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.079445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.079449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.179804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.179823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.179826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.280165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.280185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.280188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.380538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.380555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.380558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.480868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.480887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.480890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.581189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.581206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.581209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.681577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.681593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.681595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.781904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.781920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.781923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.882277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.882294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.882297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.982625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.982644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.982647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.082966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.082988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.082991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.183324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.183344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.183348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.283664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.283682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.283685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.384029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.384044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.384047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.484380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.484409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.484411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.584762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.584780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.584783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.685099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.685118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.685120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.785471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.785493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.785496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.887030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.887062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.887065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.987175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.987197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.987201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.087482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.087500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.087504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.188896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.188915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.188918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.289235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.289256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.289260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.392960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.392978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.392981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.493501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.493520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.493522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.593905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.593923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.593926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.694228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.694246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.694249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.794577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.794598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.794601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.894944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.894961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.894964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.995286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.995306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.995309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.096039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.096066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.096068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.196497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.196512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.196514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.296875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.296892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.296895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.397195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.397208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.397210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.497553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.497572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.497575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.597879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.597896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.597899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.698272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.698289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.698292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.734633Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:47.734657Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:47.734661Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:47.734666Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:47.798614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.798633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.798636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.898926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.898944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.898947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.999318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.999334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.999335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.099703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.099723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.099726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.200031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.200052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.200056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.300360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.300380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.300383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.400896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.400914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.400917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.501117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.501135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.501138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.601445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.601468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.601471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.701985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.702003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.702006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.802156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.802178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.802181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.902427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.902443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.902446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.002837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.002855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.002857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.103200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.103218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.103220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.203546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.203562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.203564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.303896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.303913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.303917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.408860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.408878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.408881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.509218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.509239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.509242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.610113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.610135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.610138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.710411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.710428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.710431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.812952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.812968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.812971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.913180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.913199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.913202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.015555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.015571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.015574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.115929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.115946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.115948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.216285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.216303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.216306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.316632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.316648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.316651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.417003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.417026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.417029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.517368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.517391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.517395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.617712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.617733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.617736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.718022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.718042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.718046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.818423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.818442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.818445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.918774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.918796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.918799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.019112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.019134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.019137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.119439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.119456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.119458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.219930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.219977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.219987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.325108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.325144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.325152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.428894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.428920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.428924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.529044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.529071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.529078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.629433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.629456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.629465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.729746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.729763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.729765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.830207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.830226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.830228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.930455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.930472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.930475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.030812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.030829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.030831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.131162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.131179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.131181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.231509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.231523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.231526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.331871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.331891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.331893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.432234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.432253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.432257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.532572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.532591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.532594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.632935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.632955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.632958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.733274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.733293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.733296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.734878Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:52.734892Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:52.734896Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:52.734901Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:52.833625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.833642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.833644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.933992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.934013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.934017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.034318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.034335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.034338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.134682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.134705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.134708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.235049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.235070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.235073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.335393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.335411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.335413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.435758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.435777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.435780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.536093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.536111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.536114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.636414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.636435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.636439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.736752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.736773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.736777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.837144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.837160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.837163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.867096Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14551" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14551" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14551" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:29:53.867202Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:29:53.867230Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:29:53.867531Z :INFO: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:29:53.867546Z :INFO: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:29:53.867560Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:29:53.867562Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:29:53.867668Z :INFO: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T09:29:53.867674Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c5e135da-c512725d-a647967b-456faf3c_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:29:53.867702Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.867839Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.867860Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-02T09:29:53.867952Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0 grpc read done: success: 0 data: 
2025-10-02T09:29:53.867959Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0 grpc read failed
2025-10-02T09:29:53.867966Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0 grpc closed
2025-10-02T09:29:53.867972Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|c5e135da-c512725d-a647967b-456faf3c_0 is DEAD
2025-10-02T09:29:53.868001Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:29:53.868162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:29:53.868214Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.868243Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:58564
2025-10-02T09:29:53.868253Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:58564 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:29:53.868256Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.868287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556554009289757324:3127] destroyed
2025-10-02T09:29:53.868303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:29:53.868311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.868314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.868316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.868737Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-02T09:29:53.868776Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.868778Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.868780Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.868784Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.869389Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.872034Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.875084Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.875099Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.875102Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.875111Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.875487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:29:53.875506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556554266987800074:4004], now have 1 active actors on pipe
2025-10-02T09:29:53.875514Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.875520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.875544Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47516c9-d9ea461c-182552b7-d82b9363_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.875558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.875562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.875564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.875577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.875594Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.875615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.875686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.875693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.875706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.875734Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0
2025-10-02T09:29:53.876049Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:29:53.876068Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397393876 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:29:53.876104Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|47516c9-d9ea461c-182552b7-d82b9363_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:29:53.937477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.937495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.937497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.037797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.037818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.037821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.138224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.138243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.138246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.238556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.238578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.238581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.340949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.340968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.340971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.441295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.441312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.441316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.541660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.541677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.541680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.641983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.642002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.642005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.742406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.742423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.742427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.842670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.842689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.842692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.875982Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.880587Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-02T09:29:54.880603Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556554266987800042:4004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.944930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.944948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.944951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.045492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.045516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.045519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.145815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.145836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.145839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.246185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.246205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.246209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.346518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.346533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.346535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.446880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.446901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.446904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.547229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.547248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.547251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.647596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.647617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.647620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.747937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.747958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.747961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.848268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.848285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.848289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.948641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.948664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.948667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.048972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.048991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.048993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.149336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.149352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.149355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.249681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.249698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.249701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.350038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.350055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.350057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.450390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.450412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.450415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.550740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.550757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.550760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.651093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.651109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.651111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.751465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.751482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.751484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.851814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.851836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.851839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.952162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.952178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.952181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.052503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.052523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.052525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.155376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.155397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.155400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.256864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.256886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.256889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.357156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.357175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.357178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.457456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.457476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.457480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.557855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.557871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.557873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.658201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.658216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.658219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.735076Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:29:57.735094Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:29:57.735097Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:29:57.735103Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:29:57.758555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.758572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.758576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.858909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.858928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.858931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.959288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.959312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.959316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.059588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.059602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.059604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.159963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.159980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.159982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.260325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.260344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.260348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.360662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.360682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.360686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.461013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.461029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.461032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.561377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.561394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.561396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.661687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.661706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.661710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.762069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.762084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.762086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.862418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.862436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.862439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.962773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.962792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.962795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.063144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.063163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.063165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.163441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.163457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.163460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.263834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.263853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.263856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.364193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.364213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.364216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.464508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.464528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.464532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.564880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.564897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.564900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.665248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.665268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.665271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.765585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.765605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.765607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.865964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.865982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.865985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.968863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.968886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.968888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.069187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.069202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.069204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.169554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.169570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.169572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.269914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.269934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.269937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.370281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.370299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.370302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.470620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.470640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.470643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.570972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.570993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.570995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.671323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.671342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.671345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.771639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.771657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.771660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.873020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.873040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.873044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.972872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.972890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.972893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.073248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.073264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.073267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.173587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.173601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.173603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.273944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.273960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.273962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.374294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.374310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.374312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.474649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.474666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.474669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.575002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.575024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.575034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.675366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.675389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.675392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.775700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.775719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.775722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.876065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.876084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.876087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.976409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.976426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.976429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.076779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.076811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.076815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.177147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.177166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.177169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.277473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.277494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.277497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.377822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.377844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.377847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.478187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.478205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.478208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.578536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.578553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.578556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.678884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.678902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.678904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.735257Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:30:02.735277Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:30:02.735281Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:30:02.735286Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:30:02.779229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.779245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.779248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.879588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.879611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.879615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.981470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.981486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.981489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.081837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.081854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.081857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.182980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.182999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.183002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.283078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.283103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.283107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.383387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.383407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.383411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.483743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.483763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.483766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.584092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.584111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.584114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.684460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.684479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.684481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.784811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.784833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.784837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.885475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.885496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.885499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.985485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.985502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.985505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.085848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.085871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.085874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.186205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.186226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.186230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.286548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.286566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.286568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.386905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.386922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.386924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.487261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.487279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.487282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.587624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.587640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.587642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.687965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.687983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.687986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.788330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.788347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.788350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.888703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.888722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.888725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.989030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.989051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.989053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.089345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.089362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.089365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.189731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.189751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.189754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.292862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.292880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.292883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.392590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.392608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.392610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.492854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.492872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.492876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.593178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.593196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.593199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.693540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.693558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.693561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.796866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.796886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.796890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.897655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.897673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.897676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.997118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.997138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.997141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.097514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.097535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.097538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.197878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.197900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.197904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.298209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.298227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.298230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.399932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.399957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.399960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.502900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.502919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.502923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.603324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.603345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.603349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.703715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.703733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.703736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.804128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.804154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.804159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.904378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.904396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.904398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.004763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.004780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.004783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.105105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.105120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.105122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.205487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.205507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.205510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.305797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.305811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.305813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.406150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.406166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.406168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.506502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.506521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.506524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.606876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.606897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.606899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.707237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.707256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.707259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.735432Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:30:07.735448Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:30:07.735452Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:30:07.735457Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:30:07.807546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.807562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.807566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.907927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.907944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.907948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.008281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.008299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.008302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.108640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.108659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.108662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.208996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.209015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.209018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.309350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.309372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.309375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.409698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.409719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.409721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.510038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.510058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.510061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.610427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.610445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.610449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.710763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.710780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.710782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.811100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.811124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.811127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.911536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.911554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.911557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.011764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.011785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.011788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.112153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.112170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.112172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.212511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.212526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.212528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.312889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.312909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.312912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.413221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.413241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.413244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.513555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.513572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.513575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.613901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.613920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.613922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.714276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.714296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.714299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.814620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.814640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.814643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.914973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.914994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.914997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.016878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.016895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.016898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.117222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.117241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.117244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.217619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.217640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.217643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.317907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.317927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.317930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.418297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.418316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.418319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.518616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.518632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.518635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.618958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.618975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.618977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.719334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.719351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.719355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.819669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.819685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.819687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.920774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.920793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.920795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.020876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.020893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.020895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.121256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.121273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.121277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.221600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.221618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.221620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.321915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.321940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.321943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.422352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.422371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.422374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.522647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.522665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.522667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.623006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.623032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.623035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.723359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.723374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.723377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.823722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.823737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.823740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.924048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.924068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.924071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.024395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.024412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.024414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.124728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.124746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.124749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.225075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.225092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.225096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.325475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.325497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.325500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.425793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.425807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.425810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.526173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.526192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.526195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.626520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.626537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.626539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.726841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.726857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.726859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.726843Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:30:12.726877Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-02T09:30:12.727111Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:30:12.727378Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:30:12.727421Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:30:12.735610Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:30:12.735624Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:30:12.735627Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-02T09:30:12.735630Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-02T09:30:12.827225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.827245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.827248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.927575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.927591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.927593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.027931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.027948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.027952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.128272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.128286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.128288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.228612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.228627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.228629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.328979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.328995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.328997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.429294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.429312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.429314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.529689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.529705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.529707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.630037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.630054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.630056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.730398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.730415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.730418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.830764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.830782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.830785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.931095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.931114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.931116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:30:13.954288Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-02T09:30:13.954531Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:30:13.954544Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-10-02T09:30:13.954897Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.955016Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.955091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.955105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.955137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:13.955169Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:30:13.955188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.955194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.955208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-02T09:30:13.955216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:30:13.955232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.955239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.955247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.955273Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T09:30:13.955317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-02T09:30:13.955327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.955363Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1759397413955
2025-10-02T09:30:13.955386Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:30:13.955398Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-10-02T09:30:13.956160Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [3:7556553833196094484:2478]
2025-10-02T09:30:13.956184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:30:13.956203Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-02T09:30:13.956207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:30:13.956213Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:30:13.956218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-02T09:30:13.956232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.956234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.956235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.956240Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:30:13.956242Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:30:13.956244Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00000?
2025-10-02T09:30:13.956245Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 480 bytes (480)
2025-10-02T09:30:13.956248Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 480 (8388608)
2025-10-02T09:30:13.956253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-10-02T09:30:13.956258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:30:13.956274Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T09:30:13.956422Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:30:13.956481Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:30:13.956486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:30:13.956489Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-02T09:30:13.956680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0 grpc read done: success: 0 data: 
2025-10-02T09:30:13.956690Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0 grpc read failed
2025-10-02T09:30:13.956695Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0 grpc closed
2025-10-02T09:30:13.956698Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|47516c9-d9ea461c-182552b7-d82b9363_0 is DEAD
2025-10-02T09:30:13.956833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:30:13.956870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556554266987800074:4004] destroyed
2025-10-02T09:30:13.956882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:30:13.956886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.956888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.956889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.956941Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-02T09:30:13.956959Z :ERROR: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-02T09:30:13.956961Z :ERROR: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-02T09:30:13.956965Z :INFO: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:30:13.956976Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:30:13.960003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|47516c9-d9ea461c-182552b7-d82b9363_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:30:14.031454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.031476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.031478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.131798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.131814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.131816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.232145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.232161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.232164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:27:59.858294Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1759397279858286
2025-10-02T09:27:59.945984Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553774769727484:2085];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.946164Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:27:59.952979Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001d2/r3tmp/tmptWu4nb/pdisk_1.dat
2025-10-02T09:27:59.956143Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.987157Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.987221Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-02T09:27:59.987983Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.997791Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 17880, node 1
2025-10-02T09:28:00.016480Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001d2/r3tmp/yandexBmzqJg.tmp
2025-10-02T09:28:00.016491Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001d2/r3tmp/yandexBmzqJg.tmp
2025-10-02T09:28:00.016548Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001d2/r3tmp/yandexBmzqJg.tmp
2025-10-02T09:28:00.016593Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:00.020668Z INFO: TTestServer started on Port 3725 GrpcPort 17880
TClient is connected to server localhost:3725
PQClient connected to localhost:17880
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:00.048315Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:00.048349Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:00.049911Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:00.052386Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T09:28:00.056894Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:00.056917Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:00.057662Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:28:00.057883Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:28:00.203851Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:00.288299Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:00.364072Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553778707478174:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.364105Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553778707478188:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.364118Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.365748Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:00.366529Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553778707478231:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.366561Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.366656Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553778707478233:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.366675Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.370832Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553778707478204:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T09:28:00.427917Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.429841Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553779064695767:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.429965Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NWY3NmMzZjQtNjQ3NWU5MzAtYzdjMDZhM2YtNmI1MmVjNzE=, ActorId: [1:7556553779064695716:2321], ActorState: ExecuteState, TraceId: 01k6j3zykt77n95wnqmhkbsb7f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.430554Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.454564Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.456085Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553778707478300:2177] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:00.460190Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553778707478314:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.460277Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=OWU5YTc2ZjgtMjA5NWI1YzItNjY1OWM3OTUtNTRlYjFmYzg=, ActorId: [2:7556553778707478172:2294], ActorState: ExecuteState, TraceId: 01k6j3zykb4rgx9zy4bfcve354, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.460419Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.475905Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17880", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:00.506655Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6j3zyqc9nrtnt59bhkhy1b6, Database: , SessionId: ydb://session/3?node_id=1&id=MWNlNzA3YzItNzE4MDg5NjEtZjc2Nzk1MTEtNjUzYTdlZGM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553779064696154:2940] 
2025-10-02T09:28:00.948187Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:00.955410Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:04.945965Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553774769727484:2085];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.946016Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:05.643395Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17880
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.666462Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17880
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:05.672500Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553800539533160:3255] connected; active server actors: 1
2025-10-02T09:28:05.672627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:05.672754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:05.673032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:05.675758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:05.676383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:05.676435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:05.676447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.676460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:05.676569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800539533159:3254], now have 1 active actors on pipe
2025-10-02T09:28:05.676579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800539533178:2446], now have 1 active actors on pipe
2025-10-02T09:28:05.676610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:05.676750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.677750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.679122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800539533215:3300], now have 1 active actors on pipe
2025-10-02T09:28:05.679209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.680099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.680310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:05.680340Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:05.680397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:05.680471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553800182315290:2402]
2025-10-02T09:28:05.681128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:05.681142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:05.681147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553800182315290:2402]
2025-10-02T09:28:05.681153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:05.681428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:05.681443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.681469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.681471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:05.681474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.681477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.681479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.681480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.681487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:05.681602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.681635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.682619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.682654Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397285723, TxId 281474976720677
2025-10-02T09:28:05.682663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.682664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.682685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.682726Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:05.683233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:05.683280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:05.683291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.683293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.683295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.683299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.683398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:05.683420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.683461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.683849Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6j403s746exvrccam5skpg4, Database: , SessionId: ydb://session/3?node_id=1&id=OTVkOWYyZTktZDU4NGNiOTYtNTU0YWEzNDAtOTY5MDBkNDE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:05.684466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.684488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.684913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285723
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285723
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17880
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.689482Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.781516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.781535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.781538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.881886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.881905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.881908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.982234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.982253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.982256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.082595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.082616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.082618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.182937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.182954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.182957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17880
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.190631Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:06.283270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.283288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.283290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.383636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.383652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.383654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.483998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.484014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.484016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.584352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.584370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.584372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.684871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.684891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.684894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17880
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.693991Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:06.695949Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:06.696206Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.696213Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17880
2025-10-02T09:28:06.696823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.696840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:06.698488Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.698749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.698792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41052
2025-10-02T09:28:06.698798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41052 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.698803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.699237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:06.699281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.699287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.699290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.699296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.699849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.726600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.726722Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500719:2480] connected; active server actors: 1
2025-10-02T09:28:06.726747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:06.726751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.726824Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500719:2480] disconnected; active server actors: 1
2025-10-02T09:28:06.726826Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500719:2480] disconnected no session
2025-10-02T09:28:06.748119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.748136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.748140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553804834500688:2480] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.748148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.748463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.749145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553804834500742:2480], now have 1 active actors on pipe
2025-10-02T09:28:06.749184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.749192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.749236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|db67ca59-60673e4e-cf0c1be9-50f7421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:06.749247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.749252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.749255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.749269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.749288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.749307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.751218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.751233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.751261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.751430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|db67ca59-60673e4e-cf0c1be9-50f7421_0
2025-10-02T09:28:06.751882Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286751 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.751915Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|db67ca59-60673e4e-cf0c1be9-50f7421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.752016Z :INFO: [] MessageGroupId [src] SessionId [src|db67ca59-60673e4e-cf0c1be9-50f7421_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:06.752025Z :INFO: [] MessageGroupId [src] SessionId [src|db67ca59-60673e4e-cf0c1be9-50f7421_0] Write session will now close
2025-10-02T09:28:06.752030Z :DEBUG: [] MessageGroupId [src] SessionId [src|db67ca59-60673e4e-cf0c1be9-50f7421_0] Write session: aborting
2025-10-02T09:28:06.752153Z :INFO: [] MessageGroupId [src] SessionId [src|db67ca59-60673e4e-cf0c1be9-50f7421_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.752160Z :DEBUG: [] MessageGroupId [src] SessionId [src|db67ca59-60673e4e-cf0c1be9-50f7421_0] Write session: destroy
2025-10-02T09:28:06.753635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|db67ca59-60673e4e-cf0c1be9-50f7421_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.753651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|db67ca59-60673e4e-cf0c1be9-50f7421_0 grpc read failed
2025-10-02T09:28:06.753661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|db67ca59-60673e4e-cf0c1be9-50f7421_0 grpc closed
2025-10-02T09:28:06.753667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|db67ca59-60673e4e-cf0c1be9-50f7421_0 is DEAD
2025-10-02T09:28:06.753919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.756961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553804834500742:2480] destroyed
2025-10-02T09:28:06.756984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.756994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.756998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.757000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-10-02T09:28:06.760683Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-02T09:28:06.760951Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:17880" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:17880 }
2025-10-02T09:28:06.761024Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:06.761228Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:06.763194Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:06.763532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.763549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:06.765188Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.765362Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:06.765515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.765584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53392
2025-10-02T09:28:06.765590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:53392 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:06.765596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.766229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:06.766264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.766278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.766280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.766287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.766886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.771563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.771776Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500766:2494] connected; active server actors: 1
2025-10-02T09:28:06.771805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:06.771809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.772116Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500766:2494] disconnected; active server actors: 1
2025-10-02T09:28:06.772122Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804834500766:2494] disconnected no session
2025-10-02T09:28:06.777451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.777463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.777466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553804834500749:2494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.777474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.779531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553804834500782:2494], now have 1 active actors on pipe
2025-10-02T09:28:06.785077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.785092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.785094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.785135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.785146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.785181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:06.785188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.785204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.785207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.785222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.785233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.785255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.784930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.789121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.789144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.789183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.789350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0
2025-10-02T09:28:06.792474Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:06.792493Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286792 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.792537Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:28:06.792622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:06.792823Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:06.792832Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T09:28:06.793031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.793148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.794405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.794427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.794471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:06.794606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.794819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.794829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.794955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-10-02T09:28:06.794968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.794988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.794997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.795000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.795034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:06.795096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-10-02T09:28:06.795105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.795158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1759397286794
2025-10-02T09:28:06.795199Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.795211Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-10-02T09:28:06.796414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [2:7556553800182315274:2402]
2025-10-02T09:28:06.796435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.796505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-10-02T09:28:06.796910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-02T09:28:06.796949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.796958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.796970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:06.797003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:06.797010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:06.797014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.797016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.797018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.797029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:06.797032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 177 bytes (177)
2025-10-02T09:28:06.797037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 177 (8388608)
2025-10-02T09:28:06.797058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:28:06.797095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:06.797119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:06.797123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:06.797134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.797154Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:06.797167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.797181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-10-02T09:28:06.797199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286794 queuesize 0 startOffset 0
2025-10-02T09:28:06.797273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T09:28:06.798056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.798778Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:06.798980Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:06.798990Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:28:06.798995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-10-02T09:28:06.799129Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
2025-10-02T09:28:06.799265Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:06.799279Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-02T09:28:06.799904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.800043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
=== AcksHandler has written a message, closing the session
2025-10-02T09:28:06.800773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.800790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.800840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-02T09:28:06.801306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.801313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.801332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-10-02T09:28:06.801339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.801354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.801360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.801363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.801390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:28:06.801422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-10-02T09:28:06.801429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.801472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1759397286800
2025-10-02T09:28:06.801494Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.801504Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-10-02T09:28:06.801016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.802961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [2:7556553800182315274:2402]
2025-10-02T09:28:06.802977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.802995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.803003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.803011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T09:28:06.803037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.803040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.803041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.803048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:06.803050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-02T09:28:06.803053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 346 bytes (346)
2025-10-02T09:28:06.803056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 346 (8388608)
2025-10-02T09:28:06.803064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-02T09:28:06.803097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-10-02T09:28:06.803216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.806383Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:06.806442Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:06.806449Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-02T09:28:06.806455Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
=== Inside SessionClosedHandler
2025-10-02T09:28:06.806812Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-10-02T09:28:06.806842Z :INFO: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:28:06.806845Z :INFO: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:28:06.806853Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:28:06.806976Z :WARNING: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-02T09:28:06.807064Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:28:06.808656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553804834500782:2494] destroyed
2025-10-02T09:28:06.808674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.808683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.808685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.808687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.808233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.808246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 grpc read failed
2025-10-02T09:28:06.808254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 grpc closed
2025-10-02T09:28:06.808261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|e117d348-ea8e154c-e6f1b7d6-3fd84c6f_0 is DEAD
2025-10-02T09:28:06.808476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.885529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.885548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.885552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
